Abstract
Indoor spraying is a crucial component of the construction industry. The future evolution of the spraying industry will inexorably involve the substitution of robot-assisted autonomous spraying for manual spraying. In this paper, a fully autonomous indoor spraying robot is designed to handle a variety of manual spraying issues. At the system level, the robot’s mechanical structure, hardware system, general control logic, and crucial technologies are meticulously constructed. The robot is equipped with a chassis that can travel in any direction, a detachable material carrier, a secondary upgrade mechanism, and a spraying system. The robot performs indoor mapping and navigation with the lidar sensor, identifies non-sprayable areas, such as windows, using the camera, and then evaluates the spraying result after spraying. After analysis of the robot’s working environment, the SLAM algorithm and the deep learning-based object detection algorithm are improved in conjunction with the actual scene to assure accuracy and meet the criteria for real-time operation on embedded devices. The robot’s ability to perform a succession of indoor spraying activities without human intervention and to automatically adapt and adjust to varied indoor conditions is an important reference for its practical application in the field of interior design.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available on request from the corresponding author.
References
Aris I, Iqbal AK, M Parvez, Ramli, AR., Shamsuddin, S.: Design and development of a programmable painting robot for houses and buildings. Jurnal Teknologi, pages 27â–48, (2005)
Asadi, Ehsan, Li, Bingbing, I-Ming, Chen, Pictobot: A cooperative painting robot for interior finishing of industrial developments. IEEE Rob. Automat. Magaz. 25(2), 82–94 (2018)
Asadi, Khashayar, Jain, Rahul, Qin, Ziqian, Sun, Mingda, Noghabaei, Mojtaba, Cole, Jeremy, Han, Kevin, Lobaton, Edgar: Vision-based obstacle removal system for autonomous ground vehicles using a robotic arm. In: Computing in Civil Engineering 2019: Data. Sensing, and Analytics, pp. 328–335. American Society of Civil Engineers Reston, VA (2019)
Chollet, François. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1251–1258, (2017)
Grisetti, Giorgio, Stachniss, Cyrill, Burgard, Wolfram: Improved techniques for grid mapping with rao-blackwellized particle filters. IEEE Transact. Rob. 23(1), 34–46 (2007)
Han, Kai, Wang, Yunhe, Tian, Qi, Guo, Jianyuan, Xu, Chunjing, Xu, Chang. Ghostnet: More features from cheap operations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1580–1589, (2020)
Hess, Wolfgang, Kohler, Damon, Rapp, Holger, Andor, Daniel. Real-time loop closure in 2d lidar slam. In 2016 IEEE International Conference on Robotics and Automation (ICRA), pages 1271–1278, (2016)
Hu, Jie, Shen, Li, Sun, Gang: Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7132–7141, (2018)
Jun, Miao, Jun, Chu, Guimei, Zhang: Window detection based on constraints of image edges and glass attributes. J. Graph. 36(5), 776 (2015)
Kohlbrecher, Stefan, Stryk, Oskar Von, Meyer, Johannes, Klingauf, Uwe. A flexible and scalable slam system with full 3d motion estimation. In: 2011 IEEE international symposium on safety, security, and rescue robotics, pages 155–160, (2011)
Law, Hei, Deng, Jia. Cornernet: Detecting objects as paired keypoints. In: Proceedings of the European conference on computer vision (ECCV), pages 734–750, (2018)
Li, Bo., Yingqiang Wang, Yu., Zhang, Wenjie Zhao, Ruan, Jianyuan, Li, Ping: Gp-slam: laser-based slam approach based on regionalized gaussian process map reconstruction. Autonom. Rob 44, 947–967 (2020)
Montemerlo, Michael, Thrun, Sebastian, Koller, Daphne, Wegbreit, Ben, et al. Fastslam: A factored solution to the simultaneous localization and mapping problem. Aaai/iaai, 593598, (2002)
Phillips, Stephen, Narasimhan, Sriram: Automating data collection for robotic bridge inspections. J. Bridge Eng 24(8), 04019075 (2019)
Qianqian, Kong, Liaoying, Zhao, Li, Zhang: Indoor window detection based on image contour analysis. Comp. Modernizat 4, 56 (2018)
Redmon, Joseph, Farhadi, Ali. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, (2018)
Ren, Shaoqing, He, Kaiming, Girshick, Ross, Sun, Jian: Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural. Inform. Process. Syst 28, 91–99 (2015)
Song, Shuai, Hui, Chen. Building windows detection based on enhanced yolov3. 2020 China Simulation Conference, page 234, (2020)
Sorour, Mohamed. Robopainter-a detailed robot design for interior wall painting. In 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO), pages 1–6, (2015)
Sorour, Mohamed T., Abdellatif, Mohamed, A., Ramadan, Ahmed, A., Abo-Ismail, Ahmed, A.: Development of roller-based interior wall painting robot. World Acad. Sci. Eng. Technol 59, 1785–1792 (2011)
Sustarevas, Julius, Butters, Daniel, Hammid, Mohammad, Dwyer, George, Stuart-Smith, Robert, Pawar, Vijay, M.: Map-a mobile agile printer robot for on-site construction. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 2441–2448, (2018)
Teoh, Boon Ean, Ragavan, S Veera. Paintbot-fpga based wall painting service robot prototype. In 2011 IEEE Recent Advances in Intelligent Computational Systems, pages 777–782), (2011)
Warszawski, Abraham, Rosenfeld, Yechiel: Robot for interior-finishing works in building: feasibility analysis. J. Const. Eng. Manag 120(1), 132–151 (1994)
Wong, Alexander, Famuori, Mahmoud, Shafiee, Mohammad, Javad, Li, Francis, Chwyl, Brendan, Chung, Jonathan. Yolo nano: highly compact you only look once convolutional neural network for object detection. In: 2019 Fifth Workshop on Energy Efficient Machine Learning and Cognitive Computing-NeurIPS Edition (EMC2-NIPS), pages 22–25, (2019)
Xuhui, Yang, Liang, Yu., Tang, Mingjie, Meng, Fu.: Research on the recognition method of shanxi traditional dwelling door and window based on improved yolov2 model. Archit. Cult 10, 65 (2020)
Yu, Fisher, Wang, Dequan, Shelhamer, Evan, Darrell, Trevor. Deep layer aggregation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2403–2412, (2018)
Zhou, Xingyi, Wang, Dequan, Krähenbühl, Philipp. Objects as points. arXiv preprint arXiv:1904.07850, (2019)
Acknowledgements
The authors would like to acknowledge the support from the AiBle project co-financed by the European Regional Development Fund, National Key R &D Program of China (Grant No. 2018YFB1304600), CAS Interdisciplinary Innovation Team (Grant No. JCTD-2018-11), and National Natural Science Foundation of China (grant No. 52075530, 51575412, and 62006204).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ji, X., Li, Y., Hong, K. et al. Design of a Fully Autonomous Indoor Spray Robot. Int J Intell Robot Appl 7, 763–777 (2023). https://doi.org/10.1007/s41315-023-00297-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41315-023-00297-9