Abstract
In this study, a robust object recognition and command understanding system for a house tidying-up robot is proposed. The robot can understand the user’s intentions by using a speech recognition system. When the user in-structs the tidying-up robot to tidy up an object using voice commands, the robot detects and recognizes the object. To detect and recognize multiple objects, we employ an instance segmentation method using deep learning. This method extracts the contour and shape of objects and generates the appropriate grasping posture of the robot arm. An experiment using the tidying-up robot is conducted to verify the effectiveness of the tidying-up system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Liu, S., Zheng, L., Wang, S., Li, R., Zhao, Y.: Cognitive abilities of indoor cleaning robots. In: 2016 12th World Congress on Intelligent Control and Automation (WCICA), Guilin, China, pp. 1508–1513 (2016)
Gopalakrishnan, R., Ramani, U., Maheswari, K.U., Thilagaraj, M.: Design and development of controller based automatic ground cleaning robot. In: 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, pp. 491–494 (2022)
Oh, Y.-J., Watanabe, Y.: Development of small robot for home floor cleaning. In: Proceedings of the 41st SICE Annual Conference, Osaka, Japan (2002)
Yi, J.-B., Yi, S.-J.: Mobile manipulation for the HSR intelligent home service robot. In: 2019 16th International Conference on Ubiquitous Robots (UR), Jeju, Korea (South), pp. 169–173 (2019)
Mahendru, M., Dubey, S.K.: Real time object detection with audio feedback using yolo vs. Yolo_v3. In: 2021 11th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Noida, India, pp. 734–740 (2021)
Araki, T., Nakamura, T., Nagai, T., Funakoshi, K., Nakano, M., Iwahashi, N.: Autonomous acquisition of multimodal information for online object concept formation by robots. In: IROS 2011, San Francisco, CA, USA, pp. 1540-1547 (2011)
Bolya, D., Zhou, C., Xiao, F., Lee, Y.J.: Yolact: real-time instance segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9157–9166 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Zhang, B., Ren, C., Wang, J., Lim, HO. (2024). Robust Object Recognition and Command Understanding for a House Tidying-Up Robot. In: Li, J., Zhang, B., Ying, Y. (eds) 6GN for Future Wireless Networks. 6GN 2023. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 553. Springer, Cham. https://doi.org/10.1007/978-3-031-53401-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-53401-0_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53400-3
Online ISBN: 978-3-031-53401-0
eBook Packages: Computer ScienceComputer Science (R0)