Abstract
Manipulators are the primary tool for robotic operations, and human-robot interaction for manipulators is an effective way in complex environments or dealing with complex operational tasks. This paper focuses on developing a human-robot interactive operating system for underwater ECA ARM 5E-Micro manipulator based on hand gesture recognition. The system used an RGB-D camera to acquire the operator's hand gestures and a hand image segmentation method was proposed based on color images combined with depth information. A convex hull algorithm and image moments were used to extract hand contour features, and then hand gesture was recognized by using Hu invariant moment features and KNN classification algorithm. The experiment results showed that the human-robot interactive operating system for underwater manipulators based on hand gesture recognition has a good hand gesture recognition rate and interaction effectiveness. This study provides a solution for implementing human-robot interaction for underwater robots.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chandrasekaran, B., Conrad, J.M.: Human-robot collaboration: a survey. In: SoutheastCon 2015, pp. 1–8. IEEE, Fort Lauderdale (2015)
Uwineza, J., Ma, H., Li, B., et al.: Static hand gesture recognition for human robot interaction. In: 2019 Intelligent Robotics and Applications (ICIRA). vol. 11741, pp. 417–430. Springer, Cham (2019)
Oudah, M., Al-Naji, A., Chahl, J.: Hand gesture recognition based on Computer Vision: a review of techniques. J. Imag. 6, 73 (2020)
Hsu, R.-L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 696–706 (2002)
Pan, H., Zhu, Q., Tang, R., et al.: Accurate hand detection method for noisy environments. In: 2018 Cloud Computing and Security (ICCCS). vol. 11068, pp. 360–368. Springer, Cham (2018)
Ozturk, O., Aksac, A., Ozyer, T., et al.: Boosting real-time recognition of hand posture and gesture for virtual mouse operations with segmentation. Appl. Intell. 43, 786–801 (2015)
Tang, H.-K., Feng, Z.-Q.: Hand's skin detection based on ellipse clustering. In: 2008 International Symposium on Computer Science and Computational Technology, pp. 758–761. IEEE, Shanghai (2008)
Shukla, J., Dwivedi, A.: A method for hand gesture recognition. In: 2014 Fourth International Conference on Communication Systems and Network Technologies, pp. 919–923. IEEE, Bhopal (2014)
Mesbahi, S.C., Mahraz, M.A., Riffi, J., et al.: Hand gesture recognition based on convexity approach and background subtraction. In: 2018 International Conference on Intelligent Systems and Computer Vision (ISCV), pp. 1–5. IEEE, Fez (2018)
MartÃn H.J.A., Santos, M., de Lope, J.: Orthogonal variant moments features in image analysis. Inform. Sci. 180, 846–860 (2010)
Ming-Kuei, H.: Visual pattern recognition by moment invariants. IEEE Trans. Inf. Theory 8, 179–187 (1962)
Acknowledgements
This research was supported by the National Natural Science Foundation of China (Nos. 62176149 and 61673252).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, Y., Hu, Z., Tu, D., Zhang, X. (2023). Human-Robot Interactive Operating System for Underwater Manipulators Based on Hand Gesture Recognition. In: Yang, H., et al. Intelligent Robotics and Applications. ICIRA 2023. Lecture Notes in Computer Science(), vol 14267. Springer, Singapore. https://doi.org/10.1007/978-981-99-6483-3_49
Download citation
DOI: https://doi.org/10.1007/978-981-99-6483-3_49
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6482-6
Online ISBN: 978-981-99-6483-3
eBook Packages: Computer ScienceComputer Science (R0)