The integration of contactless static pose recognition and dynamic hand motion tracking control system for industrial human and robot collaboration
Abstract
Purpose
The purpose of this paper is to describe the integration of a gesture control system for industrial collaborative robot. Human and robot collaborative systems can be a viable manufacturing solution, but efficient control and communication are required for operations to be carried out effectively and safely.
Design/methodology/approach
The integrated system consists of facial recognition, static pose recognition and dynamic hand motion tracking. Each sub-system has been tested in isolation before integration and demonstration of a sample task.
Findings
It is demonstrated that the combination of multiple gesture control methods can increase its potential applications for industrial robots.
Originality/value
The novelty of the system is the combination of a dual gesture controls method which allows operators to command an industrial robot by posing hand gestures as well as control the robot motion by moving one of their hands in front of the sensor. A facial verification system is integrated to improve the robustness, reliability and security of the control system which also allows assignment of permission levels to different users.
Keywords
Acknowledgements
We would like to thank John Thrower, Technical Officer in Cranfield University, for his technical input and support. This work was funded by the EPSRC Centre for Innovative Manufacturing in Intelligent Automation under the grant reference number EP/1033467/1.
Citation
Tang, G., Asif, S. and Webb, P. (2015), "The integration of contactless static pose recognition and dynamic hand motion tracking control system for industrial human and robot collaboration", Industrial Robot, Vol. 42 No. 5, pp. 416-428. https://doi.org/10.1108/IR-03-2015-0059
Publisher
:Emerald Group Publishing Limited
Copyright © 2015, Emerald Group Publishing Limited