Abstract
Unmanned aerial vehicles (UAVs) are playing important roles in many fields for their stability and flexibility. However, controlling a UAV by its remote-controller is very difficult especially for the beginners. In this paper, we propose a real-time UAV control system that only exploits shape and movements of the user’s hands. A set of gestures that map the hand actions to all motions of the UAV is designed based on subjective experience assessment. 94.898 % of motion accuracy can be achieved with only 0.19 s of latency on average. Compared with other systems, our system reduces 40.625 % and 36.667 % in the latency. To the best of our knowledge, our control system is the first one to realize all motions of the UAV in the actual experiments by only utilizing hand motions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ackerman, E.: Japan earthquake: global Hawk UAV may be able to peek inside damaged reactors. In: IEEE Spectr. 17 (2011)
Adams, S., Friedland, C., Levitan, M.: Unmanned aerial vehicle data acquisition for damage assessment in hurricane events. In: Proceedings of the 8th International Workshop on Remote Sensing for Disaster Management, Tokyo, Japan, vol. 30 (2010)
Hays, R.T., Jacobs, J.W., Prince, C., Salas, E.: Flight simulator training effectiveness: A meta-analysis. Mil. Psychol. 4(2), 63 (1992)
Kessler, G.D., Hodges, L.F., Walker, N.: Evaluation of the CyberGlove as a whole-hand input device. ACM Trans. Comput.-Hum. Interact. (TOCHI) 2(4), 263–283 (1995)
Hollar, S.E.A.: Cots dust (2000)
Guo, C., Sharlin, E.: Exploring the use of tangible user interfaces for human-robot interaction: a comparative study. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 121–130. ACM (2008)
Fernando, C.L., Igarashi, T., Inami, M., Sugimoto, M., Sugiura, Y., Withana, A.I., Gota, K.: An operating method for a bipedal walking robot for entertainment. In: ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation, pp. 79–79. ACM (2009)
Stowers, J., Hayes, M., Bainbridge-Smith, A.: Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor. In: 2011 IEEE International Conference on Mechatronics (ICM), pp. 358–362. IEEE (2011)
Asiimwe, R., Anvar, A.: Automation of the Maritime UAV command, control, navigation operations, simulated in real-time using Kinect sensor: a feasibility study. World Acad. Sci. Eng. Technol. 72 (2012)
Boudjit, K., Larbes, C., Alouache, M.: Control of flight operation of a quad rotor AR. drone using depth map from Microsoft Kinect sensor. Int. J. Eng. Innovative Technol. 3, 15–19 (2008)
Sanna, A., Lamberti, F., Paravati, G., Manuri, F.: A Kinect-based natural interface for quadrotor control. Entertainment Comput. 4(3), 179–186 (2013)
Mashood, A., Noura, H., Jawhar, I., Mohamed, N.: A gesture based kinect for quadrotor control. In: 2015 International Conference on Information and Communication Technology Research (ICTRC), pp. 298–301. IEEE (2015)
http://www.intel.com/content/www/us/en/architecture-and-technology/realsense-overview.html
Lambrecht, J., Kleinsorge, M., Krüger, J.: Markerless gesture-based motion control and programming of industrial robots. In: 2011 IEEE 16th Conference on Emerging Technologies & Factory Automation (ETFA), pp. 1–4. IEEE (2011)
Walid, M., Slaheddine, N., Mohamed, A., Lamjed, B.: Modeling and control of a quadrotor UAV. In: 2014 15th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA), pp. 343–348. IEEE (2014)
Sanna, A., Lamberti, F., Paravati, G., Manuri, F.: A Kinect-based natural interface for quadrotor control. Entertainment Comput. 4(3), 179–186 (2013)
Acknowledgments
This work was supported by the project of NSFC 61371138 and NSF project of Guangdong 2014A030313733, China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Wei, L., Jin, X., Wu, Z., Zhang, L. (2016). A Real-Time Gesture-Based Unmanned Aerial Vehicle Control System. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9916. Springer, Cham. https://doi.org/10.1007/978-3-319-48890-5_52
Download citation
DOI: https://doi.org/10.1007/978-3-319-48890-5_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48889-9
Online ISBN: 978-3-319-48890-5
eBook Packages: Computer ScienceComputer Science (R0)