You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

Dynamic hand gesture recognition using RGB-D data for natural human-computer interaction

Issue title: Recent advancements in computer, communication and computational sciences

Guest editors: K.K. Mishra

Article type: Research Article

Authors: Linqin, Cai* | Shuangjie, Cui | Min, Xiang | Jimin, Yu | Jianrong, Zhang

Affiliations: Key Laboratory of Industrial Internet of Things & Networked Control, Ministry of Education, Chongqing University of Posts and Telecommunications, Chongqing, China

Correspondence: [*] Corresponding author. Cai Linqin, Key Laboratory of Industrial Internet of Things & Networked Control, Ministry of Education, Chongqing University of Posts and Telecommunications, 400065 Chongqing, China. Tel.: +86 15215164090; Fax: +86 023 62461535; E-mail: [email protected].

Abstract: Hand gesture recognition is widely used in human-computer interaction (HCI) and has attracted substantial researching attentions. This paper aims to develop low-complexity and real-time solutions of dynamic hand gestures recognition using RGB-D depth sensor for natural human-computer interaction applications. We combine Euclidean distance between hand joints and shoulder center joint with the modulus ratios of skeleton features to generate a unifying feature descriptor for each dynamic hand gesture. And then, an improved dynamic time warping (IDTW) algorithm is proposed to obtain the final recognition results, which applies the weighted distance and a restricted search path to avoid the huge computation in conventional DTW and improves the recognition performance. Experimental results show that the proposed algorithm of dynamic hand gesture recognition not only achieves higher average recognition rate of 96.5% and better performance in response time, but also is robust to uncontrolled environments. Finally, according to our hand gesture recognition solutions, we develop one real-life HCI applications to control a virtual coalmine environment, which operates accurately and efficiently.

Keywords: Dynamic gesture, red green blue-depth (RGB-D), human-computer interaction (HCI), dynamic time warping (DTW), virtual environment

DOI: 10.3233/JIFS-169287

Journal: Journal of Intelligent & Fuzzy Systems, vol. 32, no. 5, pp. 3495-3507, 2017

Published: 24 April 2017
Price: EUR 27.50

Dynamic hand gesture recognition using RGB-D data

What is it about?

Hand gesture recognition is widely used in human-computer interaction (HCI) and has attracted substantial researching attentions.We have developed a low-complexity and real-time solution of dynamic hand gestures recognition using RGB-D depth sensor for natural human-computer interaction applications.

Why is it important?

We combine Euclidean distance between hand joints and shoulder center joint with the modulus ratios of skeleton features to generate a unifying feature descriptor for each dynamic hand gesture. And then, an improved dynamic time warping (IDTW) algorithm is proposed to obtain the final recognition results, which applies the weighted distance and a restricted search path to avoid the huge computation in conventional DTW and improves the cognition performance. Experimental results show that the proposed algorithm of dynamic hand gesture recognition not only achieves higher average recognition rate of 96.5% and better performance in response time, but also is robust to uncontrolled environments. Finally, according to our hand gesture recognition solutions, we develop one real-life HCI applications to control a virtual coalmine environment, which operates accurately and efficiently.

Read more on Kudos…
The following have contributed to this page:
Linqin CAI
Show more