Abstract
Gesture spotting is the challenging task of locating the start and end frames of the video stream that correspond to a gesture of interest, while at the same time rejecting non-gesture motion patterns. This paper proposes a new gesture spotting and recognition algorithm that is based on the continuous dynamic programming (CDP) algorithm, and runs in real-time. To make gesture spotting efficient a pruning method is proposed that allows the system to evaluate a relatively small number of hypotheses compared to CDP. Pruning is implemented by a set of model-dependent classifiers, that are learned from training examples. To make gesture spotting more accurate a subgesture reasoning process is proposed that models the fact that some gesture models can falsely match parts of other longer gestures. In our experiments, the proposed method with pruning and subgesture modeling is an order of magnitude faster and 18% more accurate compared to the original CDP algorithm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Triesch, J., von der Malsburg, C.: A gesture interface for human-robot-interaction. Automatic Face and Gesture Recognition, 546–551 (1998)
Freeman, W., Weissman, C.: Television control by hand gestures. Technical Report 1994-024, MERL (1994)
Lee, H., Kim, J.: An HMM-based threshold model approach for gesture recognition. PAMI 21, 961–973 (1999)
Freeman, W., Roth, M.: Computer vision for computer games. Automatic Face and Gesture Recognition, 100–105 (1996)
Kang, H., Lee, C., Jung, K.: Recognition-based gesture spotting in video games. Pattern Recognition Letters 25, 1701–1714 (2004)
Morguet, P., Lang, M.: Spotting dynamic hand gestures in video image sequences using hidden Markov models. In: ICIP, pp. 193–197 (1998)
Oka, R.: Spotting method for classification of real world data. The Computer Journal 41, 559–565 (1998)
Rose, R.: Word spotting from continuous speech utterances. In: Automatic Speech and Speaker Recognition - Advanced Topics, pp. 303–330. Kluwer Academic Publishers, Dordrecht (1996)
Kahol, K., Tripathi, P., Panchanathan, S.: Automated gesture segmentation from dance sequences. Automatic Face and Gesture Recognition, 883–888 (2004)
Starner, T., Pentland, A.: Real-time american sign language recognition from video using hidden Markov models. In: SCV 1995, pp. 265–270 (1995)
Darrell, T., Pentland, A.: Space-time gestures. In: Proc. CVPR, pp. 335–340 (1993)
Yoon, H., Soh, J., Bae, Y., Yang, H.: Hand gesture recognition using combined features of location, angle and velocity. Pattern Recognition 34, 1491–1501 (2001)
Zhu, Y., Xu, G., Kriegman, D.: A real-time approach to the spotting, representation, and recognition of hand gestures for human-computer interaction. CVIU 85, 189–208 (2002)
Palm: Grafitti alphabet, http://www.palmone.com/us/products/input/
Jones, M., Rehg, J.: Statistical color models with application to skin detection. IJCV 46, 81–96 (2002)
Yuan, Q., Sclaroff, S., Athistos, V.: Automatic 2D hand tracking in video sequences. In: WACV (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alon, J., Athitsos, V., Sclaroff, S. (2005). Accurate and Efficient Gesture Spotting via Pruning and Subgesture Reasoning. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. HCI 2005. Lecture Notes in Computer Science, vol 3766. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573425_19
Download citation
DOI: https://doi.org/10.1007/11573425_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29620-1
Online ISBN: 978-3-540-32129-3
eBook Packages: Computer ScienceComputer Science (R0)