Abstract
We present a system for tracking the hands of a user in a frontal camera view for gesture recognition purposes. The system uses multiple cues, incorporates tracing and prediction algorithms, and applies probabilistic inference to determine the trajectories of the hands reliably even in case of hand-face overlap. A method for assessing tracking quality is also introduced. Tests were performed with image sequences of 152 signs from German Sign Language, which have been segmented manually beforehand to offer a basis for quantitative evaluation. A hit rate of 81.1% was achieved on this material.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Akyol, S., Alvarado, P.: Finding Relevant Image Content for mobile Sign Language Recognition. In: Hamza, M.H. (ed.): IASTED International Conference-Signal Processing, Pattern Recognition and Applications (SPPRA), Rhodes (2001) 48–52
Bobick, A.-F., Davis, J.-W.: The Representation and Recognition of Action Using Temporal Templates. IEEE PAMI 3:23 (2001) 257–267
Bowden, R., Mitchell, T.A., Sahadi, M.: Non-linear statistical models for the 3D reconstruction of human pose and motion from monocular image sequences. Image and Vision Computing Journal 18 (2000) 729–737
Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal Q2 (1998)
Cutler, R., Turk, M.: View-based Interpretation of Real-time Optical Flow for Gesture Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1998) 416–421
Imagawa, K., Lu, S., Igi, S.: Color-Based Hands Tracking System for Sign Language Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1998) 462–467
Nagaya, S., Seki, S., Oka, R.: A Theoretical Consideration of Pattern Space Trajectory for Gesture Spotting Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1996) 72–77
Oliver, N., Pentland, A.: Lafter: Lips and face real-time tracker. Proc. IEEE Conf. Computer Vision Pattern Recognition (1997) 123–129
Rasmussen, C., Hager, G.D.: Joint Probabilistic Techniques for Tracking Objects Using Visual Cues. Intl. Conf. Intelligent Robotic Systems (1998) no pagenumbers
Rigoll, G., Kosmala, A., Eickeler, S.: High Performance Real-Time Gesture Recognition Using Hidden Markov Models. In: Wachsmut, I., Fröhlich, M. (eds.): Gesture and Sign Language in Human-Computer Interaction. Springer (1998) 69–80
Sherrah, J., Gong, S.: Tracking Discontinuous Motion Using Bayesian Inference. Proc. European Conf. on Computer Vision (2000) 150–166
Starner, T., Pentland, A.: Visual Recognition of American Sign language Using Hidden Markov Models. Proc. IEEE Workshop Face and Gesture Recognition (1995) 189–194
Viola, P., Jones, M.J.: Robust Real-time Object Detection. Technical Report CRL 2001/01, Cambridge Research Laboratory (2001)
Welch, G., Bishop, G.: An introduction to the Kalman Filter. Technical Report 95-041, Dept. of Computer Science, University of Chapel Hill (2001)
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-time tracking of the human body. IEEE PAMI 7:19 (1997) 780–785
Yang, M., Ahuja, N.: Extraction and Classification of Visual Motion Patterns for Hand Gesture Recognition. Proc. IEEE Conf. CVPR (1998) 892–897
Yang, M., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE PAMI 1:24 (2002) 34–58
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zieren, J., Unger, N., Akyol, S. (2002). Hands Tracking from Frontal View for Vision-Based Gesture Recognition. In: Van Gool, L. (eds) Pattern Recognition. DAGM 2002. Lecture Notes in Computer Science, vol 2449. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45783-6_64
Download citation
DOI: https://doi.org/10.1007/3-540-45783-6_64
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44209-7
Online ISBN: 978-3-540-45783-1
eBook Packages: Springer Book Archive