Skip to main content

Hands Tracking from Frontal View for Vision-Based Gesture Recognition

  • Conference paper
  • First Online:
Pattern Recognition (DAGM 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2449))

Included in the following conference series:

Abstract

We present a system for tracking the hands of a user in a frontal camera view for gesture recognition purposes. The system uses multiple cues, incorporates tracing and prediction algorithms, and applies probabilistic inference to determine the trajectories of the hands reliably even in case of hand-face overlap. A method for assessing tracking quality is also introduced. Tests were performed with image sequences of 152 signs from German Sign Language, which have been segmented manually beforehand to offer a basis for quantitative evaluation. A hit rate of 81.1% was achieved on this material.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akyol, S., Alvarado, P.: Finding Relevant Image Content for mobile Sign Language Recognition. In: Hamza, M.H. (ed.): IASTED International Conference-Signal Processing, Pattern Recognition and Applications (SPPRA), Rhodes (2001) 48–52

    Google Scholar 

  2. Bobick, A.-F., Davis, J.-W.: The Representation and Recognition of Action Using Temporal Templates. IEEE PAMI 3:23 (2001) 257–267

    Google Scholar 

  3. Bowden, R., Mitchell, T.A., Sahadi, M.: Non-linear statistical models for the 3D reconstruction of human pose and motion from monocular image sequences. Image and Vision Computing Journal 18 (2000) 729–737

    Article  Google Scholar 

  4. Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal Q2 (1998)

    Google Scholar 

  5. Cutler, R., Turk, M.: View-based Interpretation of Real-time Optical Flow for Gesture Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1998) 416–421

    Google Scholar 

  6. Imagawa, K., Lu, S., Igi, S.: Color-Based Hands Tracking System for Sign Language Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1998) 462–467

    Google Scholar 

  7. Nagaya, S., Seki, S., Oka, R.: A Theoretical Consideration of Pattern Space Trajectory for Gesture Spotting Recognition. Proc. IEEE Conf. Face and Gesture Recognition (1996) 72–77

    Google Scholar 

  8. Oliver, N., Pentland, A.: Lafter: Lips and face real-time tracker. Proc. IEEE Conf. Computer Vision Pattern Recognition (1997) 123–129

    Google Scholar 

  9. Rasmussen, C., Hager, G.D.: Joint Probabilistic Techniques for Tracking Objects Using Visual Cues. Intl. Conf. Intelligent Robotic Systems (1998) no pagenumbers

    Google Scholar 

  10. Rigoll, G., Kosmala, A., Eickeler, S.: High Performance Real-Time Gesture Recognition Using Hidden Markov Models. In: Wachsmut, I., Fröhlich, M. (eds.): Gesture and Sign Language in Human-Computer Interaction. Springer (1998) 69–80

    Google Scholar 

  11. Sherrah, J., Gong, S.: Tracking Discontinuous Motion Using Bayesian Inference. Proc. European Conf. on Computer Vision (2000) 150–166

    Google Scholar 

  12. Starner, T., Pentland, A.: Visual Recognition of American Sign language Using Hidden Markov Models. Proc. IEEE Workshop Face and Gesture Recognition (1995) 189–194

    Google Scholar 

  13. Viola, P., Jones, M.J.: Robust Real-time Object Detection. Technical Report CRL 2001/01, Cambridge Research Laboratory (2001)

    Google Scholar 

  14. Welch, G., Bishop, G.: An introduction to the Kalman Filter. Technical Report 95-041, Dept. of Computer Science, University of Chapel Hill (2001)

    Google Scholar 

  15. Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-time tracking of the human body. IEEE PAMI 7:19 (1997) 780–785

    Google Scholar 

  16. Yang, M., Ahuja, N.: Extraction and Classification of Visual Motion Patterns for Hand Gesture Recognition. Proc. IEEE Conf. CVPR (1998) 892–897

    Google Scholar 

  17. Yang, M., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE PAMI 1:24 (2002) 34–58

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zieren, J., Unger, N., Akyol, S. (2002). Hands Tracking from Frontal View for Vision-Based Gesture Recognition. In: Van Gool, L. (eds) Pattern Recognition. DAGM 2002. Lecture Notes in Computer Science, vol 2449. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45783-6_64

Download citation

  • DOI: https://doi.org/10.1007/3-540-45783-6_64

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44209-7

  • Online ISBN: 978-3-540-45783-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics