Skip to main content

Development of Real-Time Gesture Recognition System Using Visual Interaction

  • Conference paper
  • First Online:
Proceedings of the International Conference on IT Convergence and Security 2011

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 120))

Abstract

The aim of this paper is to present a methodology for hand detection, propose a finger detection method, and finally apply them to posture recognition. The detected hand and finger can be used to implement the non-contact mouse. This technology can be used to control home devices such as curtain and television. Skin color is used to segment the hand region from the background, and counter is extracted from the segmented hand. The counter analysis of gives us the location of fingertip in the hand. Fingertip tracking is performed assuming a constant velocity model and using a pixel labeling approach. From the tracking process, we extract several hand features that are fed to a finite state classifier that identifies the hand configuration. The hand can be classified into many gesture classes or several different movement directions. This method of skin segmentation assumes that the background does not contain any skin colored object beside hands. We have performed an extensive experiment and achieved a very encouraging result. Ultimately, this paper suggests an empirical application to verify the adequacy and validity of the proposed systems. Accordingly, the satisfaction and quality of services will improved gesture recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Davis J, Shah M (1994) Visual gesture recognition. Proc Vision Image Sign Proces 141(2):101–106

    Article  Google Scholar 

  2. Vogler C, Metaxas D (2001) A framework for recognizing the simultaneous aspects of American sign language. J Comput Vision Image Understanding 81:358–384

    Article  MATH  Google Scholar 

  3. Fillbrandt H, Akyol S, Kraiss KF (2003) Extraction of 3D hand shape and posture from image sequences for sign language recognition. In: Proceedings of IEEE international workshop on analysis and modeling of faces and gestures, Vol 17, pp 181–186

    Google Scholar 

  4. Chung KY (2010) Human sensibility ergonomics makeup recommendation system using context sensor information. J Contents Assoc 10(7):23–30

    Article  Google Scholar 

  5. Rehg J, Kanade T (1993) DigitEyes: vision-based human hand tracking. School of Computer Science Technical Paper CMU-CS-93-220, Carnegie Mellon Univ

    Google Scholar 

  6. Ng CW, Ranganath S (2002) Real-time gesture recognition system and application. J Image Vision Comput 20(13–14):993–1007

    Article  Google Scholar 

  7. Abe K, Saito H, Ozawa S (2002) Virtual 3D interface system via hand motion recognition from two cameras. J IEEE Trans Syst Man Cybern, Part A 32(4):536–540

    Article  Google Scholar 

  8. Kwon K, Zhang H, Dornaika F (2001) Hand pose recovery with a single video camera. In: Proceedings of the IEEE international conference on robotics and automation, pp 3181–4261

    Google Scholar 

  9. Shirai Y, Tanibata N, Shimada N (2002) “Extraction of hand features for recognition of sign language words”, VI’2002 computer-controlled mechanical systems. Graduate School of Engineering, Osaka University, Osaka

    Google Scholar 

  10. Graetzel C, Grange S, Fong T, Baur C (2003) A non-contact mouse for surgeon- computer interaction. IEEE Medical Image Computing and Computer Assisted Intervention, Toronto, Canada interface

    Google Scholar 

  11. Frigola M, Fernandez J, Aranda J (2003) Visual human machine interface by gestures. In: Proceedings IEEE international conference on robotics and automation, Vol 1, pp 386–391

    Google Scholar 

  12. Ueda E, Matsumoto Y, Imai M, Ogasawara T (2003) A hand-pose estimation for vision-based human interfaces. IEEE Trans Ind Electron 50(4):676–684

    Article  Google Scholar 

  13. Isaacs J, Foo JS (2004) Hand pose estimation for American sign language recognition. In: Proceedings of the 36th southeastern symposium on system theory, pp 132–136

    Google Scholar 

  14. Hamada Y, Shimada N, Shirai Y (2004) Hand shape estimation under complex backgrounds for sign language recognition. In: Proceedings of international conference on automatic face and gesture recognition, pp 589–594

    Google Scholar 

Download references

Acknowledgements

This research was supported by the MKE(The Ministry of Knowledge Economy), Korea, under the ITRC(Information Technology Research Center) support program supervised by the NIPA(National IT Industry Promotion Agency)” (NIPA-2011-C1090-1131-0004)

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kyung-Yong Chung .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media B.V.

About this paper

Cite this paper

Kang, SK., Chung, KY., Rim, KW., Lee, JH. (2012). Development of Real-Time Gesture Recognition System Using Visual Interaction. In: Kim, K., Ahn, S. (eds) Proceedings of the International Conference on IT Convergence and Security 2011. Lecture Notes in Electrical Engineering, vol 120. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-2911-7_25

Download citation

  • DOI: https://doi.org/10.1007/978-94-007-2911-7_25

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-007-2910-0

  • Online ISBN: 978-94-007-2911-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics