Skip to main content

Real-Time Vision Based Gesture Recognition for Human-Robot Interaction

  • Conference paper
Knowledge-Based Intelligent Information and Engineering Systems (KES 2007)

Abstract

In this paper, we propose gesture recognition in multiple people environment. Our system is divided into two modules: Segmentation and Recognition. In segmentation part, we extract foreground area from input image, and we decide the closest person as a recognition subject. In recognition part, firstly we extract feature point of subject’s both hands using contour based method and skin based method. Extracted points are tracked using Kalman filter. We use trajectories of both hands for recognizing gesture. In this paper, we use the simple queue matching method as a recognition method. We also apply our system as an animation system. Our method can select subject effectively and recognize gesture in multiple people environment. Therefore, proposed method can be used for real world application such as home appliance and humanoid robot.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zhao, T., Nevatia, R.: Tracking Multiple Humans in Crowded Environment. In: Proceedings of CVPR 2004, pp. 1063–6919 (2004)

    Google Scholar 

  2. Wu, B., Nevatia, R.: Detection of Multiple, Partially Occluded Humans in a Single Image by Bayesian Combination of Edgelet Part Detectors. In: Proceedings of ICCV, vol. 1, pp. 90–97 (2005)

    Google Scholar 

  3. Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-Time Surveillance of People and Their Activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 809–830 (2000)

    Article  Google Scholar 

  4. Siebel, N.T, Maybank, S.: Fusion of Multiple Tracking Algorithms for Robust People Tracking. In: Proceeding of ECCV 2002, pp. 373–387 (2002)

    Google Scholar 

  5. Franc, J.B., Fleuret, o., Fu, P.: Robust People Tracking with Global Trajectory Optimization. In: Proceedings of CVPR 2006, vol. 1, pp. 744–750 (2006)

    Google Scholar 

  6. Nguyen, H.T., Ji, Q., Smeulders, A.W.M.: Robust multi-target tracking using spatio-temporal context. In: Proceedings of CVPR 2006, vol. 1, pp. 578–585 (2006)

    Google Scholar 

  7. Han, J., Award, G.M., Sutherland, A., Wu, H.: Automatic Skin Segmentation for Gesture Recognition Combining Region and Support Vector Machine Active Learning. In: Proceedings of FGR 2006, pp. 237–242 (2006)

    Google Scholar 

  8. Li, H., Greenspan, M.: Multi-scale Gesture Recognition from Time-Varying Contours. In: Proceedings of ICCV 2005, vol. 1, pp. 236–224 (2005)

    Google Scholar 

  9. Lee, S.-W.: Automatic Gesture Recognition for Intelligent Human-Robot Interaction. In: Proceedings of FGR 2006, pp. 645–650 (2006)

    Google Scholar 

  10. Setiawan, N.A., Hong, S.-j., Lee, C.-w.: Gaussian Mixture Model in Improved HLS Color Space for Human Silhouette Extraction. In: Pan, Z., Cheok, A., Haller, M., Lau, R.W.H., Saito, H., Liang, R. (eds.) ICAT 2006. LNCS, vol. 4282, Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  11. http://www.sourceforge.net/projects/opencvlibrary

Download references

Author information

Authors and Affiliations

Authors

Editor information

Bruno Apolloni Robert J. Howlett Lakhmi Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hong, Sj., Setiawan, N.A., Lee, Cw. (2007). Real-Time Vision Based Gesture Recognition for Human-Robot Interaction. In: Apolloni, B., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2007. Lecture Notes in Computer Science(), vol 4692. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74819-9_61

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74819-9_61

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74817-5

  • Online ISBN: 978-3-540-74819-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics