skip to main content
10.1145/1655925.1656154acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicisConference Proceedingsconference-collections
research-article

Vision-based two hand detection and tracking

Published: 24 November 2009 Publication History

Abstract

In the field of human computer interaction (HCI), hand has been widely used as input device for natural interaction. However, during hand tracking, the continuously changing of hand shape and the interference from distractors (faces or hands) or occlusion reduce the robustness of man-machine alternation. In this paper, we use a web camera to detect two hands automatically and then track them stably in order to go against the problems mentioned above. At the first stage, we put forward a contour-based method to extract five fingertips which provide cues to locate initial hand position. At the second stage, CamShift is adopted to track the located hands. However, the means may easily lose the tracked objects due to its inadaptability to distractors and occlusion. Hence, we employ an improved Grey Model which is a good predictor of historical data to guide CamShift so as to achieve more accurate tracking. Experiments have been divided into two groups including the distractors tests and the occlusion tests. The convincing results illustrate the effectiveness of the proposed algorithm.

References

[1]
Ammouri, S. and Bilodeau, G. -A. 2008. Face and hands detection and tracking applied to the monitoring of medication intake. IEEE Trans. On CRV, 147--154.
[2]
Bradski, G. R. 1998. Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal, 2nd Quarter.
[3]
Brown, T. and Thomas, R. C. 2000. Finger tracking for the digital desk. IEEE Trans. On AUIC, 11--16.
[4]
Freeman, W. T., Anderson, D. B., and Beardsley, P. et al. 1998. Computer vision for interactive computer graphics. IEEE Trans. On Computer Graphics and Applications, 18:42--53.
[5]
Hardenberg, C. and Bérard, F. 2001. Bare-hand human-computer interaction. Proceedings of the 2001 ACM International Conference On Perceptive user interfaces, 15:1--8.
[6]
Liu, Q. and Cai, C. H. 2006. Dual searching window based face tracking. IEEE Trans. On ISPACS, 279--282.
[7]
Ongkittikul, S., Worrall, S., and Kondoz, 2008. A. Two hand tracking using colour statistical model with the K-means embedded particle filter for hand gesture recognition. IEEE Trans. On CISIM, 201--206.
[8]
Soontranon, N., Aramvith, S., and Chalidabhongse, T. H. 2005. Improved face and hand tracking for sign language recognition. IEEE Trans. On ITCC, 2:141--146.
[9]
Tang, J. X. and Zhang, J. X. 2009. Face tracking with occlusion. IEEE Trans. On ICMTMA, 1:465--468.
[10]
Wong, C. C., Lin, B. C., and Cheng C. T. 2001. Fuzzy tracking method with a switching grey prediction for mobile robot. IEEE Trans. On Fuzzy Systems, 1:103--106.
[11]
Xiao, Y. Y., Zhang, H., and Wang, H. Y. 2007. Location prediction for tracking moving objects based on grey theory. IEEE Trans. On FSKD, 2:390--394.
[12]
Yang, B., Zhou, H. I, and Wang, X. 2008. Target tracking using predicted CamShift. IEEE Trans. On WCICA, 8501--8505.
[13]
Yang, D. H. and Xia, J. S. 2009. Face tracking based on CamShift algorithm and motion prediction. IEEE Trans. On ISA, 1--4.
[14]
Yuan, M., Farbiz, F., Manders, C. M., and Tang, K. Y. 2008. Robust hand tracking using a simple color classification technique. Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, Article No.6.
[15]
Zaletelj, J., Perhavc, J., and Tasic, J. F. 2007. Vision-based human-computer interface using hand gestures. IEEE Trans. On WIAMIS, 41--44.
[16]
Zhai, H. T., Wu, X. I, and Han, H. 2005. Research of a real-time hand tracking algorithm. IEEE Trans. On ICNN&B, 2:1233--1235.
[17]
Zhou, H. L., Xie, L. L., and Fang, X. L. 2007. Visual mouse: SIFT detection and PCA recognition. IEEE Trans. On CISW, 15--19.

Cited By

View all
  • (2020)Design of Image Extraction Hardware for Hand Gesture Vision RecognitionJOURNAL OF ADVANCED INFORMATION TECHNOLOGY AND CONVERGENCE10.14801/JAITC.2020.10.1.7110:1(71-83)Online publication date: 31-Jul-2020
  • (2010)A Real Time Vision-Based Hand Gesture InteractionProceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation10.1109/AMS.2010.55(237-242)Online publication date: 26-May-2010

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICIS '09: Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human
November 2009
1479 pages
ISBN:9781605587103
DOI:10.1145/1655925
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • AICIT
  • ETRI
  • KISTI

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CamShift
  2. grey model
  3. hand detection and tracking

Qualifiers

  • Research-article

Funding Sources

Conference

ICIS '09
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Design of Image Extraction Hardware for Hand Gesture Vision RecognitionJOURNAL OF ADVANCED INFORMATION TECHNOLOGY AND CONVERGENCE10.14801/JAITC.2020.10.1.7110:1(71-83)Online publication date: 31-Jul-2020
  • (2010)A Real Time Vision-Based Hand Gesture InteractionProceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation10.1109/AMS.2010.55(237-242)Online publication date: 26-May-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media