Abstract
This paper presents a vision-based interface for controlling a computer mouse via 2D and 3D hand gestures. The proposed interface builds upon our previous work that permits the detection and tracking of multiple hands that can move freely in the field of view of a potentially moving camera system. Dependable hand tracking, combined with fingertip detection, facilitates the definition of simple and, therefore, robustly interpretable vocabularies of hand gestures that are subsequently used to enable a human operator convey control information to a computer system. Two such vocabularies are defined, implemented and validated. The first one depends only on 2D hand tracking results while the second also makes use of 3D information. As confirmed by several experiments, the proposed interface achieves accurate mouse positioning, smooth cursor movement and reliable recognition of gestures activating button events. Owing to these properties, our interface can be used as a virtual mouse for controlling any Windows application.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Argyros, A.A., Lourakis, M.I.A.: Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 368–379. Springer, Heidelberg (2004)
Argyros, A.A., Lourakis, M.I.A.: Binocular Hand Tracking and Reconstruction Based on 2D Shape Matching. In: ICPR 2006, under review (submitted, 2006)
Besl, P., McKay, N.: A Method for Registration of 3-d Shapes. IEEE Trans. on PAMI 14(2) (1992)
Chetverikov, D., Svirko, D., Stepanov, D., Krsek, P.: The Trimmed Iterative Closest Point Algorithm. In: Proceedings of ICPR 2002 (2002)
Corso, J.J., Burschka, D., Hager, G.D.: The 4D Touchpad: Unencumbered HCI With VICs. In: Proceedings of CVPR-HCI 2003, p. 55 (2003)
Gale, D., Shapley, L.S.: College Admissions and the Stability of Marriage. American Mathematical Monthly 69(9) (1962)
Goldman, R.: Intersection of two lines in three-space. In: Graphics Gems I, p. 304 (1990)
Malik, S., Laszlo, J.: Visual Touchpad: A Two-Handed Gestural Input Device. In: Proceedings of ICMI 2004, pp. 289–296 (2004)
Porta, M.: Vision-based User Interfaces: Methods and Applications. Int. J. Human-Computer Studies 57(1), 27–73 (2002)
Robertson, P., Laddaga, R., van Kleek, M.: Virtual Mouse Vision Based Interface. In: Proceedings of IUI 2004, pp. 177–183 (2004)
Rousseeuw, P.J.: Least Median of Squares Regression. Journal of American Statistics Association 79, 871–880 (1984)
van Dam, A.: Post-WIMP User Interfaces. Commun. ACM 40(2), 63–67 (1997)
Zhang, Z.: Determining the Epipolar Geometry and its Uncertainty: a Review. Int. Journal of Computer Vision 27, 161–195 (1998)
Zhang, Z., Wu, Y., Shan, Y., Shafer, S.: Visual Panel: Virtual Mouse, Keyboard and 3D Controller With an Ordinary Piece of Paper. In: Proceedings of PUI 2001, pp. 1–8 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Argyros, A.A., Lourakis, M.I.A. (2006). Vision-Based Interpretation of Hand Gestures for Remote Control of a Computer Mouse. In: Huang, T.S., et al. Computer Vision in Human-Computer Interaction. ECCV 2006. Lecture Notes in Computer Science, vol 3979. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11754336_5
Download citation
DOI: https://doi.org/10.1007/11754336_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34202-1
Online ISBN: 978-3-540-34203-8
eBook Packages: Computer ScienceComputer Science (R0)