Abstract
This paper presents a novel Human-Computer Interaction (HCI) system with calibrated mono-camera which integrates active computer vision technology and embedded speech command recognition technology. Mainly by tracking the nose tip motion robustly as the mouse trace, this system completes mouse mission with recognition rate more than 85% at the speed 15 frame per second. To achieve the goal, we adopt a novel approach based on the symmetry of the nose plane feature to localize and track invariantly to the varied environment. Comparing to other kinds of pointing device, this hand-free HCI system is hands-free, cheap, real-time, convenient and unpolluted, which can be used in the field of disabled aid, entertainment and remote control.
Keywords
Download to read the full chapter text
Chapter PDF
References
Gorodnichy, D.O., Roth, G.: Nouse use your nose as a mouse Perceptual Vision Technology for Hands-free Games and Interfaces. Image and Vision Computing 22, 931–942 (2004)
Zhang, X., Yang, Y., Li, Y.: Design of Intelligent Soccer Robot with DSP. Journal of Guangdong University of Technology 20(2), 1–4, 25 (2003)
Tsang, W-W.M., Pun, K-P.: A Finger-Tracking Virtual Mouse Realized in an Embedded System. In: Proceedings of 2005 International Symposium on Intelligent Signal Processing and Communication Systems, pp. 781–784 (December 2005)
Yuille, A.L.: Deformable Templates for Face Recognition. J. Cognitive Neurosci 3, 59–70 (1991)
Hua, G., Guangda, S., Cheng, D.: Automatic Localization of the Corner of Eyes on Human Face. Infrared and Laser Engineering, 376–380 (2004)
Sankaran, P., Gundimada, S., Tompkins, R.C., Asari, V.K.: Pose Angle Determination by Face, Eyes and Nose Localization. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005) (2005)
Li, D., Podolak, I.T., Lee, S.W.: Facial Component Extraction And Face Recognition with Support Vector Machines. In: Proceedings of Automatic Face and Gesture Recognition, Washington, DC, USA, pp. 76–81 (2002)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of online learning and an application to boosting. In: Vitányi, P.M.B. (ed.) EuroCOLT 1995. LNCS, vol. 904, pp. 23–37. Springer, Heidelberg (1995)
Reisfeld, D., Wolfson, H., Yeshurun, Y.: Context-Free Attentional Operators:The Generalized Symmetry Transform. Inter. J.Computer Vision 14, 119–130 (1995)
Jie, Z., Chunyu, L., Changshui, Z., Yanda, L.: Human Face Location Based on Directional Symmetry Transform. In: ACTA ELECTRONICA SINICA 27, pp. 12–15 (1999)
Lucas, B., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision. In: Proc. of 7th International Joint Conference on Artificial Intelligence (IJCAI), pp. 674–679
Hsu, R-L., Abdel-Mottaleb, M., Jain, A.K.: Face Detection in Color Image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 696–706 (MAY 2002)
Bookstein, F.L: Fitting conic sections to scattered data. Computer Graphics and Image Processing 9, 56–71 (1979)
Smith, S.M., Brady, J.M.: Susan-a new approach to low level image processing, International Journal of Computer Vision, 45–78 (1997)
Witkin, A.P: Scale Space Filtering. In: Int. Joint Conf. Artificial Intelligence, pp. 1019-1021 (1983)
Tat-Jen, Cipolla, C.R.: A Local Approach to Recovering Global Skewed Symmetry, Pattern Recognition 1 , Conference A: Computer Vision and Image Processing. In: Proceedings of the 12th IAPR International Conference on, pp. 222–226 (1994)
Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, New York (1998)
Gen, D.: AVR high speed microcontroller theory and application [M].Beihang University Press (2000)
Zhang, Z.: A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11) (November 2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, L., Zhou, F., Li, W., Yang, X. (2007). Human-Computer Interaction System Based on Nose Tracking. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_84
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_84
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)