Abstract
This paper discusses a technique of detecting a head nod and shake. The proposed system is composed of face detection, eye detection and head nod and head shake detection. We use motion segmentation algorithm that makes use of differencing to detect moving people’s faces. The novelty of this paper comes from the differencing in real time input images, preprocessing to remove noises (morphological operator and so on), detecting edge lines and restoration, finding the face area and cutting the head candidate. Moreover, we adopt K-means algorithm for finding head. Eye detection extracts the location of eyes from the detected face region. It is performed at the region close to a pair of eyes for real-time eye detecting. Head nod and shake can be detected by HMMs those are adapted by a directional vector. The HMMs vector can also be used to determine neutral as well as head nod and head shake. These techniques are implemented on a lot of images and a notable success is notified.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ekman, P., Huang, T., Sejnowski, T., Hager, J.: Final Report to NSF of the planning Workshop on Facial Expression Understanding, Technical report, National Science Foundation, Human Interaction Lab., UCSF, CA 94143 (1993)
Kapoor, A., Picard, R.W.: A Real-Time Head Nod and Shake Detector. In: Proceedings from the Workshop on Perceptive User Interfaces, November (2001)
Tan, W., Rong, G.: A real-time head nod and shake detector using HMMs. Expert Systems with Applications 25, 461–466 (2003)
Davis, J.W., Vakes, S.: A perceptual user interface for recognizing head gesture acknowledgements. In: ACM workshop on perceptual user interfaces (2001)
Toyama, K.: Look, ma—no hands! Hands free cursor control with real-time 3D face tracking. In: Proceedings of workshop on perceptual user interfaces, pp. 49–54 (1998)
Chen, Q., Wu, H., Fukumoto, T., Yachida, M.: 3D head pose estimation without feature tracking. In: IEEE International Conference on Automatic Face and Gesture Recognition (1998)
Heinzman, J., Zelinsky, A.: 3-D facial pose and gaze point estimation using a robust real-time tracking paradigm. In: IEEE International Conference on Automatic Face and Gesture Recognition (1998)
Kawato, S., Ohya, J.: Real-time detection of nodding and head-shaking by directly detecting and tracking the between-eyes. In: Fourth IEEE international conference on automatic face and gesture recognition (2000)
Pitas, I.: Digital image processing algorithms. Prentice-Hall, Englewood Cliffs (1993)
Lumina, R.L., Shapiro, G., Zuniga, O.: A New Connected Components Algorithm for Virtual Memory Computers. Computer Vision, Graphics, and Image Processing 22, 287–300 (1983)
Jung, J.N., Nam, M.-Y., Rhee, P.K.: Adaptive Eye Location Using FuzzyART. In: Wang, L., Chen, K., S. Ong, Y. (eds.) ICNC 2005. LNCS, vol. 3611, pp. 109–118. Springer, Heidelberg (2005)
Rabiner, L.: A tutorial on hidden markov models and Selected applications in speech recognition. Proceedings of the IEEE 77(2), 257–285 (1989)
Nefian, A.V., Hayes III, M.H.: Face detection and recognition using hidden Markov models. In: IEEE International Conference on Image Processing (1998)
Baum, L., Petrie, T., Weiss, N.: A maximization techniques occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41(1), 164–171 (1970)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kang, Y.G., Joo, H.J., Rhee, P.K. (2006). Real Time Head Nod and Shake Detection Using HMMs. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893011_90
Download citation
DOI: https://doi.org/10.1007/11893011_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46542-3
Online ISBN: 978-3-540-46544-7
eBook Packages: Computer ScienceComputer Science (R0)