Abstract
This paper addresses the issue of 3D head pose estimation and tracking. Existing approaches generally need huge database, training procedure, manual initialization or use face feature extraction manually extracted.
We propose a framework for estimating the 3D head pose in its fine level and tracking it continuously across multiple Degrees of Freedom (DOF) based on ICP and particle filtering. We propose to approach the problem, using 3D computational techniques, by aligning a face model to the 3D dense estimation computed by a stereo vision method, and propose a particle filter algorithm to refine and track the posteriori estimate of the position of the face.
This work comes with two contributions: the first concerns the alignment part where we propose an extended ICP algorithm using an anisotropic scale transformation. The second contribution concerns the tracking part. We propose the use of the particle filtering algorithm and propose to constrain the search space using ICP algorithm in the propagation step.
The results show that the system is able to fit and track the head properly, and keeps accurate the results on new individuals without a manual adaptation or training.
This work is sponsored by King Abdullah University of Science and Technology (KAUST).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Osadchy, M., Miller, M.L., Cun, Y.L.: Synergistic face detection and pose estimation with energy-based models. Machine Learning Research 1, 1197–1215 (2007)
Balasubramanian, V., Ye, J., Panchanathan, S.: Biased manifold embedding: A framework for person-independent head pose estimation. In: IEEE Conf. Computer Vision and Pattern Recognition (2007)
Fu, Y., Huang, T.: Graph embedded analysis for head pose estimation. In: IEEE Int’l. Conf. Automatic Face and Gesture Recognition, pp. 3–8 (2006)
Yan, S., Zhang, Z., Fu, Y., Hu, Y., Tu, J., Huang, T.: Learning a person-independent representation for precise 3d pose estimation. In: Workshop Classification of Events Activities and Relationships (2007)
Niyogi, S., Freeman, W.: Example-based head tracking. In: Automatic Face and Gesture Recognition, pp. 374–378 (1996)
Murphy-Chutorian, E., Doshi, A., Trivedi, M.M.: Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation. Intelligent Transportation Systems 1, 709–714 (2007)
Stiefelhagen, R., Yang, J., Waibel, A.: Modeling focus of attention for meeting indexing based on multiple cues. IEEE Trans. Neural Networks 1, 928–938 (2002)
Kruger, N., Potzsch, M., von der Malsburg, C.: Determination of face position and pose with a learned representation based on labeled graphs. Machine Learning Research 1, 665–673 (1997)
Wu, J., Trivedi, M.M.: A two-stage head pose estimation framework and evaluation. Pattern Recognition 41, 1138–1158 (2008)
Raytchev, B., Yoda, I., Sakaue, K.: Head pose estimation by nonlinear manifold learning. Pattern Recognition 1, 462–466 (2004)
Wang, J.-G., Sung, E.: EM enhancement of 3D head pose estimated by point at infinity. Image and Vision Computing 1, 1864–1874 (2007)
Breitenstein, M.D., Kuettel, D., Weise, T., van Gool, L.: Real-time face pose estimation from single range images. In: CVPR (2008)
Malassiotis, S., Strintzis, M.G.: Robust real-time 3D head pose estimation from range data. Pattern Recognition 38, 1153–1165 (2005)
Morency, L.P., Rahimi, A., Darrell, T.: Adaptative view-based apperance models. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1803 – 1810 (2003)
Breitenstein, M.D.: Pose estimation for face recognition using stereo cameras. Ph.D. dissertation, Swiss Federal Institute of Technology Zurich (2006)
Chen, Q., Yao, J., Cham, W.K.: 3d model based pose invariant face recognition from multiple views. Computer Vision, IET 1, 25–34 (2007)
Morency, L.P., Sundberg, P., Darrell, T.: Pose estimation using 3D view-based eigenspaces. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures. AMFG 2003, vol. 1, pp. 45 – 52 (2003)
Terada, K., Oba, A., Ito, A.: 3D human head tracking using hypothesized polygon model. In: IEEE International Conference on ISystem, Man and Cybernetics, vol. 2, pp. 1396 – 1401 (2005)
Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 607–626 (2009)
Boufarguine, M., Baklouti, M., Guitteny, V., Couvet, S.: Real-time dense disparity estimation using cuda’s api. In: Internation Conference on Computer Vision Theory and Application, VISAPP (2009)
Zinsser, T., Schmidt,J., Niemann, H.: A refined ICP algorithm for robust 3-D correspondence estimation. Image Processing (ICIP 2003), vol. 2 (2003)
Chavarria, M.A., Sommer, G.: Structural ICP algorithm for pose estimation based on local features
Jost, T., Hugli, H.: A multi-resolution ICP with heuristic closest point search for fast and robust 3D registration of range images. In: 3-D Digital Imaging and Modeling (2003)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Third International Conference on 3D Digital Imaging and Modeling (2001)
Fleury, C.: Le KD-Tree: une methode de subdivision spatiale, Universite de Rennes 1, INSA (2008)
Zhou, K., Hou, Q., Wang, R., Guo, B.: Real-time KD-tree construction on graphics hardware. In: International Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH Asia 2008) (2008)
Arun, K.S., Huang, T.S., Blostein, S.D.: Least square fitting of two 3-d point sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 9(5), 698–700 (1987)
Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4, 629–642 (1987)
Walker, M.W., Shao, L., Volz, R.A.: Estimating 3-d location parameters using dual number quaternions. In: CVGIP: Image Understanding, vol. 54, pp. 358–367 (1991)
Horn, B.K.P., Hilden, H.M., Negahdaripour, S.: Closed-form solution of absolute orientation using orthonormal matrices. Journal of the Optical Society of America A 5(7), 1127–1135 (1988)
Lorusso, A., Eggert, D., Fisher, R.: A comparison of four algorithms for estimating 3-d rigid transformations. In: 4th British Machine Vision Conference, BMVC ’95 (1995)
Umeyama, S.: Least-squares estimation of transformation parameters between two points. IEEE Transactions on Pattern Analysis and Machine Intelligence 13, 376–380 (1991)
Shao-Yi, D., Nan-Ning, Z., Shi-Hui, Y., Qubo, Y.: An Extension of the ICP Algorithm Considering Scale Factor
Brown, R.G., Hwang, P.Y.C.: Introduction to Random Signals and Applied Kalman Filtering, 2nd edn. John Wiley and Sons, Chichester (1996)
Menezes, P., Lerasle, F., Dias, J., Chatila, R.: Suivi visuel de structures articules 3D par filtrage particulaire
Paul, N.: Filtrage particulaire. Conservatoire National des Arts et Metiers, Tech. Rep. (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ben Ghorbel, M., Baklouti, M., Couvet, S. (2010). 3D Head Pose Estimation and Tracking Using Particle Filtering and ICP Algorithm. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2010. Lecture Notes in Computer Science, vol 6169. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14061-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-14061-7_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14060-0
Online ISBN: 978-3-642-14061-7
eBook Packages: Computer ScienceComputer Science (R0)