Abstract
The active appearance models (AAMs) provide the detailed descriptive parameters that are useful for various autonomous face analysis problems. However, they are not suitable for robust face tracking across large pose variation for the following reasons. First, they are suitable for tracking the local movements of facial features within a limited pose variation. Second, they use gradient-based optimization techniques for model fitting and the fitting performance is thus very sensitive to initial model parameters. Third, when their fitting is failed, it is difficult to obtain appropriate model parameters to re-initialize them. To alleviate these problems, we propose to combine the active appearance models and the cylinder head models (CHMs), where the global head motion parameters obtained from the CHMs are used as the cues of the AAM parameters for a good fitting or re-initialization. The good AAM parameters for robust face tracking are computed in the following manner. First, we estimate the global motion parameters by the CHM fitting algorithm. Second, we project the previously fitted 2D shape points onto the 3D cylinder surface inversely. Third, we transform the inversely projected shape points by the estimated global motion parameters. Fourth, we project the transformed 3D points onto the input image and computed the AAM parameters from them. Finally, we treat the computed AAM parameters as the initial parameters for the fitting. Experimental results showed that face tracking combining AAMs and CHMs is more pose robust than that of AAMs in terms of 170% higher tracking rate and the 115% wider pose coverage.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aggarwal, G., Veeraraghavan, A., & Chellappa, R. (2005). 3D facial pose tracking in uncalibrated videos. In International conference on pattern recognition and machine intelligence.
Basu, S., Essa, I., & Pentland, A. (1996). Motion regularization for model-based head tracking. In International conference on pattern recognition.
Blanz, V., & Vetter, T. (1999). A morphable model for the synthesis of 3D faces. In Siggraph (pp. 187–194).
Bregler, C., & Malik, J. (1998). Tracking people with twists and exponential maps. In Proc. of IEEE conference on computer vision and pattern recognition.
Cascia, M., Sclaroff, S., & Athitsos, V. (2000). Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(4), 322–336.
Cootes, T., Edwards, G., & Taylor, C. (2001). Active appearance models. IEEE Transactions on Pattern Recognition and Machine Intelligence, 23(6), 681–685.
DeCarlo, D., & Metaxas, D. (1996). The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proc. of IEEE conference on computer vision and pattern recognition.
Fidaleo, D., Medioni, G., Fua, P., & Lepetit, V. (2005). An investigation of model bias in 3D face tracking. In IEEE analysis and modeling of faces and gestures (pp. 125–139).
Gross, R., Matthews, I., & Baker, S. (2004a). Generic vs. person specific active appearance models. In Proc. of the British machine vision conference.
Gross, R., Matthews, I., & Baker, S. (2004b). Constructing and fitting active appearance models with occlusion. In Proc. of IEE workshop on face processing in video.
Kanade, T., & Lucas, B. (1981). An iterative image registration technique with an application to stereo vision. In International joint conference on artificial intelligence (Vol. 1, pp. 674–679).
Malciu, M., & Preteux, F. (2000). A robust model-based approach for 3D head tracking in video sequences. In IEEE international conference on automatic face and gesture recognition.
Matthews, I., & Baker, S. (2004). Active appearance models revisited. International Journal of Computer Vision, 60(2), 135–164.
Romdhani, S., Canterakis, N., & Vetter, T. (2003). Selective vs. global recovery of rigid and non-rigid motion (Technical Report). CS Dept., University of Basel.
Strom, J., Jebara, T., Basu, S., & Pentland, A. (1999). Real time tracking and modeling of faces: an EKF-based analysis by synthesis approach. In Proc. of the modelling people workshop at ICCV.
Vacchetti, L., Lepetit, V., & Fua, P. (2004). Stable real-time 3D tracking using online and offline information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(10), 1385–1391.
Xiao, J., & Kanade, T. (2002). Robust full-motion recovery of head by dynamic templates and registration techniques. In Automatic face and gesture recognition.
Xiao, J., Baker, S., Matthews, I., & Kanade, T. (2004a). Real-time combined 2D+3D active appearance models. In International conference on computer vision and pattern recognition.
Xiao, J., Chai, J., & Kanade, T. (2004b). A closed-form solution to non-rigid shape and motion recovery. In European conference on computer vision.
Author information
Authors and Affiliations
Corresponding author
Electronic Supplementary Material
VideoObject
VideoObject
Rights and permissions
About this article
Cite this article
Sung, J., Kanade, T. & Kim, D. Pose Robust Face Tracking by Combining Active Appearance Models and Cylinder Head Models. Int J Comput Vis 80, 260–274 (2008). https://doi.org/10.1007/s11263-007-0125-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-007-0125-1