Abstract
This paper presents a new approach to estimate 3D head pose from a sequence of input images and retarget facial expression to 3D face model using RBF(Radial Based Function) for vision-based animation. The exact head pose estimation and facial motion tracking are critical problems to be solved in developing a vision based human computer interaction or animation. Given an initial reference template of head image and corresponding 3D head pose, full the head motion is recovered by projecting a cylindrical head model to the face image. By updating the template dynamically, it is possible to recover head pose robustly regardless of light variation and self-occlusion. Moreover, to produce a realistic 3D face model, we utilize Gaussian RBF to deform the 3D face model according to the detected facial feature points from input images. During the model deformation, the clusters of the minor feature points around the major facial features are estimated and the positions of the clusters are changed according to the variation of the major feature points. From the experiments, the proposed method can efficiently estimate and track the 3D head pose and create a realistic 3D facial animation model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Preece, J.: Human-Computer Interaction. John Wiley, Chichester (1998)
Liu, Zhang, Z.: Robust Head Motion Computation by Taking Advantage of Physical Properties. In: HUMO 2000 (2000)
Essa, I.A., Pentland, A.P.: Coding analysis, interpretation, and recognition of facial expressions. PAMI 19(7), 757–763 (1997)
Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. PAMI 20(10), 1025–1039 (1998)
Chien, C.-C., Chang, Y.-J., Chen, Y.C.: Facial Expression Analysis Under Various Head Poses. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, Springer, Heidelberg (2002)
Min, K., Chun, J., Park, G.: A Nonparametric Skin Color Model for Face Detection from Color Images. In: Liew, K.-M., Shen, H., See, S., Cai, W. (eds.) PDCAT 2004. LNCS, vol. 3320, pp. 115–119. Springer, Heidelberg (2004)
Chun, J., Min, K.: A Realistic Human Face Modeling from Photographs by Use of Skin Color and Model Deformation. In: Gervasi, O., Gavrilova, M.L., Kumar, V., Laganá, A., Lee, H.P., Mun, Y., Taniar, D., Tan, C.J.K. (eds.) ICCSA 2005. LNCS, vol. 3480, pp. 1135–1143. Springer, Heidelberg (2005)
Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of Optical Flow Techniques. Int. Journal of Computer Vision, 43–77 (1994)
Noh, J., Neumann, U.: A survey of facial modeling and animation techniques. Tech. rep., USC 99-705 (1998)
Wirth, M.A.: A Nonrigid Approach to Medical Image Registration: Matching Images of the Breast. Ph.D. Thesis. RMIT University Melbourne Australia (2000)
Wojdel, A., Rothkrantx, L.J.M.: Parametric Generation of Facial Expressions Based on FACS. Computer Graphic Forum 24, 743–757 (2005)
Noh, J.Y., Neumann, U.: Expression Cloning, Computer Graphics. In: Proceedings of ACM SIGGRAPH, pp. 277–288 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chun, J., Kwon, O., Park, P. (2006). A Robust 3D Face Pose Estimation and Facial Expression Control for Vision-Based Animation. In: Cham, TJ., Cai, J., Dorai, C., Rajan, D., Chua, TS., Chia, LT. (eds) Advances in Multimedia Modeling. MMM 2007. Lecture Notes in Computer Science, vol 4351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69423-6_68
Download citation
DOI: https://doi.org/10.1007/978-3-540-69423-6_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69421-2
Online ISBN: 978-3-540-69423-6
eBook Packages: Computer ScienceComputer Science (R0)