Skip to main content
Springer Nature Link
Log in

3D Facial Modeling for Animation: A Nonlinear Approach

  • Conference paper
Advances in Multimedia Modeling (MMM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4351))

Included in the following conference series:

  • 894 Accesses

Abstract

This paper presents an efficient nonlinear method for 3D facial modeling from a single image, with the support of 3D face examples. First a set of feature points is extracted from the image. The feature points are then used to automatically estimate the head pose parameters using the 3D mean face in our database as a reference model. After the pose recovery, a similarity measurement function is proposed to find the neighborhood for the given image. The scope of neighborhood can be determined adaptively using our cross-validation algorithm. Furthermore, the individual 3D shape is synthesized by neighborhood interpolation. Texture mapping is achieved based on feature points. The experimental results show that our algorithm can robustly produce 3D facial models from images captured in various scenarios.

This work is supported by National Natural Science Foundation of China (No.60525108, No.60533090), Science and Technology Project of Zhejiang Province (2005C13032, 2005C11001-05), and China-US Million Book Digital Library Project (www.cadal.zju. edu.cn).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Parke, F.I.: Computer generated animation of faces. In: Proceedings ACM annual conference (August 1972)

    Google Scholar 

  2. Sifakis, E., Neverov, I., Fedkiw, R.: Automatic Determination of Facial Muscle Activations from Sparse Motion Capture Marker Data. In: SIGGRAPH 2005. ACM TOG, vol. 24, pp. 417–425 (2005)

    Google Scholar 

  3. Kahler, K., Haber, J., Yamauchi, H., Seidel, H.-P.: Head shop: Generating animated head models with anatomical structure. In: Proc. ACM SIGGRAPH Symposium on Computer Animation, pp. 55–64 (2002)

    Google Scholar 

  4. Terzopoulos, D., Waters, K.: Physically-based facial modelling, analysis, and animation. The Journal of Visualization and Computer Animation 1(2), 73–80 (1990)

    Google Scholar 

  5. Lee, W., Magnenat-Thalmann, N.: Fast Head Modeling for Animation. Journal Image and Vision Computing 18(4), 355–364 (2000)

    Article  Google Scholar 

  6. Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing Realistic Facial Expressions from Photographs. In: Siggraph proceedings, pp. 75–84 (1998)

    Google Scholar 

  7. Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces. In: Proc. Siggraph 1999, pp. 187–194. ACM Press, New York (1999)

    Chapter  Google Scholar 

  8. Blanz, V., Basso, C., Poggio, T., Vetter, T.: Reanimating Faces in Images and Video. Computer Graphics Forum, EUROGRAPHICS 2003, Granada, Spain 22(3), 641–650 (2003)

    Article  Google Scholar 

  9. Vlasic, D., Brand, M., Pfister, H., Popovic, J.: Face Transfer with Multilinear Models. ACM Transactions on Graphics (TOG) 24(3), 426–433 (2005)

    Article  Google Scholar 

  10. Fordham, J.: Middle earth strikes back. Cinefex (92), 71–142 (2003)

    Google Scholar 

  11. Roweis, S., Saul, L.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323–2326 (2000)

    Article  Google Scholar 

  12. Ostermann, J.: Animation of Synthetic Faces in MPEG-4. In: Computer Animation, Philadelphia, Pennsylvania, June 8-10, 1998, pp. 49–51 (1998)

    Google Scholar 

  13. Zhu, Z., Ji, Q.: Real Time 3D Face Pose Tracking From an Uncalibrated Camera. In: Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), vol. 5, p. 73 (2004)

    Google Scholar 

  14. Malassiotis, S., Strintzis, M.G.: Robust real-time 3D head pose estimation from range data. Pattern Recognition 38(8), 1153–1165 (2005)

    Article  Google Scholar 

  15. Wang, Y., Zhuang, Y., Wu, F.: Data-driven facial animation based on manifold Bayesian regression. Journal of Zhejiang Univ SCIENCE A 7(4), 556–563 (2006)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Digital media Computing & Design (DCD) Lab, Zhejiang University,  

    Yushun Wang & Yueting Zhuang

  2. MOE-Microsoft Key Laboratory of Visual Perception, Zhejiang University,  

    Yushun Wang & Yueting Zhuang

Authors
  1. Yushun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yueting Zhuang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Engineering, Nanyang Technological University, Block N4, Nanyang Avenue, 639798, Singapore

    Tat-Jen Cham  & Deepu Rajan  & 

  2. School of Computer Engineering, Nanyang Technological University, 639798, Singapore

    Jianfei Cai

  3. IBM T.J. Watson Research Center, Yorktown Heights, P.O. Box 704, 10598, New York, USA

    Chitra Dorai

  4. National University of Singapore, 3 Science Dr, 117543, Singapore

    Tat-Seng Chua

  5. Center for Multimedia and Network Technology, School of Computer Enginnering, Nanyang Technological University, 639798, Singapore

    Liang-Tien Chia

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, Y., Zhuang, Y. (2006). 3D Facial Modeling for Animation: A Nonlinear Approach. In: Cham, TJ., Cai, J., Dorai, C., Rajan, D., Chua, TS., Chia, LT. (eds) Advances in Multimedia Modeling. MMM 2007. Lecture Notes in Computer Science, vol 4351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69423-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69423-6_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69421-2

  • Online ISBN: 978-3-540-69423-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics