Skip to main content
SpringerLink
Log in

Creating and Animating Personalized Head Models from Digital Photographs and Video

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

In this paper, a survey is given of the approaches, methods, and algorithms used for creating personalized three-dimensional models of human's head from photographs or video. All stages of the model construction are considered in detail. These stages include image marking, camera registering, geometrical model adaptation, texture formation, and modeling of additional elements, such as eyes and hair. Some technologies of the animation of the models obtained, including that based on the MPEG-4 standard, are analyzed, and examples of the applications that use these technologies are given. In conclusion, some prospects of the developments in this field of the computer graphics are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. Lee, Y., Terzopoulos, D., and Waters, K., Realistic Modeling for Facial Animation, Proc. of SIGGRAPH'95, 1995, pp. 55–62.

  2. Goto, T., Kshirsagar, S., and Magnenat-Thalmann, N., Automatic Face Cloning and Animation, IEEE Signal Processing Magazine, 2001, vol. 18, no. 3, pp. 17–25.

    Article  Google Scholar 

  3. Lavagetto, F., Pockaj, R., and Costa, M., Smooth Surface Interpolation and Texture Adaptation for MPEG-4 Compliant Calibration of 3D Head Models, Image Vision Computing J., 2000, vol. 18, no. 4, pp. 345–354.

    Article  Google Scholar 

  4. Lee, W., Kalra, P., and Magnenat-Thalmann, N., Model Based Face Reconstruction for Animation, Proc. of MMM'97, World Sci., 1997, pp. 323–338.

  5. Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., and Salesin, D., Synthesizing Realistic Facial Expressions from Photographs, Proc. of SIGGRAPH'98, 1998, pp. 75–84.

  6. Blanz, V. and Vetter, T., A Morphable Model for the Synthesis of 3D Faces, Proc. of SIGGRAPH'99, 1999, pp. 187–194.

  7. Lee, W. and Magnenat-Thalmann, N., Fast Head Modeling for Animation, Image Vision Computing J.,2000, vol. 18, no. 4, pp. 355–364.

    Article  Google Scholar 

  8. Cohen, M., Jacobs, C., Liu, Z., and Zhang, Z., Rapid Modeling of Animated Faces from Video, Microsoft Tech. Report MSR-TR-2000-11, 2000.

  9. Fua, P., Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data, Int. J. Comput. Vision, 2000, vol. 38, no. 2, pp. 153–171.

    Article  Google Scholar 

  10. Lee, W., Escher, M., Sannier, G., and Magnenat-Thalmann, N., MPEG-4 Compatible Faces from Orthogonal Photos, Proc. of CA'99, 1999, pp. 186–194.

  11. Schaffalitzky, F. and Zisserman, A., Viewpoint Invariant Texture Description and Matching, Tech. Report, Dept. of Eng. Sci., Univ. of Oxford, 2001.

  12. Viola, P. and Jones, M.J., Rapid Object Detection Using a Boosted Cascade of Simple Features, IEEE CVPR, 2001.

  13. Lienhart, R. and Maydt, J., An Extended Set of Haar-like Features for Rapid Object Detection, IEEE ICIP, 2002, vol. 1, pp. 900–903.

    Google Scholar 

  14. Open Source Computer Vision Library, Intel, http://www.intel.com/research/mrl/research/opencv/.

  15. Bovyrin, A.B. and Rodyushkin, K.V., Statistical Estimation of Color Components of Lips and Face to Determine the Mouth Contour by the Deformable Template Method, Abstracts of the 11th Conf. "Mathematical Methods of Pattern Recognition,"Moscow, 2003, pp. 245–247.

  16. Rodyushkin, K.V., Eye Features Tracking by Deformable Template to Estimate Face Animation Parameters, Proc. of Advanced Concepts for Intelligent Vision Systems, Ghent, Belgium, 2003, pp. 267–274.

  17. Yuille, A.L., Hallinan, P.W., and Cohen, D.S., Feature Extraction from Faces Using Deformable Templates, Int. J. Comput. Vision, 1992, vol. 8, no. 2, pp. 99–111.

    Google Scholar 

  18. Shokurov, A., Khropov, A., and Ivanov, D., Feature Tracking in Image and Video, Proc. of GraphiCon-2003, 2003, pp. 177–179.

  19. Pollefeys, M., 3D Modeling from Images, Tutorial Course on SIGGRAPH'2001, 2001.

  20. Laurentini, A., The Visual Hull Concept for Silhouettesbased Image Understanding, IEEE Trans. Pattern Anal. Machine Intelligence, 1994, vol. 16, no. 2, pp. 150–162.

    Article  Google Scholar 

  21. Schaback, R., Creating Surfaces from Scattered Data Using Radial Basis Functions, Mathematical Methods in CAGD III, Daelhen, M., Lyche, T., and Schumaker, L., Eds., 1995, pp. 1–21.

  22. Ambrosini, L., Costa, M., Lavagetto, F., and Pockaj, R., 3D Head Model calibration Based on MPEG-4 Parameters, Proc. ISPACS'98, 1998, pp. 626–630.

  23. Lempitskii, V., Ivanov, D., and Kuzmin, Ye., High-Quality Head Model Calibration Pipeline, GraphiCon'2002, 2002.

  24. Kshirsagar, S., Garchery, S., and Magnenat-Thalmann, N., Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation, Proc. of Deform'2000, 2000, pp. 23–34.

  25. Dijkstra, E., A Note on Two Problems in Connection with Graphs, Numer. Math., 1959, vol. 1, pp. 269–271.

    Google Scholar 

  26. Ivanov, D., Lempitskii, V., Shokurov, A., Khropov, A., and Kuzmin, Ye., Creating Personalized Head Models from Image Series, Proc. of the 13th Int. Conf. on Comput. Graphics GraphiCon'2003, Moscow, 2003.

  27. Lempitskii, V., Ivanov, D., and Kuzmin, Ye., Texturing Calibrated Head Model from Images, Proc. of Euro-Graphics'2002, 2002, pp. 281–288.

  28. Turini, M., Yamauchi, H., Haber, J., and Seidel, H.-P., Texturing Faces, Proc. of Graphics Interface 2002, 2002, pp. 89–98.

  29. Parke, F.I., A Parametric Model for Human Faces, PhD Dissertation, Salt Lake City: University of Utah, 1974.

    Google Scholar 

  30. Chadwick, J.E., Haumann, D.R., and Parent, R.E., Layered Constructions for Deformable Animated Characters, in Computer Graphics(Proc. of SIGGRAPH'89 Conf.), ACM SIGGRAPH, 1989, vol. 23, pp. 243–252.

    Google Scholar 

  31. Nahas, M., Huitric, H., and Saintourens, M., Animation of a B-spline Figure, Visual Comput., 1988, vol. 3, no. 5, pp. 272–276.

    Google Scholar 

  32. Lavagetto, F. and Pockaj, R., The Facial Animation Engine: Towards a High-Level Interface for the Design of MPEG-4 Compliant Animated Faces, IEEE Trans. Circuits Systems Video Techn., 1999, vol. 9, no. 2.

  33. Haber, J., Kalher, K., Abrecht, I., Yamauchi, H., and Seidel, H.-P., Face to Face: From Real Humans to Realistic Facial Animation, Proc. Israel-Korea Binational Conf. on Geometrical Modeling and Comput. Graphics 2001, 2001, pp. 73–82.

  34. SNHC. "INFORMATION TECHNOLOGY-GENERIC CODING OF AUDIOVISUAL OBJECTS Part 2: Visual," ISO/IEC 14496-2, Final Draft of International Standard, Version of November 13, 1998, ISO/IEC JTC1/SC29/WG11 N 2502a, Atlantic City, 1998.

  35. Tekalp, A.M. and Ostermann, J., Face and 2-D Mesh Animation in MPEG-4, Image Communication J., Tutorial Issue on the MPEG-4 Standard; <http://leonardo.telecomitalialab>. com/icjfiles/mpeg-4_si/8-SNHC_visual_paper.htm.

  36. The Virtual Reality Modeling Language, http://www.web3d.org/Specifications/VRML97/.

  37. Kuriakin, V., Firsova, T., Martinova, E., Mindlina, O., and Zhislina, V., MPEF-4 Compliant 3D Face Animation, 11th Int. Conf. on Comput. Graphics Graphi-Con'2001, Nizhni Novgorod, 2001, pp. 54–58.

  38. Martinova, E., Recognition and Synthesis of High-Level MPEG-4 Facial Animation Parameters, Proc. of the 6th Int. Conf. on Comput. Graphics and Artificial Intelligence 3IA'2003, Limoges, France, 2003.

  39. Firsova, T. and Zhislina, V., MPEG-4 Compliant Talking Heads, Contour Based Approach, Proc. of the 6th Int. Conf. on Comput. Graphics and Artificial Intelligence 3IA'2003, Limoges, France, 2003.

  40. Fedorov, A., Firsova, T., Kuriakin, V., Martinova, E., Mindlina, O., Rodyushkin, K., and Zhislina, V., Talking Head: Synthetic Video Facial Animation in MPEG-4, 13th Int. Conf. on Comput. Graphics and Vision GraphiCon' 2003, Moscow, 2003, pp. 37–41.

  41. Firsova, T., Ivanov, D., Kuriakin, V., Martinova, E., Rodyushkin, K., and Zhislina, V., Life-like MPEG-4 3D "Talking Head" (beyond standard), Proc. of the 5th Int. Conf. on Comput. Graphics and Artificial Intelligence 3IA'2002, Limoges, France, 2002.

  42. Ivanov, D., Reconstruction of Structured 3D Models from Images and Video, Proc. of 4th All-Russian Symp. on Applied and Industrial Math., 2003.

  43. Ivanov, D., Lempitskii, V., and Kuzmin, Ye., 3D Talking Heads: Personalized and Animated, NORSIGD Info(The magazine of Norwegian Computer Society), 2003, 1/03, pp. 4–8.

Download references

Author information

Authors and Affiliations

  1. Intel Russian Research Center, Russian Academy of Sciences, ul. Turgeneva 30, Nizhni Novgorod, 603950, Russia

    V. G. Zhislina, V. F. Kuriakin, E. M. Martinova, K. V. Rodyushkin & T. V. Firsova

  2. Department of Mechanics and Mathematics, Moscow State University, Vorob'evy gory, Moscow, 119992, Russia

    D. V. Ivanov, V. S. Lempitskii, A. A. Khropov & A. V. Shokurov

Authors
  1. V. G. Zhislina
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. V. Ivanov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V. F. Kuriakin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. V. S. Lempitskii
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. E. M. Martinova
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. K. V. Rodyushkin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. T. V. Firsova
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. A. A. Khropov
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. A. V. Shokurov
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhislina, V.G., Ivanov, D.V., Kuriakin, V.F. et al. Creating and Animating Personalized Head Models from Digital Photographs and Video. Programming and Computer Software 30, 242–257 (2004). https://doi.org/10.1023/B:PACS.0000043050.43899.2e

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:PACS.0000043050.43899.2e

Keywords

Search

Navigation