Skip to main content

Generating 3D Virtual Populations from Pictures of a Few Individuals

  • Conference paper
  • First Online:
Algorithms and Data Structures (WADS 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1663))

Included in the following conference series:

Abstract

This paper describes a method for cloning faces from two orthogonal pictures and for generating populations from a small number of these clones. An efficient method for reconstructing 3D heads suitable for animation from pictures starts with the extraction of feature points from the orthogonal picture sets. Data from several such heads serve to statistically infer the parameters of the multivariate probability distribution characterizing a hypothetical population of heads. A previously constructed, animation-ready generic model is transformed to each individualized head based on the features either extracted from the orthogonal pictures or determined by a sample point from the multivariate distribution. Using projections of the 3D heads, 2D texture images are obtained for individuals reconstructed from pictures, which are then fitted to the clone, a fully automated procedure resulting in 360° texture mapping. For heads generated through population sampling, a texture morphing algorithm generates new texture mappings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tsuneya Kurihara and Kiyoshi Arai, “A Transformation Method for Modeling and Animation of the Human Face from Photographs”, In Proc. Computer Animation’91, Springer-Verlag, Tokyo, pp. 45–58, 1991.

    Google Scholar 

  2. Takaaki Akimoto, Yasuhito Suenaga, and Richard S. Wallace, Automatic Creation of 3D Facial Models, IEEE Computer Graphics & Applications, Sept., 1993

    Google Scholar 

  3. Horace H.S. Ip, Lijin Yin, Constructing a 3D individual head model from two orthogonal views. The Visual Computer, Springer-Verlag, 12:254–266, 1996.

    Google Scholar 

  4. Lee W. S., Kalra P., Magnenat-Thalmann N, “Model Based Face Reconstruction for Animation”, In Proc. Multimedia Modeling (MMM’97), World Scientific, Singapore, pp. 323–338, 1997.

    Google Scholar 

  5. Yuencheng Lee, Demetri Terzopoulos, and Keith Waters, “Realistic Modeling for Facial Animation”, In Computer Graphics (Proc. SIGGRAPH’96), pp. 55–62, 1996.

    Google Scholar 

  6. Douglas DeCarlo, Dimitris Metaxas and Matthew Stone, “An Anthropometric Face Model using Variational Techniques”, In Computer Graphics (Proc. SIG-GRAPH’98), pp. 67–74, 1998.

    Google Scholar 

  7. Brian Guenter, Cindy Grimm, Daniel Wood, “Making Faces”, In Computer Graphics (Proc. SIGGRAPH’98), pp. 55–66, 1998.

    Google Scholar 

  8. Frederic Pighin, Jamie Hecker, Dani Lischinski, Richard Szeliski, David H. Salesin, Synthesizing “Realistic Facial Expressions from Photographs”, In Computer Graphics (Proc. SIGGRAPH’98), pp. 75–84, 1998.

    Google Scholar 

  9. Peter J. Burt and Edward H. Andelson, “A Multiresolution Spline with Application to Image Mosaics”, ACM Transactions on Graphics, 2(4):217–236, Oct., 1983.

    Article  Google Scholar 

  10. Marc Proesmans, Luc Van Gool, “Reading between the lines-a method for extracting dynamic 3D with texture”. In Proc. of VRST’97, pp. 95–102, 1997.

    Google Scholar 

  11. S.-Y. Lee, K.-Y. Chwa, S.-Y. Shin, G. Wolberg, “Image metamorphosis using Snakes and Free-Form deformations”, In Computer Graphics (Proc. SIG-GRAPH’95), pp. 439–448, 1995.

    Google Scholar 

  12. P. Fua, “Face Models from Uncalibrated Video Sequences”, In Proc. CAPTECH’98, pp. 215–228, 1998.

    Google Scholar 

  13. Sederberg T. W., Parry S. R., “Free-Form Deformation of Solid Geometric Models”, In Computer Graphics (Proc. SIGGRAPH’86), pp. 151–160, 1986.

    Google Scholar 

  14. Sibson R., “A Vector Identity for the Dirichlet Tessellation”, Math. Proc. Cambridge Philos. Soc., 87, pp. 151–155, 1980.

    Article  MathSciNet  MATH  Google Scholar 

  15. Aurenhammer F., “Voronoi Diagrams-A Survey of a Fundamental Geometric Data Structure”, ACM Computing Survey, 23, 3, September 1991.

    Google Scholar 

  16. Farin G., “Surface Over Dirichlet Tessellations”, Computer Aided Geometric Design, 7, pp. 281–292, North-Holland, 1990.

    Article  MathSciNet  MATH  Google Scholar 

  17. DeRose T.D., “Composing Bezier Simplexes”, ACM Transactions on Graphics, 7(3), pp. 198–221, 1988.

    Article  MATH  Google Scholar 

  18. Moccozet L., MagnenatThalmann N., “Dirichlet Free-Form Deformations and their Application to Hand Simulation”, In Proc. Computer Animation’97, IEEE Computer Society, pp.93–102, 1997.

    Google Scholar 

  19. Kalra P, Mangili A, Magnenat-Thalmann N, Thalmann D, “Simulation of Facial Muscle Actions Based on Rational Free Form Deformations”, Proc. Eurographics’92, pp. 59–69, NCC Blackwell,1992.

    Google Scholar 

  20. Kendall, M. G. and Stuart, A. Advanced Theory of Statistics, vol. 3. Griffin, 1976.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lee, W., Beylot, P., Sankoff, D., Magnenat-Thalmann, N. (1999). Generating 3D Virtual Populations from Pictures of a Few Individuals. In: Dehne, F., Sack, JR., Gupta, A., Tamassia, R. (eds) Algorithms and Data Structures. WADS 1999. Lecture Notes in Computer Science, vol 1663. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48447-7_15

Download citation

  • DOI: https://doi.org/10.1007/3-540-48447-7_15

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-66279-2

  • Online ISBN: 978-3-540-48447-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics