Skip to main content

Weight, Sex, and Facial Expressions: On the Manipulation of Attributes in Generative 3D Face Models

  • Conference paper
Advances in Visual Computing (ISVC 2009)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5875))

Included in the following conference series:

Abstract

Generative 3D Face Models are expressive models with applications in modelling and editing. They are learned from example faces, and offer a compact representation of the continuous space of faces. While they have proven to be useful as strong priors in face reconstruction they remain to be difficult to use in artistic editing tasks. We describe a way to navigate face space by changing meaningful parameters learned from the training data. This makes it possible to fix attributes such as height, weight, age, expression or ‘lack of sleep’ while letting the infinity of unfixed other attributes vary in a statistically meaningful way.

We propose an inverse approach based on learning the distribution of faces in attribute space. Given a set of target attributes we then find the face which has the target attributes with high probability, and is as similar as possible to the input face.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: SIGGRAPH 1999, pp. 187–194. ACM Press/Addison-Wesley Publishing Co., New York (1999)

    Chapter  Google Scholar 

  2. Ilić, S., Salzmann, M., Fua, P.: Implicit meshes for effective silhouette handling. Int. J. Comput. Vision 72, 159–178 (2007)

    Article  Google Scholar 

  3. Amberg, B., Knothe, R., Vetter, T.: Expression invariant face recognition with a morphable model. In: Face and Gesture 2008 (2008)

    Google Scholar 

  4. Amberg, B., Romdhani, S., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR 2007, pp. 1–8 (2007)

    Google Scholar 

  5. Blanz, V., Albrecht, I., Haber, J., Seidel, H.P.: Creating face models from vague mental images. In: Gröller, E., Szirmay-Kalos, L. (eds.) EUROGRAPHICS 2006 (EG 2006), Vienna, Austria. Computer Graphics Forum, vol. 25(3), pp. 645–654. Blackwell, Malden (2006)

    Google Scholar 

  6. Allen, B., Curless, B., Popović, Z.: The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans. on Graphics, SIGGRAPH 2003 22, 587–594 (2003)

    Google Scholar 

  7. Allen, B., Curless, B., Popović, Z.: Exploring the space of human body shapes: Data-driven synthesis under anthropometric control. In: Proc. Digital Human Modeling for Design and Engineering Conference, Rochester, MI, vol. 113(1), pp. 245–248. SAE International (2004)

    Google Scholar 

  8. Skorupski, J., Yee, J., McCoy, J., Davis, J.: Facial type, expression, and viseme generation. In: SIGGRAPH 2007: ACM SIGGRAPH 2007 posters, vol. 34 (2007)

    Google Scholar 

  9. Allen, B., Curless, B., Popović, Z., Hertzmann, A.: Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. In: SCA 2006: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, Aire-la-Ville, Switzerland, pp. 147–156. Eurographics Association, Switzerland (2006)

    Google Scholar 

  10. Zhang, Y., Badler, N.I.: Face modeling and editing with statistical local feature control models. International Journal of Imaging Systems and Technology 17, 341–358 (2007)

    Article  Google Scholar 

  11. Vlasic, D., Brand, M., Pfister, H., Popovic, J.: Face transfer with multilinear models. ACM Trans. Graph. 24, 426–433 (2005)

    Article  Google Scholar 

  12. Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: Tensorfaces. In: Proceedings of the European Conference on Computer Vision, vol. 1, pp. 447–460 (2002)

    Google Scholar 

  13. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: Scape: shape completion and animation of people. ACM Trans. Graph. 24, 408–416 (2005)

    Article  Google Scholar 

  14. Scherbaum, K., Sunkel, M., Seidel, H.P., Blanz, V.: Prediction of individual non-linear aging trajectories of faces. In: Eurographics 2007, Prague, Czech Republic. Computer Graphics Forum, vol. 26(3), pp. 285–294. Blackwell, Malden (2007)

    Google Scholar 

  15. Leyvand, T., Cohen-Or, D., Dror, G., Lischinski, D.: Data-driven enhancement of facial attractiveness. ACM Trans. on Graphics, SIGGRAPH 2008 27 (2008) (to appear)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Amberg, B., Paysan, P., Vetter, T. (2009). Weight, Sex, and Facial Expressions: On the Manipulation of Attributes in Generative 3D Face Models. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2009. Lecture Notes in Computer Science, vol 5875. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10331-5_81

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-10331-5_81

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-10330-8

  • Online ISBN: 978-3-642-10331-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics