Skip to main content

A model for creating and visualizing speech and emotion

  • Conference paper
  • First Online:
Aspects of Automated Natural Language Generation (IWNLG 1992)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 587))

Included in the following conference series:

Abstract

This paper presents a methodology of specifying, controlling and synchronizing the temporal and spatial characteristics for 3D animation of facial expressions. The proposed approach consists of hierarchical levels of controls. The top level requires direct animator input of global abstract actions and their durations, which correspond to intuitive and natural specifications for facial animation. These actions are then decomposed to less abstract entities and transmitted to lower levels of control. At the lowest level, muscle actions are integrated with their respective intensities to cause the appropriate movement of points in the 3D facial model. This multi-level system encapsulates facial movements linked to both emotion and conversation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • deGraf, B. (1989): In: State of the Art in Facial Animation. SIGGRAPH '89 Course Notes, No. 26, pp. 10–20.

    Google Scholar 

  • Ekman, P; Friesen, WV. (1975): Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. Printice-Hall.

    Google Scholar 

  • Ekman, P.; Friesen, WV. (1978): Facial Action Coding System. Investigator's Guide Part 2. Consulting Psychologists Press Inc.

    Google Scholar 

  • Hill, DR; Pearce, A.; Wyvill, B. (1988): Animating Speech: An Automated Approach Using Speech Synthesised by Rules. The Visual Computer, Vol. 3, No. 5. Pages 277–289.

    Google Scholar 

  • Kalra, P.; Mangili, A.; Magnenat-Thalmann, N.; Thalmann, D. (1991): SMILE: A Multilayered Facial Animation System. Proceedings IFIP WG 5.10. Tokyo, Japan (Ed Kunii Tosiyasu L). Pages 189–198.

    Google Scholar 

  • Kurihara, T.; Arai, K. (1991): A Transformation Method for Modeling and Animation of the Human Face from Photographs. Proceedings Computer Animation '91. Geneva, Switzerland (Eds Magnenat-Thalmann, N. and Thalmann, D.). Pages 45–57.

    Google Scholar 

  • LeBlanc, A.; Kalra, P.; Magnenat-Thalmann, N.; Thalmann, D. (1991): Sculpting with the ”Ball & Mouse” Metaphor. Proceedings Graphics Interface '91. Calgary, Canada. Pages 152–159.

    Google Scholar 

  • Lewis, JP.; Parke, FI. (1987): Automated Lipsynch and Speech Synthesis for Character Animation. Proceedings CHI '87 and Graphics Interface '87. Toronto. Pages 143–147.

    Google Scholar 

  • Magnenat-Thalmann, N.; Primeau, E.; Thalmann, D. (1988): Abstract Muscle Action Procedures for Human Face Animation. The Visual Computer, Vol. 3, No. 5. Pages 290–297.

    Google Scholar 

  • Magnenat-Thalmann, N.; Thalmann, D. (1987): The Direction of Synthetic Actors in the film Rendez-vous Montral. IEEE Computer Graphics and Applications, Vol. 7, No. 12. Pages 9–19.

    Google Scholar 

  • Nahas, M.; Huitric, H.; Saintourens, M. (1988): Animation of a B-Spline Figure. The Visual Computer, Vol. 3, No. 5. Pages 272–276.

    Google Scholar 

  • Parke, FI. (1975): A Model for Human Faces that allows Speech Synchronized Animation. Computer and Graphics. Pregamon Press. Vol. 1, No. 1. Pages 1–4.

    Google Scholar 

  • Parke, FI. (1982): Parametrized Models for Facial Animation. IEEE Computer Graphics and Applications, Vol. 2, No. 9. Pages 61–68.

    Google Scholar 

  • Parke, FI. (1991): Control Parameterization for Facial Animation. Proceedings Computer Animation '91. Geneva, Switzerland (Eds Magnenat-Thalmann, N. and Thalmann, D.). Pages 3–13.

    Google Scholar 

  • Platt, S.; Badler, N. (1981): Animating Facial Expressions. Proceedings SIGGRAPH '81. Pages 245–252.

    Google Scholar 

  • Sederberg, TW.; Parry, SR. (1986): Free Form Deformation of Solid Geometric Models. Proceedings SIGGRAPH '86. Pages 151–160.

    Google Scholar 

  • Terzopoulos, D.; Waters, K. (1990): Physically Based Facial Modeling, Analysis and Animation. Visualization and Computer Animation, Vol. 1, No. 2. Pages 73–80.

    Google Scholar 

  • Terzopoulos, D.; Waters, K. (1991): Techniques for Realistic Facial Modeling and Animation. Proceedings Computer Animation '91. Geneva, Switzerland (Eds Magnenat-Thalmann, N. and Thalmann, D.). Pages 59–74.

    Google Scholar 

  • Waters, K. (1987): A Muscle Model for Animating Three Dimensional Facial Expression. Proceedings SIGGRAPH '87, Vol. 21, No. 4. Pages 17–24.

    Google Scholar 

  • Williams, L. (1990): Performance Driven Facial Animation. Proceedings SIGGRAPH '90. Pages 235–242.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

R. Dale E. Hovy D. Rösner O. Stock

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Magnenat-Thalmann, N., Kalra, P. (1992). A model for creating and visualizing speech and emotion. In: Dale, R., Hovy, E., Rösner, D., Stock, O. (eds) Aspects of Automated Natural Language Generation. IWNLG 1992. Lecture Notes in Computer Science, vol 587. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-55399-1_1

Download citation

  • DOI: https://doi.org/10.1007/3-540-55399-1_1

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-55399-1

  • Online ISBN: 978-3-540-47054-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics