Skip to main content

Emotion Synthesis in Virtual Environments

  • Conference paper
Enterprise Information Systems VI

Abstract

Man-Machine Interaction (MMI) systems that utilize multimodal information about users’ current emotional state are presently at the forefront of interest of the computer vision and artificial intelligence communities. Interfaces with human faces expressing emotions may help users feel at home when interacting with a computer because they are accepted as the most expressive means for communicating and recognizing emotions. Thus, emotion synthesis can enhance the atmosphere of a virtual environment and communicate messages far more vividly than any textual or speech information. In this paper, we present an abstract means of description of facial expressions, by utilizing concepts included in the MPEG-4 standard to synthesize expressions using a reduced representation, suitable for networked and lightweight applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Kendon, A, 1988. How gestures can become like words. In Crosscultural perspectives in nonverbal communication. Potyatos, F. (ed.). Hogrefe, Toronto, Canada.

    Google Scholar 

  • Wexelblat, A., 1995. An approach to natural gesture in virtual environments. In ACM Transactions on Computer-Human Interaction, Vol. 2, iss. 3.

    Google Scholar 

  • Parke, F., Waters, K., 1996. Computer Facial Animation. A K Peters.

    Google Scholar 

  • Quek, F., 1996. Unencumbered gesture interaction. In IEEE Multimedia, Vol. 3. no. 3.

    Google Scholar 

  • Faigin, G., 1990. The Artist’s Complete Guide to Facial Expressions. Watson-Guptill, New York.

    Google Scholar 

  • Lin, J., Wu, Y., Huang, T.S., 2000. Modeling human hand constraints. In Proc. Workshop on Human Motion.

    Google Scholar 

  • Bassili, J. N., 1979. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37.

    Google Scholar 

  • Kuch, J. J., Huang, T. S., 1995. Vision-based hand modeling and tracking for virtual teleconferencing and telecollaboration. In Proc. IEEE Int. Conf. Computer Vision.

    Google Scholar 

  • Karpouzis, K., Tsapatsoulis, N., Kollias, S., 2000. Moving to Continuous Facial Expression Space using the MPEG-4 Facial Definition Parameter (FDP) Set. In Electronic Imaging 2000 Conference of SPIE. San Jose, CA, USA.

    Google Scholar 

  • Davis, M., College, H., 1975. Recognition of Facial Expressions. Arno Press, New York.

    Google Scholar 

  • Preda, M., PrĂŞteux, F., 2002. Advanced animation framework for virtual characters within the MPEG-4 standard. In Proc. of the International Conference on Image Processing. Rochester, NY.

    Google Scholar 

  • Tekalp, M., Ostermann, J., 2000. Face and 2-D mesh animation in MPEG-4.In Image Communication Journal, Vol.15, Nos. 4–5.

    Google Scholar 

  • Ekman, P., Friesen, W., 1978. The Facial Action Coding System. In Consulting Psychologists Press. San Francisco, CA.

    Google Scholar 

  • Ekman, P., 1993. Facial expression and Emotion. In Am. Psychologist, Vol. 48.

    Google Scholar 

  • Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J., 2001. Emotion Recognition in Human-Computer Interaction. In IEEE Signal Processing Magazine.

    Google Scholar 

  • Plutchik, R., 1980. Emotion: A psychoevolutionary synthesis. Harper and Row New York.

    Google Scholar 

  • Whissel, C.M., 1989. The dictionary of affect in language. In Emotion: Theory, research and experience: Vol 4, The measurement of emotions. Plutchnik, R., Kellerman, H. (eds). Academic Press, New York.

    Google Scholar 

  • Wilson, A., Bobick, A., 1998. Recognition and interpretation of parametric gesture. In Proc. IEEE Int. Conf. Computer Vision.

    Google Scholar 

  • Wu, Y., Huang, T.S., 2001. Hand modeling, analysis, and recognition for vision-based human computer interaction. In IEEE Signal Processing Magazine. Vol. 18, iss. 3.

    Google Scholar 

  • Raouzaiou, A., Tsapatsoulis, N., Karpouzis, K., Kollias, S., 2002. Parameterized facial expression synthesis based on MPEG-4. In EURASIP Journal on Applied Signal Processing. Vol. 2002, No. 10. Hindawi Publishing Corporation.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer

About this paper

Cite this paper

Raouzaiou, A., Karpouzis, K., Kollias, S. (2006). Emotion Synthesis in Virtual Environments. In: Seruca, I., Cordeiro, J., Hammoudi, S., Filipe, J. (eds) Enterprise Information Systems VI. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3675-2_36

Download citation

  • DOI: https://doi.org/10.1007/1-4020-3675-2_36

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-3674-3

  • Online ISBN: 978-1-4020-3675-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics