Skip to main content

Fuzzy Similarity of Facial Expressions of Embodied Agents

  • Conference paper
Intelligent Virtual Agents (IVA 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4722))

Included in the following conference series:

Abstract

In this paper we propose an algorithm based on fuzzy similarity which models the concept of resemblance between facial expressions of an Embodied Conversational Agent (ECA). The algorithm measures the degree of visual resemblance between any two facial expressions. We also present an evaluation study in which we compared the users’ perception of similarity of facial expressions. Finally we describe an application of this algorithm to generate complex facial expressions of an ECA.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Albrecht, I., Schröder, M., Haber, J., Seidel, H.: Mixed feelings: expression of non-basic emotions in a muscle-based talking head. Virtual Reality 8(4), 201–212 (2005)

    Article  Google Scholar 

  2. Bartneck, C., Reichenbach, J.: Subtle emotional expressions of synthetic characters, International. Journal Human-Computer Studies 62(2), 179–192 (2005)

    Article  Google Scholar 

  3. Bassili, J.N.: Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37(11), 2049–2058 (1979)

    Article  Google Scholar 

  4. Bevacqua, E., Mancini, M., Niewiadomski, R., Pelachaud, C.: An expressive ECA showing complex emotions. In: Proceedings of the AISB Annual Convention, Newcastle, UK, pp. 208–216 (2007)

    Google Scholar 

  5. Bouchon-Meunier, B., Rifqi, M., Bothorel, S.: Towards general measures of comparison of objects. Fuzzy sets and systems 84(2), 143–153 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  6. Constantini, E., Pianesi, F., Prete, M.: Recognizing Emotions in Human and Synthetic Faces: The Role of the Upper and Lower Parts of the Face. In: Proceedings of the 10th International Conference on Intelligent User Interfaces, San Diego, California, USA, pp. 20–27 (January 10-13, 2005)

    Google Scholar 

  7. Ekman, P.: The Face Revealed. Weidenfeld & Nicolson, London (2003)

    Google Scholar 

  8. Ekman, P.: Darwin, deception, and facial expression. Ann. N.Y. Acad. Sci. 1000, 205–221 (2003)

    Article  Google Scholar 

  9. Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behavior’s. Categories, Origins, Usage and Coding, Semiotica 1, 49–98 (1969)

    Google Scholar 

  10. Ekman, P., Friesen, W.V.: Unmasking the Face. A guide to recognizing emotions from facial clues. Prentice-Hall, Inc., Englewood Cliffs, New Jersey (1975)

    Google Scholar 

  11. Etcoff, N., Magee, J.: Categorical perception of facial expressions. Cognition 44(3), 227–240 (1992)

    Article  Google Scholar 

  12. Frank, M.G., Ekman, P., Friesen, W.V.: Behavioral Markers and Recognizability of the Smile of Enjoyment. In: Ekman, P., Rosenberg, E.L. (eds.) What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), Oxford University Press, Oxford (1995)

    Google Scholar 

  13. Gonzaga, G.C., Keltner, D., Londahl, E.A., Smith, M.D.: Love and commitment problem in romantic relation and friendship. Journal of Personality and Social Psychology 81(2), 247–262 (2001)

    Article  Google Scholar 

  14. Gosselin, P., Kirouac, G., Doré, F.Y.: Components and Recognition of Facial Expression in the Communication of Emotion by Actors. In: Ekman, P., Rosenberg, E.L. (eds.) What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), pp. 243–267. Oxford University Press, Oxford (1995)

    Google Scholar 

  15. Haidt, J., Keltner, D.: Culture and facial expression: Open-ended methods find more expressions and a gradient of recognition. Cognition and Emotion 13(3), 225–266 (1999)

    Article  Google Scholar 

  16. Izard, C.E.: Human emotion. Plenum Press, New York (1977)

    Google Scholar 

  17. Kätsyri, J., Klucharev, V., Frydrych, M., Sams, M.: Identification of synthetic and natural emotional facial expressions. In: AVSP 2003. ISCA Tutorial and Research Workshop on Audio Visual Speech Processing, St. Jorioz, France, pp. 239–244 (2003)

    Google Scholar 

  18. Keltner, D.: Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame. Journal of Personality and Social Psychology 68, 441–454 (1992)

    Article  Google Scholar 

  19. Matsumoto, D.: More evidence for the universality of a contempt expression. Motivation and Emotion 16(4), 363–368 (1992)

    Article  Google Scholar 

  20. Niewiadomski, R.: A model of complex facial expressions in interpersonal relations for animated agents, Ph.D. thesis, University of Perugia (2007)

    Google Scholar 

  21. Ostermann, J.: Face Animation in MPEG-4. In: Pandzic, I.S., Forchheimer, R. (eds.) MPEG-4 Facial Animation - The Standard Implementation and Applications, pp. 17–55. Wiley, England (2002)

    Chapter  Google Scholar 

  22. Poggi, I.: Interacting bodies and interacting minds. In: 2nd lInternational Society for Gesture Studies (ISGS) Conference Interacting Bodies, Lyon, pp. 15–18 (2005)

    Google Scholar 

  23. Rifqi, M.: Mesures de comparaison, typicalité et classification d’objets flous: théorie et pratique, Ph.D Thesis (1996)

    Google Scholar 

  24. Scozzafava, R., Vantaggi, B. (eds.): Fuzzy Relations in a Coherent Conditional Probability Setting, 7th International Conference on Information and Management Sciences (IMS), Chengdu, China, pp. 496–500 (2006)

    Google Scholar 

  25. Teknomo, K.: Similarity Measurement, http://people.revoledu.com/kardi/tutorial/Similarity/index.html

  26. Tsapatsoulis, N., Raouzaiou, A., Kollias, S., Crowie, R., Douglas-Cowie, E.: Emotion Recognition and Synthesis Based on MPEG-4 FAPs. In: Pandzic, I., Forchheimer, R. (eds.) MPEG-4 Facial Animation - The standard, implementations, applications, John Wiley & Sons, UK (2002)

    Google Scholar 

  27. Young, A.W., Rowland, D., Calder, A.J., Etcoff, N.L., Seth, A., Perrett, D.I.: Facial expression megamix: tests of dimensional and category accounts of emotion recognition. Cognition 63(3), 271–313 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Catherine Pelachaud Jean-Claude Martin Elisabeth André Gérard Chollet Kostas Karpouzis Danielle Pelé

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Niewiadomski, R., Pelachaud, C. (2007). Fuzzy Similarity of Facial Expressions of Embodied Agents. In: Pelachaud, C., Martin, JC., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds) Intelligent Virtual Agents. IVA 2007. Lecture Notes in Computer Science(), vol 4722. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74997-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74997-4_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74996-7

  • Online ISBN: 978-3-540-74997-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics