Abstract
A smile may communicate different meanings depending on subtle characteristics of the facial expression. In this article, we have studied the morphological and dynamic characteristics of amused, polite, and embarrassed smiles displayed by a virtual agent. A web application has been developed to collect virtual agent’s smile descriptions corpus directly constructed by users. Based on the corpora and using a decision tree classification technique, we propose an algorithm to determine the characteristics of each type of the smile that a virtual agent may express. The proposed algorithm enables one to generate a variety of facial expressions corresponding to the polite, embarrassed, and amused smiles.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ekman, P., Friesen, W.: Felt, false, and miserable smiles. Journal of Nonverbal Behavior 6, 238–252 (1982)
Rehm, M.: Catch me if you can – exploring lying agents in social settings. In: AAMAS, pp. 937–944. Academic Press Inc., London (2005)
Niewiadomski, R., Pelachaud, C.: Model of facial expressions management for an embodied conversational agent. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 12–23. Springer, Heidelberg (2007)
Krumhuber, E., Manstead, A., Cosker, D., Marshall, D., Rosin, P.: Effects of dynamic attributes of smiles in human and synthetic faces: A simulated job interview setting. Journal of Nonverbal Behavior 33, 1–15 (2008)
Theonas, G., Hobbs, D., Rigas, D.: Employing virtual lecturers’ facial expressions in virtual educational environments. International Journal of Virtual Reality 7, 31–44 (2008)
Frank, M., Ekman, P., Friesen, W.: Behavioral markers and recognizability of the smile of enjoyment. Journal of Personality and Social Psychology 64, 83–93 (1993)
Keltner, D.: Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame. Journal of Personality and Social Psychology 68(3), 441–454 (1995)
Harrigan, J.A., O’Connell, D.M.: How do you look when feeling anxious? Facial displays of anxiety. Personality and Individual Differences 21, 205–212 (1996)
Ambadar, Z., Cohn, J., Reed, L.: All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior 17-34, 238–252 (2009)
Ekman, P.: Darwin, deception, and facial expression. Ann. N.Y. Acad. Sci. 1000, 205–221 (2003)
Ekman, P., Friesen, W.V., Hager, J.C.: The facial action coding system. Weidenfeld and Nicolson (2002)
Duchenne, G.: The Mechanism of Human Facial Expression. Cambridge University Press, Cambridge (1990) (1862)
Krumhuber, E.G., Manstead, A.S.R.: Can duchenne smiles be feigned? new evidence on felt and false smiles. Emotion 9(6), 807–820 (2009)
Hess, U., Kleck, R.E.: Differentiating emotion elicited and deliberate emotional facial expressions. European J. of Social Psychology 20(5), 369–385 (1990)
Tanguy, E.: Emotions: the art of communication applied to virtual actors. PhD thesis, Department of Computer Science, University of Bath, England (2006)
Ekman, P., Friesen, W.: Unmasking the Face. A guide to recognizing emotions from facial clues. Prentice-Hall, Inc., Englewood Cliffs (1975)
Poggi, I., Pelachaud, C.: Emotional meaning and expression in performative faces. In: Affective Interactions: Towards a New Generation of Computer Interfaces (2000)
Rakotomalala, R.: Tanagra: un logiciel gratuit pour l’enseignement et la recherche. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds.) EGC 2005. LNCS, vol. 3470, pp. 697–702. Springer, Heidelberg (2005)
Breiman, L., Friedman, J., Olsen, R., Stone, C.: Classification and Regression Trees. Chapman and Hall, Boca Raton (1984)
Faigin, G.: The Artist’s Complete Guide to Facial Expression. Watson-Guptill (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ochs, M., Niewiadomski, R., Pelachaud, C. (2010). How a Virtual Agent Should Smile?. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds) Intelligent Virtual Agents. IVA 2010. Lecture Notes in Computer Science(), vol 6356. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15892-6_47
Download citation
DOI: https://doi.org/10.1007/978-3-642-15892-6_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15891-9
Online ISBN: 978-3-642-15892-6
eBook Packages: Computer ScienceComputer Science (R0)