Synonyms
Facial action coding; Facial expression analysis
Definition
Facial expression recognition is a process performed by humans or computers, which consists of:
- 1.
Locating faces in the scene (e.g., in an image; this step is also referred to as face detection)
- 2.
Extracting facial features from the detected face region (e.g., detecting the shape of facial components or describing the texture of the skin in a facial area; this step is referred to as facial feature extraction)
- 3.
Analyzing the motion of facial features and/or the changes in the appearance of facial features and classifying this information into some facial expression-interpretative categories such as facial muscle activations like smile or frown, emotion (affect) categories like happiness or anger, attitude categories like (dis)liking or ambivalence, etc. (this step is also referred to as facial expression interpretation)
Introduction
A widely accepted prediction is that computing will move to the background, weaving...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
M. Pantic, A. Pentland, A. Nijholt, T.S. Huang, Human computing and machine understanding of human behavior: a survey, in Artifical Intelligence for Human Computing. Lecture Notes in Computer Science, vol. 4451 (Springer, Berlin/Heidelberg, 2007) pp. 47–71
M. Pantic, L.J.M. Rothkrantz, Toward an affect-sensitive multimodal HCI. Proc. IEEE 91(9), 1370–1390 (2003)
Y.L. Tian, T. Kanade, J.F. Cohn, Facial expression analysis, in Handbook of Face Recognition, ed. by S.Z. Li, A.K. Jain (Springer, New York, 2005), pp. 247–276
M. Pantic, M.S. Bartlett, Machine analysis of facial expressions, in Face Recognition, ed. by K. Delac, M. Grgic (I-Tech Education and Publishing, Vienna, 2007), pp. 377–416
Z. Zeng, M. Pantic, G.I. Roisman, T.S. Huang, A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)
N. Ambady, R. Rosenthal, Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychol. Bull. 111(2), 256–274 (1992)
P. Ekman, E.L. Rosenberg (eds.), What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (Oxford University Press, Oxford, 2005)
M.H. Yang, D.J. Kriegman, N. Ahuja, Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)
S.Z. Li, A.K. Jain (eds.), Handbook of Face Recognition (Springer, New York, 2005)
P. Viola, M. Jones, Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)
M. Pantic, I. Patras, Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. Syst. Man Cybern. B Cybern. 36(2), 433–449 (2006)
J.F. Cohn, P. Ekman, Measuring facial actions, in The New Handbook of Methods in Nonverbal Behavior Research, ed. by J.A. Harrigan, R. Rosenthal, K. Scherer (Oxford University Press, New York, 2005), pp. 9–64
D. Keltner, P. Ekman, Facial expression of emotion, in Handbook of Emotions, ed. by M. Lewis, J.M. Haviland-Jones (Guilford Press, New York, 2000), pp. 236–249
P. Ekman, W.V. Friesen, J.C. Hager, Facial Action Coding System (A Human Face, Salt Lake City, 2002)
M. Pantic, M.F. Valstar, R. Rademaker, L. Maat, Web-based database for facial expression analysis, in Proceedings of the IEEE International Conference on Multimedia & Expo (ICME), Amsterdam, 2005, pp. 317–321
P. Ekman, T.S. Huang, T.J. Sejnowski, J.C. Hager (eds.), NSF Understanding the Face (A Human Face eStore, Salt Lake City, 1992). (see Library)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this entry
Cite this entry
Pantic, M. (2015). Automatic Analysis of Facial Expressions. In: Li, S.Z., Jain, A.K. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7488-4_98
Download citation
DOI: https://doi.org/10.1007/978-1-4899-7488-4_98
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4899-7487-7
Online ISBN: 978-1-4899-7488-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering