Skip to main content
Springer Nature Link
Log in

Facial Expression Recognition

  • Reference work entry
Encyclopedia of Biometrics

Synonyms

Facial Expression Analysis; Facial Action Coding

Definition

Facial expression recognition is a process performed by humans or computers, which consists of:

  1. 1.

    Locating faces in the scene (e.g., in an image; this step is also referred to as face detection),

  2. 2.

    Extracting facial features from the detected face region (e.g., detecting the shape of facial components or describing the texture of the skin in a facial area; this step is referred to as facial feature extraction),

  3. 3.

    Analyzing the motion of facial features and/or the changes in the appearance of facial features and classifying this information into some facial-expression-interpretative categories such as facial muscle activations like smile or frown, emotion (affect) categories like happiness or anger, attitude categories like (dis)liking or ambivalence, etc. (this step is also referred to as facial expression interpretation).

Introduction

A widely accepted prediction is that computing will move to the background,...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pantic, M., Pentland, A., Nijholt, A., Huang, T.S.: Human computing and machine understanding of human behavior: A Survey. Lect. Notes Artif. Intell. 4451, 47–71 (2007)

    Google Scholar 

  2. Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal HCI. Proceedings of the IEEE 91(9), 1370–1390 (2003)

    Article  Google Scholar 

  3. Tian, Y.L., Kanade, T., Cohn, J.F.: Facial expression analysis. In: Li, S.Z., Jain, A.K. (eds.) Handbook of Face Recognition, pp. 247–276. Springer, New York (2005)

    Chapter  Google Scholar 

  4. Pantic, M., Bartlett, M.S.: Machine analysis of facial expressions. In: Delac, K., Grgic, M. (eds.) 1Face Recognition, pp. 377–416. I-Tech Education and Publishing, Vienna, Austria (2007)

    Google Scholar 

  5. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)

    Google Scholar 

  6. Ambady, N., Rosenthal, R.: Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychol. Bull. 111(2), 256–274 (1992)

    Article  Google Scholar 

  7. Ekman, P., Rosenberg, E.L. (eds.): What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system. Oxford University Press, Oxford, UK (2005)

    Google Scholar 

  8. Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)

    Article  Google Scholar 

  9. Li, S.Z., Jain, A.K. (eds.): Handbook of face recognition. Springer, New York (2005)

    MATH  Google Scholar 

  10. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  11. Pantic, M., Patras, I.: Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. Syst. Man Cybern. B Cybern. 36(2), 433–449 (2006)

    Article  Google Scholar 

  12. Cohn, J.F., Ekman, P.: Measuring facial actions. In: Harrigan, J.A., Rosenthal, R., Scherer, K. (eds.) The New Handbook of Methods in Nonverbal Behavior Research, pp. 9–64. Oxford University Press, New York (2005)

    Google Scholar 

  13. Keltner, D., Ekman, P.: Facial expression of emotion. In: Lewis, M., Haviland-Jones, J.M. (eds.) Handbook of Emotions, pp. 236–249. Guilford Press, New York (2000)

    Google Scholar 

  14. Ekman, P., Friesen, W.V., Hager, J.C.: Facial action coding system. A Human Face, Salt Lake City, USA (2002)

    Google Scholar 

  15. Pantic, M., Valstar, M.F, Rademaker, R., Maat, L. Web-based database for facial expression analysis. Proc. IEEE Int’l Conf. Multimedia & Expo (ICME) 317–321 (2005)

    Google Scholar 

  16. Ekman, P., Huang, T.S., Sejnowski, T.J., Hager, J.C. (eds.): NSF Understanding the Face. A Human Face eStore, Salt Lake City, USA, (see Library) (1992)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing Imperial College London, London, UK

    Maja Pantic

Authors
  1. Maja Pantic
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Biometrics and Security Research, Chinese Academy of Sciences, Beijing, China

    Stan Z. Li (Professor) (Professor)

  2. Departments of Computer Science & Engineering, Michigan State University, East Lansing, MI, USA

    Anil Jain (Professor) (Professor)

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this entry

Cite this entry

Pantic, M. (2009). Facial Expression Recognition. In: Li, S.Z., Jain, A. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-73003-5_98

Download citation

Publish with us

Policies and ethics