Abstract
The recognition of emotional information is a key step toward giving computers the ability to interact more naturally and intelligently with people. This paper presents a completely automated real-time system for facial expression’s recognition based on facial features’ tracking and a simple emotional classification method. Facial features’ tracking uses a standard webcam and requires no specific illumination or background conditions. Emotional classification is based on the variation of certain distances and angles from the neutral face and manages the six basic universal emotions of Ekman. The system has been integrated in a 3D engine for managing virtual characters, allowing the exploration of new forms of natural interaction.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Turk, M., Kölsch, M.: Perceptual Interfaces. In: Medioni, G., Kang, S.B. (eds.) Emerging Topics in Computer Vision, Prentice Hall, Englewood Cliffs (2005)
Bradski, G.R.: Computer Vision Face Tracking as a Component of a Perceptual User Interface. In: Proceedings of the IEEE Workshop on Applications of Computer Vision, pp. 214–219 (1998)
Toyama, K.: “Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking. In: Proceedings of the Workshop on Perceptual User Interfaces, pp. 49–54 (1998)
Gorodnichy, D.O., Malik, S., Roth, G.: Nouse ‘Use Your Nose as a Mouse’ – a New Technology for Hands-free Games and Interfaces. Image and Vision Computing 22, 931–942 (2004)
Betke, M., Gips, J., Fleming, P.: The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access for People with Severe Disabilities. IEEE Transactions on neural systems and Rehabilitation Engineering 10 (2002)
Pantic, M., Rothkrantz, L.J.M.: Automatic Analysis of Facial Expressions: The State of the Art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1424–1445 (2000)
Ekman, P.: Facial Expression, the Handbook of Cognition and Emotion. John Wiley & Sons, Chichester (1999)
Viola, P., Jones, M.: Robust Real-Time Face Detection. International Journal of Computer Vision 57, 137–154 (2004)
Shi, J., Tomasi, C.: Good Features to Track. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
Baker, S., Matthews, I.: Lucas-Kanade 20 Years On: A Unifying Framework. International Journal of Computer Vision 56, 221–225 (2004)
Hammal, Z., Couvreur, L., Caplier, A., Rombaut, M.: Facial Expression Recognition Based on the Belief Theory: Comparison with Different Classifiers. In: Roli, F., Vitulano, S. (eds.) ICIAP 2005. LNCS, vol. 3617, pp. 743–752. Springer, Heidelberg (2005)
http://www.mmk.ei.tum.de/~waf/fgnet/feedtum.html (Reviewed in February 2006)
Bassili, J.N.: Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37, 2049–2059 (1997)
Seron, F., Baldassarri, S., Cerezo, E.: MaxinePPT: Using 3D Virtual Characters for Natural Interaction. In: Proc. WUCAmI’06: 2nd International Workshop on Ubiquitous Computing and Ambient Intelligence, pp. 241–250 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Cerezo, E. et al. (2007). Real-Time Facial Expression Recognition for Natural Interaction. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds) Pattern Recognition and Image Analysis. IbPRIA 2007. Lecture Notes in Computer Science, vol 4478. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72849-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-72849-8_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72848-1
Online ISBN: 978-3-540-72849-8
eBook Packages: Computer ScienceComputer Science (R0)