Abstract
Towards building new, friendlier human-computer interaction and multimedia interactive services systems, we developed a image processing system which consists of the face detection module, which first determines automatically whether or not there are any faces in given images and, if so, returns the location and extent of each face and a facial expression classification module, which allow the classification of several facial expressions. In order to increase the accuracy of the facial expression classification module, we developed four different classifiers, namely:(1) Multilayer perceptrons, (2) Radial basis networks, (3) K-nearest neighbor classifiers and, (4) Support vector machines. In this paper we make an evaluation of performance of these classifiers versus the human’s expression recognition performance for five expression: ‘neutral’, ‘happy’, ‘surprised’, ‘angry’ and ‘disgusted’.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Stathopoulou, I.O., Tsihrintzis, G.: Facial Expression Classification: Specifying Requirements for an Automated System. In: Proceedings of the 10th International Conference on Knowledge-Based & Intelligent Information & Engineering Systems, Bournemouth, United Kingdom (October 2006)
Cohn, J., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Allen, J.B., Coan, J.A. (ed.) The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science (2006) (in press)
Goneid, A., e.K.R.: Facial feature analysis of spontaneous facial expression. In: Proceedings of the 10th International AI Applications Conference (2002)
Lien, J.J.J., Kanade, T., Cohn, J.F., Li, C.C.: Detection, tracking and classification of action units in facial expression. Journal of Robotics and Autonomous Systems
Cohen, I., Sebe, N., Chen, L., Garg, A., Huang, T.S.: Facial expression recognition from video sequences: Temporal and static modeling. Computer Vision and Image Understanding, 160–187 (2003)
Terzopoulos, D., Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Pattern Anal. Mach. Intell. 15(6), 569–579 (1993)
Essa, I.A., Pentland, A.P.: Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 757–763 (1997)
Zhang, Z., Lyons, M., Schuster, M., Akamatsu, S.: Comparison between geometry-based and gabor-wavelets-based facial expression recognition using multi-layer perceptron. In: FG 1998: Proceedings of the 3rd International Conference on Face & Gesture Recognition, Washington, DC, USA, p. 454. IEEE Computer Society, Los Alamitos (1998)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)
Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: Development and application to human computer interaction. In: CVPR Workshop on CVPR for HCI, pp. 139–157 (2003)
Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: FG 1998: Proceedings of the 3rd International Conference on Face & Gesture Recognition, Washington, DC, USA, p. 200. IEEE Computer Society, Los Alamitos (1998)
Black, M.J., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: ICCV, pp. 374–381 (1995)
Lisetti, C.L., Schiano, D.J.: Automatic facial expression interpretation: Where human-computer interaction, ai and cognitive science intersect. Pragmatics and Cognition 8(1), 185–235 (2000)
Dailey, M.N., Cottrell, G.W., Adolphs, R.: A six-unit network is all you need to discover happiness. In: TwentySecond Annual Conference of the Cognitive Science Society, pp. 101–106. Erlbaum, Mahwah (2000)
Rosenblum, Y.Y., Davis, L.: Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks 7(5), 1121–1138 (1996)
Kotsia, I., Buciu, I., Pitas, I.: An analysis of facial expression recognition under partial facial image occlusion. Image Vision Comput. 26(7), 1052–1067 (2008)
Hernández, B., Olague, G., Hammoud, R., Trujillo, L., Romero, E.: Visual learning of texture descriptors for facial expression recognition in thermal imagery. Comput. Vis. Image Underst. 106(2-3), 258–269 (2007)
Hammal, Z., Couvreur, L., Caplier, A., Rombaut, M.: Facial expression classification: An approach based on the fusion of facial deformations using the transferable belief model. Int. J. Approx. Reasoning 46(3), 542–567 (2007)
Kim, D.H., Jung, S.U., Chung, M.J.: Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn. Lett. 29(11), 1621–1631 (2008)
Liang, D., Yang, J., Zheng, Z., Chang, Y.: A facial expression recognition system based on supervised locally linear embedding. Pattern Recogn. Lett. 26(15), 2374–2389 (2005)
Xiang, T., Leung, M.K.H., Cho, S.Y.: Expression recognition using fuzzy spatio-temporal modeling. Pattern Recogn. 41(1), 204–216 (2008)
Pantic, M., Rothkrantz, L.: Expert system for automatic analysis of Facial Expression. Image and Vision Computing Journal 18(11), 881–905 (2000)
Chung-Lin Huang, Y.M.H.: Facial expression recognition using model-based feature extraction and action parameters classification. Journal of Visual Communication and Image Representation 8(3), 278–290 (1997)
Ekman, P., Friesen, W.V.: Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1977)
Pantic, M., Rothkrantz, L.: Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1424–1445 (2000)
Stathopoulou, I.O., Tsihrintzis, G.: A neural network-based facial analysis system. In: Proceedings of the 5th International Workshop on Image Analysis for Multimedia Interactive Services, Lisboa, Portugal (April 2004)
Stathopoulou, I.O., Tsihrintzis, G.: An Improved Neural Network-Based Face Detection and Facial Expression Classification System. In: IEEE International Conference on Systems, Man, and Cybernetics, The Hague, Netherlands (October 2004)
Stathopoulou, I.O., Tsihrintzis, G.: Pre-processing and expression classification in low quality face images. In: Proceedings of 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services (July 2005)
Stathopoulou, I.O., Tsihrintzis, G.: Evaluation of the Discrimination Power of Features Extracted from 2-D and 3-D Facial Images for Facial Expression Analysis. In: Proceedings of the 13th European Signal Processing Conference, Antalya, Turkey (September 2005)
Stathopoulou, I.O., Tsihrintzis, G.: Detection and Expression Classification Systems for Face Images (FADECS). In: Proceedings of the IEEE Workshop on Signal Processing Systems (SiPS 2005), Athens, Greece (November 2005)
Stathopoulou, I.O., Tsihrintzis, G.: An Accurate Method for eye detection and feature extraction in face color images. In: Proceedings of the 13th International Conference on Signals, Systems, and Image Processing, Budapest, Hungary (September 2006)
Stathopoulou, I.O., Tsihrintzis, G.: NEU-FACES: A Neural Network-based Face Image Analysis System. In: Proceedings of the 8th International Conference on Adaptive and Natural Computing Systems, Warsaw, Poland (April 2007)
Bishop, C.M.: Neural Networks for Pattern Recognition, 1st edn. Oxford University Press, Oxford (1995)
Haykin, S.: Neural Networks, 2nd edn. Prentice Hall, Englewood Cliffs (1999)
Duda, R.O., Hart, P.E., Strock, D.G.: Pattern Classification, 2nd edn. John Wiley, Chichester (2000)
Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 1st edn. Academic Press, London (1998)
Alepis, E., Virvou, M., Kabassi, K.: Knowledge Engineering Aspects of Affective Bi-Modal Educational Applications. In: E-business and Telecommunications, Book Series CCIS, vol. 23, pp. 328–339 (2008)
Alepis, E., Virvou, M., Kabassi, K.: Affective reasoning based on bi-modal interaction and user stereotypes. Studies in Computational Intelligence 142, 523–532 (2008)
Alepis, E., Virvou, M., Kabassi, K.: Development process of an affective bi-modal Intelligent Tutoring System. Intelligent Decision Technologies 142, 117–126 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Lampropoulos, A.S., Stathopoulou, IO., Tsihrintzis, G.A. (2009). Comparative performance evaluation of classifiers for Facial Expression Recognition. In: Damiani, E., Jeong, J., Howlett, R.J., Jain, L.C. (eds) New Directions in Intelligent Interactive Multimedia Systems and Services - 2. Studies in Computational Intelligence, vol 226. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02937-0_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-02937-0_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02936-3
Online ISBN: 978-3-642-02937-0
eBook Packages: EngineeringEngineering (R0)