Abstract
A human face does not play its role in the identification of an individual but also communicates useful information about a person’s emotional state at a particular time. No wonder automatic face expression recognition has become an area of great interest within the computer science, psychology, medicine, and human–computer interaction research communities. Various feature extraction techniques based on statistical to geometrical data have been used for recognition of expressions from static images as well as real-time videos. In this paper, we present a method for automatic recognition of facial expressions from face images by providing discrete wavelet transform features to a bank of seven parallel support vector machines (SVMs). Each SVM is trained to recognize a particular facial expression, so that it is most sensitive to that expression. Multi-classification is achieved by combining multiple SVMs performing binary classification using one-against-all approach. The outputs of all SVMs are combined using a maximum function. The classification efficiency is tested on static images from the publicly available Japanese Female Facial Expression database. The experiments using the proposed method demonstrate promising results.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bell C (1896) Essays on the anatomy of expression in painting, 3rd edn. Longman, Reese, Hurst & Orme, London (first edition published 1806)
Darwin C (1872) The expression of the emotions in man and animal. J. Murray, London
Essa IA, Pentland AP (1995) Facial expression recognition using a dynamic model and motion energy. In: Proceedings of the fifth international conference on computer vision, p 360
Essa IA, Pentland AP (1997) Coding, analysis, interpretation, and recognition of facial expressions. In: IEEE transactions on pattern analysis and machine intelligence, pp 757–763
Feng X (2004) Facial expression recognition based on local binary patterns and coarse-to-fine classification. In: Proceedings of the the fourth international conference on computer and information technology (CIT’04), pp 178–183
Kimura S, Yachida M (1997) Facial expression recognition and its degree estimation. In: Proceedings of the 1997 conference on computer vision and pattern recognition (CVPR’97), p 295
Kotsia I, Buciu I, Pitas I (2008) An analysis of facial expression recognition under partial facial image occlusion. Trans Image Vis Comput 26(7):1052–1067
Moses Y, Reynard D, Blake A (1995) Determining facial expressions in real time. In: Proceedings of the fifth international conference on computer vision, p 296
Nan Z, Youwei Z (2006) Inducement analysis in facial expression recognition. In: The 8th international conference on signal processing 2006, vol III
Pantic M, Rothkrantz LJM (1999) An expert system for multiple emotional classification of facial expressions. In: Proceedings of the 11th IEEE international conference on tools with artificial intelligence ICTAI’99, p 113
Polikar R (2006) Ensemble based systems in decision making. IEEE Circuits Syst Mag 6(3):21–45
Samal A, Iyengar PA (1991) Automatic recognition and analysis of human faces and facial expressions: a survey. Pattern Recognit 25(1):65–77
Scheirer J, Fernandez R, Picard RW (1999) Expression glasses: a wearable device for facial expression recognition. In: Conference on human factors in computing systems, Pittsburgh, PA, pp 262–263
Tai S, Huang H (2009) Facial expression recognition in video sequences. In: Proceedings of the 6th international symposium on neural networks: advances in neural networks—part III, pp 1026–1033
Takeuchi A, Nagao K (1993) Communicative facial displays as a new conversational modality. In: Proceedings of INTERCHI’93, Amsterdam, The Netherlands, pp 187–193
Tian Y, Kanade T, Cohn JF (2001) Recognizing action units for facial expression analysis. IEEE Trans Pattern Anal Mach Intell 23(2):97–115
Tsai PH, Jan T (2005) Expression-invariant face recognition system using subspace model analysis. In: IEEE international conference on systems, man and cybernetics
Viola P, Jones MJ (2001) Robust real-time face detection. In: IEEE ICCV workshop on statistical and computational theories of vision, pp 137–154
Wallhoff F, Schuller B, Hawellek M, Rigoll G (2006) Efficient recognition of authentic dynamic facial expressions on FEEDTUM database. In: IEEE conference on multimedia and expo (ICME’06), pp 493–496
Whitehill J, Bartlett M, Movellan J (2008) Automatic facial expression recognition for intelligent tutoring systems. In: Proceedings of IEEE computer society workshop on computer vision and pattern recognition, pp 1–6
Acknowledgments
We thank JAFFE database for providing us the face images for the experiments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kazmi, S.B., Qurat-ul-Ain & Arfan Jaffar, M. Wavelets-based facial expression recognition using a bank of support vector machines. Soft Comput 16, 369–379 (2012). https://doi.org/10.1007/s00500-011-0721-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-011-0721-4