Abstract
Facial Emotion recognition is a significant requirement in machine vision society. In this sense, this paper utilizes geometric facial features and calculates displacement of feature points between expressive and neutral frames and finally applies a two-stage fuzzy reasoning model for facial emotion recognition and classification. The prototypical emotion sequence according to the Facial Action Coding System (FACS) is formed analyzing small, medium and large displacement. Furthermore geometric displacements are fuzzified and mapped onto an Action Units (AUs) by employing first-stage fuzzy reasoning model and later AUs are fuzzified and mapped onto an Emotion space by employing second-stage fuzzy relational model. The overall performance of the proposed system is evaluated on the extended Cohn-Kanade (CK+) database for classifying basic emotions like surprise, sadness, fear, anger, and happiness. The experimental results on the task of facial emotion analysis and emotion recognition are shown to outperform other existing methods available in the literature.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lewis, M., Haviland-Jones, J.M., Barrett, L.F.: Handbook of emotions. Guilford Press (2010)
Mehrabian, A.: Communication without words. Psychological Today 2, 53–55 (1968)
Picard, R.W.: Affective computing: challenges. International Journal of Human-Computer Studies 59(1), 55–64 (2003)
Ekman, P., Friesen, W.V.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto (1978)
Bashyal, S., Venayagamoorthy, G.K.: Recognition of facial expressions using Gabor wavelets and learning vector quantization. Engineering Applications of Artificial Intelligence 21(7), 1056–1064 (2008)
He, X., et al.: Face recognition using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(3), 328–340 (2005)
Cho, K.-S., Kim, Y.-G., Lee, Y.-B.: Real-Time Expression Recognition System Using Active Appearance Model and EFM. In: Wang, Y., Cheung, Y.-m., Liu, H. (eds.) CIS 2006. LNCS (LNAI), vol. 4456, pp. 1078–1084. Springer, Heidelberg (2007)
Senechal, T., et al.: Facial Action Recognition Combining Heterogeneous Features via Multikernel Learning. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 42(4), 993–1005 (2012)
Tsalakanidou, F., Malassiotis, S.: Real-time 2D+ 3D facial action and expression recognition. Pattern Recognition 43(5), 1763–1775 (2010)
Lin, D.-T.: Facial expression classification using PCA and hierarchical radial basis function network. Journal of Information Science and Engineering 22(5), 1033–1046 (2006)
Saragih, J.M., Lucey, S., Cohn, J.F.: Face alignment through subspace constrained mean-shifts. In: 2009 IEEE 12th International Conference on Computer Vision. IEEE (2009)
Kim, S.-P., et al.: Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. Journal of Neural Engineering 5(4), 455 (2008)
Nuevo, J., Bergasa, L.M., Jiménez, P.: RSMAT: Robust simultaneous modeling and tracking. Pattern Recognition Letters 31(16), 2455–2463 (2010)
Wood, F., Black, M.J.: A nonparametric Bayesian alternative to spike sorting. Journal of Neuroscience Methods 173(1), 1–12 (2008)
Libralon, G.L., Romero, R.A. F.: Investigating Facial Features for Identification of Emotions. In: Lee, M., Hirose, A., Hou, Z.-G., Kil, R.M. (eds.) ICONIP 2013, Part II. LNCS, vol. 8227, pp. 409–416. Springer, Heidelberg (2013)
Contreras, R., Starostenko, O., Alarcon-Aquino, V., Flores-Pulido, L.: Facial feature model for emotion recognition using fuzzy reasoning. In: MartÃnez-Trinidad, J.F., Carrasco-Ochoa, J.A., Kittler, J., et al. (eds.) MCPR 2010. LNCS, vol. 6256, pp. 11–21. Springer, Heidelberg (2010)
Gomathi, V., Ramar, K., Jeevakumar, A.S.: Human Facial Expression Recognition using MANFIS Model. Proceedings of World Academy of Science: Engineering & Technology 50 (2009)
Kharat, G., Dudul, S.: Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques. WSEAS Transactions on Computers 7(6), 650–659 (2008)
Lucey, P., et al.: The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW (2010)
Ghimire, D., Lee, J.: Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines. Sensors 13(6), 7714–7734 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Islam, M.N., Loo, C.K. (2014). Geometric Feature-Based Facial Emotion Recognition Using Two-Stage Fuzzy Reasoning Model. In: Loo, C.K., Yap, K.S., Wong, K.W., Teoh, A., Huang, K. (eds) Neural Information Processing. ICONIP 2014. Lecture Notes in Computer Science, vol 8835. Springer, Cham. https://doi.org/10.1007/978-3-319-12640-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-319-12640-1_42
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12639-5
Online ISBN: 978-3-319-12640-1
eBook Packages: Computer ScienceComputer Science (R0)