Hua Wang
ABSTRACT
Human emotion detection is of substantial importance in diverse pervasive applications in assistive environments. Because facial expressions provide a key mechanism for understanding and conveying emotion, automatic emotion detection through facial expression recognition has attracted increased attention in both scientific research and practical applications in recent years. Traditional facial expression recognition methods normally use only one type of facial expression data, either static data extracted from one single face image or motion dependent data obtained from dynamic face image sequences, but seldom employ both. In this work, we propose a novel Discriminative Kernel Facial Emotion Recognition (DKFER) method to integrate these two types of facial expression data using a hybrid kernel, such that the advantages of both of them are exploited. In addition, by using Linear Discriminant Analysis (LDA) to transform the two types of original facial expression data into two more discriminative lower-dimensional subspaces, the succeeding classification for emotion detection can be carried out in a more efficient and effective way. Encouraging experimental results in empirical studies demonstrate the practical usage of the proposed DKFER method for emotion detection.
- R. Chellappa, C. Wilson, S. Sirohey, et al. Human and machine recognition of faces: A survey. Proceedings of the IEEE, 83(5):705--740, 1995.Google Scholar
Cross Ref
- N. Cristianini and J. Shawe-Taylor. An introduction to support Vector Machines: and other kernel-based learning methods. Cambridge Univ Pr, 2000. Google ScholarDigital Library
- K. Duan and S. Keerthi. Which is the best multiclass SVM method? An empirical study. Multiple Classifier Systems, 3541:278--285, 2005. Google ScholarDigital Library
- P. Ekman and W. Friesen. Facial action coding system: A technique for the measurement of facial movement, 1978.Google Scholar
- N. Esau, E. Wetzel, L. Kleinjohann, and B. Keinjohann. Real-time facial expression recognition using a fuzzy emotion model. In IEEE International Fuzzy Systems Conference FUZZ-IEEE 2007, pages 1--6, 2007.Google ScholarCross Ref
- W. Fellenz, J. Taylor, R. Cowie, E. Douglas-Cowie, F. Piat, S. Kollias, C. Orovas, and B. Apolloni. On emotion recognition of faces and of speech using neuralnetworks, fuzzy logic and the ASSESS system. In Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on, volume 2, 2000. Google ScholarDigital Library
- K. Fukunaga. Introduction to statistical pattern recognition. Academic Press, 1990. Google ScholarDigital Library
- D. Graham and N. Allinson. Face recognition: From theory to applications. NATO ASI Series F, Computer and Systems Sciences, 163:446--456, 1998.Google Scholar
- C. Hsu and C. Lin. A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks, 13(2):415--425, 2002. Google ScholarDigital Library
- S. Kimura and M. Yachida. Facial expression recognition and its degree estimation. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 295--300, 1997. Google ScholarDigital Library
- U. Kressel. Pairwise classification and support vector machines. Advances in kernel methods: support vector learning, pages 255--268, 1999. Google ScholarDigital Library
- I. Maglogiannis, D. Vouyioukas, and C. Aggelopoulos. Face detection and recognition of natural human emotion using Markov random fields. Personal and Ubiquitous Computing, 13(1):95--101, 2009. Google ScholarDigital Library
- A. Metallinou, L. S., and N. S. Audio-visual emotion recognition using gaussian mixture models for face and voice. Proceedings of the tenth IEEE Symposium on Multimedia, 2008. Google ScholarDigital Library
- P. Michel. Support vector machines in automated emotion classification. Churchill College, June, 2003.Google Scholar
- M. Rizon, M. Karthigayan, S. Yaacob, and R. Nagarajan. Japanese face emotions classification using lip features. Geometric Modeling and Imaging, 2007. GMAI'07, pages 140--144, 2007. Google ScholarDigital Library
- J. Rottenberg and J. Gross. Emotion and emotion regulation: A map for psychotherapy researchers. Clinical Psychology: Science and Practice, 14(4):323--328, 2007.Google ScholarCross Ref
- M. Shackleton and W. Welsh. Classification of facial features for recognition. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1991. Proceedings CVPR'91., pages 573--579, 1991.Google ScholarCross Ref
- D. Sloan and A. Kring. Measuring changes in emotion during psychotherapy: Conceptual and methodological issues. Clinical Psychology: Science and Practice, 14(4):307--322, 2007.Google ScholarCross Ref
- A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on pattern analysis and machine intelligence, 22(12):1349--1380, 2000. Google ScholarDigital Library
- M. Suwa, N. Sugie, and K. Fujimora. A preliminary note on pattern recognition of human emotional expression. In International Joint Conference on Pattern Recognition, pages 408--410, 1978.Google Scholar
- D. Terzopoulos and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(6):569--579, 1993. Google ScholarDigital Library
- Y. Yacoob and L. Davis. Computing spatio-temporal representations of human faces. In IEEE Computer Society Conference On Computer Vision And Pattern Recognition, pages 70--70. Citeseer, 1994.Google ScholarCross Ref
- Z. Zeng, Y. Hu, Y. Fu, T. Huang, G. Roisman, and Z. Wen. Audio-visual emotion recognition in adult attachment interview. In Proceedings of the 8th international conference on Multimodal interfaces, page 145. ACM, 2006. Google ScholarDigital Library
- W. Zhao, R. Chellappa, P. Phillips, and A. Rosenfeld. Face recognition: A literature survey. Acm Computing Surveys (CSUR), 35(4):399--458, 2003. Google ScholarDigital Library
Index Terms
- Emotion detection via discriminative kernel method
Recommendations
Emotion Detection via Discriminant Laplacian Embedding
Human emotion detection is of substantial importance in a variety of pervasive applications in assistive environments. Because facial expressions provide a key mechanism for understanding and conveying emotion, automatic emotion detection through facial ...
Collaborative discriminative multi-metric learning for facial expression recognition in video
We present a new metric learning approach for facial expression recognition in videos.Our approach combines both audio and visual features and achieves better facial expression recognition performance.Experimental results clearly show the advantages of ...
Emotion Recognition with Facial Landmark Heatmaps
MultiMedia ModelingAbstractFacial expression recognition is a very challenging problem and has attracted more and more researchers’ attention. In this paper, considering that facial expression recognition is closely related to the features of key facial regions, we propose ...
Comments