Yulia Gizatdinova
ABSTRACT
Facial expressions are emotionally, socially and otherwise meaningful reflective signals in the face. Facial expressions play a critical role in human life, providing an important channel of nonverbal communication. Automation of the entire process of expression analysis can potentially facilitate human-computer interaction, making it to resemble mechanisms of human-human communication. In this paper, we present an ongoing research that aims at development of a novel spatiotemporal approach to expression classification in video. The novelty comes from a new facial representation that is based on local spatiotemporal feature descriptors. In particular, a combined dynamic edge and texture information is used for reliable description of both appearance and motion of the expression. Support vector machines are utilized to perform a final expression classification. The planned experiments will further systematically evaluate the performance of the developed method with several databases of complex facial expressions.
- Aleksic, P. S. and Katsaggelos, A. K. Automatic facial expression recognition using facial animation parameters and multi-stream HMMs. IEEE Trans. Information Forensics and Security 1, 1 (2005), 3. Google Scholar
Digital Library
- Chang, C.-C. and Lin, C.-J. LIBSVM: A library for support vector machines (2001). http://www.csie.ntu.edu.tw/~cjlin/libsvm. Google ScholarDigital Library
- Ekman, P. and Friesen, W. Facial Action Coding System (FACS): A technique for the measurement of facial action. Consulting Psychologists Press, Palo Alto, California, 1978.Google Scholar
- Fasel, B. and Luettin, J. Automatic facial expression analysis: A survey. J. Pattern Recognition 36, 1 (2003), 259--275.Google ScholarCross Ref
- Gizatdinova, Y. and Surakka, V. Feature-based detection of facial landmarks from neutral and expressive facial images. IEEE Trans. Pattern Analysis and Machine Intelligence 28, 1 (2006), 135--139. Google ScholarDigital Library
- Kotsia, I. and Pitas, I. Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Processing 16, 1 (2007), 172--187. Google ScholarDigital Library
- Lei, Z., Liao, S., He, R., Pietikäinen, M. and Li, SZ. Gabor volume based local binary pattern for face representation and recognition. In Proc. Int. Conf. Automatic Face and Gesture Recognition (2008), 1--6.Google ScholarCross Ref
- Liao, S., Fan, W., Chung, A. C. S., and Yeung, D.-Y. Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features. In Proc. IEEE Int. Conf. Image Processing (2006), 665--668.Google ScholarCross Ref
- Mattivi, R. and Shao, L. Human action recognition using LBP-TOP as sparse spatio-temporal feature descriptor. Lecture Notes in Computer Science 5702. In Proc. Int. Conf. Computer Analysis of Images and Patterns (2009), 740--747. Google ScholarDigital Library
- Ojala, T., Pietikäinen, M. and Mäenpää, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 7 (2002), 971--987. Google ScholarDigital Library
- Pantic, M., Rothkrantz, J. Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 12 (2000), 1424--1445. Google ScholarDigital Library
- Viola, P. and Jones, M. Robust real-time face detection. Int. J. Computer Vision 57, 2 (2004), 137--154. Google ScholarDigital Library
- Wehrle, Th., Kaiser, S., Schmidt, S., Scherer Kl. R. Studying the dynamics of emotional expression using synthesized facial muscle movements. J. Personality and Social Psychology 78, 1 (2000), 105--119.Google ScholarCross Ref
- Zeng, Z., Pantic, M., Roisman, G. I. and Huang T. S. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Analysis and Machine Intelligence 31, 1 (2009), 39--58. Google ScholarDigital Library
- Zhao, G. and Pietikäinen, M. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Analysis and Machine Intelligence 29, 6 (2007), 915--928. Google ScholarDigital Library
- Zhang, Y. and Ji, Q. Active and dynamic information fusion for facial expression understanding from image sequence. IEEE Trans. Pattern Analysis and Machine Intelligence 27, 5 (2005), 699--714. Google ScholarDigital Library
Index Terms
- Facial expression classification based on local spatiotemporal edge and texture descriptors
Recommendations
Facial expression analysis and expression-invariant face recognition by manifold-based synthesis
Over the last decades, expression classification and face recognition have received substantial attention in computer vision and pattern recognition with more recent efforts focusing on understanding and modelling expression variations. In this paper, ...
Emotional facial expression interface: effects of displayed facial designs
Ergo'IA '10: Proceedings of the Ergonomie et Informatique Avancee ConferenceIn supporting the visual-mediated emotional recognition, little research has centred on analysing the effect of presenting different combinatorial facial designs. Moreover, in the theoretical field of emotions, research on the recognition of emotional ...
Automatic Facial Expression Recognition Using Boosted Discriminatory Classifiers
Analysis and Modeling of Faces and GesturesAbstractOver the last two decades automatic facial expression recognition has become an active research area. Facial expressions are an important channel of non-verbal communication, and can provide cues to emotions and intentions. This paper introduces a ...
Comments