Abstract
In this paper, a novel system is proposed to recognize facial expression based on face sketch, which is produced by programmable graphics hardware-GPU(Graphics Processing Unit). Firstly, an expression subspace is set up from a corpus of images consisting of seven basic expressions. Secondly, by applying a GPU based edge detection algorithm, the real-time facial expression sketch extraction is performed. Subsequently, noise elimination is carried out by tone mapping operation on GPU. Then, an ASM instance is trained to track the facial feature points in the sketched face image more efficiently and precisely than that on a grey level image directly. Finally, by the normalized key feature points, Eigen expression vector is deduced to be the input of MSVM(Multi-SVMs) based expression recognition model, which is introduced to perform the expression classification. Test expression images are categorized by MSVM into one of the seven basic expression subspaces. Experiment on a data set containing 500 pictures clearly shows the efficacy of the algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pantic, M., Rothkrantz, L.J.M.: Towards an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE 91(9), 1370–1390 (2003)
Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Alto (1978)
Ekman, P.: Strong Evidence for Universals in Facial Expressions: A Reply to Russel’s Mistaken Critique. Psychological Bulletin 115(2), 268–287 (1994)
Cohen, I., Sebe, N., Cozman, F.G., Cirelo, M.C., Huang, T.S.: Learning Bayesian Network Classifiers for Facial Expression Recognition with both Labeled and Unlabeled data. In: Proceedings of IEEE CVPR 2003, pp. 585–601 (2003)
Cristianini, N., Shawe-Taylor, J.: An Introduction To Support Vector Machines. Cambridge University Press, Cambridge (2000)
Ahmad, T., Taylor, C.J., Lanitis, A., Cootes, T.F.: Tracking and Recognising Hand Gestures using Statistical Shape Models. Image and Vision Computing 15(5), 345–352 (1997)
Macedonia, M.: The gpu enters computing’s mainstream. IEEE Computer, Los Alamitos (2003)
Dudash, B.: Filter Blit Example. nVidia SDK White Paper (2004)
Ashikhmin, M.: A Tone Mapping Algorithm for High Contrast Images. In: Eurographics Workshop on Rendering, pp. 1–11 (2002)
Covell, M., Bregler, C.: Eigen-Points. In: Proceedings of IEEE ICIP 1996 (1996)
Nogueiras, A., Moreno, A., Bonafonte, A., Mariño, J.B.: Speech Emotion Recognition Using Hidden Markov Models. In: Proceedings of EUROSPEECH 2001 (2001)
Cohen, I., Sebe, N., Cozman, F.G., Cirelo, M.C., Huang, T.S.: Learning Bayesian Network Classifiers for Facial Expression Recognition with both Labeled and Unlabeled data. In: Proceedings of IEEE CVPR 2003, pp. 595–601 (2003)
Song, M., Bu, J., Chen, C., Li, N.: Audio-Visual based Emotion Recognition-A New Approach. In: Proceedings of IEEE CVPR 2004, pp. 1020–1025 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bu, J., Song, M., Wu, Q., Chen, C., Jin, C. (2005). Sketch Based Facial Expression Recognition Using Graphics Hardware. In: Tao, J., Tan, T., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol 3784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573548_10
Download citation
DOI: https://doi.org/10.1007/11573548_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29621-8
Online ISBN: 978-3-540-32273-3
eBook Packages: Computer ScienceComputer Science (R0)