Abstract
An efficient, global and local image-processing based extraction and tracking of intransient facial features and automatic recognition of facial expressions from both static and dynamic 2D image/video sequences is presented. Expression classification is based on Facial Action Coding System (FACS) a lower and upper face action units (AUs), and discrimination is performed using Probabilistic Neural Networks (PNN) and a Rule-Based system. For the upper face detection and tracking, we use systems based on a novel two-step active contour tracking system while for the upper face, cross-correlation based tracking system is used to detect and track of Facial Feature Points (FFPs). Extracted FFPs are used to extract some geometric features to form a feature vector which is used to classify input image or image sequences into AUs and basic emotions. Experimental results show robust detection and tracking and reasonable classification where an average recognition rate is 96.11% for six basic emotions in facial image sequences and 94% for five basic emotions in static face images.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ekman, P., Friesen, W.V.: Facial Action Coding System (FACS). Consulting Psychologists Press, Palo Alto (1978)
Pantic, M., Rothkrantz, L.J.M.: Expert system for automatic analysis of facial expressions. Journal of Image and Vision Computing 18, 881–905 (2000)
Lien, J.J., Kanade, T., Cohn, J.F., Li, C.C.: Detection, tracking and classification of action units in facial expression. Journal of Robotics and Autonomous Systems 31, 131–146 (2000)
Valstar, M., Partas, I., Pantic, M.: Facial Action Unit Recognition Using Temporal Templates. In: Proc. Of the IEEE int. workshop on Robot and Human Interactive Communication, Japan, pp. 253–258 (2004)
Bartlett, M.S., et al.: Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behaviour. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 568–573 (2005)
Kanade, T., Cohn, J., Tian, Y.: Comprehensive database for facial expression analysis (2000)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. Int. J. of Computer Vision, 321–331 (1998)
Seyedarabi, H., Aghagolzadeh, A., Khanmohammadi, S.: Facial Expressions Animation and Lip Tracking Using Facial Characteristic Points and Deformable Model. Int. Journal of Information Technology (IJIT) 1(4), 284–287 (2004)
Aghagolzadeh, A., Seyedarabi, H., Khanmohammadi, S.: Single and Composite Action Units Classification in Facial Expressions by Feature-Points Tracking and RBF Neural Networks. In: Ukrainian Int. conf. signal/Image processing, UkrObraz 2004, Kiev, Ukraine, pp. 181–184 (2004)
Yeasin, M., Bullot, B., Sharma, R.: Recognition of Facial Expressions and Measurement of Levels of Interest From Video. IEEE Transactions on Multimedia 8(3), 500–508 (2006)
Zhang, Y.: Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences. IEEE Transactions on pattern analysis and machine intelligence 27(5), 699–714 (2005)
Ma, L., Khorasani, K.: Facial Expression Recognition Using Constructive Feedforward Neural Networks. IEEE Transactions on Systems, Man and Cybernetics 34(3), 1588–1595 (2004)
Chibelushi, C.C., Bourel, F.: Hierarchical Multistream Recognition of Facial Expressions. IEE Proceeding of Vision, Image and Signal Processing 151(4), 303–313 (2004)
Pantic, M., Rothkrantz, L.J.M.: Facial Action Recognition for Facial Expression Analysis From Static Face Images. IEEE Transactions on Systems, Man and Cybernetics 34(3), 1449–1461 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Seyedarabi, H., Lee, WS., Aghagolzadeh, A., Khanmohammadi, S. (2006). Facial Expressions Recognition in a Single Static as well as Dynamic Facial Images Using Tracking and Probabilistic Neural Networks. In: Chang, LW., Lie, WN. (eds) Advances in Image and Video Technology. PSIVT 2006. Lecture Notes in Computer Science, vol 4319. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11949534_29
Download citation
DOI: https://doi.org/10.1007/11949534_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68297-4
Online ISBN: 978-3-540-68298-1
eBook Packages: Computer ScienceComputer Science (R0)