Abstract
Geometric variation is one of the important components deteriorating the facial expression recognition performance. Aligning the face image to a base shape is a commonly used preprocess step to alleviate the variation. However, the assumption of single base shape can not necessarily guarantee the best performance. In this paper, we propose for the first time a facial expression recognition framework based on multiple base shapes, which aims to minimize the geometric variation between face images with the same facial expression and retain the geometric shape difference between face images with different facial expressions. For a new sample, a weighed vote based criterion is used to give the final predicted facial expression given multiple base shapes. Experimental results on CK+ (Extended Cohn-Kanade) and JAFFE (Japanese Female Facial Expression databases) show the effectiveness of proposed method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Kotsia, I., Pitas, I.: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Proc. 16, 172–187 (2007)
Pai, N.S., Chang, S.P.: An embedded system for real-time facial expression recognition based on the extension theory. Comput. Math. Appl. 61, 2101–2106 (2011)
Xiao, R., Zhao, Q.J., Zhang, D., Shi, P.F.: Facial expression recognition on multiple manifolds. Pattern Recog. 44, 107–116 (2011)
Zafeiriou, S., Petrou, M.: Sparse representations for facial expressions recognition via l1 optimization. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 32–39. IEEE Press, San Francisco (2010)
Shan, C.F., Gong, S.G., McOwan, P.W.: Facial expression recognition based on local binary patterns: A comprehensive study. Image Vision Computing 27, 803–816 (2009)
Buciu, I., Kotropoulos, C., Pitas, I.: ICA and Gabor representation for facial expression recognition. In: International Conference on Image Processing, pp. 855–858. IEEE Press (2003)
Ashraf, A.B., Lucey, S.C., Jeffrey, F., Chen, T., Ambadar, Z.P., Kenneth, M., Solomon, P.E.: The painful face-pain expression recognition using active appearance models. Image Vision Computing 27, 1788–1796 (2009)
Lucey, P., Cohn, J., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade Dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: IEEE Computer Society on Computer Vision and Pattern Recognition Workshops, pp. 94–101. IEEE Press, San Fransico (2010)
Sadeghi, H., Raie, A.A., Mohammadi, M.R.: Facial expression recognition using geometric normalization and appearance representation. In: 8th Iranian Conference on Machine Vision and Image Processing, pp. 159–163. IEEE Press, Zanjan (2013)
Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Machine Intell. 23, 681–685 (2001)
Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Islam, M.S., Auwatanamongkol, S.: A novel feature extraction technique for facial expression recognition. Int. J. Comput. Science 10, 9–14 (2013)
Ptucha, R., Savakis, A.: Manifold based sparse representation for facial understanding in natural images. Image Vision Computing 31, 365–378 (2013)
Jain, S., Hu, C., Aggarwal, J.: Facial expression recognition with temporal modeling of shapes. In: IEEE International Conference on Computer Vision Workshops, pp. 1642–1649. IEEE Press, Bacilona (2011)
Khan, R.A., Meyer, A., Konik, H., Bouakaz, S.: Human vision inspired framework for facial expressions recognition. In: International Conference on Image Processing, pp. 2593–2596. IEEE Press, Orlando (2012)
Jeni, L., Girard, J., Cohn, J., Fernando D.L.T.: Continuous AU intensity estimation using localized, sparse facial feature space. In: 10th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1–7. IEEE Press, Shanghai (2013)
Cao, X.D., Wei, Y.C., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vision 107, 177–190 (2014)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Techno. 2, 27 (2011)
Ma, W.H., Huang, L., Liu, C.P.: Advanced local binary pattern descriptors for crowd estimation. In: Pacific-Asia Workshop on Computational Intelligence and Induatrial Application, pp. 958–962. IEEE Press, Wuhan (2008)
Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with Gabor wavelets. In: Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE Press, Nara (1998)
Sadeghi, H., Raie, A.A., Mohammadi, M.R.: Facial Expression Recognition Using Texture Description of Displacement Image. J. Inf. Syst. Telecom. 2, 205–212 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Cai, L., Huang, L., Liu, C. (2015). Facial Expression Recognition Based on Multiple Base Shapes. In: Yang, J., Yang, J., Sun, Z., Shan, S., Zheng, W., Feng, J. (eds) Biometric Recognition. CCBR 2015. Lecture Notes in Computer Science(), vol 9428. Springer, Cham. https://doi.org/10.1007/978-3-319-25417-3_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-25417-3_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25416-6
Online ISBN: 978-3-319-25417-3
eBook Packages: Computer ScienceComputer Science (R0)