Abstract
In this paper, a novel framework is proposed for feature extraction and classification of facial expression recognition, namely multiple manifold discriminant analysis (MMDA), which assumes samples of different expressions reside on different manifolds, thereby learning multiple projection matrices from training set. In particular, MMDA first incorporates five local patches, including the regions of left and right eyes, mouth and left and right cheeks from each training sample to form a new training set, and then learns projection matrix from each expression so that maximizes the manifold margins among different expressions and minimizes the manifold distances of the same expression. A key feature of MMDA is that it can extract the discriminative information of expression-specific for classification rather than that of subject-specific, leading to a robust performance in practical applications. Our experiments on Cohn-Kanade and JAFFE databases demonstrate that MMDA can effectively enhance the discriminant power of the extracted expression features.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
He, X., Niyogi, P.: Locality preserving projections. In: NIPS, pp. 234–241 (2003)
Zhi, R., Ruan, Q.: Facial expression recognition based on two-dimensional discriminant locality preserving projections. J. Neurocomput. 71(7), 1730–1734 (2008)
Ptucha, R., Savakis, A.: Facial expression recognition using facial features and manifold learning. In: Bebis, G., et al. (eds.) ISVC 2010, Part III. LNCS, vol. 6455, pp. 301–309. Springer, Heidelberg (2010)
Xiao, R., Zhao, Q., Zhang, D., Shi, P.: Facial expression recognition on multiple manifolds. J. Pattern Recogn. 44(1), 107–116 (2011)
Lu, J., Peng, Y., Wang, G., Yang, G.: Discriminative multimanifold analysis for face recognition from a single training sample per person. J. Pattern Anal. Mach. Intell. 35(1), 39–51 (2013)
Martinez, A.M.: Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. J. Pattern Anal. Mach. Intell. 24(6), 748–763 (2002)
Chang, W.-Y., Chen, C.-S., Hung, Y.-P.: Analyzing facial expression by fusing manifolds. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part II. LNCS, vol. 4844, pp. 621–630. Springer, Heidelberg (2007)
Kotsia, I., Buciu, I., Pitas, I.: An analysis of facial expression recognition under partial facial image occlusion. J. Image Vis. Comput. 26(7), 1052–1067 (2008)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. J. Comput. Vis. Image Underst. 61(1), 38–59 (1995)
Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: 4th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000)
Fisher, R.A.: The use of multiple measurements in taxonomic problems. J. Ann. Eugen. 7(2), 179–188 (1936)
Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data with application to face recognition. J. Pattern Recogn. 34(10), 2067–2070 (2001)
Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expression with Gabor wavelets. In: 3th IEEE International Conference in Automatic Face and Gesture Recognition, pp. 200–205. IEEE (1998)
Belhumeur, P.N., Hespnha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. J. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Gottumukkal, R., Asari, V.K.: An improved face recognition technique based on modular PCA approach. J. Pattern Recogn. Lett. 25(4), 429–436 (2004)
Zheng, N., Qi, L., Gao, L., Guan, L.: Generalized MMSD feature extraction using QR decomposition. In: Visual Communication and Image Processing, pp. 1–5. IEEE (2012)
Yu, W., Teng, X., Liu, C.: Face recognition using discriminant locality preserving projections. J. Image Vis. Comput. 24(3), 239–248 (2006)
Yan, S., Xu, D., Zhang, B., Zhang, H., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. J. Pattern Anal. Mach. Intell. 29(1), 40–51 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Zheng, N., Qi, L., Guan, L. (2015). Multiple-manifolds Discriminant Analysis for Facial Expression Recognition from Local Patches Set. In: Schwenker, F., Scherer, S., Morency, LP. (eds) Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction. MPRSS 2014. Lecture Notes in Computer Science(), vol 8869. Springer, Cham. https://doi.org/10.1007/978-3-319-14899-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-14899-1_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14898-4
Online ISBN: 978-3-319-14899-1
eBook Packages: Computer ScienceComputer Science (R0)