Abstract
As we know, classical Fisher discriminant analysis usually suffers from the small sample size problem due to the singularity problem of the within-class scatter matrix. In this paper, a novel fuzzy linear classifier, called fuzzy maximum scatter difference (FMSD) discriminant criterion, is proposed to extract features from samples, especially deals with outlier samples. FMSD takes the scatter difference between between-class and within-class as discriminant criterion, so it will not suffer from the small sample size problem. The conventional scatter difference discriminant criterion (SDDC) assumes the same level of relevance of each sample to the corresponding class. In this paper, the fuzzy set theory is introduced to the conventional SDDC algorithm, where the fuzzy k-nearest neighbor is adopted to achieve the distribution information of original samples. The distribution is utilized to redefine the scatter matrices that are different from the conventional SDDC and effective to extract discriminative features from outlier samples. Experiments conducted on FERET and ORL face databases demonstrate the effectiveness of the proposed method.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Chen LF, Liao HYM, Ko MT et al (2000) A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recogn 33(10):1713–1726
Yu H, Yang J (2001) A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recogn 34(10):2067–2070
Zhao W, Chellappa R, Phillips J (1999) Subspace linear discriminant analysis for face recognition. Technical Report CS-TR4009, University of Maryland
Yang J, Yang JY (2003) Why can LDA be performed in PCA transformed space? Pattern Recogn 36(2):563–566
Zhuang XS, Dai DQ (2007) Improved discriminant analysis for high-dimensional data and its application to face recognition. Pattern Recogn 40(5):1570–1578
Swets DL, Weng J (1996) Using discriminant eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18(8):831–836
Belhumeur V, Hespanha J, Kriegman D (1997) Eigenfaces vs fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720
Song FX, Cheng K, Yang JY et al (2004) Maximum scatter difference, large margin linear projection and support vector machines. Acta automatica sinica 30(6):890–896 (in Chinese)
Zhang X-D (2004) Matrix analysis and application (in Chinese). Tsinghua University Press, Beijing
Heo G, Gader P (2011) Robust kernel discriminant analysis using fuzzy memberships. Pattern Recogn 44(3):716–723
Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37
Yang J, Zhang D, Yong X, Yang JY (2005) Two-dimensional discriminant transform for face recognition. Pattern Recogn 38(7):1125–1129
Guru DS, Suraj MG, Manjunath S (2011) Fusion of covariance matrices of PCA and FLD. Pattern Recogn Lett 32(3):432–440
Phillips PJ (2006) The facial recognition technology (FERET) database. http://www.itl.nist.gov/iad/humanid/feret/feret_master.html
The ORL face database. http://www.cam_orl.co.uk/facedatabase.html
Chen Z-P, Jiang J-H, Li Y et al (1999) Fuzzy linear discriminant analysis for chemical data sets. Chemometrics Intell Lab Syst 45(1–2):295–302
Yang WK, Yan XY, Zhang L, Sun CY (2010) Feature extraction based on fuzzy 2DLDA. Neurocomputing 73:1556–1561
Wang JG, Yang WK, Yang JY (2008) Fuzzy maximum scatter discriminant analysis and its application to face recognition. ICPR
He XF, Yan SC, Hu YX, Zhang HJ (2005) Face recognition using laplacian faces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340
Zhi R, Ruan Q, Miao Z (2008) Fuzzy discriminant projections for facial expression recognition. ICPR
Li X, Fei S, Zhang T (2009) Median MSD-based method for face recognition. Neurocomputing 72(16-18):3930–3934
Kw KC, Pedry W (2005) Face recognition using a fuzzy fisher classifier. Pattern Recogn 38(10):1717–1732
Zheng Y, Yang J et al (2006) Fuzzy Kernel Fisher Discriminant algorithm with application to face recognition. The 6th world Congress on Intelligent and Automation(WCICA06) 12(12): 9669–9672
Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New York
Keller JM, Gray MR, Givens JR (1985) A fuzzy k-nearest neighbor algorithm. IEEE Trans Syst Man Cybern 15(4):580–585
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326
Tenenbaum JB, deSilva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323
Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396
Bengio Y, Paiement JF, Vincent P et al (2004) Out-of-sample extensions for LLE, isomap, MDS, eigenmaps, and spectral clustering. Neural Comput 16(10):2197–2219
Yu W, Teng X, Liu C (2006) Face recognition using discriminant locality preserving projections. Image Vis Comput 24(3):239–248
Hu H (2008) Orthogonal neighborhood preserving discriminant analysis for face recognition. Pattern Recogn 41(6):2045–2054
Xu Y, Feng G, Zhao Y (2009) One improvement to two-dimensional locality preserving projection method for use with face recognition. Neurocomputing 73(1–3):245–249
Xu Y, Song F, Feng G, Zhao Y (2010) A novel local preserving projection scheme for use with face recognition. Expert Syst Appl 37:6718–6721
Xu Y, Zhong A, Yang J, Zhang D (2010) LPP solution schemes for use with face recognition. Pattern Recogn 43(12):4165–4176
Acknowledgments
This work was supported by the National Natural Science Foundation P.R. China under Grant No. 60632050; the Research Program of Hebei Education Department under Grant Nos. Z2009141 and Z2010174; and the Research Program of Hebei Municipal Science & Technology Department under Grant No. 10213551.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, J., Yang, W. & Yang, J. Face recognition using fuzzy maximum scatter discriminant analysis. Neural Comput & Applic 23, 957–964 (2013). https://doi.org/10.1007/s00521-012-1020-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-012-1020-4