Skip to main content
SpringerLink
Log in

Embedded Manifold-Based Kernel Fisher Discriminant Analysis for Face Recognition

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Manifold learning algorithms mainly focus on discovering the intrinsic low-dimensional manifold embedded in the high-dimensional Euclidean space. Among them, locally linear embedding (LLE) is one of the most promising dimensionality reduction methods. Though LLE holds local neighborhood information, it doesn’t fully take the label information and the global structure information into account for classification tasks. To enhance classification performance, this paper proposes a novel dimensionality reduction method for face recognition, termed embedded manifold-based kernel Fisher discriminant analysis, or EMKFDA for short. The goal of EMKFDA is to emphasize the local geometry structure of the data while utilizing the global discriminative structure obtained from linear discriminant analysis, which can maximize the between-class scatter and minimize the within-class scatter. In addition, by optimizing an objective function in a kernel feature space, nonlinear features can be extracted. Thus, EMKFDA, which combines manifold criterion and Fisher criterion, has better discrimination, and is more suitable for recognition tasks. Experiments on the ORL, Yale, and FERET face databases show the impressive performance of the proposed method. Results show that this proposed algorithm exceeds other popular approaches reported in the literature and achieves much higher recognition accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458

    Article  Google Scholar 

  2. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Article  Google Scholar 

  3. Belhumeour PN, Hedpsnhs JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  4. Howland P, Wang JL, Park H (2006) Solving the small sample size problem in face recognition using generalized discriminant analysis. Pattern Recognit 39(2):277–287

    Article  Google Scholar 

  5. Liang YX, Li CR, Gong WG, Pan YJ (2007) Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion. Pattern Recognit 40(12):3606–3625

    Article  MATH  Google Scholar 

  6. Zhao W, Zhao L, Zou C (2004) An efficient algorithm to solve the small sample size problem for LDA. Pattern Recognit 37(5):1077–1079

    Article  MATH  Google Scholar 

  7. Ye J, Li Q (2005) A two-stage linear discriminant analysis via QR-decomposition. IEEE Trans Pattern Anal Mach Intell 27(6):929–941

    Article  Google Scholar 

  8. Scholkopf B, Smola A, Muller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319

    Article  Google Scholar 

  9. Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404

    Article  Google Scholar 

  10. Tenebaum J, Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323

    Article  Google Scholar 

  11. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326

    Article  Google Scholar 

  12. Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Proceedings of neural information processing systems, Vancouver, pp 585–591

  13. Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396

    Article  MATH  Google Scholar 

  14. Weinberger K, Saul L (2004) Unsupervised learning of image manifolds by semidefinite programming. In: Proceedings of the IEEE international conference computer vision and pattern recognition, vol 2, pp 988–985

  15. Zhang Z, Zha H (2005) Principal manifolds and nonlinear dimensionality reduction via local tangent space alignment. SIAM J Sci Comput 26(1):313–318

    Article  MathSciNet  Google Scholar 

  16. Zhang TH, Li XL, Tao DC, Yang J (2008) Local coordinates alignment (LCA): a novel method for manifold learning. Int J Pattern Recognit Artif Intell 22(4):667–690

    Article  Google Scholar 

  17. Xiang SM, Nie FP, Xiang SM, Zhuang YT, Wang WH (2009) Nonlinear dimensionality reduction with local spline embedding. IEEE Trans Knowl Data Eng 21(9):1285–1298

    Article  Google Scholar 

  18. He X, Cai D, Yan S, Zhang H (2005) Neighborhood preserving embedding. In: Proceedings of the IEEE international conference computer vision, pp 1208–1213

  19. He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340

    Article  Google Scholar 

  20. Chen HT, Chang HW, Liu TL (2005) Local discriminant embedding and its variants. In: Proceedings of the conference on computer vision and pattern recognition, vol 2, pp 846–853

  21. Yan SC, Xu D, Zhang BY, Zhang HJ (2005) Graph embedding: a general framework for dimensionality reduction. In: Proceedings of the conference on computer vision and pattern recognition, vol 2, pp 20–25

  22. Cai D, He XF, Zhou K (2007) Locality sensitive discriminant analysis. In: Proceedings of the conference on artificial intelligence, pp 708–713

  23. Vapnik V (1995) The nature of statistical learning theory. Springer, New York

    Book  MATH  Google Scholar 

  24. The ORL face database. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html. Accessed 2004

  25. The Yale face database. http://cvc.yale.edu/projects/yalefaces/yalefaces.html. Accessed 2004

  26. Seung HS, Lee DD (2000) The manifold ways of perception. Science 290:2258–2259

    Article  Google Scholar 

  27. Zhang J, Li SZ, Wang J (2004) Manifold learning and applications in recognition. In: Intelligent multimedia processing with soft computing, vol 168, pp 281–300

  28. Li B, Huang DS (2008) Locally linear discriminant embedding: an efficient method for face recognition. Pattern Recognit 41(12):3813–3821

    Article  MATH  Google Scholar 

  29. Pang YW, Yu NH, Li HQ et al (2005) Face recognition using neighborhood preserving projections. In: Proceedings of pacific-rim conference on multimedia, vol 3768, pp 854–864

  30. Li H, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–165

    Article  Google Scholar 

  31. Saul LK, Roweis ST (2003) Think globally, fit locally: unsupervised learning of low dimensional manifolds. J Mach Learn Res 4:119–155

    MathSciNet  Google Scholar 

  32. The facial recognition technology (FERET) database. http://www.itl.nist.gov/iad/humanid/feret/feret_master.html. Accessed 2008

  33. Zhang TH, Tao DC, Li XL, Yang J (2008) A unifying framework for spectral analysis based dimensionality reduction. In: Proceedings of the international joint conference on neural networks, pp 1670–1677

Download references

Acknowledgments

This work is supported by the Young Core Instructor of Colleges and Universities in Henan Province Funding Scheme (No. 2011GGJS-173), the Science and Technology Project of Henan Province (No. 122102210138), Foundation of Henan Educational Committee (No. 14A520055), the Nation Scholarship Fund (No. 201308410352).

Author information

Authors and Affiliations

  1. Department of Computer and Information Engineering, Luoyang Institute of Science and Technology, Luoyang, 471023, People’s Republic of China

    Guoqiang Wang, Nianfeng Shi & Yunxing Shu

  2. Department of Electrical and Computer Engineering, University of Miami, Coral Gables, FL, 33124, USA

    Dianting Liu

Authors
  1. Guoqiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nianfeng Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunxing Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dianting Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yunxing Shu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, G., Shi, N., Shu, Y. et al. Embedded Manifold-Based Kernel Fisher Discriminant Analysis for Face Recognition. Neural Process Lett 43, 1–16 (2016). https://doi.org/10.1007/s11063-014-9398-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-014-9398-x

Keywords

Search

Navigation