Skip to main content
SpringerLink
Log in

Face recognition based on manifold constrained joint sparse sensing with K-SVD

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Face recognition based on Sparse representation idea has recently become an important research topic in computer vision community. However, the dictionary learning process in most of the existing approaches suffers from the perturbations brought by the variations of the input samples, since the consistence of the learned dictionaries from similar input samples based on K-SVD are not well addressed in the existing literature. In this paper, we will propose a novel technique for dictionary learning based on K-SVD to address the consistence issue. In particular, the proposed method embeds the manifold constraints into a standard dictionary learning framework based on k-SVD and force the optimization process to satisfy the structure preservation requirement. Therefore, this new approach can consistently integrate the manifold constraints during the optimization process, and it can contribute a better solution which is robust to the variance of the input samples. Extensive experiments on several popular face databases show a consistent performance improvement in comparison to some related state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Aharon M, Elad M, Bruckstein A (2006) R m k-svd: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322

    Article  Google Scholar 

  2. Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: NIPS, vol 14, pp 585–591

  3. Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7 (Nov):2399–2434

    MathSciNet  MATH  Google Scholar 

  4. Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends®;, in Machine Learning 3(1):1–122

    Article  Google Scholar 

  5. Cai S, Zuo W, Zhang L, Feng X, Wang P (2014) Support vector guided dictionary learning. In: European conference on computer vision, Springer, pp 624–639

  6. Cevikalp H, Triggs B (2010) Face recognition based on image sets. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 2567–2573

  7. Chen Y-C, Patel VM, Phillips PJ, Chellappa R (2012) Dictionary-based face recognition from video. In: European conference on computer vision, Springer, pp 766–779

  8. Deng W, Hu J, Guo J (2012) Extended src: Undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864–1870

    Article  Google Scholar 

  9. Deng W, Hu J, Guo J (2013) In defense of sparsity based face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 399–406

  10. Ding R-X, Du DK, Huang Z-H, Li Z-M, Shang K (2015) Variational feature representation-based classification for face recognition with single sample per person. J Vis Commun Image Represent 30:35–45

    Article  Google Scholar 

  11. Donoho D, Tsaig Y (2006) Fast solution of l1-norm minimization problems when the solution may be sparse. Preprint, vol 1, no 2

  12. Engan K, Aase SO, Husoy JH (1999) Method of optimal directions for frame design. In: 1999 IEEE international conference on acoustics, speech, and signal processing, 1999. Proceedings, vol 5. IEEE, pp 2443–2446

  13. Gao S, Jia K, Zhuang L, Ma Y (2015) Neither global nor local: regularized patch-based representation for single sample per person face recognition. Int J Comput Vis 111(3):365–383

    Article  MathSciNet  Google Scholar 

  14. Gao S, Tsang IW-H, Chia L-T (2010) Kernel sparse representation for image classification and face recognition. In: European conference on computer vision, Springer, pp 1–14

  15. Gao S, Tsang IW-H, Chia L-T, Zhao P (2010) Local features are not lonely–laplacian sparse coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 3555–3561

  16. Hadid A, Pietikainen M (2004) From still image to video-based face recognition: an experimental analysis. In: 2004. Proceedings. Sixth IEEE international conference on automatic face and gesture recognition, IEEE, pp 813–818

  17. Hu Y (2012) Face recognition using sparse approximated nearest points between image sets. IEEE Trans Pattern Anal Mach Intell 34(10):1992–2004

    Article  Google Scholar 

  18. Hu Y, Mian AS, Owens R (2011) Sparse approximated nearest points for image set classification. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 121–128

  19. Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments, Technical Report 07-49, University of Massachusetts, Amherst, Tech. Rep.

  20. Huang K, Aviyente S (2006) Sparse representation for signal classification. In: NIPS, vol 19, pp 609–616

  21. Huang S-M, Yang J-F (2013) Linear discriminant regression classification for face recognition. IEEE Signal Process Lett 20(1):91–94

    Article  Google Scholar 

  22. Huang L, Lu J, Tan Y-P (2014) Co-learned multi-view spectral clustering for face recognition based on image sets. IEEE Signal Process Lett 21(7):875–879

    Article  Google Scholar 

  23. Kan M, Shan S, Su Y, Chen X, Gao W (2011) Adaptive discriminant analysis for face recognition from single sample per person. In: 2011 IEEE international conference on automatic face & gesture recognition and workshops (FG 2011), IEEE, pp 193–199

  24. Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recogn 46(9):2497–2509

    Article  Google Scholar 

  25. Kim S-J, Koh K, Lustig M, Boyd S, Gorinevsky D (2007) An interior-point method for large-scale-regularized least squares. IEEE J Sel Top Sign Proces 1(4):606–617

    Article  Google Scholar 

  26. Kim T-K, Kittler J, Cipolla R (2007) Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans Pattern Anal Mach Intell 29(6):1005–1018

    Article  Google Scholar 

  27. Li X, Mo L, Yuan X, Zhang J (2014) Linearized alternating direction method of multipliers for sparse group and fused lasso models. Comput Stat Data Anal 79:203–221

    Article  MathSciNet  Google Scholar 

  28. Li Z-M, Huang Z-H, Shang K (2016) A customized sparse representation model with mixed norm for undersampled face recognition. IEEE Trans Inf Forensics Secur 11(10):2203–2214

    Article  Google Scholar 

  29. Liu J, Liu W, Li Q, Ma S, Chen G (2016) Evaluation of k-svd with different embedded sparse representation algorithms. In: 2016 12th international conference on natural computation, fuzzy systems and knowledge discovery (ICNC-FSKD), IEEE, pp 426–432

  30. Liu J, Liu W, Ma S, Wang M, Li L, Chen G (2018) Image-set based face recognition using k-svd dictionary learning. Int J Mach Learn Cybern :1–14

  31. Long M, Ding G, Wang J, Sun J, Guo Y, Yu PS (2013) Transfer sparse coding for robust image representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 407–414

  32. Lu J, Wang G, Deng W, Moulin P, Zhou J (2015) Multi-manifold deep metric learning for image set classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1137–1145

  33. Luo X, Wohlberg B (2016) Convolutional laplacian sparse coding. In: 2016 IEEE Southwest symposium on image analysis and interpretation (SSIAI). IEEE, pp 133–136

  34. Maaten Lvd, Hinton G (2008) Visualizing data using t-sne. J Mach Learn Res 9(Nov):2579–2605

    MATH  Google Scholar 

  35. Martinez AM (1998) The ar face database. CVC Technical Report, vol 24

  36. Naseem I, Togneri R, Bennamoun M (2010) Linear regression for face recognition. IEEE Trans Pattern Anal Mach Intell 32(11):2106–2112

    Article  Google Scholar 

  37. Nefian A (2013) Georgia tech face database

  38. Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1. IEEE, pp 947–954

  39. Rakotomamonjy A (2011) Surveying and comparing simultaneous sparse approximation (or group-lasso) algorithms. Signal Process 91(7):1505–1526

    Article  Google Scholar 

  40. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

    Article  Google Scholar 

  41. Su Y, Shan S, Chen X, Gao W (2010) Adaptive generic learning for face recognition from a single sample per person. In: CVPR, pp 2699–2706

  42. Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745

    Article  Google Scholar 

  43. Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction . Science 290(5500):2319–2323

    Article  Google Scholar 

  44. Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 3360–3367

  45. Wang R, Shan S, Chen X, Gao W (2008) Manifold-manifold distance with application to face recognition based on image set. In: CVPR 2008. IEEE conference on computer vision and pattern recognition, 2008, IEEE, pp 1–8

  46. Wang R, Guo H, Davis LS, Dai Q (2012) Covariance discriminative learning: A natural and efficient approach to image set classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, pp 2496–2503

  47. Wang Z, Yang J, Nasrabadi N, Huang T (2013) A max-margin perspective on sparse representation-based classification. In: Proceedings of the IEEE international conference on computer vision, pp 1217–1224

  48. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IIEEE Trans Pattern Anal Mach Intell 31 (2):210–227

    Article  Google Scholar 

  49. Yang M, Zhang L, Yang J, Zhang D (2011) Robust sparse coding for face recognition. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 625–632

  50. Yang M, Van Gool L, Zhang L (2013) Sparse variation dictionary learning for face recognition with a single training sample per person. In: Proceedings of the IEEE international conference on computer vision, pp 689–696

  51. Yang M, Zhang L, Feng X, Zhang D (2014) Sparse representation based fisher discrimination dictionary learning for image classification. Int J Comput Vis 109(3):209–232

    Article  MathSciNet  Google Scholar 

  52. Yang L, Li C, Han J, Chen C, Ye Q, Zhang B, Cao X, Liu W (2017) Image reconstruction via manifold constrained convolutional sparse coding for image sets. IEEE Journal of Selected Topics in Signal Processing

  53. Zhang Q, Li B (2010) Discriminative k-svd for dictionary learning in face recognition. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 2691–2698

  54. Zhang H, Nasrabadi NM, Zhang Y, Huang TS (2012) Joint dynamic sparse representation for multi-view face recognition. Pattern Recogn 45(4):1290–1298

    Article  Google Scholar 

  55. Zhang B, Perina A, Murino V, Del Bue A (2015) Sparse representation classification with manifold constraints transfer. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4557–4565

  56. Zhang X, Pham D-S, Venkatesh S, Liu W, Phung D (2015) Mixed-norm sparse representation for multi view face recognition. Pattern Recogn 48(9):2935–2946

    Article  Google Scholar 

  57. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458

    Article  Google Scholar 

  58. Zhuang L, Chan T-H, Yang AY, Sastry SS, Ma Y (2015) Sparse illumination learning and transfer for single-sample face recognition with image corruption and misalignment. Int J Comput Vis 114(2-3):272–287

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This work was partially supported by the National Natural Science Foundation of China with Grant Nos.61671285, 61363066, 11671029 and 61603211.

Author information

Authors and Affiliations

  1. School of Mechatronical Engineering and Automation, Shanghai University, Shanghai, People’s Republic of China

    Jingjing Liu, Shiwei Ma, Guanghua Chen & Weimin Zeng

  2. Department of Computing, Curtin University, Perth, WA, Australia

    Wanquan Liu, Nadith Pathirage & Ling Li

  3. Xinjiang Vocational and Technical College of Communications, Wulumuqi, 831401, People’s Republic of China

    Chong Lu

  4. Department of Applied Mathematics, Beijing Jiaotong University, Beijing, People’s Republic of China

    Xianchao Xiu

Authors
  1. Jingjing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wanquan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiwei Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chong Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xianchao Xiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nadith Pathirage
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ling Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Guanghua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Weimin Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wanquan Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, J., Liu, W., Ma, S. et al. Face recognition based on manifold constrained joint sparse sensing with K-SVD. Multimed Tools Appl 77, 28863–28883 (2018). https://doi.org/10.1007/s11042-018-6071-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6071-9

Keywords

Search

Navigation