Skip to main content
SpringerLink
Log in

Image-set based face recognition using K-SVD dictionary learning

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

With rapid development of digital imaging and communication technologies, image set based face recognition (ISFR) is becoming increasingly important and popular. On one hand, easy capture of large number of samples for each subject in training and testing makes us have more information for possible utilization. On the other hand, this large size of data will eventually increase training and classification time and possibly reduce the recognition rate if they are not used appropriately. In this paper, a new face recognition approach is proposed based on the K-SVD dictionary learning to solve this large sample problem by using joint sparse representation. The core idea of this proposed approach is to learn variation dictionaries from gallery and probe face images separately, and then we propose an improved joint sparse representation, which employs the information learned from both gallery and probe samples effectively. Finally, the proposed method is compared with some related methods on several popular face databases, including YaleB, AR, CMU-PIE, Georgia and LFW databases. The experimental results show that the proposed method outperforms several related face recognition methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458

    Article  Google Scholar 

  2. Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol 1. IEEE, pp. 947–954

  3. Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: A survey. Pattern Recogn 39(9):1725–1745

    Article  MATH  Google Scholar 

  4. Gao S, Tsang IW-H, Chia L-T (2010) Kernel sparse representation for image classification and face recognition. In: European Conference on Computer Vision, Springer, New York, pp 1–14

  5. Naseem I, Togneri R, Bennamoun M (2010) Linear regression for face recognition. IEEE Trans Pattern Anal Mach Intell 32(11):2106–2112

    Article  Google Scholar 

  6. Zhang L, Yang M, Feng X (2011) Sparse representation or collaborative representation: which helps face recognition? In: 2011 International Conference on Computer Vision, IEEE, pp 471–478

  7. Peng X, Zhang L, Yi Z, Tan KK (2014) Learning locality-constrained collaborative representation for robust face recognition. Pattern Recogn 47(9):2794–2806

    Article  Google Scholar 

  8. Hadid A, Pietikainen M (2004) From still image to video-based face recognition: an experimental analysis. In: Automatic Face and Gesture Recognition. Proceedings Sixth IEEE International Conference on IEEE, pp 813–818

  9. Arandjelovic O, Shakhnarovich G, Fisher J, Cipolla R, Darrell T (2005) Face recognition with image sets using manifold density divergence. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol 1. IEEE, pp 581–588

  10. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  11. Wang X, Yang M, Shen L (2016) Structured regularized robust coding for face recognition. Neurocomputing 216:18–27

    Article  Google Scholar 

  12. Mi J-X, Liu T (2016) Multi-step linear representation-based classification for face recognition. IET Comput Vision 10(8):836–841

    Article  Google Scholar 

  13. Chen S, Liu J, Zhou Z-H (2004) Making flda applicable to face recognition with one sample per person. Pattern Recogn 37(7):1553–1555

    Article  Google Scholar 

  14. Gao Q-X, Zhang L, Zhang D (2008) Face recognition using flda with single training image per person. Appl Math Comput 205(2):726–734

    MATH  Google Scholar 

  15. Su Y, Shan S, Chen X, Gao W (2010) Adaptive generic learning for face recognition from a single sample per person. CVPR 2010:2699–2706

    Google Scholar 

  16. Majumdar A, Ward RK (2008) Pseudo-fisherface method for single image per person face recognition. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE, pp 989–992

  17. Deng W, Hu J, Guo J (2012) Extended src: undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864–1870

    Article  Google Scholar 

  18. Deng W, Hu J, Guo J (2013) In defense of sparsity based face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 399–406

  19. Yang M, Van Gool L, Zhang L (2013) Sparse variation dictionary learning for face recognition with a single training sample per person. In: Proceedings of the IEEE international conference on computer vision, pp 689–696

  20. Zhuang L, Chan T-H, Yang AY, Sastry SS, Ma Y (2015) Sparse illumination learning and transfer for single-sample face recognition with image corruption and misalignment. Int J Comput Vision 114(2–3):272–287

    Article  MathSciNet  MATH  Google Scholar 

  21. Ding R-X, Du DK, Huang Z-H, Li Z-M, Shang K (2015) Variational feature representation-based classification for face recognition with single sample per person. J Vis Commun Image Represent 30:35–45

    Article  Google Scholar 

  22. Li Z-M, Huang Z-H, Shang K A customized sparse representation model with mixed norm for undersampled face recognition

  23. Lu J, Tan Y-P, Wang G, Yang G (2013) Image-to-set face recognition using locality repulsion projections and sparse reconstruction-based similarity measure. IEEE Trans Circuits Syst Video Technol 23(6):1070–1080

    Article  Google Scholar 

  24. Wang R, Shan S, Chen X, Gao W (2008) Manifold-manifold distance with application to face recognition based on image set. In: Computer Vision and Pattern Recognition. CVPR IEEE Conference on IEEE, pp 1–8

  25. Cevikalp H, Triggs B (2010) Face recognition based on image sets. In: Computer vision and pattern recognition (CVPR), IEEE Conference on IEEE, pp 2567–2573

  26. Hu Y, Mian AS, Owens R (2011) Sparse approximated nearest points for image set classification. In: Computer vision and pattern recognition (CVPR), IEEE conference on IEEE, pp 121–128

  27. Hu Y, Mian AS, Owens R (2012) Face recognition using sparse approximated nearest points between image sets. IEEE Trans Pattern Anal Mach Intell 34(10):1992–2004

    Article  Google Scholar 

  28. Wang R, Guo H, Davis LS, Dai Q (2012) Covariance discriminative learning: a natural and efficient approach to image set classification. In: Computer vision and pattern recognition (CVPR), 2012 IEEE Conference on IEEE, pp 2496–2503

  29. Huang L, Lu J, Tan Y-P (2014) Co-learned multi-view spectral clustering for face recognition based on image sets. IEEE Signal Process Lett 21(7):875–879

    Article  Google Scholar 

  30. Kim T-K, Kittler J, Cipolla R (2007) Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans Pattern Anal Mach Intell 29(6):1005–1018

    Article  Google Scholar 

  31. Zhang H, Nasrabadi NM, Zhang Y, Huang TS (2012) Joint dynamic sparse representation for multi-view face recognition. Pattern Recogn 45(4):1290–1298

    Article  Google Scholar 

  32. Zhang X, Pham D-S, Venkatesh S, Liu W, Phung D (2015) Mixed-norm sparse representation for multi view face recognition. Pattern Recogn 48(9):2935–2946

    Article  Google Scholar 

  33. Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments, Tech. rep., Technical Report 07-49, University of Massachusetts, Amherst

  34. Kim S-J, Koh K, Lustig M, Boyd S, Gorinevsky D (2007) An interior-point method for large-scale-regularized least squares. IEEE J Sel Topics Sig Process 1(4):606–617

    Article  Google Scholar 

  35. Nefian A (2013) Georgia tech face database

  36. Chen Y-C, Patel VM, Phillips PJ, Chellappa R (2012) Dictionary-based face recognition from video. European conference on computer vision, Springer, New York, pp 766–779

  37. Martinez AM, The ar face database, CVC Technical Report 24

  38. Donoho D, Tsaig Y (2006) Fast solution of l1-norm minimization problems when the solution may be sparse, Preprint 1(2)

  39. Yang M, Chang H, Luo W (2017) Discriminative analysis-synthesis dictionary learning for image classification. Neurocomputing 219:404–411

    Article  Google Scholar 

  40. Li Z, Lai Z, Xu Y, Yang J, Zhang D (2017) A locality-constrained and label embedding dictionary learning algorithm for image classification. IEEE Trans Neural Netw Learn Syst 28(2):278–293

    Article  MathSciNet  Google Scholar 

  41. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  42. Fan Z, Ni M, Zhu Q, Liu E (2015) Weighted sparse representation for face recognition. Neurocomputing 151:304–309

    Article  Google Scholar 

  43. Zhu P, Zhang L, Hu Q, Shiu SC (2012) Multi-scale patch based collaborative representation for face recognition with margin distribution optimization. European Conference on Computer Vision, Springer, New York, pp 822–835

  44. Huang S-M, Yang J-F (2013) Linear discriminant regression classification for face recognition. IEEE Signal Process Lett 20(1):91–94

    Article  Google Scholar 

  45. Yang M, Zhang L, Yang J, Zhang D (2013) Regularized robust coding for face recognition. IEEE Trans Image Process 22(5):1753–1766

    Article  MathSciNet  MATH  Google Scholar 

  46. Lai J, Jiang X (2012) Modular weighted global sparse representation for robust face recognition. IEEE Signal Process Lett 19(9):571–574

    Article  Google Scholar 

  47. Zhu P, Zuo W, Zhang L, Shiu SC-K, Zhang D (2014) Image set-based collaborative representation for face recognition. IEEE Trans Inf Forensics Secur 9(7):1120–1132

    Article  Google Scholar 

  48. Kan M, Shan S, Su Y, Chen X, Gao W (2011) Adaptive discriminant analysis for face recognition from single sample per person, In: Automatic Face and Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on IEEE, pp. 193–199

  49. Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recogn 46(9):2497–2509

    Article  Google Scholar 

  50. Gao S, Jia K, Zhuang L, Ma Y (2015) Neither global nor local: regularized patch-based representation for single sample per person face recognition. Int J Comput Vision 111(3):365–383

    Article  MathSciNet  Google Scholar 

  51. Jin Y, Lu J, Ruan Q (2015) Coupled discriminative feature learning for heterogeneous face recognition. IEEE Trans Inf Forensics Secur 10(3):640–652

    Article  Google Scholar 

  52. Aharon M, Elad M, Bruckstein A (2006) \(rm k\)-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322

    Article  MATH  Google Scholar 

  53. Shekhar S, Patel VM, Nasrabadi NM, Chellappa R (2014) Joint sparse representation for robust multimodal biometrics recognition. IEEE Trans Pattern Anal Mach Intell 36(1):113–126

    Article  Google Scholar 

  54. Chen C, He B, Ye Y, Yuan X (2016) The direct extension of admm for multi-block convex minimization problems is not necessarily convergent. Math Program 155(1–2):57–79

    Article  MathSciNet  MATH  Google Scholar 

  55. Martinez A, Benavente R (1998) The ar face database, 1998. Computer Vision Center, Technical Report, p 3

  56. Sim T, Baker S, Bsat M (2002) The cmu pose, illumination, and expression (pie) database. In: Automatic Face and Gesture Recognition. Proceedings Fifth IEEE International Conference on IEEE, pp. 46–51

  57. Rakotomamonjy A (2011) Surveying and comparing simultaneous sparse approximation (or group-lasso) algorithms. Sig Process 91(7):1505–1526

    Article  MATH  Google Scholar 

  58. Li Z-M, Huang Z-H, Shang K (2016) A customized sparse representation model with mixed norm for undersampled face recognition. IEEE Trans Inf Forensics Secur 11(10):2203–2214

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by the National Natural Science Foundation of China with Grant Nos. 61671285 and 61363066.

Author information

Authors and Affiliations

  1. School of Mechatronical Engineering and Automation, Shanghai University, Shanghai, China

    Jingjing Liu, Shiwei Ma, Meixi Wang & Guanghua Chen

  2. Department of Computing, Curtin University, Perth, WA, USA

    Wanquan Liu & Ling Li

Authors
  1. Jingjing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wanquan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiwei Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Meixi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ling Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Guanghua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wanquan Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, J., Liu, W., Ma, S. et al. Image-set based face recognition using K-SVD dictionary learning. Int. J. Mach. Learn. & Cyber. 10, 1051–1064 (2019). https://doi.org/10.1007/s13042-017-0782-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-017-0782-5

Keywords

Search

Navigation