Skip to main content
SpringerLink
Log in

Multi-resolution dictionary learning method based on sample expansion and its application in face recognition

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In recent years, dictionary learning method has been widely applied to face recognition and achieved good performance. However, most dictionary learning methods have two problems. First, they focused on only the resolution of the original images and did not consider impact of different resolutions on dictionary performance. When the attained dictionary is used to solve practical application problems, the recognition result of real-world images that may have a large difference in resolution with the original images will be very disappointed. Second, function of the dictionary will decrease due to insufficient training samples. Considering the above problems, this paper proposes a multi-resolution dictionary learning method based on sample expansion. We convert the original images to different resolutions and generate a dictionary for each resolution. Similarly, a dictionary is also produced for each resolution of reasonable virtual images generated by the original images. Then, for a test sample, a simple and efficient score fusion scheme is used to combine scores of the original image and the virtual image to obtain the ultimate classification score. We have performed experiments on multiple face databases, and the results show that our method has better performance than some state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Moeini, A., Moeini, H.: Real-world and rapid face recognition toward pose and expression variations via feature library matrix. IEEE Trans. Inf. Forensics Secur. 10(5), 969–984 (2015)

    Article  Google Scholar 

  2. Ding, C., Xu, C., Tao, D.: Multi-task pose-invariant face recognition. IEEE Trans. Image Process. 24(3), 980–993 (2015)

    Article  MathSciNet  Google Scholar 

  3. Tan, X., Chen, S., Zhou, Z.H., et al.: Face recognition from a single image per person: a survey. Pattern Recognit. 39(9), 1725–1745 (2006)

    Article  Google Scholar 

  4. Kafai, M., An, L., Bhanu, B.: Reference Face Graph for Face Recognition. IEEE Press, Hoboken (2014)

    Book  Google Scholar 

  5. Yang, J., Zhang, D., et al.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 131–137 (2004)

    Article  Google Scholar 

  6. Xu, Y., Li, X., Yang, J., Lai, Z., Zhang, D.: Integrating conventional and inverse representation for face recognition. IEEE Trans. Cybern. 44(10), 1738–1746 (2014)

    Article  Google Scholar 

  7. Zhang, B., Qiao, Y.: Face recognition based on gradient gabor feature and Efficient Kernel Fisher analysis. Neural Comput. Appl. 19(4), 617–623 (2010)

    Article  Google Scholar 

  8. Zhang, L., Yang, M., Feng, X.: Sparse representation or collaborative representation: which helps face recognition?. In: IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain, November 6–13, 2011. IEEE (2011)

  9. Yang, J., Luo, L., Qian, J., Tai, Y., Zhang, F., Xu, Y.: Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans. Pattern Anal. Mach. Intell. 39(1), 156–171 (2017)

    Article  Google Scholar 

  10. Peng, Y., Li, L., Liu, S., et al.: Space-frequency domain based joint dictionary learning and collaborative representation for face recognition. Signal Process. 147, 101–109 (2018)

    Article  Google Scholar 

  11. You, X., Ou, W., Chen, C.L.P., et al.: Robust nonnegative patch alignment for dimensionality reduction. IEEE Trans. Neural Netw. Learn. Syst. 26(11), 2760–2774 (2015)

    Article  MathSciNet  Google Scholar 

  12. Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)

    Article  Google Scholar 

  13. Xu, Y., Zhang, D., Yang, J., Yang, J.-Y.: A two-phase test sample sparse representation method for use with face recognition. IEEE Trans. Circuits Syst. Video Technol. 21(9), 1255–1262 (2011)

    Article  MathSciNet  Google Scholar 

  14. Tang, D., Zhu, N., Yu, F., et al.: A novel sparse representation method based on virtual samples for face recognition. Neural Comput. Appl. 24(3–4), 513–519 (2014)

    Article  Google Scholar 

  15. Xu, Y., Zhang, Z., Lu, G., Yang, J.: Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification. Pattern Recognit. 54, 68–82 (2016)

    Article  Google Scholar 

  16. Ou, W., You, X., Tao, D., et al.: Robust face recognition via occlusion dictionary learning. Pattern Recognit. 47(4), 1559–1572 (2014)

    Article  Google Scholar 

  17. Wen, Y., Liu, W., Yang, M., et al.: Structured occlusion coding for robust face recognition. Neurocomputing 178(20), 11–24 (2016)

    Article  Google Scholar 

  18. Ou, W., Luan, X., Gou, J., et al.: Robust discriminative nonnegative dictionary learning for occluded face recognition. Pattern Recognit. Lett. 107(1), 41–49 (2018)

    Article  Google Scholar 

  19. Chang, H., Yang, M., Yang, J.: Learning a structure adaptive dictionary for sparse representation based classification. Neurocomputing 190, 124–131 (2016)

    Article  Google Scholar 

  20. Lin, G., Yang, M., Shen, L., et al.: Robust and discriminative dictionary learning for face recognition. Int. J. Wavelets Multiresolut. Inf. Process. 16, 1840004 (2018)

    Article  MathSciNet  Google Scholar 

  21. Pengyue, Z., Xinge, Y., Weihua, O., et al.: Sparse discriminative multi-manifold embedding for one-sample face identification. Pattern Recognit. 52, 249–259 (2016)

    Article  Google Scholar 

  22. Aharon, M., Elad, M., Bruckstein, A.M.: K-SVD: an algorithm for designing of over-complete dictionaries for sparse representation. IEEE Trans. Signal Proces. 54(11), 4311–4322 (2016)

    Article  Google Scholar 

  23. Jiang, Z., Lin, Z., Davis, L.S.: Learning a discriminative dictionary for sparse coding via label consistent K-SVD. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 1697–1704 (2011)

  24. Xu, Y., Li, Z., Tian, C., Yang, J.: Multiple vector representations of images and robust dictionary learning. Pattern Recognit. Lett. 128, 131–136 (2019)

    Article  Google Scholar 

  25. Lin, G., Yang, M., Yang, J., Shen, L., Xie, W.: Robust, discriminative and comprehensive dictionary learning for face recognition. Pattern Recognit. 81, 341–356 (2018)

    Article  Google Scholar 

  26. Luo, X., Xu, Y., Yang, J.: Multi-resolution dictionary learning for face recognition. Pattern Recognit. 93, 283–292 (2019)

    Article  Google Scholar 

  27. Xu, Y., Zhang, B., Zhong, Z.: Multiple representations and sparse representation for image classification. Pattern Recognit. Lett. 68, 9–14 (2015)

    Article  Google Scholar 

  28. Xu, Y., Zhu, X., Li, Z., Liu, G., Lu, Y., Liu, H.: Using the original and ‘symmetrical face’ training samples to perform representation based two-step face recognition. Pattern Recognit. 46(4), 1151–1158 (2013)

    Article  Google Scholar 

  29. Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)

    Article  Google Scholar 

  30. Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification. In: Proceedings of 1994 IEEE Workshop on Applications of Computer Vision, pp. 138–142. IEEE Computer Society Press (1994)

  31. Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (PIE) database. In: Proceedings of 5th IEEE International Conference on Automatic Face Gesture Recognition, pp. 46–51 (2002)

  32. Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2691–2698. IEEE (2010)

  33. Jiang, Z., Lin, Z., Davis, L.S.: Label consistent K-SVD: learning a discriminative dictionary for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2651–2664 (2013)

    Article  Google Scholar 

  34. Wang, D., Kong, S.: A classification-oriented dictionary learning model: explicitly learning the particularity and commonality across categories. Pattern Recognit. 47(2), 885–898 (2014)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Research Foundation for Advanced Talents of Guizhou University under Grant: (2016) No. 49, Key Disciplines of Guizhou Province—Computer Science and Technology (ZDXK [2018]007), Key Supported Disciplines of Guizhou Province—Computer Application Technology (No. QianXueWeiHeZi ZDXK[2016]20), and the work was also supported by National Natural Science Foundation of China (61462013, 61661010).

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, College of Computer Science and Technology, Guizhou University, Guiyang, China

    Yongjun Zhang, Shijun Zheng & Xuexue Zhang

  2. School of Mathematics and Big Data, Guizhou Education University, Guiyang, 550018, China

    Zhongwei Cui

  3. Big Data Science and Intelligent Engineering Research Institute, Guizhou Education University, Guiyang, 550018, China

    Zhongwei Cui

Authors
  1. Yongjun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shijun Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xuexue Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongwei Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongjun Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Zheng, S., Zhang, X. et al. Multi-resolution dictionary learning method based on sample expansion and its application in face recognition. SIViP 15, 307–313 (2021). https://doi.org/10.1007/s11760-020-01755-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01755-8

Keywords

Search

Navigation