Skip to main content

Discriminative and Robust Analysis Dictionary Learning for Pattern Classification

  • Conference paper
  • First Online:
  • 1865 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13532))

Abstract

Analysis dictionary learning (ADL) model has attracted much interest from researchers in representation-based classification due to its scalability and efficiency in out-of-sample classification. However, the discrimination of the analysis representation is not fully explored when roughly consider the supervised information with redundant and noisy samples. In this paper, we propose a discriminative and robust analysis dictionary learning model (DR-ADL), which explores the underlying structural information of data samples. Firstly, the supervised latent structural term is first implicitly considered to generate a roughly block-diagonal representation for intra-class samples. However, this discriminative structure is fragile and weak in the presence of noisy and redundant samples. Concentrating on both intra-class and inter-class information, we then explicitly incorporate an off-block suppressing term on the ADL model for discriminative structure representation. Moreover, non-negative constraint is incorporated on representations to ensure a reasoning explanation for the contributions of each atoms. Finally, the DR-ADL model is alternatively solved by the K-SVD method, iterative re-weighted method and gradient method efficiently. Experimental results on four benchmark face datasets classification validate the performance superiority of our DR-ADL model.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54(11), 4311–4322 (2006)

    Article  Google Scholar 

  2. Chen, Z., Wu, X.J., Cai, Y.H., Kittler, J.: Sparse non-negative transition subspace learning for image classification. Signal Process. 183 (2021)

    Google Scholar 

  3. Chen, Z., Wu, X.J., Kittler, J.: Relaxed block-diagonal dictionary pair learning with locality constraint for image recognition. In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1–15 (2021)

    Google Scholar 

  4. Guo, J., Guo, Y., Kong, X., Zhang, M., He, R.: Discriminative analysis dictionary learning. In: Schuurmans, D., Wellman, M.P. (eds.) Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 12–17 February 2016, Phoenix, Arizona, USA, pp. 1617–1623. AAAI Press (2016)

    Google Scholar 

  5. Hawe, S., Kleinsteuber, M., Diepold, K.: Analysis operator learning and its application to image reconstruction. IEEE Trans. Image Process. 22(6), 2138–2150 (2013)

    Google Scholar 

  6. Jiang, Z., Lin, Z., Davis, L.S.: Label consistent k-SVD: learning a discriminative dictionary for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2651–2664 (2013)

    Google Scholar 

  7. Kong, S., Wang, D.: dictionary learning approach for classification: separating the particularity and the commonality. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 186–199. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33718-5_14

  8. Li, Z., Lai, Z., Xu, Y., Yang, J., Zhang, D.: A locality-constrained and label embedding dictionary learning algorithm for image classification. IEEE Trans. Neural Netw. Learn. Syst. 28(2), 278–293 (2017)

    Google Scholar 

  9. Ravishankar, S., Bresler, Y.: Learning sparsifying transforms. IEEE Trans. Signal Process. 61(5), 1072–1086 (2013)

    Google Scholar 

  10. Rubinstein, R., Peleg, T., Elad, M.: Analysis k-SVD: a dictionary-learning algorithm for the analysis sparse model. IEEE Trans. Signal Process. 61(3), 661–677 (2013)

    Google Scholar 

  11. Sadanand, S., Corso, J.J.: Action bank: a high-level representation of activity in video. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1234–1241 (2012)

    Google Scholar 

  12. Shekhar, S., Patel, V.M., Chellappa, R.: Analysis sparse coding models for image-based classification. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 5207–5211 (2014)

    Google Scholar 

  13. Tang, W., Panahi, A., Krim, H., Dai, L.: Analysis dictionary learning based classification: Structure for robustness. IEEE Trans. Image Process. 28(12), 6035–6046 (2019)

    Google Scholar 

  14. Wang, J., Guo, Y., Guo, J., Li, M., Kong, X.: Synthesis linear classifier based analysis dictionary learning for pattern classification. Neurocomputing 238, 103–113 (2017)

    Google Scholar 

  15. Wang, J., Guo, Y., Guo, J., Luo, X., Kong, X.: Class-aware analysis dictionary learning for pattern classification. IEEE Signal Process. Lett. 24(12), 1822–1826 (2017)

    Google Scholar 

  16. Wang, Q., Guo, Y., Guo, J., Kong, X.: Synthesis k-SVD based analysis dictionary learning for pattern classification. Multim. Tools Appl. 77(13), 17023C17041 (2018)

    Google Scholar 

  17. Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Patt. Anal. Mach. Intell. 31(2), 210–227 (2009)

    Google Scholar 

  18. Xu, J., An, W., Zhang, L., Zhang, D.: Sparse, collaborative, or nonnegative representation: which helps pattern classification? Patt. Recogn. 88, 679–688 (2019)

    Google Scholar 

  19. Yang, M., Zhang, L., Feng, X., Zhang, D.: Fisher discrimination dictionary learning for sparse representation. In: 2011 International Conference on Computer Vision, pp. 543–550 (2011)

    Google Scholar 

  20. Yi, Y., Wang, J., Zhou, W., Zheng, C., Kong, J., Qiao, S.: Non-negative matrix factorization with locality constrained adaptive graph. IEEE Trans. Circ. Syst. Video Technol. 30(2), 427–441 (2020)

    Google Scholar 

  21. Zhang, L., Yang, M., Feng, X.: Sparse representation or collaborative representation: which helps face recognition? In: Proceedings of the 2011 International Conference on Computer Vision, ICCV 2011, pp. 471–478, IEEE Computer Society, USA (2011)

    Google Scholar 

  22. Zhang, Q., Li, B.: Discriminative k-svd for dictionary learning in face recognition. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2691–2698 (2010)

    Google Scholar 

  23. Zhuang, L., Gao, H., Lin, Z., Ma, Y., Zhang, X., Yu, N.: Non-negative low rank and sparse graph for semi-supervised learning. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2328–2335 (2012)

    Google Scholar 

Download references

Acknowledgement

This work is supported by the Natural Science Basic Research Program of Shaanxi, China (Program No. 2021JM-339).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kun Jiang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jiang, K., Zhu, L., Liu, Z. (2022). Discriminative and Robust Analysis Dictionary Learning for Pattern Classification. In: Pimenidis, E., Angelov, P., Jayne, C., Papaleonidas, A., Aydin, M. (eds) Artificial Neural Networks and Machine Learning – ICANN 2022. ICANN 2022. Lecture Notes in Computer Science, vol 13532. Springer, Cham. https://doi.org/10.1007/978-3-031-15937-4_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-15937-4_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-15936-7

  • Online ISBN: 978-3-031-15937-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics