Skip to main content
SpringerLink
Log in

A Novel Nonlinear Dictionary Learning Algorithm Based on Nonlinear-KSVD and Nonlinear-MOD

  • Conference paper
  • First Online:
Artificial Intelligence (CICAI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13606))

Included in the following conference series:

Abstract

At present, scholars have proposed numerous linear dictionary learning methods. In the field of dictionary learning, linear dictionary learning is the most commonly applied method, and it is typically utilized to address various signal processing problems. However, linear dictionary learning cannot meet the requirements of nonlinear signal processing, and the nonlinear signals cannot be accurately simulated and processed. In this study, we first construct a nonlinear dictionary learning model. Then we propose two algorithms to solve the optimization problem. In the dictionary update stage, based on the K-SVD and the method of optimal directions (MOD), we design nonlinear-KSVD (NL-KSVD) and nonlinear-MOD (NL-MOD) algorithms to update the dictionary. In the sparse coding stage, the nonlinear orthogonal matching pursuit (NL-OMP) algorithm is designed to update the coefficient. Numerical experiments are used to verify the effectiveness of the proposed nonlinear dictionary learning algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhao, H., Ding, S., Li, X., Huang, H.: Deep neural network structured sparse coding for online processing. IEEE Access 6, 74778–74791 (2018)

    Article  Google Scholar 

  2. Li, Z., Zhao, H., Guo, Y., Yang, Z., Xie, S.: Accelerated log-regularized convolutional transform learning and its convergence guarantee. IEEE Trans. Cybern. (2021)

    Google Scholar 

  3. Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Sig. Process. 54, 4311–4322 (2006)

    Article  MATH  Google Scholar 

  4. Engan, K., Rao, B.D., Kreutz-Delgado, K.: Frame design using FOCUSS with method of optimal directions (MOD), In: Proc. NORSIG, Citeseer, pp. 65–69 (1999)

    Google Scholar 

  5. Dumitrescu, B., Irofti, P.: Dictionary Learning Algorithms and Applications. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78674-2

  6. Elad, M.: Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. Springer, New York (2010). https://doi.org/10.1007/978-1-4419-7011-4

  7. Li, X., Ding, S., Li, Z., Tan, B.: Device-free localization via dictionary learning with difference of convex programming. IEEE Sens. J. 17, 5599–5608 (2017)

    Google Scholar 

  8. Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE computer Society Conference on Computer Vision and Pattern Recognition, pp. 2691–2698. IEEE (2010)

    Google Scholar 

  9. Zhang, Z., Xu, Y., Yang, J., Li, X., Zhang, D.: A survey of sparse representation: algorithms and applications. IEEE Access 3, 490–530 (2015)

    Article  Google Scholar 

  10. Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Discriminative learned dictionaries for local image analysis. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008)

    Google Scholar 

  11. Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1794–1801. IEEE (2009)

    Google Scholar 

  12. Zhang, K., Tan, B., Ding, S., Li, Y., Li, G.: Cybernetics, device-free indoor localization based on sparse coding with nonconvex regularization and adaptive relaxation localization criteria. Int. J. Mach. Learn. I, 1–15 (2022)

    Google Scholar 

  13. Hu, J., Tan, Y.-P.: Nonlinear dictionary learning with application to image classification. Pattern Recogn. 75, 282–291 (2018)

    Article  Google Scholar 

  14. Tan, B., Li, Y., Zhao, H., Li, X., Ding, S.: A novel dictionary learning method for sparse representation with nonconvex regularizations. Neurocomputing 417, 128–141 (2020)

    Article  Google Scholar 

  15. Tropp, J.A.: Greed is good: algorithmic results for sparse approximation. IEEE Trans. Inf. Theory 50, 2231–2242 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  16. Wang, J., Kwon, S., Shim, B.: Generalized orthogonal matching pursuit. IEEE Trans. Sig. Process. 60, 6202–6216 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  17. Daubechies, I., Defrise, M., De Mol, C.: An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun. Pure 57, 1413–1457 (2004)

    Google Scholar 

  18. Cui, A., Peng, J., Li, H., Wen, M., Jia, A. J.: Mathematics, Iterative thresholding algorithm based on non-convex method for modified lp-norm regularization minimization, 347, 173–180 (2019)

    Google Scholar 

  19. Selesnick, I.: Sparse regularization via convex analysis. IEEE Trans. Sig. Process. 65, 4481–4494 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  20. Li, Z., Ding, S., Hayashi, T., Li, Y.: Incoherent dictionary learning with log-regularizer based on proximal operators. Digit. Sig. Process. 63, 86–99 (2017)

    Article  Google Scholar 

  21. Kreutz-Delgado, K., Murray, J.F., Rao, B.D., Engan, K., Lee, T.-W., Sejnowski, T.: Dictionary learning algorithms for sparse representation. Neural Comput. 15, 349–396 (2003)

    Article  MATH  Google Scholar 

  22. Van Nguyen, H., Patel, V.M., Nasrabadi, N.M., Chellappa, R.: Kernel dictionary learning. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2021–2024. IEEE (2012)

    Google Scholar 

  23. Cai, S., Weng, S., Luo, B., Hu, D., Yu, S., Xu, S.: A dictionary-learning algorithm based on method of optimal directions and approximate K-SVD. In: 2016 35th Chinese control conference (CCC), pp. 6957–6961. IEEE (2016)

    Google Scholar 

  24. Yaghoobi, M., Blumensath, T., Davies, M.E.: Dictionary learning for sparse approximations with the majorization method. IEEE Trans. Sig. Process. 57, 2178–2191 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  25. Li, Z., Yang, Z., Zhao, H., Xie, L.S.: Systems, direct-optimization-based dc dictionary learning with the MCP Regularizer (2021)

    Google Scholar 

  26. Rakotomamonjy, A.: Direct optimization of the dictionary learning problem. IEEE Trans. Sig. Process. 61, 5495–5506 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  27. Hu, J., Tan, Y.-P.: Nonlinear dictionary learning with application to image classification, 75, 282–291 (2018)

    Google Scholar 

  28. Zhang, H., Liu, H., Song, R., et al.: Nonlinear dictionary learning based deep neural networks. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 3771–3776. IEEE (2016)

    Google Scholar 

  29. Liu, H., Liu, H., Sun, F., et al.: Kernel regularized nonlinear dictionary learning for sparse coding. IEEE Trans. Syst. Man Cybern. Syst. 49(4), 766–775 (2017)

    Article  Google Scholar 

  30. Tropp, J.A., Gilbert, A.C.: Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 53, 4655–4666 (2007)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This research was partially funded by the Guangxi Postdoctoral Special Foundation and the National Natural Science Foundation of China under Grants 61903090 and 62076077, respectively.

Author information

Authors and Affiliations

  1. School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin, 541004, China

    Xiaoju Chen, Yujie Li, Shuxue Ding, Benying Tan & Yuqi Jiang

Authors
  1. Xiaoju Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yujie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shuxue Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Benying Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuqi Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Benying Tan .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Lu Fang

  2. Xiaomi Inc., Beijing, China

    Daniel Povey

  3. Shanghai Jiao Tong University, Shanghai, China

    Guangtao Zhai

  4. JD Explore Academy, Beijing, China

    Tao Mei

  5. Chinese Academy of Sciences, Beijing, China

    Ruiping Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, X., Li, Y., Ding, S., Tan, B., Jiang, Y. (2022). A Novel Nonlinear Dictionary Learning Algorithm Based on Nonlinear-KSVD and Nonlinear-MOD. In: Fang, L., Povey, D., Zhai, G., Mei, T., Wang, R. (eds) Artificial Intelligence. CICAI 2022. Lecture Notes in Computer Science(), vol 13606. Springer, Cham. https://doi.org/10.1007/978-3-031-20503-3_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-20503-3_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-20502-6

  • Online ISBN: 978-3-031-20503-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation