Skip to main content
SpringerLink
Log in

A Collaborative Neurodynamic Approach to Sparse Coding

  • Conference paper
  • First Online:
Advances in Neural Networks – ISNN 2019 (ISNN 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11554))

Included in the following conference series:

Abstract

In this paper, a collaborative neurodynamic approach is proposed for sparse coding. As the formulated sparse coding optimization problem with \(l_{0}\)-norm objective function is NP-hard, it is reformulated as a global optimization problem based on an inverted Gaussian function. A group of neurodynamic optimization models is employed to solve the reformulated problem by gradually decreasing the value of the parameter of the inverted Gaussian function. The experimental results show the superior performance of the proposed approach.

This work was supported in part by the Research Grants Council of the Hong Kong Special Administrative Region of China, under Grants 11208517 and 11202318, in part by the National Natural Science Foundation of China under grant 61673330, and in part by International Partnership Program of Chinese Academy of Sciences under Grant GJHZ1849.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Berger, C.R., Wang, Z., Huang, J., Zhou, S.: Application of compressive sensing to sparse channel estimation. IEEE Commun. Mag. 48(11), 164–174 (2010)

    Google Scholar 

  2. Candès, E.J., Romberg, J., Tao, T.: Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52(2), 489–509 (2006)

    Google Scholar 

  3. Carlin, M., Rocca, P., Oliveri, G., Viani, F., Massa, A.: Directions-of-arrival estimation through Bayesian compressive sensing strategies. IEEE Trans. Antennas Propag. 61(7), 3828–3838 (2013)

    Google Scholar 

  4. Che, H., Wang, J.: A two-timescale duplex neurodynamic approach to biconvex optimization. IEEE Trans. Neural Netw. Learn. Syst. (2018). https://doi.org/10.1109/TNNLS.2018.2884788

    Google Scholar 

  5. Che, H., Wang, J.: A collaborative neurodynamic approach to global and combinatorial optimization. Neural Netw. 114, 15–27 (2019)

    Google Scholar 

  6. Fan, J., Wang, J.: A collective neurodynamic optimization approach to nonnegative matrix factorization. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2344–2356 (2017)

    Google Scholar 

  7. Foucart, S., Lai, M.J.: Sparsest solutions of underdetermined linear systems via \(l_{q}\)-minimization for \(0<q<=1\). Appl. Comput. Harmon. Anal. 26(3), 395–407 (2009)

    Google Scholar 

  8. Guo, C., Yang, Q.: A neurodynamic optimization method for recovery of compressive sensed signals with globally converged solution approximating to \(l_{0}\) minimization. IEEE Trans. Neural Netw. Learn. Syst. 26(7), 1363–1374 (2015)

    Google Scholar 

  9. Guo, Z., Liu, Q., Wang, J.: A one-layer recurrent neural network for pseudoconvex optimization subject to linear equality constraints. IEEE Trans. Neural Netw. 22(12), 1892–1900 (2011)

    Google Scholar 

  10. Guo, Z., Wang, J.: A neurodynamic optimization approach to constrained sparsity maximization based on alternative objective functions. In: Proceedings of International Joint Conference on Neural Networks (IJCNN), pp. 273–280. IEEE (2010)

    Google Scholar 

  11. He, X., Li, C., Huang, T., Li, C., Huang, J.: A recurrent neural network for solving bilevel linear programming problem. IEEE Trans. Neural Netw. Learn. Syst. 25(4), 824–830 (2014)

    Google Scholar 

  12. Kim, S.J., Koh, K., Lustig, M., Boyd, S., Gorinevsky, D.: An interior-point method for large-scale \(l_{1}\)-regularized least squares. IEEE J. Sel. Top. Sig. Process. 1(4), 606–617 (2007)

    Google Scholar 

  13. Le, X., Wang, J.: A two-time-scale neurodynamic approach to constrained minimax optimization. IEEE Trans. Neural Netw. Learn. Syst. 28(3), 620–629 (2017)

    Google Scholar 

  14. Leung, M.F., Wang, J.: A collaborative neurodynamic approach to multiobjective optimization. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5738–5748 (2018)

    Google Scholar 

  15. Li, G., Yan, Z., Wang, J.: A one-layer recurrent neural network for constrained nonsmooth invex optimization. Neural Netw. 50, 79–89 (2014)

    Google Scholar 

  16. Li, G., Yan, Z., Wang, J.: A one-layer recurrent neural network for constrained nonconvex optimization. Neural Netw. 61, 10–21 (2015)

    Google Scholar 

  17. Lingala, S.G., Jacob, M.: Blind compressive sensing dynamic \(\text{ MRI }\). IEEE Trans. Med. Imaging 32(6), 1132–1145 (2013)

    Google Scholar 

  18. Liu, Q., Huang, T., Wang, J.: One-layer continuous-and discrete-time projection neural networks for solving variational inequalities and related optimization problems. IEEE Trans. Neural Netw. Learn. Syst. 25(7), 1308–1318 (2014)

    Google Scholar 

  19. Liu, Q., Wang, J.: A one-layer projection neural network for nonsmooth optimization subject to linear equalities and bound constraints. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 812–824 (2013)

    Google Scholar 

  20. Liu, Q., Wang, J.: L\(_{1}\)-minimization algorithms for sparse signal reconstruction based on a projection neural network. IEEE Trans. Neural Netw. Learn. Syst. 27(3), 698–707 (2016)

    Google Scholar 

  21. Liu, Q., Yang, S., Wang, J.: A collective neurodynamic approach to distributed constrained optimization. IEEE Transactions on Neural Networks and Learning Systems 28(8), 1747–1758 (2017)

    Google Scholar 

  22. Mohimani, H., Babaie-Zadeh, M., Jutten, C.: A fast approach for overcomplete sparse decomposition based on smoothed \(l_{0}\) norm. IEEE Trans. Sig. Process. 57(1), 289–301 (2009)

    Google Scholar 

  23. Needell, D., Tropp, J.A.: Cosamp: Iterative signal recovery from incomplete and inaccurate samples. Appl. Comput. Harmon. Anal. 26(3), 301–321 (2009)

    Google Scholar 

  24. Qin, S., Le, X., Wang, J.: A neurodynamic optimization approach to bilevel quadratic programming. IEEE Trans. Neural Netw. Learn. Syst. 28(11), 2580–2591 (2017)

    Google Scholar 

  25. Tropp, J.A., Gilbert, A.C.: Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 53(12), 4655–4666 (2007)

    Google Scholar 

  26. Wang, T., He, X., Huang, T., Li, C., Zhang, W.: Collective neurodynamic optimization for economic emission dispatch problem considering valve point effect in microgrid. Neural Netw. 93, 126–136 (2017)

    Google Scholar 

  27. Xu, X., Ansari, R., Khokhar, A., Vasilakos, A.V.: Hierarchical data aggregation using compressive sensing (\(\text{ HDACS }\)) in \(\text{ WSN }\)s. ACM Trans. Sens. Netw. (TOSN) 11(3), 45 (2015)

    Google Scholar 

  28. Yan, Z., Fan, J., Wang, J.: A collective neurodynamic approach to constrained global optimization. IEEE Trans. Neural Netw. Learn. Syst. 28(5), 1206–1215 (2017)

    Google Scholar 

  29. Yan, Z., Le, X., Wang, J.: Tube-based robust model predictive control of nonlinear systems via collective neurodynamic optimization. IEEE Trans. Ind. Electron. 63(7), 4377–4386 (2016)

    Google Scholar 

  30. Yan, Z., Wang, J.: Nonlinear model predictive control based on collective neurodynamic optimization. IEEE Trans. Neural Netw. Learn. Syst. 26(4), 840–850 (2015)

    Google Scholar 

  31. Yan, Z., Wang, J., Li, G.: A collective neurodynamic optimization approach to bound-constrained nonconvex optimization. Neural Netw. 55, 20–29 (2014)

    Google Scholar 

  32. Yang, J., Zhang, Y.: Alternating direction algorithms for \(l_{1}\) problems in compressive sensing. SIAM J. Sci. Comput. 33(1), 250–278 (2011)

    Google Scholar 

  33. Yang, S., Liu, Q., Wang, J.: Distributed optimization based on a multiagent system in the presence of communication delays. IEEE Trans. Syst. Man Cybern.: Syst. 47(5), 717–728 (2017)

    Google Scholar 

  34. Yang, S., Liu, Q., Wang, J.: A multi-agent system with a proportional-integral protocol for distributed constrained optimization. IEEE Trans. Autom. Control. 62(7), 3461–3467 (2017)

    Google Scholar 

  35. Yang, S., Liu, Q., Wang, J.: A collaborative neurodynamic approach to multiple-objective distributed optimization. IEEE IEEE Trans. Neural Netw. Learn. Syst. 29(4), 981–992 (2018)

    Google Scholar 

  36. Yin, P., Lou, Y., He, Q., Xin, J.: Minimization of \(l_{1-2}\) for compressed sensing. SIAM J. Sci. Comput. 37(1), A536–A563 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong

    Hangjun Che & Jun Wang

  2. School of Data Science, City University of Hong Kong, Kowloon, Hong Kong

    Jun Wang

  3. Shenzhen Research Institute, City University of Hong Kong, Shenzhen, China

    Hangjun Che & Jun Wang

  4. Key Laboratory of Intelligent Information Processing and Control of Chongqing Municipal Institutions of Higher Education, Chongqing Three Gorges University, Wanzhou, Chongqing, 404100, China

    Wei Zhang

Authors
  1. Hangjun Che
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hangjun Che .

Editor information

Editors and Affiliations

  1. Dalian University of Technology, Dalian, China

    Huchuan Lu

  2. Sichuan University, Chengdu, China

    Huajin Tang

  3. Northeastern University, Shenyang, China

    Zhanshan Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Che, H., Wang, J., Zhang, W. (2019). A Collaborative Neurodynamic Approach to Sparse Coding. In: Lu, H., Tang, H., Wang, Z. (eds) Advances in Neural Networks – ISNN 2019. ISNN 2019. Lecture Notes in Computer Science(), vol 11554. Springer, Cham. https://doi.org/10.1007/978-3-030-22796-8_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-22796-8_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-22795-1

  • Online ISBN: 978-3-030-22796-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation