Skip to main content

A Nonlinear Neural Network’s Stability Analysis and Its kWTA Application

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9377))

Abstract

In this paper, the stability of a novel nonlinear neural network solving linear programming problems is studied. We prove that this nonlinear neural network is stable in the sense of Lyapunov under certain conditions. Inspired by the study of this neural network, we propose a novel neural system to solving the k-winners-take-all (kWTA) problem. Numerical simulations demonstrate that the effectiveness and good performance of our new kWTA neural network.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dorfman, R., Samuelson, P.A. and Solow, R. M.: Linear Programming and Economic Analysis. Dover Publications (1987)

    Google Scholar 

  2. Matousek, J., Gärtner, B.: Understanding and Using Linear Programming. Springer (2006)

    Google Scholar 

  3. Gass, S.I.: Linear Programming: Methods and Applications, 5th edn. Dover Publications (2010)

    Google Scholar 

  4. Sultan, A.: Linear Programming: An Introduction With Applications, 2nd edn. CreateSpace Independent Publishing Platform (2011)

    Google Scholar 

  5. Tank, D.W., Hopfield, J.J.: Simple neural optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit. IEEE Transactions on Circuits and Systems 33(5), 533–541 (1986)

    Article  Google Scholar 

  6. Hopfield, J.J., Tank, D.W.: Computing with neural circuits: A model. Science 233, 625–633 (1986)

    Article  Google Scholar 

  7. Kennedy, M.P., Chua, L.O.: Neural networks for nonlinear programming. IEEE Transactions on Circuits and Systems 35(5), 554–562 (1988)

    Article  MathSciNet  Google Scholar 

  8. Maa, C.Y., Schanblatt, M.A.: A two-phase optimization neural network. IEEE Transactions on Neural Network 3(6), 1003–1009 (1992)

    Article  Google Scholar 

  9. Xia, Y.: A new neural network for solving linear programming problems and its application. IEEE Transactions on Neural Networks 7(2), 525–529 (1996)

    Article  Google Scholar 

  10. Zhang, S., Constantinides, A.G.: Lagrange programming neural networks. IEEE Transactions on Circuits and Systems II 39(7), 441–452 (1992)

    MATH  Google Scholar 

  11. Wang, J.: A deterministic annealing neural network for convex programming. Neural Networks 5(4), 962–971 (1994)

    Google Scholar 

  12. Nguyen, K.V.: A Nonlinear Neural Network for Solving Linear Programming Problems. In: International Symposium on Mathematical Programming, ISMP 2000, Atlanta, GA, USA (2000)

    Google Scholar 

  13. Suresh, S., Mani, V., Omkar, S.N., Kim, H.J.: Parallel Video Processing Using Divisible Load Scheduling Paradigm. Journal of Broadcast Engineering 10(1), 83–102 (2005)

    Google Scholar 

  14. Senthilnath, J., Omkar, S.N., Mani, V., Katti, A.R.: Cooperative communication of UAV to perform multi-task using nature inspired techniques. In: IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA), pp. 45–50 (2013)

    Google Scholar 

  15. Yan, Y.: A New Nonlinear Neural Network for Solving QP Problems. In: Zeng, Z., Li, Y., King, I. (eds.) ISNN 2014. LNCS, vol. 8866, pp. 347–357. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  16. Taylor, J.G.: Mathematical Approaches to Neural Networks. North-Holland (1993)

    Google Scholar 

  17. Harvey, R.L.: Neural Network Principles. Prentice Hall (1994)

    Google Scholar 

  18. Veelenturf, L.: Analysis and Applications of Artifical Neural Networks. Prentice Hall (1995)

    Google Scholar 

  19. Rojas, R., Feldman, J.: Neural Networks A Systematic Introduction. Springer (1996)

    Google Scholar 

  20. Mehrotra, K., Mohan, C.K., Ranka, S.: Elements of Artificial Neural Networks. MIT Press (1997)

    Google Scholar 

  21. Haykin, S.: Neural Networks A Comprehensive Foundation, 2nd edn. Prentice Hall (1998)

    Google Scholar 

  22. Michel, A., Liu, D.: Qualitative Analysis and Synthesis of Recurrent Neural Networks. CRC Press (2001)

    Google Scholar 

  23. Hagan, M.T., Demuth, H.B., Beale, M.H.: Neural Network Design. Martin Hagan (2002)

    Google Scholar 

  24. Gurney, K.: An Introduction to Neural Networks. CRC Press (2003)

    Google Scholar 

  25. Graupe, D.: Principles of Artificial Neural Networks, 2nd edn. World Scientific Pub. Co. Inc. (2007)

    Google Scholar 

  26. Krogh, A., Hertz, J., Palmer, R.G.: Introduction to the Theory of Neural Computation. Addison-Wesley, Redwook (1991)

    Google Scholar 

  27. Marr, D., Poggio, T.: Cooperative computation of stereo disparity. Science 195, 283–328 (1977)

    Google Scholar 

  28. Yuille, A.L., Geiger, D.: The Handbook of Brain Theory and Neural Networks. MIT Press (2002)

    Google Scholar 

  29. Xia, Y., Feng, G., Wang, J.: A primal-dual neural network for online resolving constrained kinematic redundancy in robot motion control. IEEE Transactions on Systems, Man and Cybernetics 35(1), 54–64 (2005)

    Article  Google Scholar 

  30. Xia, Y., Wang, J.: A general projection neural network for solving monotone variational inequalities and related optimization problems. IEEE Transactions on Neural Networks 15(2), 318–328 (2004)

    Article  Google Scholar 

  31. Gu, S., Wang, J.: A K-Winners-Take-All Neural Network Based on Linear Programming Formulation. In: Proceedings of International Joint Conference on Neural Networks, Orlando, Florida, USA (2007)

    Google Scholar 

  32. Boyd, S., Vandenbeghe, L.: Convex Optimization. Cambridge University Press (2004)

    Google Scholar 

  33. Bertsekas, D.P., Tsitsiklis, J.N.: Parallel and Distributed Computation: Numerical Methods. Prentice-Hall (1989)

    Google Scholar 

  34. Wang, J.: Analogue neural network for solving the assignment problem. Electronics Letters 28(11), 1047–1050 (1992)

    Article  Google Scholar 

  35. Hu, X., Wang, J.: Solving the assignment problem with the improved dual neural network. In: Liu, D., Zhang, H., Polycarpou, M., Alippi, C., He, H. (eds.) ISNN 2011, Part I. LNCS, vol. 6675, pp. 547–556. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  36. Effati, S., Ranjbar, M.: Neural network models for solving the maximum flow problem. Applications and Applied Mathematics 3(3), 149–162 (2008)

    MathSciNet  MATH  Google Scholar 

  37. Nazemi, A., Omidi, F.: A capable neural network model for solving the maximum flow problem. Journal of Computational and Applied Mathematics 236(14), 3498–3513 (2012)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yinhui Yan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Yan, Y. (2015). A Nonlinear Neural Network’s Stability Analysis and Its kWTA Application. In: Hu, X., Xia, Y., Zhang, Y., Zhao, D. (eds) Advances in Neural Networks – ISNN 2015. ISNN 2015. Lecture Notes in Computer Science(), vol 9377. Springer, Cham. https://doi.org/10.1007/978-3-319-25393-0_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25393-0_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25392-3

  • Online ISBN: 978-3-319-25393-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics