Skip to main content
SpringerLink
Log in

From Different Zhang Functions to Various ZNN Models Accelerated to Finite-Time Convergence for Time-Varying Linear Matrix Equation

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

In addition to the parallel-distributed nature, recurrent neural networks can be implemented physically by designated hardware and thus have been found broad applications in many fields. In this paper, a special class of recurrent neural network named Zhang neural network (ZNN), together with its electronic realization, is investigated and exploited for online solution of time-varying linear matrix equations. By following the idea of Zhang function (i.e., error function), two ZNN models are proposed and studied, which allow us to choose plentiful activation functions (e.g., any monotonically-increasing odd activation function). It is theoretically proved that such two ZNN models globally and exponentially converge to the theoretical solution of time-varying linear matrix equations when using linear activation functions. Besides, the new activation function, named Li activation function, is exploited. It is theoretically proved that, when using Li activation function, such two ZNN models can be further accelerated to finite-time convergence to the time-varying theoretical solution. In addition, the upper bound of the convergence time is derived analytically via Lyapunov theory. Then, we conduct extensive simulations using such two ZNN models. The results substantiate the theoretical analysis and the efficacy of the proposed ZNN models for solving time-varying linear matrix equations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Prasanna GNS, Musicus BR (1996) Generalized multiprocessor scheduling and applications to matrix computations. IEEE Trans Parallel Distrib Syst 7(6):932–943

    Article  Google Scholar 

  2. Kurzak J, Buttari A, Dongarra J (2008) Solving systems of linear equations on the cell processor using cholesky factorization. IEEE Trans Parallel Distrib Syst 19(9):1175–1185

    Article  Google Scholar 

  3. Ding F, Chen T (2005) Gradient based iterative algorithms for solving a class of matrix equations. IEEE Trans Autom Control 50(8):1216–1221

    Article  MathSciNet  Google Scholar 

  4. Huang GX, Yin F, Guo K (2008) An iterative method for the skew-symmetric solution and the optimal spproximate solution of the matrix equation \(AXB=C\). J Comput Appl Math 212:231–244

    Article  MATH  MathSciNet  Google Scholar 

  5. Wu AG, Lv L, Hou MZ (2011) Finite iterative algorithms for extended sylvester-conjugate matrix equations. J Comput Appl Math 54:2363–2384

    MATH  MathSciNet  Google Scholar 

  6. Zhou B, Duan GR (2005) An explicit solution to the matrix equation \(AX-XF=BY\). Linear Algebra Appl 402(1):345–366

    Article  MATH  MathSciNet  Google Scholar 

  7. Zhou B, Duan GR, Li ZY (2009) Gradient based iterative algorithm for solving coupled matrix equations. Syst Control Lett 58:327–333

    Article  MATH  MathSciNet  Google Scholar 

  8. Mathews JH, Fink KD (2004) Numerical methods using MATLAB. Prentice Hall, New Jersey

    Google Scholar 

  9. Cheng SC, Tsai WH (2009) A neural network implementation of the moment- preserving technique and its application to thresholding. IEEE Trans Comput 42(4):501–507

    Article  Google Scholar 

  10. Luque-Baena RM, Ortiz-de-Lazcano-Lobato JM, Lopez-Rubio E, Dominguez E, Palomo EJ (2013) A competitive neural network for multiple object tracking in video sequence analysis. Neural Process Lett 37(1):47–67

    Article  Google Scholar 

  11. Pande S, Morgan F, Cawley S, Bruintjes T, Smit G, McGinley B, Carrillo S, Harkin J, McDaid L (2012) Modular neural tile architecture for compact embedded hardware spiking neural network. Neural Process Lett. doi:10.1007/s11063-012-9274-5

  12. Gao C, Zhou D, Guo Y (2013) An iterative thresholding segmentation model using a modified pulse coupled neural network. Neural Process Lett. doi:10.1007/s11063-013-9291-z

  13. Wang L, Liu W, Shi H (2009) Delay-constrained multicast routing using the noisy chaotic neural networks. IEEE Trans Comput 58(1):82–89

    Article  MathSciNet  Google Scholar 

  14. Elhadef M, Nayak A (2012) Comparison-based system-level fault diagnosis: a neural network approach. IEEE Trans Parallel Distrib Syst 23(6):1047–1059

    Article  Google Scholar 

  15. Ge SS, Yang C, Lee TH (2008) Adaptive predictive control using neural network for a class of pure-feedback systems in discrete time. IEEE Trans Neural Netw 19(9):1599–1614

    Article  Google Scholar 

  16. Yang C, Ge SS, Xiang C, Chai T, Lee TH (2008) Output feedback nn control for two classes of discrete-time systems with unknown control directions in a unified approach. IEEE Trans Neural Netw 19(9):1873–1886

    Article  Google Scholar 

  17. Xia Y, Feng G, Wang J (2008) A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints. IEEE Trans Neural Netw 19(8):1340–1353

    Article  Google Scholar 

  18. Guo D, Yi C, Zhang Y (2011) Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving. Neurocomputing 74:3708–3712

    Article  Google Scholar 

  19. Zhang Y, Jiang D, Wang J (2002) A recurrent neural network for solving sylvester equation with time-varying coefficients. IEEE Trans Neural Netw 13(5):1053–1063

    Article  Google Scholar 

  20. Zhang Y, Ge SS (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490

    Article  Google Scholar 

  21. Zhang Y, Ma W, Cai B (2009) From Zhang neural networks to newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415

    Article  MathSciNet  Google Scholar 

  22. Xiao L, Zhang Y (2011) Zhang neural network versus gradient neural network for solving time-varying linear inequalities. IEEE Trans Neural Netw 22(10):1676–1684

    Article  MathSciNet  Google Scholar 

  23. Xiao L, Zhang Y (2012) Two new types of Zhang neural networks solving systems of time-varying nonlinear inequalities. IEEE Trans Circuits Syst I 59(10):2363–2373

    Article  MathSciNet  Google Scholar 

  24. Zhang Y, Li F, Yang Y, Li Z (2012) Different Zhang functions leading to different zhang-dynamics models illustrated via time-varying reciprocal solving. Appl Math Model 36:4502–4511

    Article  MATH  MathSciNet  Google Scholar 

  25. Bhat SP, Bernstein DS (2000) Finite-time stability of continuous autonomous systems. SIAM J Control Optim 38:751–766

    Article  MATH  MathSciNet  Google Scholar 

  26. Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205

    Article  Google Scholar 

  27. Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309

    Article  Google Scholar 

  28. Li S, Li Y, Wang Z (2013) A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application. Neural Netw 39:27–39

    Article  Google Scholar 

  29. Khalil HK (2001) Nonlinear Systems, 3rd edn. Prentice Hall, Englewood Cliffs

    Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (under Grants 61075121 and 60935001) and the Specialized Research Fund for the Doctoral Program of Institutions of Higher Education of China (with Project No. 20100171110045).

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, 510006, China

    Lin Xiao & Yunong Zhang

Authors
  1. Lin Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yunong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yunong Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xiao, L., Zhang, Y. From Different Zhang Functions to Various ZNN Models Accelerated to Finite-Time Convergence for Time-Varying Linear Matrix Equation. Neural Process Lett 39, 309–326 (2014). https://doi.org/10.1007/s11063-013-9306-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-013-9306-9

Keywords

Search

Navigation