Skip to main content
Springer Nature Link
Log in

Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Two gradient-based recurrent neural networks (GNNs) for solving two matrix equations are presented and investigated. These GNNs can be used for generating various inner inverses, including the Moore–Penrose, and in the computation of the Drazin inverse. Convergence properties of defined GNNs are considered. Certain conditions which impose convergence towards the pseudoinverse, and the Drazin inverse are exactly specified. The influence of nonlinear activation functions on the convergence performance of defined GNN models is investigated. Computer simulation experience further confirms the theoretical results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Ben-Israel A, Greville TNE (2003) Generalized inverses: theory and applications, 2nd edn. Springer, New York

    MATH  Google Scholar 

  2. Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224

    MathSciNet  MATH  Google Scholar 

  3. Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975

    MathSciNet  Google Scholar 

  4. Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394

    MATH  Google Scholar 

  5. Higham NJ (2002) Accuracy and stability of numerical algorithms, 2nd edn. SIAM, Philadelphia

    Book  MATH  Google Scholar 

  6. Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1987) An optimization network for matrix inversion. In: Neural information processing systems, pp 397–401

  7. Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205

    Article  Google Scholar 

  8. Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218

    Article  Google Scholar 

  9. Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631

    Article  Google Scholar 

  10. Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120

    MathSciNet  MATH  Google Scholar 

  11. Qiao S, Wang X-Z, Wei Y (2017) Two finite-time convergent Zhang neural network models for time-varying complex matrix Drazin inverse. Linear Algebra Appl. doi:10.1016/j.laa.2017.03.014

    Google Scholar 

  12. Sheng X, Wang T (2013) An iterative method to compute Moore–Penrose inverse based on gradient maximal convergence rate. Filomat 27(7):1269–1276

    Article  MathSciNet  MATH  Google Scholar 

  13. Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131

    Article  Google Scholar 

  14. Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843

    Article  MathSciNet  Google Scholar 

  15. Soleymani F, Stanimirović PS (2013) A higher order iterative method for computing the Drazin inverse. Sci World J 2013, Article ID 708647. doi:10.1155/2013/708647

  16. Wang G, Wei Y, Qiao S (2003) Generalized inverses: theory and computations. Science Press, New York

    MATH  Google Scholar 

  17. Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100

    MathSciNet  MATH  Google Scholar 

  18. Wang J (1993) Recurrent neural networks for solving linear matrix equations. Comput Math Appl 26:23–34

    Article  MathSciNet  MATH  Google Scholar 

  19. Wang J (1997) Recurrent neural networks for computing pseudoinverses of rank-defficient matrices. SIAM J Sci Comput 18:1479–1493

    Article  MathSciNet  MATH  Google Scholar 

  20. Wang X-Z, Wei Y, Stanimirović PS (2016) Complex neural network models for time-varying Drazin inverse. Neural Comput 28:2790–2824

    Article  Google Scholar 

  21. Wang X-Z, Ma H, Stanimirović PS (2017) Nonlinearly activated recurrent neural network for computing the Drazin inverse. Neural Process Lett. doi:10.1007/s11063-017-9581-y

    Google Scholar 

  22. Wei Y (2000) Recurrent neural networks for computing weighted Moore–Penrose inverse. Appl Math Comput 116:279–287

    Article  MathSciNet  MATH  Google Scholar 

  23. Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174

  24. Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121

    Article  MathSciNet  MATH  Google Scholar 

  25. Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306

    MathSciNet  MATH  Google Scholar 

  26. Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490

    Article  Google Scholar 

  27. Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415

    Article  MathSciNet  Google Scholar 

  28. Zhang Y, Qiu B, Jin L, Guo D (2015) Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse. Inf Process Lett 115:703–706

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The author would like to thank the editor and three referees for their detailed comments which greatly improved the presentation of the paper.

Author information

Authors and Affiliations

  1. Faculty of Sciences and Mathematics, University of Niš, Višegradska 33, Niš, 18000, Serbia

    Predrag S. Stanimirović & Marko D. Petković

  2. Aristoteleion Panepistimion, Thessalonikis, Greece

    Dimitrios Gerontitis

Authors
  1. Predrag S. Stanimirović
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Marko D. Petković
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Dimitrios Gerontitis
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Predrag S. Stanimirović.

Additional information

Predrag S. Stanimirović and Marko D. Petković gratefully acknowledge the support from Research Project 174013 of the Serbian Ministry of Science.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stanimirović, P.S., Petković, M.D. & Gerontitis, D. Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse. Neural Process Lett 48, 109–133 (2018). https://doi.org/10.1007/s11063-017-9705-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-017-9705-4

Keywords

Mathematics Subject Classification