Skip to main content
SpringerLink
Log in

Stability and Chaos of a Class of Learning Algorithms for ICA Neural Networks

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Independent component analysis (ICA) neural networks can estimate independent components from the mixed signal. The dynamical behavior of the learning algorithms for ICA neural networks is crucial to effectively apply these networks to practical applications. The paper presents the stability and chaotic dynamical behavior of a class of ICA learning algorithms with constant learning rates. Some invariant sets are obtained so that the non-divergence of these algorithms can be guaranteed. In these invariant sets, the stability and chaotic behaviors are analyzed. The conditions for stability and chaos are derived. Lyapunov exponents and bifurcation diagrams are presented to illustrate the existence of chaotic behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Comon P (1994) Independent component analysis - a new concept. Signal Process 36: 287–314

    Article  MATH  Google Scholar 

  2. Jutten C, Herault J (1991) Blind separation of sources part I an adaptive algorithm based on neuromimetic architecture. Signal Process 24: 1–10

    Article  MATH  Google Scholar 

  3. Bell A, Sejnowski TJ (1997) Edges are the independent components of natural scenes. In: Advances in neural information processing 9 (NIPS 96). MIT Press, pp 831–837

  4. Karhunen J, Hyvärinen A, Vigario R, Hurri J, Oja E (1997) Applications of neural blind separation to signal and image processing. In: Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP 97). Munich, Germany, pp 131–134

  5. Kotani M, Ozawa S (2005) Feature extraction using independent components of each category. Neural Process Lett 22: 113–124

    Article  Google Scholar 

  6. Donoho D (1981) On minimum entropy deconvolution. In: Applied Time Series Analysis II. Academic Press, pp 565–608

  7. Cichocki A, Thawonmas R (2000) On-line algorithms for blind signal extraction of arbitrarily distributed, but temporally correlated sources using second order statistics. Neural Process Lett 12: 91–98

    Article  MATH  Google Scholar 

  8. Hyvärinen A, Oja E (1997) Simple neuron models for independent component analysis. Int J Neural Syst 7(6): 671–687

    Article  Google Scholar 

  9. Hyvärinen A, Oja E (1998) Independent component analysis by general non-linear hebbian-like learning Rues. Signal Process 64(3): 301–313

    Article  MATH  Google Scholar 

  10. Ilin A, Valpola H (2005) On the effect of the form of the posterior approximation in variational learning of ICA models. Neural Process Lett 22: 183–204

    Article  Google Scholar 

  11. Karhunen J, Oja E, Wang L, Vigario R, Joutsensalo J (1997) A class of neural networks for independent component analysis. IEEE Trans Neural Netw 8(3): 486–504

    Article  Google Scholar 

  12. Karhunen J (2005) A resampling test for the total independence of stationary time series: application to the performance evaluation of ICA algorithms. Neural Process Lett 22: 311–324

    Article  Google Scholar 

  13. Mollah MNH, Eguchi S, Minami M (2007) Robust prewhitening for ICA by minimizing β-divergence and its application to fastICA. Neural Process lett 25: 91–110

    Article  Google Scholar 

  14. Oja E, Yuan Z (2006) The fastICA algorithm revisited: convergence analysis. IEEE Trans Neural Netw 17(6): 1370–1381

    Article  Google Scholar 

  15. Wang X, Tian L (2006) Bifurcation analysis and linear control of the Newton-Leipnik system. Chaos Solitons Fractals 27: 31–38

    Article  MATH  MathSciNet  Google Scholar 

  16. AGIZA HN (1999) On the analysis of stability, bifurcation, chaos and chaos control of Kopel Map. Chaos Solitons Fractals 10: 1909–1916

    Article  MATH  MathSciNet  Google Scholar 

  17. Cheng Z, Lin Y, Cao J (2006) Dynamical behaviors of a partial-dependent predator–prey system. Chaos Solitons Fractals 28: 67–75

    Article  MathSciNet  Google Scholar 

  18. Jing Z, Yang J (2006) Bifurcation and chaos in discrete-time predator–prey system. Chaos Solitons Fractals 27: 259–277

    Article  MATH  MathSciNet  Google Scholar 

  19. Li C, Chen G (2004) Chaos in the fractional order Chen system and its control. Chaos Solitons Fractals 22: 549–554

    Article  MATH  Google Scholar 

  20. Lv JC, Yi Z (2007) Stability and chaos of LMSER PCA learning algorithm. Chaos Solitons Fractals 32: 1440–1447

    Article  MATH  MathSciNet  Google Scholar 

  21. Lv JC, Yi Z, Tan KK (2007) Global convergence of GHA learning algorithm with nonzero-approaching learning rates. IEEE Trans Neural Netw 18(6): 1557–1571

    Article  Google Scholar 

  22. Lv JC, Yi Z, Tan KK (2006) Global convergence of Oja’s PCA learning algorithm with a non-zero-approaching adaptive learning rate. Theor Comput Sci 367: 286–307

    Article  MATH  MathSciNet  Google Scholar 

  23. Lv JC, Yi Z, Tan KK (2006) Convergence analysis of Xu’s LMSER learning algorithm via deterministic discrete time system method. Neurocomputing 70: 362–372

    Article  Google Scholar 

  24. Xu L, Oja E, Suen CY (1992) Modified hebbian learning for curve and surface fitting. Neural Netw 5: 441–457

    Article  Google Scholar 

  25. Yi Z, Ye M, Lv JC, Tan KK (2005) Convergence analysis of a deterministic discrete time system of Oja’s PCA learning algorithm. IEEE Trans Neural Netw 16(6): 1318–1328

    Article  Google Scholar 

  26. Zufiria PJ (2002) On the discrete-time dynamic of the basic Hebbian neural-network nodes. IEEE Trans Neural Netw 13(6): 1342–1352

    Article  Google Scholar 

  27. Yi Z, Tan KK (2004) Convergence analysis of recurrent neural networks. Kluwer Academic Publishers

  28. Dror G, Tsodyks M (2000) Chaos in neural networks with dynamical synapses. Neurocomputing 32: 365–370

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, National University of Singapore, 4 Engineering Drive 3, Singapore, 117576, Singapore

    Jian Cheng Lv, Kok Kiong Tan & Sunan Huang

  2. Computational Intelligence Laboratory, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 610054, People’s Republic of China

    Zhang Yi

Authors
  1. Jian Cheng Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kok Kiong Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhang Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sunan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jian Cheng Lv.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lv, J.C., Tan, K.K., Yi, Z. et al. Stability and Chaos of a Class of Learning Algorithms for ICA Neural Networks. Neural Process Lett 28, 35–47 (2008). https://doi.org/10.1007/s11063-008-9080-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-008-9080-2

Keywords

Search

Navigation