Skip to main content
SpringerLink
Log in

A Chaotic Feature Extracting BAM and Its Application in Implementing Memory Search

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

An unsupervised trained, chaotic BAM composed of units with saturated limits logistic function can extract intrinsic features of data and exhibit various associative dynamics for different values of transmission parameters of the neurons’ activation functions during recall. The output behavior of its units can be a fixed point or periodic attractor, a constrained aperiodic attractor consisting of one or more stored patterns, or a chaotic attractor. This characteristic indicates that the model is a promising technique that can be applied to information processing, such as pattern recognition and memory recall. However, controlling the amount of output variability and stabilizing it in a desired attractor is a crucial issue in practice. In this work it is shown that the transmission parameters of the units’ activation functions play a significant role in identifying the output behavior. Using different time-series generated by the trained network, Largest Lyapunov Exponent is computed for different values of transmission parameter. Then, critical values of this parameter that lead to the highest chaotic behavior for each unit are stored and used to set the network during recall. Interaction between some chaotic feature units and some fixed-point ones produces desired behaviors with various degrees of uncertainty. An evolutionary algorithm is then introduced to find the units that should work chaotically to generate the desired behavior. Achievement of this method implies that such a controlled chaotic feature extracting BAM can be feasibly applied to information processing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kosko B (1988) Bidirectional associative memories. IEEE Trans Syst Man Cybern 18(1): 49–60

    Article  MathSciNet  Google Scholar 

  2. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8): 2554–2558

    Article  MathSciNet  Google Scholar 

  3. Ott E (1993) Chaos in dynamical systems. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  4. Babloyantz A, Lourenco C (1996) Brain chaos and computation. Int J Neural Syst 7: 461–471

    Article  Google Scholar 

  5. Dafilis MP, Liley DTJ, Cadusch PJ (2001) Robust chaos in a model of the electroencephalogram: implications for brain dynamics. Chaos 11: 474–478

    Article  MATH  Google Scholar 

  6. Korn H, Faure P (2003) Is there chaos in the brain? II. Experimental evidence and related models. Comptes Rendus Biologies 326(9): 787–840

    Article  Google Scholar 

  7. Tsuda I (2001) Towards an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behav Brain Sci 24(4): 793–847

    Article  MathSciNet  Google Scholar 

  8. Arieli A, Sterkin A, Grinvald A, Aertsen A (1996) Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses. Science 273(5283): 1868–1871

    Article  Google Scholar 

  9. Kaplan D, Glass L (1995) Understanding nonlinear dynamics, 1 edn. Springer, New York

    Book  Google Scholar 

  10. Freeman WJ (1985) Strange attractors in the olfactory system of rabbits. Electroencephalogr. Clin. Neurophysiol 61

  11. Freeman WJ (1987) Simulation of EEG chaotic patterns with adynamic model of the olfactory system. Biol Cybern 56: 139–150

    Article  Google Scholar 

  12. Freeman WJ, Barrie JM (1994) Chaotic oscillations and the genesis of meaning in cerebral cortex. Springer, Berlin, pp 13–37

    Google Scholar 

  13. Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3: 153–170

    Article  Google Scholar 

  14. Andreyev YV, Belsky YL, Dmitriev AS, Kuminov DA (1996) Information processing using dynamical chaos: neural networks implementation. IEEE Trans Neural Netw 7(2): 290–299

    Article  Google Scholar 

  15. Aihara K, Takabe T, Toyoda M (1990) Chaotic neural networks. Phys Lett A 44(6–7): 333–339

    Article  MathSciNet  Google Scholar 

  16. Chen L, Aihara K (1999) Global searching ability of chaotic neural networks. IEEE Trans Circuits Syst 46(8): 974–993

    Article  MathSciNet  MATH  Google Scholar 

  17. Chen S, Shih C (2004) Asymptotic behaviors in a transiently chaotic neural network. Discret Contin Dyn Syst 10(3): 805–826

    Article  MathSciNet  MATH  Google Scholar 

  18. Crook N, Goh W, Hawara M (2007) Pattern recall in networks of chaotic neurons. BioSystems 87: 267–274

    Article  Google Scholar 

  19. Lee RST (2006) Lee-associator: a chaotic auto-associative network for progressive memory recalling. Neural Netw 19(5): 644–666

    Article  MATH  Google Scholar 

  20. Sprott JC, Albers DJ, Dechert WE (1998) Routes to chaos in neural networks with random weights. Int J Bifurcation Chaos 8(7): 1463–1478

    Article  MATH  Google Scholar 

  21. Choi MY, Huberman BA (1983) Dynamic behavior of nonlinear networks. Phys Rev A 28: 1204–1206

    Article  MathSciNet  Google Scholar 

  22. Sandler Y, Yu M (1990) Model of neural networks with selective memorization and chaotic behavior. Phys Lett A 144: 462–466

    Article  Google Scholar 

  23. Zhenkun H, Xinghua W, Chunhua F (2010) Multiperiodicity of periodically oscillated discrete-time neural networks with transient excitatory self-connections and sigmoidal nonlinearities. IEEE Trans Neural Netw 21: 1643–1655

    Article  Google Scholar 

  24. Zhenkun H, Mohamad S, Honghua B (2010) Multiperiodicity analysis and numerical simulation of discrete-time transiently chaotic non-autonomous neural networks with time-varying delays. Commun Nonlinear Sci Numeri Simul 15: 1348–1357

    Article  MATH  Google Scholar 

  25. Chartier S, Boukadoum M (2006) A chaotic bidirectional associative memory. Proceedings of Maghrebian conference on software engineering and artificial intelligence, pp 498–501

  26. Chartier S, Boukadoum M (2006) A bidirectional heteroassociative memory for binary and grey-level patterns. IEEE Trans Neural Netw 17(2): 385–396

    Article  Google Scholar 

  27. Chartier S, Proulx R (2005) NDRAM: Nonlinear dynamic recurrent associative memory for learning bipolar and nonbipolar correlated patterns. IEEE Trans Neural Netw 16(6): 1393–1400

    Article  Google Scholar 

  28. Giguère G, Chartier S, Proulx R, Lina J (2007a) Category development and reorganization using a bidirectional associative memory-inspired architecture. Proceedings of the 8th international conference on cognitive modeling, pp 97–102

  29. Giguère G, Chartier S, Proulx R, Lina J (2007b) Creating perceptual features using a BAM architecture. Proceedings of the 29th annual cognitive science society, pp 1025–1030

  30. Chartier S, Renaud P, Boukadoum M (2008) A nonlinear dynamic artificial neural network model of memory. New Ideas in Psychol 26(2): 252–277

    Article  Google Scholar 

  31. He G, Chan L, Aihara K (2008) Associative memory with a controlled chaotic neural network. Neurocomputing 71: 2794–2805

    Article  Google Scholar 

  32. He G, Shrimali MD, Aihara K (2008) Threshold control of chaotic neural network. Neural Netw 21: 114–121

    Article  Google Scholar 

  33. Krishnaiah J, Kumar CS, Faruqi MA (2006) Modeling and control of chaotic processes through their bifurcation diagrams generated with the help of recurrent neural network models. J Process Control 16: 67–79

    Article  Google Scholar 

  34. Xia M, Fang J, Tang Y, Wang Z (2010) Dynamic depression control of chaotic neural networks for associative memory. Neurocomputing 73: 776–783

    Article  Google Scholar 

  35. He G, Cao Z, Zhu P, Ogura H (2003) Controlling chaos in a chaotic neural network. Neural Netw 16: 1195–1200

    Article  Google Scholar 

  36. Chartier S, Giguère G, Renaud P, Lina J, Proulx R (2007) FEBAM: A feature-extracting bidirectional associative memory. Proceedings of the international joint conference on neural networks, pp 1679–1684

  37. Haykin S (1999) Neural networks: a comprehensive foundation. Prentice-Hall, Englewood Cliffs

    MATH  Google Scholar 

  38. Skarda CA, Freeman WJ (1987) How brains make chaos in order to make sense of the world. Behav Brain Sci 10: 161–195

    Article  Google Scholar 

  39. Wolf A, Swift JB, Swinney HL, Vastano JA (1985) Determining Lyapunov exponents from a time series. Physica D 16: 153–164

    Article  MathSciNet  Google Scholar 

  40. Sprott JC (2003) Chaos and time-series analysis. Oxford University Press, Oxford

    MATH  Google Scholar 

  41. Adachi M, Aihara K (1997) Associative dynamics in a chaotic neural network. Neural Netw 10(1): 83–98

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Biomedical Engineering Faculty, AmirKabir University of Technology (Tehran Polytechnic), Hafez Street, Tehran, Iran

    Isar Nejadgholi & Seyyed Ali Seyyedsalehi

  2. School of Psychology, University of Ottawa, Ottawa, Canada

    Sylvain Chartier

Authors
  1. Isar Nejadgholi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seyyed Ali Seyyedsalehi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sylvain Chartier
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyyed Ali Seyyedsalehi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nejadgholi, I., Seyyedsalehi, S.A. & Chartier, S. A Chaotic Feature Extracting BAM and Its Application in Implementing Memory Search. Neural Process Lett 36, 69–99 (2012). https://doi.org/10.1007/s11063-012-9223-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-012-9223-3

Keywords

Search

Navigation