Abstract
In the brain, the discrete elements in a temporal order is encoded as a sequence memory. At the neural level, the reproducible sequence order of neural activity is very crucial for many cases. In this paper, a mechanism for oscillation in the network has been proposed to realize the sequence memory. The mechanism for oscillation in the network that cooperates with hetero-association can help the network oscillate between the stored patterns, leading to the sequence memory. Due to the oscillatory mechanism, the firing history will not be sampled, the stability of the sequence is increased, and the evolvement of neurons’ states only depends on the current states. The simulation results show that neural network can effectively achieve sequence memory with our proposed model.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson J R. Learning and Memory. New York: John Wiley & Sons, 1995
Waves L. The wheres and hows of memory. Science, 2004, 27:1210
Schacter D L, Addis D R. Constructive memory: The ghosts of past and future. Nature, 2007, 445:27
Branco T, Clark B A, Häusser M. Dendritic discrimination of temporal input sequences in cortical neurons. Science, 2010, 329:1671–1675
Laurent G. Odor encoding as an active, dynamical process: experiments, computation, and theory. Annu Rev Neurosci, 2001, 24:263–97
Dupret D, O’Neill J, Bouverie B P, et al. The reorganization and reactivation of hippocampal maps predict spatial memory performance. Nat Neurosci, 2010, 13:995–1002
Stephanie B, Moriel Z, Ravikumar P, et al. Electrical synapses control hippocampal contributions to fear learning and memory. Science, 2011, 7:87–91
Hahnloser R H R, Kozhevnikov A A, Fee M S. An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature, 2002, 419:65–70
Bird C M, Burgess N. The hippocampus and memory: insights from spatial processing. Nat Rev Neurosci, 2008, 9:182–194
Bohland J W, Minai A A. Efficient associative memory using small-world architecture. Neurocomputing, 2001, 38:489–496
Hopfield J J. Neural networks and physical systems with emergent collective computation abilities. Proc Nat Acad Sci USA, 1982, 79:2445–2558
Juan I, Francisco A, Sergio A. A scale-free neural network for modelling neurogenesis. Physica A, 2006, 371:71–75
Huang Z K, Wang X H, Sannay M. Self-excitation of neurons leads to multiperiodicity of discrete-time neural networks with distributed delays. Sci China Inf Sci, 2011, 54:305–317
Amit D J. Attractor neural networks and biological reality: associative memory and learning. Futur Gener Comp Syst, 1990, 6:111–119
Xia M, Fang J, Yang T, et al. Dynamic depression control of chaotic neural networks for associative memory. Neurocomputing, 2010, 73:776–783
Sandberg A, Lansner A. Synaptic depression as an intrinsic driver of reinstatement dynamics in an attractor network. Neurocomputing, 2002, 44:615–622
Sompolinsky H, Kanter I. Temporal association in asymmetric neural networks. Phys Rev Lett, 1986, 57:2861–2864
Philip S, Tsimring L S, Rabinnovich M I. Dynamics-based sequential memory: winnerless competition of patterns. Phys Rev E, 2003, 67:011905
Rehn M, Lansner A. Sequence memory with dynamical synapses. Neurocomputing, 2004, 58:271–278
Tank D W, Hopfield J J. Neural computation by concentrating information in time. Proc Nat Acad Sci, 1987, 84:1896–1900
Kleinfeld D. Sequential state generation by model neural networks. Proc Nat Acad Sci, 1986, 83:9469–9473
Gutfreund H, Mezard M. Processing of temporal sequences in neural networks. Phys Rev Lett, 1988, 61:235–238
Lawrence M, Trappenberg T, Fine A. Rapid learning and robust recall of long sequences in modular associator networks. Neurocomputing, 2006, 69:634–641
Ramón H, Mikhail R. Reproducible sequence generation in random neural ensembles. Phys Rev Lett, 2004, 93:238104
Kleinfeld D, Sompolinsky H. Associative neural network model for the generation of temporal patterns. Theory and application to central pattern generators. Biophys J, 1988, 54:1039–1051
Carpinteiro O A S. A hierarchical self-organizing map model for sequence recognition. Neural Process Lett, 1999, 9:209–220
Xia M, Wang Z, Fang J. Temporal association based on dynamic depression synapses and chaotic neurons. Neurocomputing, 2011, 74:3242–3247
Hopfield J J. Neural networks and physical systems with emergent collective computation abilities. Proc Nat Acad Sci, 1982, 79:2445–2558
Wickramasinghe L K, Alahakoon L D, Smith-Miles K. A novel episodic associative memory model for enhanced classification accuracy. Pattern Recogn Lett, 2007, 28:1193–1202
Amari S. Characteristics of sparsely encoded associative memory. Neural Netw, 1989, 2:451–457
Sompolinsky H, Kanter I. Temporal association in asymmetric neural networks. Phys Rev Lett, 1986, 57:2861–2864
Xia M, Tang Y, Fang J, et al. Efficient multi-sequence memory with controllable steady-state period and high sequence storage capacity. Neural Comput Appl, 2011, 20:17–24
Horn D, Usher M. Parallel activation of memories in an oscillatory neural network. Neural Comput, 1991, 3:31–43
Ransom K W, James A R, Scott A W, et al. An oscillatory hebbian network model of short-term memory. Neural Comput, 2009, 21:741–761
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Xia, M., Weng, L., Wang, Z. et al. Sequence memory based on an oscillatory neural network. Sci. China Inf. Sci. 57, 1–12 (2014). https://doi.org/10.1007/s11432-013-4998-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-013-4998-z