Abstract
A neural mechanism for control of dynamics and function of associative processes in a hierarchical memory system is demonstrated. For the representation and processing of abstract knowledge, the semantic declarative memory system of the human brain is considered. The dynamics control mechanism is based on the influence of neuronal adaptation on the complexity of neural network dynamics. Different dynamical modes correspond to different levels of the ultrametric structure of the hierarchical memory being invoked during an associative process. The mechanism is deterministic but may also underlie free associative thought processes. The formulation of an abstract neural network model of hierarchical associative memory utilizes a recent approach to incorporate neuronal adaptation. It includes a generalized neuronal activation function recently derived by a Hodgkin-Huxley-type model. It is shown that the extent to which a hierarchically organized memory structure is searched is controlled by the neuronal adaptability, i.e. the strength of coupling between neuronal activity and excitability. In the brain, the concentration of various neuromodulators in turn can regulate the adaptability. An autonomously controlled sequence of bifurcations, from an initial exploratory to a final retrieval phase, of an associative process is shown to result from an activity-dependent release of neuromodulators. The dynamics control mechanism may be important in the context of various disorders of the brain and may also extend the range of applications of artificial neural networks.
Similar content being viewed by others
Change history
01 April 1996
Due to a typing error g i k (i i k (t)) in equation (3) should be replaced by g p k (i p k (t),c p k (t)). The activity of a pyramidal unit s p j (t) in equations (9) and (12) is equal to g p j (i p j (t),c p j (t)).
References
Ambros-Ingerson J, Granger R, Lynch G (1990) Simulation of paleocortex performs hierarchical clustering. Science 247:1344–1348
Baskys A (1992) Metabotropic receptors and “slow” excitatory actions of glutamate agonists in the hippocampus. Trends Neurosci 15:92–96
Baskys A, Bernstein NK, Barolet AW, Carlen PL (1990) NMDA and quisqualate reduce a Ca-dependent K+ current by a protein kinase-mediated mechanism. Neurosci Lett 112:76–81
Benettin G, Galgani L, Strelcyn J-M (1976) Kolmogorov entropy and numerical experiments. Phys Rev A 14:2338–2345
Bland BH (1986) The physiology and pharmacology of hippocampal formation theta rhythms. Prog Neurobiol 26:1–54
Blatz AL, Magleby KL (1986) Single apamin-blocked Ca-activated K+ channels of small conductance in cultured rat skeletal muscle. Nature 323:718–720
Buhl EH, Halasy K, Somogyi P (1994) Diverse sources of hippocampal unitary inhibitory postsynaptic potentials and the number of synaptic release sites. Nature 368:823–828
Cartling B (1993) Control of the complexity of associative memory dynamics by neuronal adaptation. Int J Neural Syst 4:129–141
Cartling B (1994) Generation of associative processes in a neural network with realistic features of architecture and units. Int J Neural Syst 5:181–194
Cartling B (1995a) Autonomous neuromodulatory control of associative processes. Network 6:247–260
Cartling B (1995b) A generalized neuronal activation function derived from ion channel characteristics. Network 6:389–401
Cartling B (1995c) Response characteristics of a low-dimensional model neuron. Neural Comp (submitted)
Chapeau-Blondeau F, Chambet N (1995) Synapse models for neural networks:from ion channel kinetics to multiplicative coefficient w ij .Neural Comp 7:713–734
Charpak S, Gähwiler BH, Do KQ, Knöpfel T (1990) Potassium conductances in hippocampal neurons blocked by excitatory aminoacid transmitters. Nature 347:765–767
Colino A, Halliwell JV (1987) Differential modulation of three separate K-conductances in hippocampal CA1 neurons by serotonin. Nature 328:73–77
Collins AM, Quillian MR (1969) Retrieval time from semantic memory. J Verbal Learn Verbal Behav 8:240–247
Connors BW, Gutnick MJ (1990) Intrinsic firing patterns of diverse neocortical neurons. Trends Neurosci 13:99–104
Constanti A, Sim JA (1987) Calcium-dependent potassium conductance in guinea-pig olfactory cortex neurons in vitro. J Physiol (Lond) 387:173–194
Cortes C, Krogh A, Hertz JA (1987) Hierarchical associative networks. J Phys A:Math Gen 20:4449–4455
Coyle JT, Price DL, DeLong MR (1983) Alzheimer's disease:a disorder of cortical cholinergic innervation. Science 219:1184–1190
Crick F, Koch C (1990) Towards a neurobiological theory of consciousness. Semin Neurosci 2:263–275
Destexhe A, Mainen ZF, Sejnowski TJ (1994) An efficient method for computing synaptic conductances based on a kinetic model of receptor binding. Neural Comp 6:14–18
Feigelman MV, Ioffe LB (1987) The augmented models of associative memory asymmetric interaction and hierarchy of patterns. Int J Mod Phys B 1:51–68
Fransén E, Lansner A (1995) Low spiking rates in a population of mutually exciting pyramidal cells. Network 6:271–288
Gröbler T, Marton P, Erdi P (1991) On the dynamic organization of memory. Biol Cybern 65:73–79
Gutfreund H (1988) Neural networks with hierarchically correlated patterns. Phys Rev A 37:570–577
Hasselmo ME, Bower JM (1992) Cholinergic suppression specific to intrinsic not afferent fiber synapses in rat piriform (olfactory) cortex. J Neurophysiol 67:1222–1229
Hasselmo ME, Anderson BP, Bower JM (1992) Cholinergic modulation of cortical associative memory function. J Neurophysiol 67:1230–1246
Hebb DO (1949) The organization of behavior. Wiley, New York
Herrmann M, Ruppin E, Usher M (1993) A neural model of the dynamic activation of memory. Biol Cybern 68:455–463
Hertz J, Krogh A, Palmer, RG (1991) Introduction to the theory of neural computation. Addison-Wesley, Redwood City
Hille B (1992) Ionic channels of excitable membranes. Sinauer, Sunderland
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558
Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 81:3088–3092
Kanter I, Sompolinsky H (1987) Associative recall of memory without errors. Phys Rev A 35:380–392
Kihlstrom JF (1987) The cognitive unconscious. Science 237:1445–1452
Krogh A, Hertz JA (1988) Mean-field analysis of hierarchical associative networks with “magnetisation”. J Phys A:Math Gen 21:2211–2224
Madison DV, Nicoll RA (1982) Noradrenaline blocks accommodation of pyramidal cell discharge in the hippocampus. Nature 299:636–638
Magleby KL (1987) Short-term changes in synaptic efficacy. In: Edelman GM, Gall WE, Cowan WM (eds) Synaptic function. Wiley, New York, pp 21–56
Mason A, Larkman A (1990) Correlations between morphology and electrophysiology of pyramidal neurons in slices of rat visual cortex. II. Electrophysiology. J Neurosci 10:1415–1428
McCormick DA (1989) Cholinergic and nonadrenergic modulation of thalamocortical processing. Trends Neurosci 12:215–221
McCormick DA, Connors BW, Lighthall JW, Prince DA (1985) Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. J Neurophysiol 54:780–806
Nicoll RA (1988) The coupling of neurotransmitter receptors to ion channels in the brain. Science 241:545–551
Nicoll RA (1994) Cajal's rational psychology. Nature 368:808–809
Parga N, Virasoro MA (1986) The ultrametric organization of memories in a neural network. J Phys (Paris) 47:1857–1864
Parnas H, Parnas I, Segal LA (1990) On the contribution of mathematical models to the understanding of neurotransmitter release. Int Rev Neurobiol 32:1–50
Personnaz L, Guyon I, Dreyfus G (1985) Information storage and retrieval in spin-glass like neural networks. J Phys (Paris) Lett 46:L359-L365
Personnaz L, Guyon I, Dreyfus G (1986) Collective computational properties of neural networks: new learning mechanisms. Phys Rev A 34:4217–4228
Press WH, Teukolsky SA, Vetterling WT, Flannery BP (1992) Numerical recipes:the art of scientific computing. Cambridge University Press, Cambridge
Ruppin E, Usher M (1990) An attractor neural network model of semantic fact retrieval. Network 1:325–344
Shepherd GM (1990) The synaptic organization of the brain. Oxford University Press, Oxford
Shimada I, Nagashima T (1979) A numerical approach to ergodic problem of dissipative dynamical systems. Prog Theor Phys 61:1605–1616
Smith EE, Shoben EJ, Rips LJ (1974) Structure and process in semantic memory: a featural model for semantic decisions. Physiol Rev 81:214–241
Squire LR (1982) The neuropsychology of human memory. Annu Rev Neurosci 5:241–273
Squire LR (1987) Memory and brain. Oxford University Press, New York
Stern P, Edwards FA, Sakmann B (1992) Fast and slow components of unitary EPSCs on stellate cells elicited by focal stimulation in slices of rat visual cortex. J Physiol (Lond) 449:247–278
Stratton KR, Worley PF, Baraban JM (1989) Excitation of hippocampal neurons by stimulation of glutamate Q p receptors. Eur J Pharmacol 173:235–237
Treisman A, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12:97–136
Tsodyks MV (1990) Hierarchical associative memory in neural networks with low activity level. Mod Phys Lett B 4:259–265
Tulving E (1972) Episodic and semantic memory. In: Tulving E, Donaldson W (eds) Organization of memory. Academic Press, New York, pp 381–403
Tulving E (1985) How many memory systems are there? Am Psychol 40:385–398
White EL (1989) Cortical circuits. Synaptic organization of the cerebral cortex: structure, function, and theory. Birkhäuser, Boston
Yamada WM, Koch C, Adams PR (1989) Multiple channels and calcium dynamics. In: Koch C, Segev I (eds) Methods in neuronal modeling: from synapses to networks. MIT Press, Cambridge, Mass, pp 97–133
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Cartling, B. Dynamics control of semantic processes in a hierarchical associative memory. Biol. Cybern. 74, 63–71 (1996). https://doi.org/10.1007/BF00199138
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00199138