Skip to main content
Log in

Dynamics control of semantic processes in a hierarchical associative memory

  • Original Papers
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

An Erratum to this article was published on 01 April 1996

This article has been updated

Abstract

A neural mechanism for control of dynamics and function of associative processes in a hierarchical memory system is demonstrated. For the representation and processing of abstract knowledge, the semantic declarative memory system of the human brain is considered. The dynamics control mechanism is based on the influence of neuronal adaptation on the complexity of neural network dynamics. Different dynamical modes correspond to different levels of the ultrametric structure of the hierarchical memory being invoked during an associative process. The mechanism is deterministic but may also underlie free associative thought processes. The formulation of an abstract neural network model of hierarchical associative memory utilizes a recent approach to incorporate neuronal adaptation. It includes a generalized neuronal activation function recently derived by a Hodgkin-Huxley-type model. It is shown that the extent to which a hierarchically organized memory structure is searched is controlled by the neuronal adaptability, i.e. the strength of coupling between neuronal activity and excitability. In the brain, the concentration of various neuromodulators in turn can regulate the adaptability. An autonomously controlled sequence of bifurcations, from an initial exploratory to a final retrieval phase, of an associative process is shown to result from an activity-dependent release of neuromodulators. The dynamics control mechanism may be important in the context of various disorders of the brain and may also extend the range of applications of artificial neural networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Change history

  • 01 April 1996

    Due to a typing error g i k (i i k (t)) in equation (3) should be replaced by g p k (i p k (t),c p k (t)). The activity of a pyramidal unit s p j (t) in equations (9) and (12) is equal to g p j (i p j (t),c p j (t)).

References

  • Ambros-Ingerson J, Granger R, Lynch G (1990) Simulation of paleocortex performs hierarchical clustering. Science 247:1344–1348

    Google Scholar 

  • Baskys A (1992) Metabotropic receptors and “slow” excitatory actions of glutamate agonists in the hippocampus. Trends Neurosci 15:92–96

    Google Scholar 

  • Baskys A, Bernstein NK, Barolet AW, Carlen PL (1990) NMDA and quisqualate reduce a Ca-dependent K+ current by a protein kinase-mediated mechanism. Neurosci Lett 112:76–81

    Google Scholar 

  • Benettin G, Galgani L, Strelcyn J-M (1976) Kolmogorov entropy and numerical experiments. Phys Rev A 14:2338–2345

    Google Scholar 

  • Bland BH (1986) The physiology and pharmacology of hippocampal formation theta rhythms. Prog Neurobiol 26:1–54

    Google Scholar 

  • Blatz AL, Magleby KL (1986) Single apamin-blocked Ca-activated K+ channels of small conductance in cultured rat skeletal muscle. Nature 323:718–720

    Google Scholar 

  • Buhl EH, Halasy K, Somogyi P (1994) Diverse sources of hippocampal unitary inhibitory postsynaptic potentials and the number of synaptic release sites. Nature 368:823–828

    Google Scholar 

  • Cartling B (1993) Control of the complexity of associative memory dynamics by neuronal adaptation. Int J Neural Syst 4:129–141

    Google Scholar 

  • Cartling B (1994) Generation of associative processes in a neural network with realistic features of architecture and units. Int J Neural Syst 5:181–194

    Google Scholar 

  • Cartling B (1995a) Autonomous neuromodulatory control of associative processes. Network 6:247–260

    Google Scholar 

  • Cartling B (1995b) A generalized neuronal activation function derived from ion channel characteristics. Network 6:389–401

    Google Scholar 

  • Cartling B (1995c) Response characteristics of a low-dimensional model neuron. Neural Comp (submitted)

  • Chapeau-Blondeau F, Chambet N (1995) Synapse models for neural networks:from ion channel kinetics to multiplicative coefficient w ij .Neural Comp 7:713–734

    Google Scholar 

  • Charpak S, Gähwiler BH, Do KQ, Knöpfel T (1990) Potassium conductances in hippocampal neurons blocked by excitatory aminoacid transmitters. Nature 347:765–767

    Google Scholar 

  • Colino A, Halliwell JV (1987) Differential modulation of three separate K-conductances in hippocampal CA1 neurons by serotonin. Nature 328:73–77

    Google Scholar 

  • Collins AM, Quillian MR (1969) Retrieval time from semantic memory. J Verbal Learn Verbal Behav 8:240–247

    Google Scholar 

  • Connors BW, Gutnick MJ (1990) Intrinsic firing patterns of diverse neocortical neurons. Trends Neurosci 13:99–104

    Google Scholar 

  • Constanti A, Sim JA (1987) Calcium-dependent potassium conductance in guinea-pig olfactory cortex neurons in vitro. J Physiol (Lond) 387:173–194

    Google Scholar 

  • Cortes C, Krogh A, Hertz JA (1987) Hierarchical associative networks. J Phys A:Math Gen 20:4449–4455

    Google Scholar 

  • Coyle JT, Price DL, DeLong MR (1983) Alzheimer's disease:a disorder of cortical cholinergic innervation. Science 219:1184–1190

    Google Scholar 

  • Crick F, Koch C (1990) Towards a neurobiological theory of consciousness. Semin Neurosci 2:263–275

    Google Scholar 

  • Destexhe A, Mainen ZF, Sejnowski TJ (1994) An efficient method for computing synaptic conductances based on a kinetic model of receptor binding. Neural Comp 6:14–18

    Google Scholar 

  • Feigelman MV, Ioffe LB (1987) The augmented models of associative memory asymmetric interaction and hierarchy of patterns. Int J Mod Phys B 1:51–68

    Google Scholar 

  • Fransén E, Lansner A (1995) Low spiking rates in a population of mutually exciting pyramidal cells. Network 6:271–288

    Google Scholar 

  • Gröbler T, Marton P, Erdi P (1991) On the dynamic organization of memory. Biol Cybern 65:73–79

    Google Scholar 

  • Gutfreund H (1988) Neural networks with hierarchically correlated patterns. Phys Rev A 37:570–577

    Google Scholar 

  • Hasselmo ME, Bower JM (1992) Cholinergic suppression specific to intrinsic not afferent fiber synapses in rat piriform (olfactory) cortex. J Neurophysiol 67:1222–1229

    Google Scholar 

  • Hasselmo ME, Anderson BP, Bower JM (1992) Cholinergic modulation of cortical associative memory function. J Neurophysiol 67:1230–1246

    Google Scholar 

  • Hebb DO (1949) The organization of behavior. Wiley, New York

    Google Scholar 

  • Herrmann M, Ruppin E, Usher M (1993) A neural model of the dynamic activation of memory. Biol Cybern 68:455–463

    Google Scholar 

  • Hertz J, Krogh A, Palmer, RG (1991) Introduction to the theory of neural computation. Addison-Wesley, Redwood City

    Google Scholar 

  • Hille B (1992) Ionic channels of excitable membranes. Sinauer, Sunderland

    Google Scholar 

  • Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558

    Google Scholar 

  • Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 81:3088–3092

    Google Scholar 

  • Kanter I, Sompolinsky H (1987) Associative recall of memory without errors. Phys Rev A 35:380–392

    Google Scholar 

  • Kihlstrom JF (1987) The cognitive unconscious. Science 237:1445–1452

    Google Scholar 

  • Krogh A, Hertz JA (1988) Mean-field analysis of hierarchical associative networks with “magnetisation”. J Phys A:Math Gen 21:2211–2224

    Google Scholar 

  • Madison DV, Nicoll RA (1982) Noradrenaline blocks accommodation of pyramidal cell discharge in the hippocampus. Nature 299:636–638

    Google Scholar 

  • Magleby KL (1987) Short-term changes in synaptic efficacy. In: Edelman GM, Gall WE, Cowan WM (eds) Synaptic function. Wiley, New York, pp 21–56

    Google Scholar 

  • Mason A, Larkman A (1990) Correlations between morphology and electrophysiology of pyramidal neurons in slices of rat visual cortex. II. Electrophysiology. J Neurosci 10:1415–1428

    Google Scholar 

  • McCormick DA (1989) Cholinergic and nonadrenergic modulation of thalamocortical processing. Trends Neurosci 12:215–221

    Google Scholar 

  • McCormick DA, Connors BW, Lighthall JW, Prince DA (1985) Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. J Neurophysiol 54:780–806

    Google Scholar 

  • Nicoll RA (1988) The coupling of neurotransmitter receptors to ion channels in the brain. Science 241:545–551

    Google Scholar 

  • Nicoll RA (1994) Cajal's rational psychology. Nature 368:808–809

    Google Scholar 

  • Parga N, Virasoro MA (1986) The ultrametric organization of memories in a neural network. J Phys (Paris) 47:1857–1864

    Google Scholar 

  • Parnas H, Parnas I, Segal LA (1990) On the contribution of mathematical models to the understanding of neurotransmitter release. Int Rev Neurobiol 32:1–50

    Google Scholar 

  • Personnaz L, Guyon I, Dreyfus G (1985) Information storage and retrieval in spin-glass like neural networks. J Phys (Paris) Lett 46:L359-L365

    Google Scholar 

  • Personnaz L, Guyon I, Dreyfus G (1986) Collective computational properties of neural networks: new learning mechanisms. Phys Rev A 34:4217–4228

    Google Scholar 

  • Press WH, Teukolsky SA, Vetterling WT, Flannery BP (1992) Numerical recipes:the art of scientific computing. Cambridge University Press, Cambridge

    Google Scholar 

  • Ruppin E, Usher M (1990) An attractor neural network model of semantic fact retrieval. Network 1:325–344

    Google Scholar 

  • Shepherd GM (1990) The synaptic organization of the brain. Oxford University Press, Oxford

    Google Scholar 

  • Shimada I, Nagashima T (1979) A numerical approach to ergodic problem of dissipative dynamical systems. Prog Theor Phys 61:1605–1616

    Google Scholar 

  • Smith EE, Shoben EJ, Rips LJ (1974) Structure and process in semantic memory: a featural model for semantic decisions. Physiol Rev 81:214–241

    Google Scholar 

  • Squire LR (1982) The neuropsychology of human memory. Annu Rev Neurosci 5:241–273

    Google Scholar 

  • Squire LR (1987) Memory and brain. Oxford University Press, New York

    Google Scholar 

  • Stern P, Edwards FA, Sakmann B (1992) Fast and slow components of unitary EPSCs on stellate cells elicited by focal stimulation in slices of rat visual cortex. J Physiol (Lond) 449:247–278

    Google Scholar 

  • Stratton KR, Worley PF, Baraban JM (1989) Excitation of hippocampal neurons by stimulation of glutamate Q p receptors. Eur J Pharmacol 173:235–237

    Google Scholar 

  • Treisman A, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12:97–136

    Google Scholar 

  • Tsodyks MV (1990) Hierarchical associative memory in neural networks with low activity level. Mod Phys Lett B 4:259–265

    Google Scholar 

  • Tulving E (1972) Episodic and semantic memory. In: Tulving E, Donaldson W (eds) Organization of memory. Academic Press, New York, pp 381–403

    Google Scholar 

  • Tulving E (1985) How many memory systems are there? Am Psychol 40:385–398

    Google Scholar 

  • White EL (1989) Cortical circuits. Synaptic organization of the cerebral cortex: structure, function, and theory. Birkhäuser, Boston

    Google Scholar 

  • Yamada WM, Koch C, Adams PR (1989) Multiple channels and calcium dynamics. In: Koch C, Segev I (eds) Methods in neuronal modeling: from synapses to networks. MIT Press, Cambridge, Mass, pp 97–133

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cartling, B. Dynamics control of semantic processes in a hierarchical associative memory. Biol. Cybern. 74, 63–71 (1996). https://doi.org/10.1007/BF00199138

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00199138

Keywords

Navigation