Abstract
Cells in the rat hippocampus fire as a function of the animal's location in space. Thus, a rat moving through the world produces a statistically reproducible sequence of “place cell” firings. With this perspective, spatial navigation can be viewed as a sequence learning problem for the hippocampus. That is, learning entails associating the relationships among a sequence of places that are represented by a sequence of place cell firing. Recent experiments by McNaughton and colleagues suggest the hippocampus can recall a sequence of place cell firings at a faster rate than it was experienced. This speedup, which occurs during slow-wave sleep, is called temporal compression. Here, we show that a simplified model of hippocampal area CA3, based on integrate-and-fire cells and unsupervised Hebbian learning, reproduces this temporal compression. The amount of compression is proportional to the activity level during recall and to the relative timespan of associativity during learning. Compression seems to arise from an alteration of network dynamics between learning and recall. During learning, the dynamics are paced by external input and slowed by a low overall level of activity. During recall, however, external input is absent, and the dynamics are controlled by intrinsic network properties. Raising the activity level by lowering inhibition increases the rate at which the network can transition between previously learned states and thereby produces temporal compression. The tendency for speeding up future activations, however, is limited by the temporal range of associations that were present during learning.
Similar content being viewed by others
References
Alvarez P, Squire LR (1994) Memory consolidation and the medial temporal lobe: A simple network model. Proc. Natl. Acad. Sci. USA 91: 7041–7045.
Amaral DG (1987) Memory: Anatomical organization of candidate brain regions. In: F Plum, ed. Handbook of Physiology, Section I: The Nervous System V. Oxford University Press, New York. pp. 211–293.
Amaral DG, Ishizuka N, Claiborne B (1990) Neurons, numbers, and the hippocampal network. In: J Storm-Mathisen, J Zimmer, OP Ottersen, eds. Understanding the Brain Through the Hippocampus: The Hippocampal Region as a Model for Studying Structure and Function. Elsevier, pp. 1–11.
August DA, Levy WB (1996) Temporal sequence compression by a hippocampal network model. In: INNSWorld Congress on Neural Networks. Erlbaum, Mahwah, NJ. pp. 1299–1303.
Benington JH, Heller HC (1995) Restoration of brain energy metabolism as the function of sleep. Prog. Neurobiol. 45: 347–360.
Bernard C, Wheal HV (1994) Model of local connectivity patterns in CA3 and CA1 areas of the hippocampus. Hippocampus 4(5): 497–529.
Blum KI, Abbott LF (1995) Functional significance of long-term potentiation in recurrent networks. Intl. J. Neural Syst. (Supp.) 6:25–31.
Blum KI, Abbott LF (1996) A model of spatial map formation in the hippocampus of the rat. Neural Comp. 8(1):85–93.
Buhl EH, Halasy K, Somogyi P (1994) Diverse sources of hippocampal unitary inhibitory postsynaptic potentials and the number of synaptic release sites. Nature 368:823–828.
Bunsey M, Eichenbaum H(1995) Selective damage to the hippocampal region blocks long-term retention of a natural and nonspatial stimulus-stimulus assocation. Hippocampus 5:546–556.
Buzsaki G (1984a) Feed-forward inhibition in the hippocampal formation. Prog. Neurobiol. 22:131–153.
Buzsaki G (1984b) Long-term changes of hippocampal sharp-waves following high-frequency afferent activation. Brain Res. 300: 179–82.
Buzsaki G (1986) Hippocampal sharp waves: Their origin and significance. Brain Res. 398:242–252.
Buzsaki G (1989) Two-stage model of memory trace formation: A role for "noisy" brain states. Neurosci. 31(3):551–570.
Buzsaki G (1996) The hippocampo-neocortical dialogue. Cerebral Cortex 6:81–92.
Buzsaki G, Chrobak JJ (1995) Temporal structure in spatially organized neuronal ensembles: A role for interneuronal networks. Curr. Opin. Biol. 5:504–510.
Buzsaki G, Horvath Z, Urioste R, Hetke J, Wise K (1992) High-frequency network oscillation in the hippocampus. Science 256:1025–1027.
Chrobak JJ, Buzsaki G (1994) Selective activation of deep layer (V–VI) retrohippocampal cortical neurons during hippocampal sharp waves in the behaving rat. J. Neurosci. 14(10): 6160–6170.
Deacon TW, Eichenbaum H, Rosenberg P, Eckmann KW (1983) Afferent connections of the perirhinal cortex in the rat. J. Comp. Neurol. 220:168–190.
Gulyas AI, Miles R, Sik A, Toth K, Tamamaki N, Freund TF (1993) Hippocampal pyramidal cells excite inhibitory neurons through a single release site. Nature 366:683–687.
Gustafsson B, Wigstrom H (1986) Hippocampal long-lasting potentiation produced by pairing single volleys and brief conditioning tetani evoked in separate afferents. J. Neurosci. 6(6): 1575–1582.
Holmes WR, Levy WB (1990) Insights into associative long-term potentiation from computational models of NMDA receptormediated calcium influx and intracellular calcium concentration changes. J. Neurophys. 63(5):1148–1168.
Holmes WR, Levy WB (1994) Temporal requirements for associative LTP in the dentate. Dependence on modeled r m and r i values. In: FH Eeckman, ed. Computation in Neurons and Neural Systems. Kluwer, Boston. pp. 299–304.
Ishizuka N, Weber J, Amaral DG (1990) Organization of intrahippocampal projections originating from CA3 pyramidal cells in the rat. J. Comp. Neurol. 295:580–623.
Jensen O, Lisman JE (1996) Hippocampal CA3 region predicts memory sequences: Accounting for the phase precession of place cells. Learning and Memory 3: 279–287.
Leonard BJ, McNaughton BL, Barnes CA (1987) Supression of hippocampal plasticity during slow-wave sleep. Brain Res. 425: 174-177.
Levy WB (1989) A computational approach to hippocampal function. In: RD Hawkins, GH Bower, eds. Computational Modeling of Learning in Simple Neural Systems. Academic Press, Orlando, FL. pp. 243–305.
Levy WB (1994) Unification of hippocampal function via computational considerations. In: INNS World Congress on Neural Networks, vol. 4. Erlbaum, NJ. pp. 661–666.
Levy WB, Colbert CM, Desmond, NL (1995a). Another network model bites the dust: Entorhinal inputs are no more than weakly excitatory in the hippocampal CA1 region. Hippocampus 5: 137–140.
Levy WB, Sederberg PB (1997) A neural network model of hippocampally mediated trace conditioning. In: IEEE International Congress on Neural Networks, vol. 1, IEEE, NJ, pp. 372–376.
Levy WB, Sederberg PB, August DA (1998) Sequence compression by a hippocampal model: A functional dissection. Comput. and Neural Sys.
Levy WB, Steward O (1983) Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus. Neurosci. 8(4):791–797.
Levy WB, Wu X (1996) The relationship of local context codes to sequence length memory capacity. Network 7:371–384.
Levy WB, Wu X, Baxter RA (1995b) Unification of hippocampal function via computational/encoding considerations. In: Proceedings of the Third Workshop: From Biology to High-Energy Physics. Intl. J. Network Sys., 6 suppl.:71–80.
Levy WB, Wu X, Tyrcha JM (1996) Solving the transverse patterning problem by learning context present: A special role for input codes. In: INNS World Congress on Neural Networks. Erlbaum, NJ. pp. 1305–1309.
Lisman JE, Idiart MAP (1995) Storage of 7±2 short-term memories in oscillatory subcycles. Science 267:1512–1515.
Marr D (1971) Simple memory: Atheory for archicortex. Phil.Trans. Royal. Soc. Lond. 262:23–81.
McBain C, Dingledine R (1992) Dual-component miniature excitatory synaptic currents in rate hippocampal CA3 pyramidal neurons. J. Neurophys. 68(1):16–27.
McClelland JL, McNaughton BL, O'Reilly RC (1994) Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Technical Report PDP.CNS.94.1, Carnegie Mellon University.
McGaugh JL, Petrinovich L (1959) The effect of strychnine sulfate on maze learning. Am. J. Psychol. 72:99–102.
McNaughton BL, Barnes CA, Gerrard JL, Gothard K (1996) Deciphering the hippocampal polyglot: The hippocampus as a path integration system. J. Exp. Biol. 199:173–185.
Miles R (1990) Synaptic excitation of inhibitory cells by single CA3 hippocampal pyramidal cells of the guinea-pig in vitro. J. Physiol. 428:61–77.
Minai AA, Levy WB (1993a) The dynamics of sparse random networks. Biol. Cybern. 70:177–187.
Minai AA, Levy WB (1993b) Sequence learning in a single trial. In: INNS World Congress on Neural Networks, vol. 2. Erlbaum, NJ. pp. 505–508.
Minai AA, Levy WB (1993c) Setting the activity level in sparse random networks. Neural Computation 6:85–99.
Muller RU, Kubie JL (1989) The firing of hippocampal place cells predicts the future position of freely moving rats. J. Neurosci. 9(12):4101–4110.
O'Keefe J, Conway DH (1978) Hippocampal place units in the freely moving rat: Why they fire when they fire. Exp. Brain Res. 31: 573–590.
O'Keefe J, Reece ML (1993) Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 3: 317–330.
Prepscius C, Levy WB (1994) Sequence prediction and cognitive mapping by a biologically plausible neural network. In: INNS World Congress on Neural Networks, vol. 4. Erlbaum, NJ. pp. 164–169.
Quirk GJ, Muller RU, Kubie JL, Jr., Ranck JB (1992) The positional firing properties of medial entorhinal neurons: Description and comparison with hippocampal place cells. J. Neurosci. 12(5):1945–1963.
Ranck JB (1973) Studies on single neurons in dorsal hippocampal formation and septum in unrestrained rats. I. Behavioral correlates and firing repetoires. Exp. Neurol. 43:461–531.
Ranck JB (1975) Behavioral correlates and firing repertoires of neurons in the dorsal hippocampal formation and septum of unrestrained rats. In: RL Isaacson, KH Pribram, eds. The Hippocampus, vol. 2. Plenum Press, New York. pp. 207–244.
Redish AD, Touretzky DS (1997) Cognitive maps beyond the hippocampus. Hippocampus 7(1):15–35.
Shen B, McNaughton BL (1996) Modeling the spontaneous reactivation of experience-specific hippocampal cell assemblies during sleep. Hippocampus 6:685–692.
Skaggs WE, McNaughton BL (1995) The hippocampal theta rhythm and memory for temporal sequences of events. Intl. J. Neural Sys. 6:101–105.
Skaggs WE, McNaughton BL (1996) Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science 271:1870–1873.
Skaggs WE, McNaughton BL, Wilson MA, Barnes CA (1996) Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6:149–172.
Smith AC, Levy WB (1998) Controlling activity fluctuations in large, sparsely connected random networks. Neural Comput. submitted.
Spruston N, Jonas P, Sakmann B (1995) Dendritic glutamate receptor channels in rat hippocampal CA3 and CA1 pyramidal neurons. J. Physiol. 482(2):325–352.
Squire LR, Zola-Morgan S (1991) The medial temporal lobe memory system. Science 253:1380–1386.
Staley KJ, Mody I (1992) Shunting of excitatory input to dentate gyrus granule cells by a depolarizing GABA-A receptor-mediated postsynaptic conductance. J. Neurophys. 68(1):197–212.
Steward O, Scoville S (1976) Cells of origin of entorhinal cortical afferents to the hippocampus and fascia dentata of the rat. J. Comp. Neurol. 169:347–370.
Suzuki SS, Smith GK (1987) Spontaneous EEG spikes in the normal hippocampus. I. Behavioral correlates, laminar profiles and bilateral synchrony. Electroenceph. Clin. Neurophys. 67(4):348–359.
Thompson LT, Best PJ (1989) Place cells and silent cells in the hippocampus of freely-behaving rats. J. Neurosci. 9(7):2382–2390.
Treves A, Rolls ET (1992) Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network. Hippocampus 2(2):189–200.
Tsodyks MV, Skaggs WE, Sejnowski TJ, McNaughton BL (1996) Population dynamics and theta rhythm phase precession of hippocampal place cell firing: Aspiking neuron model. Hippocampus 6:271–280.
Wallenstein GV, Hasselmo ME (1997) GABAergic modulation of hippocampal population activity: Sequence learning, place field development, and phase precession effect. J. Neurophys. 78(1), 1993, 408.
Whishaw IQ, Jarrard LE (1996) Evidence for extra-hippocampal involvement in place learning and hippocampal involvement in path integration. Hippocampus 6(5):513–524.
Wiener SI, Paul CA, Eichenbaum H (1989) Spatial and behavioral correlates of hippocampal neuronal activity. J. Neurosci. 9(8):2737–2763.
Wilson MA, McNaughton BL (1994) Reactivation of hippocampal ensemble memories during sleep. Science 265:676–679.
Witter MP (1993) Organization of the entorhinal-hippocampal system: A review of current anatomical data. Hippocampus 3:33–44.
Wu XB, Levy WB (1995) Controlling performance by controlling activity levels in a model of hippocampal region CA3. I. Overcoming the effect of noise by adjusting network excitability parameters. In: INNS World Congress on Neural Networks. vol. 1. Erlbaum, NJ. pp. 577–581.
Wu X, Levy WB (1996) Goal finding in a simple, biologically inspired neural network. In: INNS World Congress on Neural Networks. Erlbaum, NJ. pp. 1279–1282.
Ylinen A, Bragin A, Nadasdy Z, Jando G, Szabo I, Sik A, Buzsaki G (1995) Sharpwave-associated high-frequency oscillation (200 Hz) in the intact hippocampus: Network and intracellular mechanisms. J. Neurosci. 15(1):30–46.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
August, D., Levy, W. Temporal Sequence Compression by an Integrate-and-Fire Model of Hippocampal Area CA3. J Comput Neurosci 6, 71–90 (1999). https://doi.org/10.1023/A:1008861001091
Issue Date:
DOI: https://doi.org/10.1023/A:1008861001091