Abstract
Mean-Field theory is extended to recurrent networks of spiking neurons endowed with short-term depression (STD) of synaptic transmission. The extension involves the use of the distribution of interspike intervals of an integrate-and-fire neuron receiving a Gaussian current, with a given mean and variance, in input. This, in turn, is used to obtain an accurate estimate of the resulting postsynaptic current in presence of STD. The stationary states of the network are obtained requiring self-consistency for the currents—those driving the emission processes and those generated by the emitted spikes. The model network stores in the distribution of two-state efficacies of excitatory-to-excitatory synapses, a randomly composed set of external stimuli. The resulting synaptic structure allows the network to exhibit selective persistent activity for each stimulus in the set. Theory predicts the onset of selective persistent, or working memory (WM) activity upon varying the constitutive parameters (e.g. potentiated/depressed long-term efficacy ratio, parameters associated with STD), and provides the average emission rates in the various steady states. Theoretical estimates are in remarkably good agreement with data “recorded” in computer simulations of the microscopic model.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbott LF, Varela JA, Sen K, Nelson SB (1997) Synaptic depression and cortical gain control. Science 275: 220–224.
Amit DJ (1998) Simulation in neurobiology - theory or experiment? TINS 21: 231–237.
Amit DJ, Bernacchia A, Yakovlev V (2003) Multiple working memory - model for behavioral experiment. Cerebral Cortex 13: 435–443.
Amit DJ, Brunel N (1997a) Dynamics of recurrent network of spiking neurons before and following learning. Network 8: 373–404.
Amit DJ, Brunel N (1997b) Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 7: 237–252.
Amit DJ, Mongillo G (2003a) Selective delay activity in the cortex: Phenomena and Interpretation. Cereb. Cortex 13: 1139–1150.
Amit DJ, Mongillo G (2003b) Spike-driven synaptic dynamics generating working memory states. Neural Comp. 15: 565–596.
Amit DJ, Tsodyks MV (1991a) Quantitative study of attractor neural networks retrieving at low spike rates I: Substrate spikes, rates and neurons gain. Network 2: 259–274.
Amit DJ, Tsodyks MV (1991b) Quantitative study of attractor neural networks retrieving at low spike rates. II: Low-rate retrieval in symmetric networks. Network 2: 275–294.
Bibitchkov D, Herrmann JM, Geisel T (2002) Pattern storage and processing in attractor networks with short-time synaptic dynamics. Network 13: 115–129.
Brunel N (2003) Dynamics and plasticity of stimulus-selective persistent activity in cortical network models. Cerebral Cortex 13: 1151–1161.
Brunel N, Carusi F, Fusi S (1998) Slow stochastic hebbian learning of classes of stimuli in a recurrent neural network. Network 9: 123–152.
Brunel N, Hakim V (1999) Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Computation 11: 1621–1671.
Brunel N, Sergi S (1998) Firing frequency of leaky integrate-and-fire neurons with synaptic currents dynamics. J. Theor. Biol. 195: 87–95.
Brunel N, Wang X-J (2001) Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 11: 63–85.
Compte A, Brunel N, Goldman-Rakic PS, Wang X-J (2000) Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb. Cortex 10: 910–923.
Compte A, Constantinidis C, Tegner J, Raghavachari S, Chafee MV, Goldman-Rakic PS, Wang X-J (2003) Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J. Neurophysiol. 90(5): 3441–3454.
Cox D, Miller HD (1977) The Theory of stochastic processes. CRC Press.
Curti E, Mongillo G, La Camera G, Amit DJ (2004) Mean-field and capacity in realistic networks of spiking neurons storing sparsely coded random memories. Neural Comp. 16: 2597–2637.
Erickson CA, Desimone R (1999) Responses of macaque perirhinal neurons during and after visual stimulus association learning. J. Neurosci. 19: 10404–10416.
Fusi S, Annunziato M, Badoni D, Salamon A, Amit DJ (2000) Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation. Neural Comp. 12: 2227–2258.
Galarreta M, Hestrin S (1998) Frequency-dependent synaptic depression and the balance of excitation and inhibition in the neocortex. Nat. Neurosci. 1: 587–594.
Kistler WM, van Hemmen JL (1999) Short-term synaptic plasticity and network behavior. Neural Computation 11: 1579–1594.
Loebel A, Tsodyks M (2002) Computation by ensemble synchronization in recurrent networks with synaptic depression. J. Comput. Neurosci. 13: 111–124.
Markram H, Wang Y, Tsodyks M (1998) Differential signaling via the same axon of neocortical pyramidal neurons. PNAS 95: 5323–5328.
Mongillo G, Amit DJ, Brunel N (2003) Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network. Eur. J. Neurosci. 18: 2011–2024.
Mongillo G, Curti E, Romani S, Amit DJ (2005) Learning in realistic networks of spiking neurons and spike-driven plastic synapses. Eur. J. Neurosci. 21: 3143–3160.
Moreno-Bote R, Parga N (2004) Role of synaptic filtering on the firing response of simple model neurons. Phys. Rev. Lett. 92: 028102.
Pantic L, Torres JJ, Kappen HJ, Gielen SC (2002) Associative memory with dynamic synapses. Neural Computation 14: 2903–2923.
Patie P (2004) On some First Passage Time Problems Motivated by Financial Applications. PhD thesis, ETH Zurich.
Rao SC, Rainer G, Miller EK (1997) Integration of what and where in the primate prefrontal cortex. Science 276: 821–824.
Rauch A, La Camera G, Luscher H-R, Senn W, Fusi S (2003) Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. J. Neurophysiol. 90: 1598–1612.
Renart A, Brunel N, Wang X-J (2003) Computational Neuroscience: A Comprehensive Approach, chapter 15. CRC press, pp. 431–490.
Tsodyks MV, Markram H (1997) The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. PNAS 94: 719–723.
Tsodyks MV, Pawelzik K, Markram H (1998) Neural networks with dynamic synapses. Neural Comp. 10: 821–835.
Tsodyks MV, Uziel A, Markram H (2000) Synchrony generation in recurrent networks with frequency-dependent synapses. J. Neurosci. 20(RC50): 1–5.
Tuckwell HC (1988). Introduction to theoretical neurobiology. Cambridge University Press.
van Vreeswijk CA, Sompolinsky H (1996) Chaos in neural networks with balanced excitatory and inhibitory activity. Science 274: 1724–1726.
Varela JA, Song S, Turrigiano GG, Nelson SB (1999) Differential depression at excitatory and inhibitory synapses in visual cortex. J. Neurosci. 19: 4293–4304.
Wang X-J (1999) Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. J. Neurosci. 19: 9587–9603.
Author information
Authors and Affiliations
Corresponding author
Additional information
Action Editor: Karen Sigvardt
Rights and permissions
About this article
Cite this article
Romani, S., Amit, D.J. & Mongillo, G. Mean-field analysis of selective persistent activity in presence of short-term synaptic depression. J Comput Neurosci 20, 201–217 (2006). https://doi.org/10.1007/s10827-006-6308-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10827-006-6308-x