Abstract
We discuss numerical methods for simulating large-scale, integrate-and-fire (I&F) neuronal networks. Important elements in our numerical methods are (i) a neurophysiologically inspired integrating factor which casts the solution as a numerically tractable integral equation, and allows us to obtain stable and accurate individual neuronal trajectories (i.e., voltage and conductance time-courses) even when the I&F neuronal equations are stiff, such as in strongly fluctuating, high-conductance states; (ii) an iterated process of spike-spike corrections within groups of strongly coupled neurons to account for spike-spike interactions within a single large numerical time-step; and (iii) a clustering procedure of firing events in the network to take advantage of localized architectures, such as spatial scales of strong local interactions, which are often present in large-scale computational models—for example, those of the primary visual cortex. (We note that the spike-spike corrections in our methods are more involved than the correction of single neuron spike-time via a polynomial interpolation as in the modified Runge-Kutta methods commonly used in simulations of I&F neuronal networks.) Our methods can evolve networks with relatively strong local interactions in an asymptotically optimal way such that each neuron fires approximately once in \(\mathcal{O}(N)\) operations, where N is the number of neurons in the system. We note that quantifications used in computational modeling are often statistical, since measurements in a real experiment to characterize physiological systems are typically statistical, such as firing rate, interspike interval distributions, and spike-triggered voltage distributions. We emphasize that it takes much less computational effort to resolve statistical properties of certain I&F neuronal networks than to fully resolve trajectories of each and every neuron within the system. For networks operating in realistic dynamical regimes, such as strongly fluctuating, high-conductance states, our methods are designed to achieve statistical accuracy when very large time-steps are used. Moreover, our methods can also achieve trajectory-wise accuracy when small time-steps are used.
Similar content being viewed by others
References
Anderson J, Lampl I, Gillespie D, Ferster D (2000) The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science, 290: 1968–1972
Angelucci A, Levitt JB, Walton EJ, Hupe JM, Bullier J, Lund JS (2002) Circuits for local and global signal integration in primary visual cortex. J. Neurosci., 22: 8633–8646
Borg-Graham L, Monier C, Fregnac Y (1996) Voltage-clamp measurement of visually-evoked conductances with whole-cell patch recordings in primary visual cortex. J Physiol Paris, 90(3-4): 185–188
Borg-Graham LJ, Monier C, Fregnac Y (1998) Visual input evokes transient and strong shunting inhibition in visual cortical neurons. Nature, 393(6683): 369–373
Bosking WH, Zhang Y, Schofield B, Fitzpatrick D (1997) Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. J. Neurosci., 17: 2112–2127
Brette R (to appear) Exact simulation of integrate-and-fire models with synaptic conductances. Neural Comput
Cai D, Rangan AV, McLaughlin DW (2005) Architectural and synaptic mechanisms underlying coherent spontaneous activity in v1. Proc. Nat’l Acad. Sci (USA), 102: 5868–5873
Cai D, Tao L, Shelley M, Mclaughlin DW (2004) An effective representation of fluctuation-driven neuronal networks with application to simple & complex cells in visual cortex. Pro. Nat. Acad. Sci. (USA), 101: 7757–7762
Callaway E (1998) Local circuits in primary visual cortex of the macaque monkey. Ann. Rev. Neurosci., 21: 47–74
Callaway E, Wiser A (1996) Contributions of individual layer 2 to 5 spiny neurons to local circuits in macaque primary visual cortex. Visual Neuroscience, 13: 907–922
Compte A, Sanchez-Vives MV, McCormick DA, Wang X-J (2003) Cellular and network mechanisms of slow oscillatory activity (< 1hz) and wave propagations in a cortical network model. J Neurophysiol., 89: 2707–2725
Destexhe A, Rudolph M, Pare D (2003) The high-conductance state of neocortical nurons in vivo. Nat. Rev., Neurosci, 4: 730–751
Fitzpatrick D, Lund J, Blasdel G (1985) Intrinsic connections of macaque striate cortex Afferent and efferent connections of lamina 4C. Journal of Neuroscience, 5: 3329–3349
Fornberg B (1998) A Practical Guide to Pseudospectral Methods. Cambridge University Press, New York.
Fourcaud-Trocme N, Hansel D, van Vreeswijk C, Brunel N (2003) How spike generation mechanisms determine the neuronal response to fluctuating inputs. J. Neurosci., 23
Frenkel D, Smit B (1996) Understanding Molecular Simulation. Academic Press, New York.
Gear CW (1971) Numerical Initial Value Problems in Ordinary Differential Equations. Prentice Hall, Englewood Cliffs, NJ.
Geisler C, Brunel N, Wang X-J (2005) Contributions of intrinsic membrane dynamics to fast network oscillations with irregular neuronal discharges. J. Neurophysiol., page in press.
Gilbert CD, Wiesel TN (1983) Clustered intrinsic connections in cat visual cortex. J. Neurosci., 3: 1116–1133
Grinvald A, Heildesheim R (2004) VSDI: a new era in functional imaging of cortical dynamics. Nat. Rev. Neurosci., 5: 874–885
Hansel D, Mato G, Meunier C, Neltner L (1998) On numerical simulations of integrate-and-fire neural networks. Neural Comput., 10
Jancke D, Chavance F, Naaman S, Grinvald A (2004) Imaging cortical correlates of illusion in early visual cortex. Nature, 428: 423–426
Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) spontaneously emerging cortical representations of visual attributes. Nature, 425: 954–956
Koch C (1999) Biophysics of Computation. Oxford University Press, Oxford.
Lytton W, Hines ML (2005) Independent variable time-step integration of individual neurons for network simulations. Neural Comput, 17: 903–921
Lund JS (1987) Local circuit neurons of macaque monkey striate cortex: Neurons of laminae 4C and 5A. Journal of Comparative Neurology, 257: 60–92
Makino T (2003) A discrete-even neural network simulator for general neuron models. Neural Comput. and Appl., 11: 210–223
Marino J, Schummers J, Lyon DC, Schwabe L, Beck O, Wiesing P, Obermayer K, Sur M (2005) Invariant computations in local cortical networks with balanced excitation and inhibition. Nat. Neurosci., 8
McLaughlin D, Shapley R, Shelley M, Wielaard J (2000) A neuronal network model of macaque primary visual cortex (V1): Orientation selectivity and dynamics in the input layer 4Cα. Proc. Natl. Acad. Sci. USA, 97: 8087–8092
Morrison A, Mehring C, Geisel T, Aertsen A, Diesmann M (2005) Advancing the boundaries of high-connectivity network simulation with distributed computing. Neural Comput, 17: 1776–1801
Pare D, Shink E, Gaudreau H, Destexhe A, Lang EJ (1998) Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons in vivo. J Neurophysiol, 79: 1450–1460
Rangan AV, Cai D, McLaughlin DW (2005) Modeling the spatiotemporal cortical activity associated with the line-motion illusion in primary visual cortex. Proc. Nat’l Acad. Sci (USA), 102(52): 18793–18800
Rauch A, LaCamera G, Luscher HR, Senn W, Fusi S (2003) Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. J. Neurophysiol., 90
Rochel O, Martinez D (2003) An event-driven framework for the simulation of networks of spiking neurons. In Proc. 11th European Symposium on Artificial Neural Networks d-side publications, 295–300
Rudolph M, Destexhe A. (2003a) A fast-conducting, stochastic integrative mode for neocortical neurons in vivo. J Neurosci, 23(6): 2466–2476
Rudolph M, Destexhe A (2003b) Characterization of subthreshold voltage fluctuations in neuronal membranes. Neural Comput, 15(11): 2577–2618
Rudolph M, Destexhe A (2003c) The discharge variability of neocortical neurons during high-conductance states. Neuroscience, 119(3): 855–873
Rudolph M, Destexhe A (2003d) Tuning neocortical pyramidal neurons between integrators and coincidence detectors. J Comput Neurosci, 14(3): 239–251
Shadlen MN, Newsome WT (1998) The variable discharge of cortical neurons: Implications for connectivity, computation and information coding. J Neurosci, 18: 3870–3896
Shelley MJ, Tao L (2001) Efficient and accurate time-stepping schemes for integrate-and-fire neuronal networks. J. Comput. Neurosci., 11
Sincich L, Blasdel G (2001) Oriented axon projections in primary visual cortex of the monkey. J. Neurosci., 21: 4416–4426
Somers D, Nelson S, Sur M (1995) An emergent model of orientation selectivity in cat visual cortical simple cells. J. of Neurosci., 15: 5448–5465
Stern EA, Kincaid AE, Wilson CJ (1997) Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo. J. Neurophysiol., 77: 1697–1715
Tao L, Shelley M, McLaughlin D, Shapley R (2003) An egalitarian network model for the emergence of simple and complex cells in visual cortex. PNAS.
Troyer T, Krukowski A, Priebe N, Miller K (1998) Contrast invariant orientation tuning in cat visual cortex with feedforward tuning and correlation based intracortical connectivity. J. Neurosci., 18: 5908–5927
Tsodyks M,Kenet T, Grinvald A, Arieli A (1999) Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science, 286: 1943–1946
Wang X-J (1999) Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. J Neurosci., 19: 9587–9603
Author information
Authors and Affiliations
Corresponding author
Additional information
Action Editor: Nicolas Brunel
Rights and permissions
About this article
Cite this article
Rangan, A.V., Cai, D. Fast numerical methods for simulating large-scale integrate-and-fire neuronal networks. J Comput Neurosci 22, 81–100 (2007). https://doi.org/10.1007/s10827-006-8526-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10827-006-8526-7