Frances S Chance
ABSTRACT
Shunting inhibition is a potential mechanism by which biological systems multiply two time-varying signals, most recently proposed in single neurons of the fly visual system. Our work demonstrates this effect in a biological neuron model and the equivalent circuit in neuromorphic hardware modeling dendrites. We present a multi-compartment neuromorphic dendritic model that produces a multiplication-like effect using the shunting inhibition mechanism by varying leakage along the dendritic cable. Dendritic computation in neuromorphic architectures has the potential to increase complexity in single neurons and reduce the energy footprint for neural networks by enabling computation in the interconnect.
- LF Abbott. 1991. Realistic synaptic inputs for model neural networks. Network: Computation in Neural Systems 2, 3 (1991), 245–258.Google Scholar
Cross Ref
- Richard A Andersen, Greg K Essick, and Ralph M Siegel. 1985. Encoding of spatial location by posterior parietal neurons. Science 230, 4724 (1985), 456–458.Google Scholar
- Richard A Andersen and Vernon B Mountcastle. 1983. The influence of the angle of gaze upon the excitability of the light-sensitive neurons of the posterior parietal cortex. Journal of Neuroscience 3, 3 (1983), 532–548.Google ScholarCross Ref
- Stephen Blomfield. 1974. Arithmetical operations performed by nerve cells. Brain research 69, 1 (1974), 115–124.Google Scholar
- Kwabena Boahen. 2022. Dendrocentric learning for synthetic intelligence. Nature 612, 7938 (2022), 43–50.Google Scholar
- Lyle J Borg-Graham, Cyril Monier, and Yves Fregnac. 1998. Visual input evokes transient and strong shunting inhibition in visual cortical neurons. Nature 393, 6683 (1998), 369–373.Google Scholar
- Peter R Brotchie, Richard A Andersen, Lawrence H Snyder, and Sabrina J Goodman. 1995. Head position signals used by parietal neurons to encode locations of visual stimuli. Nature 375, 6528 (1995), 232–235.Google Scholar
- Matteo Carandini and David J Heeger. 1994. Summation and division by neurons in primate visual cortex. Science 264, 5163 (1994), 1333–1336.Google Scholar
- Matteo Carandini, David J Heeger, and J Anthony Movshon. 1997. Linearity and normalization in simple cells of the macaque primary visual cortex. Journal of Neuroscience 17, 21 (1997), 8621–8644.Google ScholarCross Ref
- Frances S Chance. 2020. Interception from a Dragonfly Neural Network Model. In International Conference on Neuromorphic Systems 2020. 1–5.Google ScholarDigital Library
- Frances S Chance, Larry F Abbott, and Alex D Reyes. 2002. Gain modulation from background synaptic input. Neuron 35, 4 (2002), 773–782.Google ScholarCross Ref
- Brent Doiron, André Longtin, Neil Berman, and Leonard Maler. 2001. Subtractive and divisive inhibition: effect of voltage-dependent inhibitory conductances and noise. Neural computation 13, 1 (2001), 227–248.Google Scholar
- P Fatt and B Katz. 1953. The effect of inhibitory nerve impulses on a crustacean muscle fibre. The Journal of physiology 121, 2 (1953), 374.Google ScholarCross Ref
- Yves Frégnac, Cyril Monier, Frédéric Chavane, Pierre Baudot, and Lyle Graham. 2003. Shunting inhibition, a silent step in visual cortical computation. Journal of Physiology-Paris 97, 4-6 (2003), 441–451.Google ScholarCross Ref
- Fabrizio Gabbiani, Holger G Krapp, Christof Koch, and Gilles Laurent. 2002. Multiplicative computation in a visual neuron sensitive to looming. Nature 420, 6913 (2002), 320–324.Google Scholar
- Fabrizio Gabbiani, Jens Midtgaard, and Thomas Knopfel. 1994. Synaptic integration in a model of cerebellar granule cells. Journal of neurophysiology 72, 2 (1994), 999–1009.Google ScholarCross Ref
- Suma George, Jennifer Hasler, Scott Koziol, Stephen Nease, and Shubha Ramakrishnan. 2013. Low power dendritic computation for wordspotting. Journal of Low Power Electronics and Applications 3, 2 (2013), 73–98.Google ScholarCross Ref
- Suma George, Sihwan Kim, Sahil Shah, Jennifer Hasler, Michelle Collins, Farhan Adil, Richard Wunderlich, Stephen Nease, and Shubha Ramakrishnan. 2016. A programmable and configurable mixed-mode FPAA SoC. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 24, 6 (2016), 2253–2261.Google ScholarDigital Library
- Lukas N Groschner, Jonatan G Malis, Birte Zuidinga, and Alexander Borst. 2022. A biophysical account of multiplication by a single neuron. Nature 603, 7899 (2022), 119–123.Google Scholar
- Juergen Haag, Adrian Wertz, and Alexander Borst. 2010. Central gating of fly optomotor response. Proceedings of the National Academy of Sciences 107, 46 (2010), 20104–20109.Google ScholarCross Ref
- Richard HR Hahnloser, Rahul Sarpeshkar, Misha A Mahowald, Rodney J Douglas, and H Sebastian Seung. 2000. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. nature 405, 6789 (2000), 947–951.Google Scholar
- Jiang Hao, Xu-dong Wang, Yang Dan, Mu-ming Poo, and Xiao-hui Zhang. 2009. An arithmetic rule for spatial summation of excitatory and inhibitory inputs in pyramidal neurons. Proceedings of the National Academy of Sciences 106, 51 (2009), 21906–21911.Google ScholarCross Ref
- Bernhard Hassenstein and Werner Reichardt. 1956. Systemtheoretische analyse der zeit-, reihenfolgen-und vorzeichenauswertung bei der bewegungsperzeption des rüsselkäfers chlorophanus. Zeitschrift für Naturforschung B 11, 9-10 (1956), 513–524.Google Scholar
- David J Heeger. 1992. Normalization of cell responses in cat striate cortex. Visual neuroscience 9, 2 (1992), 181–197.Google Scholar
- Gary R Holt and Christof Koch. 1997. Shunting inhibition does not have a divisive effect on firing rates. Neural computation 9, 5 (1997), 1001–1013.Google Scholar
- Stephen J Huston and Holger G Krapp. 2009. Nonlinear integration of visual and haltere inputs in fly neck motor neurons. Journal of Neuroscience 29, 42 (2009), 13097–13105.Google ScholarCross Ref
- Christof Koch and Tomaso Poggio. 1992. Multiplying with synapses and neurons. In Single neuron computation. Elsevier, 315–345.Google Scholar
- Christof Koch, Tomaso Poggio, and Vincent Torre. 1983. Nonlinear interactions in a dendritic tree: localization, timing, and role in information processing.Proceedings of the National Academy of Sciences 80, 9 (1983), 2799–2802.Google Scholar
- Maria Lavzin, Sophia Rapoport, Alon Polsky, Liora Garion, and Jackie Schiller. 2012. Nonlinear dendritic processing determines angular tuning of barrel cortex neurons in vivo. Nature 490, 7420 (2012), 397–401.Google Scholar
- Guosong Liu. 2004. Local structural balance and functional interaction of excitatory and inhibitory synapses in hippocampal dendrites. Nature neuroscience 7, 4 (2004), 373–379.Google Scholar
- Michael London and Michael Hausser. 2005. Dendritic Computation. Annual Review of Neuroscience 28 (July 2005), 503–532.Google Scholar
- Carrie J McAdams and John HR Maunsell. 1999. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. Journal of Neuroscience 19, 1 (1999), 431–441.Google ScholarCross Ref
- Bartlett W Mel. 1993. Synaptic integration in an excitable dendritic tree. Journal of neurophysiology 70, 3 (1993), 1086–1101.Google ScholarCross Ref
- Simon J Mitchell and R Angus Silver. 2003. Shunting inhibition modulates neuronal gain during synaptic excitation. Neuron 38, 3 (2003), 433–445.Google ScholarCross Ref
- Stephen Nease, Suma George, Paul Hasler, Scott Koziol, and Stephen Brink. 2011. Modeling and implementation of voltage-mode CMOS dendrites on a reconfigurable analog platform. IEEE transactions on biomedical circuits and systems 6, 1 (2011), 76–84.Google Scholar
- Mark E Nelson. 1994. A mechanism for neuronal gain control by descending pathways. Neural Computation 6, 2 (1994), 242–254.Google ScholarDigital Library
- José Luis Peña and Masakazu Konishi. 2001. Auditory spatial receptive fields created by multiplication. Science 292, 5515 (2001), 249–252.Google Scholar
- Alon Poleg-Polsky and Jeffrey S Diamond. 2016. NMDA receptors multiplicatively scale visual signals and enhance directional motion discrimination in retinal ganglion cells. Neuron 89, 6 (2016), 1277–1290.Google ScholarCross Ref
- Alexandre Pouget and Terrence J Sejnowski. 1997. Spatial transformations in the parietal cortex using basis functions. Journal of cognitive neuroscience 9, 2 (1997), 222–237.Google ScholarDigital Library
- Steven A Prescott and Yves De Koninck. 2003. Gain control of firing rate by shunting inhibition: roles of synaptic noise and dendritic saturation. Proceedings of the National Academy of Sciences 100, 4 (2003), 2076–2081.Google ScholarCross Ref
- Ning Qian and Terrence J Sejnowski. 1990. When is an inhibitory synapse effective?Proceedings of the National Academy of Sciences 87, 20 (1990), 8145–8149.Google Scholar
- Shubha Ramakrishnan, Richard Wunderlich, Jennifer Hasler, and Suma George. 2013. Neuron array with plastic synapses and programmable dendrites. IEEE transactions on biomedical circuits and systems 7, 5 (2013), 631–642.Google ScholarCross Ref
- Kaushik Roy, Indranil Chakraborty, Mustafa Ali, Aayush Ankit, and Amogh Agrawal. 2020. In-memory computing in emerging memory technologies for machine learning: an overview. In 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE, 1–6.Google ScholarCross Ref
- Emilio Salinas and LF Abbott. 1997. Invariant visual responses from attentional gain fields. Journal of Neurophysiology 77, 6 (1997), 3267–3272.Google ScholarCross Ref
- Emilio Salinas and Larry F Abbott. 1995. Transfer of coded information from sensory to motor networks. Journal of Neuroscience 15, 10 (1995), 6461–6474.Google ScholarCross Ref
- Emilio Salinas and Laurence F Abbott. 1996. A model of multiplicative neural responses in parietal cortex.Proceedings of the national academy of sciences 93, 21 (1996), 11956–11961.Google Scholar
- Emilio Salinas and Peter Thier. 2000. Gain modulation: a major computational principle of the central nervous system. Neuron 27, 1 (2000), 15–21.Google ScholarCross Ref
- Johannes Schemmel, Laura Kriener, Paul Müller, and Karlheinz Meier. 2017. An accelerated analog neuromorphic hardware system emulating NMDA-and calcium-based non-linear dendrites. In 2017 International Joint Conference on Neural Networks (IJCNN). IEEE, 2217–2226.Google ScholarCross Ref
- Bryan A Seybold, Elizabeth AK Phillips, Christoph E Schreiner, and Andrea R Hasenstaub. 2015. Inhibitory actions unified by network integration. Neuron 87, 6 (2015), 1181–1192.Google ScholarCross Ref
- Marianne R Smith, Alexandra B Nelson, and Sascha Du Lac. 2002. Regulation of firing response gain by calcium-dependent mechanisms in vestibular nucleus neurons. Journal of neurophysiology 87, 4 (2002), 2031–2042.Google ScholarCross Ref
- Mandyam V Srinivasan and Gary D Bernard. 1976. A proposed mechanism for multiplication of neural signals. Biological cybernetics 21, 4 (1976), 227–236.Google Scholar
- Stefan Treue and Julio C Martinez Trujillo. 1999. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399, 6736 (1999), 575–579.Google Scholar
- Yingxue Wang and Shih-Chii Liu. 2012. Active processing of spatio-temporal input patterns in silicon dendrites. IEEE transactions on biomedical circuits and systems 7, 3 (2012), 307–318.Google Scholar
- Qiangfei Xia and J Joshua Yang. 2019. Memristive crossbar arrays for brain-inspired computing. Nature materials 18, 4 (2019), 309–323.Google Scholar
- David Zipser and Richard A Andersen. 1988. A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 331, 6158 (1988), 679–684.Google Scholar
Index Terms
- Shunting Inhibition as a Neural-Inspired Mechanism for Multiplication in Neuromorphic Architectures
Recommendations
Dendritic Computation for Neuromorphic Applications
ICONS '23: Proceedings of the 2023 International Conference on Neuromorphic SystemsIn this paper, we highlight how computational properties of biological dendrites can be leveraged for neuromorphic applications. Specifically, we demonstrate analog silicon dendrites that support multiplication mediated by conductance-based input in ...
Adaptation and shunting inhibition leads to pyramidal/interneuron gamma with sparse firing of pyramidal cells
Gamma oscillations are a prominent phenomenon related to a number of brain functions. Data show that individual pyramidal neurons can fire at rate below gamma with the population showing clear gamma oscillations and synchrony. In one kind of idealized ...
Effects of Noise on Leaky Integrate-and-Fire Neuron Models for Neuromorphic Computing Applications
Computational Science and Its Applications – ICCSA 2022AbstractArtificial neural networks (ANNs) have been extensively used for the description of problems arising from biological systems and for constructing neuromorphic computing models. The third generation of ANNs, namely, spiking neural networks (SNNs), ...
Comments