skip to main content
10.1145/3649153.3649199acmconferencesArticle/Chapter ViewAbstractPublication PagescfConference Proceedingsconference-collections
research-article
Open access

Clustering and Allocation of Spiking Neural Networks on Crossbar-Based Neuromorphic Architecture

Published: 02 July 2024 Publication History

Abstract

Neuromorphic hardware, designed to mimic the neural structure of the human brain, offers an energy-efficient platform for implementing machine-learning models in the form of Spiking Neural Networks (SNNs). Achieving efficient SNN execution on this hardware requires careful consideration of various objectives, such as optimizing utilization of individual neuromorphic cores and minimizing inter-core communication. Unlike previous approaches that overlooked the architecture of the neuromorphic core when clustering the SNN into smaller networks, our approach uses architecture-aware algorithms to ensure that the resulting clusters can be effectively mapped to the core. We base our approach on a crossbar architecture for each neuromorphic core. We start with a basic architecture where neurons can only be mapped to the columns of the crossbar. Our technique partitions the SNN into clusters of neurons and synapses, ensuring that each cluster fits within the crossbar's confines, and when multiple clusters are allocated to a single crossbar, we maximize resource utilization by efficiently reusing crossbar resources. We then expand this technique to accommodate an enhanced architecture that allows neurons to be mapped not only to the crossbar's columns but also to its rows, with the aim of further optimizing utilization. To evaluate the performance of these techniques, assuming a multi-core neuromorphic architecture, we assess factors such as the number of crossbars used and the average crossbar utilization. Our evaluation includes both synthetically generated SNNs and spiking versions of well-known machine-learning models: LeNet, AlexNet, DenseNet, and ResNet. We also investigate how the structure of the SNN impacts solution quality and discuss approaches to improve it.

References

[1]
Aayush Ankit, Abhronil Sengupta, Priyadarshini Panda, and Kaushik Roy. 2017. RESPARC: A Reconfigurable and Energy-Efficient Architecture with Memristive Crossbars for Deep Spiking Neural Networks. In Proceedings of the 54th Annual Design Automation Conference 2017 (DAC '17). ACM.
[2]
Adarsha Balaji et al. 2020. Mapping Spiking Neural Networks to Neuromorphic Hardware. IEEE Trans. VLSI Syst. 28, 1 (2020), 76--86.
[3]
Adarsha Balaji et al. 2020. PyCARL: A PyNN Interface for Hardware-Software Co-Simulation of Spiking Neural Network. In IJCNN.
[4]
Geoffrey W. Burr, Robert M. Shelby, Abu Sebastian, Sangbum Kim, Seyoung Kim, Severin Sidler, Kumar Virwani, Masatoshi Ishii, Pritish Narayanan, Alessandro Fumarola, Lucas L. Sanches, Irem Boybat, Manuel Le Gallo, Kibong Moon, Jiyoo Woo, Hyunsang Hwang, and Yusuf Leblebici. 2017. Neuromorphic computing using non-volatile memory. Advances in Physics: X 2, 1 (2017), 89--124.
[5]
Elisabetta Chicca et al. 2003. A VLSI recurrent network of integrate-and-fire neurons connected by plastic synapses with long-term memory. IEEE Trans. Neural Networks 14, 5 (2003).
[6]
Federico Corradi et al. 2021. Gyro: A Digital Spiking Neural Network Architecture for Multi-Sensory Data Analytics. In Proc. ACM Drone Syst. Eng. & Rapid Simulation & Perf. Eval. 9--15.
[7]
Anup Das et al. 2018. Mapping of local and global synapses on spiking neuromorphic hardware. In Design, Automation Test in Europe Conference (DATE). 1217--1222.
[8]
Anup Das et al. 2018. Mapping of local and global synapses on spiking neuromorphic hardware. In DATE. 1217--1222.
[9]
Mike Davies et al. 2018. Loihi: A neuromorphic manycore processor with on-chip learning. IEEE Micro 38, 1 (2018), 82--99.
[10]
Andrew P Davison. 2008. PyNN: a common interface for neuronal network simulators. Frontiers in Neuroinformatics 2 (2008).
[11]
Samanwoy Ghosh-Dastidar et al. 2009. Spiking neural networks. J. Neural Systems (2009), 295--308.
[12]
Miao Hu et al. 2014. Memristor Crossbar-Based Neuromorphic Computing System: A Case Study. IEEE Trans. Neural Networks & Learning Syst. 25, 10 (2014), 1864--1878.
[13]
E. M. Izhikevich. 2003. Simple model of spiking neurons. IEEE Trans. Neural Networks 14, 6 (Nov 2003), 1569--1572.
[14]
Ouwen Jin et al. 2023. Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware. In ACM ASPLOS.
[15]
Shiming Li et al. 2020. SNEAP: A Fast and Efficient Toolchain for Mapping Large-Scale Spiking Neural Network onto NoC-based Neuromorphic Platform. In Proc. ACM Great Lakes VLSI Symp.
[16]
Chenchen Liu et al. 2015. A Spiking Neuromorphic Design with Resistive Crossbar. In Proc. ACM Annual Design Automation Conference (DAC).
[17]
S. Moradi et al. 2018. A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DY-NAPs). IEEE Trans. Biomedical Circuits & Systems 12, 1 (Feb. 2018), 106--122.
[18]
Lars Niedermeier et al. 2022. CARL sim 6: An Open Source Library for Large-Scale, Biologically Detailed Spiking Neural Network Simulation. In Int l'IEEE Joint Conf. Neural Networks (IJCNN). 1--10.
[19]
Lars Niedermeieretal. 2022. CARLsim 6: An Open Source Library for Large-Scale, Biologically Detailed Spiking Neural Network Simulation. In IJCNN.
[20]
Bodo Rueckauer et al. 2022. NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi. ACM J. Emerging Tech. Comput. Syst. (2022).
[21]
Shihao Song et al. 2021. A Design Flow for Mapping Spiking Neural Networks to Many-Core Neuromorphic Hardware. In ICCAD. 1--9.
[22]
Shihao Song et al. 2022. DFSynthesizer: Dataflow-based Synthesis of Spiking Neural Networks to Neuromorphic Hardware. ACM Trans. Embedded Comput. Syst. (2022).
[23]
Indar Sugiarto et al. 2017. Optimized Task Graph Mapping on a Many-core Neuromorphic Supercomputer. In HPEC 2017.
[24]
Lakshmi Varshika et al. 2022. Design of Many-Core Big Little μBrain for Energy-Efficient Embedded Neuromorphic Computing. In DATE.
[25]
Chao Xiao et al. 2022. Optimal Mapping of Spiking Neural Network to Neuromorphic Hardware for Edge-AI. Sensors (2022).
[26]
Qi Xu et al. 2023. Reliability-Driven Memristive Crossbar Design in Neuromorphic Computing Systems. IEEE Trans. Automation Science & Eng. 20, 1 (2023), 74--87.

Index Terms

  1. Clustering and Allocation of Spiking Neural Networks on Crossbar-Based Neuromorphic Architecture

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CF '24: Proceedings of the 21st ACM International Conference on Computing Frontiers
      May 2024
      345 pages
      ISBN:9798400705977
      DOI:10.1145/3649153
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 July 2024

      Check for updates

      Author Tags

      1. Clustering
      2. Neuromorphic Architectures
      3. Spiking Neural Network

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      CF '24
      Sponsor:

      Acceptance Rates

      CF '24 Paper Acceptance Rate 33 of 105 submissions, 31%;
      Overall Acceptance Rate 273 of 785 submissions, 35%

      Upcoming Conference

      CF '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 187
        Total Downloads
      • Downloads (Last 12 months)187
      • Downloads (Last 6 weeks)32
      Reflects downloads up to 11 Feb 2025

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media