Training Spiking Neural Networks Using Combined Learning Approaches
Spiking neural networks (SNNs), the class of neural networks used in neuromorphic computing, are difficult to train using traditional back-propagation techniques. Spike timingdependent plasticity (STDP) is a biologically inspired learning mechanism that can be used to train SNNs. Evolutionary algorithms have also been demonstrated as a method for training SNNs. In this work, we explore the relationship between these two training methodologies. We evaluate STDP and evolutionary optimization as standalone methods for training networks, and also evaluate a combined approach where STDP weight updates are applied within an evolutionary algorithm. We also apply Bayesian hyperparameter optimization as a meta learner for each of the algorithms. We find that STDP by itself is not an ideal learning rule for randomly connected networks, while the inclusion of STDP within an evolutionary algorithm leads to similar performance, with a few interesting differences. This study suggests future work in understanding the relationship between network topology and learning rules.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1760122
- Resource Relation:
- Conference: IEEE Symposium Series on Computational Intelligence (SSCI) - Canberra, , Australia - 12/1/2020 10:00:00 AM-12/4/2020 10:00:00 AM
- Country of Publication:
- United States
- Language:
- English
Similar Records
Multi-Objective Optimization for Size and Resilience of Spiking Neural Networks
Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution