Abstract
The purpose of supervised learning with temporal encoding for spiking neurons is to make the neurons emit arbitrary spike trains in response to given synaptic inputs. Recent years, the supervised learning algorithms based on synaptic plasticity have developed rapidly. As one of the most efficient supervised learning algorithms, the remote supervised method (ReSuMe) uses the conventional pair-based spike-timing-dependent plasticity rule, which depends on the precise timing of presynaptic and postsynaptic spikes. In this paper, using the triplet-based spike-timing-dependent plasticity, which is a powerful synaptic plasticity rule and acts beyond the classical rule, a novel supervised learning algorithm, dubbed T-ReSuMe, is presented to improve ReSuMe’s performance. The proposed algorithm is successfully applied to various spike trains learning tasks, in which the desired spike trains are encoded by Poisson process. The experimental results show that T-ReSuMe has higher learning accuracy and fewer iteration epoches than the traditional ReSuMe, so it is effective for solving complex spatio-temporal pattern learning problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rosenblatt, F.: The Perceptron: A Perceiving and Recognizing Automaton Project Para. Cornell Aeronautical Laboratory (1957)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)
Bohte, S.M.: The evidence for neural information processing with precise spike-times: a survey. Nat. Comput. 3(2), 195–206 (2004)
Ghosh-Dastidar, S., Adeli, H.: Spiking neural networks. Int. J. Neural Syst. 19, 295–308 (2009)
Kerr, D., McGinnity, T.M., Coleman, S., et al.: A biologically inspired spiking model of visual processing for image feature detection. Neurocomputing 158, 268–280 (2015)
Cao, Z., Cheng, L., Zhou, C., et al.: Spiking neural network-based target tracking control for autonomous mobile robots. Neural Comput. Appl. 26(8), 1839–1847 (2015)
Dennis, J., Tran, H.D., Li, H.: Spiking neural networks and the generalised hough transform for speech pattern detection. In: The 16th Annual Conference of the International Speech Communication Association (2015)
Lin, X., Wang, X., Zhang, N., et al.: Supervised learning algorithms for spiking neural networks: a review. Acta Electronica Sinica 43(3), 577–586 (2015)
Hebb, D.O.: The Organization of Behavior: A Neuropsychological Theory. Wiley, New York (1949)
Abbott, L.F., Nelson, S.B.: Synaptic plasticity - taming the beast. Nat. Neurosci. 3, 1178–1183 (2000)
Wang, H., Gerkin, R., Nauen, D., et al.: Coactivation and timing dependent integration of synaptic potentiation and depression. Nat. Neurosci. 8(2), 187–193 (2005)
Markram, H., Gerstner, W., Sjöström, P.J.: Spike-timing-dependent plasticity: a comprehensive overview. Front. Synaptic Neurosci. 4, 8 (2012)
Daniel, E.F.: The spike-timing dependence of plasticity. Neuron 75(8), 558–571 (2012)
Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., et al.: STDP and STDP variations with memristors for spiking neuromorphic learning systems. Front Neurosci 7(2), 1–15 (2013)
Pfister, J.P., Gerstner, W.: Triplets of spikes in a model of spike timing dependent plasticity. J. Neurosci. 26(38), 9673–9682 (2006)
Shahim-Aeen, A., Karimi, G.: Triplet-based spike timing dependent plasticity (TSTDP) modeling using VHDL-AMS. Neurocomput. 149, 1440–1444 (2015)
Ruf, B., Schmitt, M.: Learning temporally encoded patterns in networks of spiking neurons. Neural Process. Lett. 5(1), 9–18 (1997)
Legenstein, R., Naeger, C., Maass, W.: What can a neuron learn with spike-timing-dependent plasticity? Neural Comput. 17(11), 2337–2382 (2005)
Franosch, J.M.P., Urban, S., van Hemmen, J.L.: Supervised spike-timing-dependent plasticity: a spatiotemporal neuronal learning rule for function approximation and decisions. Neural Comput. 25(12), 3113–3130 (2013)
Ponulak, F., Kasinski, A.: Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification and spike shifting. Neural Comput. 22(10), 467–510 (2010)
Hu, J., Tang, H., Tan, K.C., et al.: A spike-timing-based integrated model for pattern recognition. Neural Comput. 25(2), 450–472 (2013)
Bi, G., Poo, M.: Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength and postsynaptic cell type. J. Neurosci. 18(24), 10464–10472 (1998)
Pfister, J.P., Gerstner,W.: Beyond pair-based STDP: a phenomenological rule for spike triplet and frequency effects. In: Advance Neural Information Process System, vol. 18, pp. 1083–1090 (2006)
Gjorgjieva, J., Clopath, C., Audet, J., et al.: A triplet spike-timing-dependent plasticity model generalizes the bienenstock-cooper-munro rule to higher-order spatiotemporal correlations. Proc. Natl. Acad. Sci. 108(48), 19383–19388 (2011)
Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)
Acknowledgement
This work is supported by the National Natural Science Foundation of China (No. 61165002, No. 61363058), the Natural Science Foundation of Gansu Province of China (No. 1506RJZA127), and Scientific Research Project of Universities of Gansu Province (No. 2015A-013).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Lin, X., Chen, G., Wang, X., Ma, H. (2016). An Improved Supervised Learning Algorithm Using Triplet-Based Spike-Timing-Dependent Plasticity. In: Huang, DS., Han, K., Hussain, A. (eds) Intelligent Computing Methodologies. ICIC 2016. Lecture Notes in Computer Science(), vol 9773. Springer, Cham. https://doi.org/10.1007/978-3-319-42297-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-42297-8_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42296-1
Online ISBN: 978-3-319-42297-8
eBook Packages: Computer ScienceComputer Science (R0)