Skip to main content
SpringerLink
Log in

Advances in Design and Application of Spiking Neural Networks

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This paper presents new findings in the design and application of biologically plausible neural networks based on spiking neuron models, which represent a more plausible model of real biological neurons where time is considered as an important feature for information encoding and processing in the brain. The design approach consists of an evolutionary strategy based supervised training algorithm, newly developed by the authors, and the use of different biologically plausible neuronal models. A dynamic synapse (DS) based neuron model, a biologically more detailed model, and the spike response model (SRM) are investigated in order to demonstrate the efficacy of the proposed approach and to further our understanding of the computing capabilities of the nervous system. Unlike the conventional synapse, represented as a static entity with a fixed weight, employed in conventional and SRM-based neural networks, a DS is weightless and its strength changes upon the arrival of incoming input spikes. Therefore its efficacy depends on the temporal structure of the impinging spike trains. In the proposed approach, the training of the network free parameters is achieved using an evolutionary strategy where, instead of binary encoding, real values are used to encode the static and DS parameters which underlie the learning process. The results show that spiking neural networks based on both types of synapse are capable of learning non-linearly separable data by means of spatio-temporal encoding. Furthermore, a comparison of the obtained performance with classical neural networks (multi-layer perceptrons) is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Gerstner W (1995) Time structure of the activity in neural network models. Phys Rev E 51(1):738–758

    Article  Google Scholar 

  2. Gerstner W, Kistler W (2002) Spiking neuron models: single neurons, populations, plasticity. Cambridge University Press, Cambridge

    Google Scholar 

  3. Maass W, Bishop CM (eds) (1999) Pulsed neural networks. The MIT Press, Cambridge

    MATH  Google Scholar 

  4. Hopfield JJ (1995) Pattern recognition computation using action potential timing for stimulus representation. Nature 376:33–36

    Article  PubMed  Google Scholar 

  5. Maass W (1997) Networks of spiking neurons: the third generation of neural network models. Neural Netw 10:1659–1671

    Article  Google Scholar 

  6. Thorpe SJ, Fize F, Marlot C (1996) Speed of processing in the human visual system. Nature 381:520–522

    Article  PubMed  Google Scholar 

  7. Thorpe S, Delorme A, Van Rullen R (2001) Spike-based strategies for rapid processing. Neural Netw 14:715–725

    Article  PubMed  Google Scholar 

  8. Gautrais J, Thorpe S (1998) Rate coding versus temporal order coding: a theoretical approach. BioSystems 48:57–65

    Article  PubMed  Google Scholar 

  9. Tsodyks M, Pawelzik K, Markram H (1998) Neural networks with dynamic synapses. Neural Comput 10:821–835

    Article  PubMed  Google Scholar 

  10. Fuhrmann G, Segev I, Markram H, Tsodyks M (2002) Coding of temporal information by activity dependent synapses. J Neurophysiol 87:140–148

    PubMed  Google Scholar 

  11. Markram H, Tsodyks M (1996) Redistribution of synaptic efficacy between pyramidal neurons. Nature 382:807–810

    Article  PubMed  Google Scholar 

  12. Pantic L, Torres JJ, Kappen HJ (2003) Coincidence detection with dynamic synapses. Netw Comput Neural Syst 14(1):17–34

    Article  Google Scholar 

  13. Zador A, Dobrunz L (1997) Dynamic synapses in the cortex. Neuron 19:1–4

    Article  PubMed  Google Scholar 

  14. George S, Dibazar A, Desai V, Berger TW (2003) Using dynamic synapse based neural networks with wavelet preprocessing for speech applications, Neural Networks. In: Proceedings of the international joint conference on volume 1, pp 666–669. 20–24 July 2003

  15. Dibazar AA, Namarvar HH, Berger TW (2003) A new approach for isolated word recognition using dynamic synapse neural networks, Neural Networks. In: Proceedings of the international joint conference on volume 4, pp 3146–3150. July 20–24, 2003

  16. Heittmann A, Ramacher U (2004) An architecture for feature detection utilizing dynamic synapses, Circuits and Systems, 2004. MWSCAS ’04. The 2004 47th Midwest symposium on volume 2, pp II 373–376. 25–28 July 2004

  17. Song S, Miller KD et al (2000) Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci 3:919–926

    Article  PubMed  Google Scholar 

  18. Bohte SM, La Poutré H, Kok JN (2000) SpikeProp: error- for networks of spiking neurons. ESANN’2000, pp 419–425

  19. Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102

    Article  MATH  Google Scholar 

  20. Rao RP, Sejnowski TJ (2001) Spike-timing-dependent plasticity as temporal difference learning. Neural Comput 13:2221–2237

    Article  PubMed  MATH  Google Scholar 

  21. Hodgkin AL, Huxley AF (1952) A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 117:500–544

    PubMed  Google Scholar 

  22. Belatreche A, Maguire LP, McGinnity M (2004) Pattern recognition with spiking neural networks and dynamic synapses. In: Applied computational intelligence, world scientific, proceedings of the 6th international FLINS conference, pp 205–210

  23. Bäck T, Schwefel H-P (1993) An overview of evolutionary algorithms for parameter optimization. Evol Comput 1(1):1–23

    Google Scholar 

  24. Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison Wesley, Reading

    MATH  Google Scholar 

  25. Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor

    Google Scholar 

  26. Beyer H-G (1996) Toward a theory of evolution strategies: self-adaptation. Evol Comput 3(3):311 –347

    Google Scholar 

  27. Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:179–188

    Google Scholar 

  28. Woldberg WH, Mangasarian OL (1990) Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proc Natl Acad Sci USA 87:9193–9196

    Article  PubMed  Google Scholar 

  29. Mangasarian OL, Wolberg WH (1990) Cancer diagnosis via linear programming. SIAM News 23(5):1–18

    Google Scholar 

  30. Belatreche A, Maguire LP, McGinnity M, Wu QX (2003) An evolutionary strategy for supervised training of biologically plausible neural networks. In: The sixth international conference on computational intelligence and natural computing (CINC), proceedings of the 7th joint conference on information sciences, pp 1524–1527, North Carolina, USA

Download references

Author information

Authors and Affiliations

  1. Intelligent Systems Engineering Laboratory, School of Computing and Intelligent Systems, Faculty of Engineering, University of Ulster, Magee campus, Northland Road, Derry, BT48 7JL, Northern Ireland

    Ammar Belatreche, Liam P. Maguire & Martin McGinnity

Authors
  1. Ammar Belatreche
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liam P. Maguire
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Martin McGinnity
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ammar Belatreche.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Belatreche, A., Maguire, L.P. & McGinnity, M. Advances in Design and Application of Spiking Neural Networks. Soft Comput 11, 239–248 (2007). https://doi.org/10.1007/s00500-006-0065-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-006-0065-7

Keywords

Search

Navigation