Skip to main content

Biologically Sound Neural Networks for Embedded Systems Using OpenCL

  • Conference paper
  • 891 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 7853))

Abstract

In this paper, we present an OpenCL implementation of a biologically sound spiking neural network with two goals in mind: First, applied neural dynamics should be accurate enough for bio-inspired training methods, thus resulting network data is reproducible in ”in vitro” experiments. The second is that the implementation produces code that runs adequately on up-to-date embedded graphical chips for fast on-board classification applications, e.g., video image processing. We describe the necessary steps required to implement an efficient algorithm using the OpenCL framework and present evaluation results of the execution time compared to traditional serial CPU code. We show that an optimized GPU kernel code can perform sufficiently fast to be used for future embedded neural processing.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Maass, W.: Noisy spiking neurons with temporal coding have more computational power than sigmoidal neurons. Advances in Neural Information Processing Systems 9 (1997)

    Google Scholar 

  2. Pallipuram, V., Bhuiyan, M., Smith, M.: Evaluation of GPU architectures using spiking neural networks. In: 2011 Symposium on Application Accelerators in High-Performance Computing (SAAHPC), pp. 93–102 (July 2011)

    Google Scholar 

  3. Yudanov, D., Shaaban, M., Melton, R., Reznik, L.: GPU-based simulation of spiking neural networks with real-time performance amp; high accuracy. In: International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (July 2010)

    Google Scholar 

  4. Nageswaran, J., Dutt, N., Wang, Y., Delbrueck, T.: Computing spike-based convolutions on GPUs. In: IEEE International Symposium on Circuits and Systems (ISCAS 2009), pp. 1917–1920 (2009)

    Google Scholar 

  5. Yudanov, D., Reznik, L.: Scalable multi-precision simulation of spiking neural networks. In: 2012 IEEE World Congress on Computational Intelligence (WCCI 2012) (June 2012)

    Google Scholar 

  6. Bernhard, F., Keriven, R.: Spiking neurons on GPUs. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2006. LNCS, vol. 3994, pp. 236–243. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Ferrari, S., Mehta, B., Di Muro, G., VanDongen, A., Henriquez, C.: Biologically realizable reward-modulated hebbian training for spiking neural networks. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008 (IEEE World Congress on Computational Intelligence), pp. 1780–1786 (June 2008)

    Google Scholar 

  8. Karimi, K., Dickson, N.G., Hamze, F.: A performance comparison of CUDA and OpenCL. In: CoRR abs/1005.2581 (2010), http://arxiv.org/abs/1005.2581

  9. Maass, W.: Networks of spiking neurons: The third generation of neural network models. Neural Networks 10(9), 1659–1671 (1997)

    Article  Google Scholar 

  10. Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations, Plasticity, 1st edn. Cambridge University Press (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fehérvári, I., Sobe, A., Elmenreich, W. (2013). Biologically Sound Neural Networks for Embedded Systems Using OpenCL. In: Gramoli, V., Guerraoui, R. (eds) Networked Systems. NETYS 2013. Lecture Notes in Computer Science, vol 7853. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40148-0_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40148-0_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40147-3

  • Online ISBN: 978-3-642-40148-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics