Skip to main content

Spike-Timing-Dependent Synaptic Plasticity to Learn Spatiotemporal Patterns in Recurrent Neural Networks

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4668))

Abstract

Assuming asymmetric time window of the spike-timing- dependent synaptic plasticity (STDP), we study spatiotemporal learning in recurrent neural networks. We first show numerical simulations of spiking neural networks in which spatiotemporal Poisson patterns (i.e., random spatiotemporal patterns generated by independent Poisson process) are successfully memorized by the STDP-based learning rule. Then, we discuss the underlying mechanism of the STDP-based learning, mentioning our recent analysis on associative memory analog neural networks for periodic spatiotemporal patterns. Order parameter dynamics in the analog neural networks explains time scale change in retrieval process and the shape of the STDP time window optimal to encode a large number of spatiotemporal patterns. The analysis further elucidates phase transition due to destabilization of retrieval state. These findings on analog neural networks are found to be consistent with the previous results on spiking neural networks. These STDP-based spatiotemporal associative memory possibly gives some insights into the recent experimental results in which spatiotemporal patterns are found to be retrieved at the various time scale.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. MacLeod, K., Laurent, G.: Science 274, 976 (1996)

    Google Scholar 

  2. Lorenzo, P.M.D., Hallock, R.M., Kennedy, D.P.: Behavior Neuroscience 117, 1423 (2003)

    Google Scholar 

  3. Nádasdy, Z., Hirase, H., Czurkó, A., Csicsvari, J., Buzsáki, G.: J. Neurosci. 19, 9497 (1999)

    Google Scholar 

  4. Hopfield, J.J.: Proc. Natl. Acad. Sci. USA 79, 2554 (1982)

    Google Scholar 

  5. Amit, D.J., Gutfreund, H., Sompolinsky, H.: Phys. Rev. Lett. 55, 1530 (1985)

    Google Scholar 

  6. Amari, S.: IEEE Transactions on Computers C-21, 1197 (1972)

    Google Scholar 

  7. Matsumoto, N., Okada, M.: Neural Comp. 14, 2883 (2002)

    Google Scholar 

  8. Sompolinsky, H., Kanter, I.: Phys. Rev. A 57, 2861 (1986)

    Google Scholar 

  9. Coolen, A.C.C., Ruijgrok, T.W.: Phys. Rev. A 38, 4253 (1988)

    Google Scholar 

  10. Cook, J.: J. Phys. A 22, 2057 (1989)

    Google Scholar 

  11. Arenas, A., Vicente, C.J.P.: Europhys. Lett. 26, 79 (1994)

    Google Scholar 

  12. Kühn, R., Bös, S., van Hemmen, J.L.: Phys. Rev. A 43, 2084 (1991)

    Google Scholar 

  13. Amari, S., Maginu, K.: Neural Netw. 1, 63 (1988)

    Google Scholar 

  14. Nishimori, H., Nakamura, T., Shiino, M.: Phys. Rev. A 41, 3346 (1990)

    Google Scholar 

  15. Shiino, M., Fukai, T.: J. Phys. A 25, L375 (1992)

    Google Scholar 

  16. Okada, M.: Neural Netw. 8, 833 (1995)

    Google Scholar 

  17. Yoshioka, M.: Phys. Rev. E 65, 011903 (2001)

    Google Scholar 

  18. Yoshioka, M.: Phys. Rev. E 66, 061913 (2002)

    Google Scholar 

  19. Scarpetta, S., Zhaoping, L., Hertz, J.: Neural Comp. 14, 2371 (2002)

    Google Scholar 

  20. Scarpetta, S., Marinaro, M.: Hippocampus 15, 979 (2005)

    Google Scholar 

  21. Yoshioka, M., Scarpetta, S., Marinaro, M.: Phys. Rev. E, 75 (2007) 051917

    Google Scholar 

  22. Markram, H., Lübke, J., Frotscher, M., Sakmann, B.: Science 275, 213 (1997)

    Google Scholar 

  23. Bi, G.Q., Poo, M.M.: J. Neurosci. 18, 10464 (1998)

    Google Scholar 

  24. Zhang, L.I., Tao, H.W., Holt, C.E., Harris, W.A., Poo, M.M.: Nature 395, 37 (1998)

    Google Scholar 

  25. Bi, G.Q., Poo, M.M.: Annu. Rev. Neurosci. 24, 139 (2001)

    Google Scholar 

  26. Foster, D.J., Wilson, M.A.: Nature 440, 680 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Joaquim Marques de Sá Luís A. Alexandre Włodzisław Duch Danilo Mandic

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yoshioka, M., Scarpetta, S., Marinaro, M. (2007). Spike-Timing-Dependent Synaptic Plasticity to Learn Spatiotemporal Patterns in Recurrent Neural Networks. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D. (eds) Artificial Neural Networks – ICANN 2007. ICANN 2007. Lecture Notes in Computer Science, vol 4668. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74690-4_77

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74690-4_77

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74689-8

  • Online ISBN: 978-3-540-74690-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics