Abstract
Pulsed Neuron (PN) model was proposed as one of the simplest models working by pulse trains. PN model has a membrane potential to deal with the temporal information, and the calculation process is inexpensive. However, as the output function of PN model is an Unit Step function, PN model cannot directly use the back-propagation (BP) method. It would be possible to solve general pattern recognition problems if the PN model could be trained by the BP method. In this paper, we propose a BP method for multilayer pulsed neural networks. The proposed method uses the duality of PN model, in which the desired output of hidden layer neuron is calculated from output layer neurons’ weights and output. Experimental results show that the multilayer pulsed neural networks can learn and recognize non-linear problems using the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Representations by Back-propagating Errors. Nature 323(9), 533–536 (1986)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Internal Representation by Error Propagation. In: McClelland, J.L., Rumelhart, D.E., The PDP Research Group (eds.) Parallel Distributed Processing, vol. 1, MIT Press, Cambridge (1986)
Maass, W., Bishop, C.M.: Pulsed Neural Networks. MIT Press, Cambridge (1998)
Iwasa, K., Kuroyanagi, S., Iwata, A.: A Sound Localization and Recognition System using Pulsed Neural Networks on FPGA. In: Proceeding of International Joint Conference of Neural Networks 2007, August 2007 (to appear)
Simei, G.W., Lubica, B., Nikola, K.: Adaptive Learning Procedure for a Network of Spiking Neurons and Visual Pattern Recognition. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2006. LNCS, vol. 4179, pp. 1133–1142. Springer, Heidelberg (2006)
Simei, G.W., Lubica, B., Nikola, K.: Adaptive Spiking Neural Networks for Audiovisual Pattern Recognition. In: Proceedings of International Conference on Neural Information Processing 2007, pp. 406–415 (2008)
Sander, M.B., Han, A.L.P., Joost, N.K.: Error-Backpropagation in Temporally Encoded Networks of Spiking Neurons. In: Proceedings of Neurocomputing, vol. 48, pp. 17–37 (2002)
Sander, M.B., Han, A.L.P., Joost, N.K.: Error-Backpropagation in Temporally Encoded Networks of Spiking Neurons, CWI Technical Report, SEN-R0036 (2000)
Yamada, K., Kuroyanagi, S., Iwata, A.: A Supervised Learning Method Using Duality in the Artificial Neuron model (Japanese). Proceedings of IEICE J87-D2(2), 399–406 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Iwasa, K., Kugler, M., Kuroyanagi, S., Iwata, A. (2009). A Back-Propagation Training Method for Multilayer Pulsed Neural Networks Using Principle of Duality. In: Köppen, M., Kasabov, N., Coghill, G. (eds) Advances in Neuro-Information Processing. ICONIP 2008. Lecture Notes in Computer Science, vol 5507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03040-6_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-03040-6_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03039-0
Online ISBN: 978-3-642-03040-6
eBook Packages: Computer ScienceComputer Science (R0)