Abstract
The separation property of Liquid State Machine (LSM) is a key for its power of computing, but the weights and delays of the inter-connections in the spiking neural circuit are usually randomly created and kept unchanged, which hinders the performance of the LSM greatly. In this paper, particle swarm optimization (PSO) was applied to optimize the weights and delays of the circuit so as to enhance the separation property of the LSM. Separation of random spike trains and Fisheriris data-set classification experiments are done by the optimized circuit. Demonstration examples show that the PSO can enlarge the separation property of the circuit greatly compared to the normal Hebbian-learning algorithm and enhance the computing ability of LSM.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Amir, F., Atiya, A.G.P.: New Results on Recurrent Network Training: Unifying the Algorithms and Accelerating Convergence. IEEE Trans. on Neural Network 11, 697–709 (2000)
Verstraeten, D., Schrauwen, B., et al.: An Experimental Unification of Reservoir Computing Methods. Neural Network 2, 391–403 (2007)
Jaeger, H.: The "Echo State" Approach to Analysing and Training Recurrent Neural Networks. GMD Report 148, German National Research Center for Information Technology (2001)
Maass, W., Natschläger, T., Markram, H.: Real-time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations. Neural Computation 14, 2531–2560 (2002)
Steil, J.J.: Backpropagation-decorrelation: Online Recurrent Learning with O(N) Complexity. In: Proceedings of 2004 IEEE International Joint Conference on Neural Network, vol. 2, pp. 843–848 (2004)
Gerstner, W., Kistler, W.: Spiking Neuron Models. Cambridge University Press, Cambridge (2002)
Fang, H.J., Wang, Y.J., Liu, S.: Error-backpropagation with Adaptive Learning Rate in Spiking Neural Network. In: Pre-Proceedings of the Second International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA), pp. 14–17 (2007)
Goodman, E.L., Ventura, D.: Spatiotemporal Pattern Recognition via Liquid State Machine. In: Proceedings of the 2006 International Joint Conference on Neural Networks, pp. 3848–3853 (2006)
Kennedy, J., Eberhart, R.: Particle Swarm Optimization. In: Proceeding of the 1995 IEEE International Conference on Neural Network, pp. 1942–1948 (2005)
Norton, D., Ventura, D.: Preparing More Effective Liquid State Machines Using Hebbian Learning. In: 2006 International Joint Conference On Neural Network, pp. 4243–4248 (2006)
Sander, M.B., Han, A.L.P., Joost, N.K.: Error-backpropagation in Temporally Encoded Networks of Spiking Neurons. Neurocomputing 48, 17–37 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huang, J., Wang, Y., Huang, J. (2009). The Separation Property Enhancement of Liquid State Machine by Particle Swarm Optimization. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5553. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01513-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-01513-7_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01512-0
Online ISBN: 978-3-642-01513-7
eBook Packages: Computer ScienceComputer Science (R0)