Abstract
A new on-line criterion for identifying “useless” neurons of a self-organizing network is proposed. When this criterion is used in the context of the (formerly developed) growing neural gas model to guide deletions of units, the resulting method is able to closely track nonstationary distributions. Slow changes of the distribution are handled by adaptation of existing units. Rapid changes are handled by removal of “useless” neurons and subsequent insertions of new units in other places.
Preview
Unable to display preview. Download preview PDF.
References
H. U. Bauer and Th. Villmann. Growing a hypercubical output space in a selforganizing feature map. TR-95-030, International Computer Science Institute, Berkeley, 1995.
B. Fritzke. Growing cell structures-a self-organizing network for unsupervised and supervised learning. Neural Networks, 7(9):1441–1460, 1994.
B. Fritzke. A growing neural gas network learns topologies. In G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems 7, pages 625–632. MIT Press, Cambridge MA, 1995.
B. Fritzke. Growing grid-a self-organizing network with constant neighborhood range and adaptation strength. Neural Processing Letters, 2(5):9–13, 1995.
B. Fritzke. The LBG-U method for vector quantization-an improvement over LBG inspired from neural networks. Neural Processing Letters, 5(1):35–45, 1997.
T. Kohonen. Analysis of a simple self-organizing process. Biological Cybernetics, 44:135–140, 1982.
T. M. Martinetz. Competitive Hebbian learning rule forms perfectly topology preserving maps. In ICANN'93: International Conference on Artificial Neural Networks, pages 427–434, Amsterdam, 1993. Springer.
T. M. Martinetz, S. G. Berkovich, and K. J. Schulten. Neural-gas network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks, 4(4):558–569, 1993.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fritzke, B. (1997). A self-organizing network that can follow non-stationary distributions. In: Gerstner, W., Germond, A., Hasler, M., Nicoud, JD. (eds) Artificial Neural Networks — ICANN'97. ICANN 1997. Lecture Notes in Computer Science, vol 1327. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0020222
Download citation
DOI: https://doi.org/10.1007/BFb0020222
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63631-1
Online ISBN: 978-3-540-69620-9
eBook Packages: Springer Book Archive