Abstract
The internet age has fuelled an enormous explosion in the amount of information generated by humanity. Much of this information is transient in nature, created to be immediately consumed and built upon (or discarded). The field of data mining is surprisingly scant with algorithms that are geared towards the unsupervised knowledge extraction of such dynamic data streams. This chapter describes a new neural network algorithm inspired by self-organising maps. The new algorithm is a hybrid algorithm from the growing self-organising map (GSOM) and the cellular probabilistic self-organising map (CPSOM). The result is an algorithm which generates a dynamically growing feature map for the purpose of clustering dynamic data streams and tracking clusters as they evolve in the data stream.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sato, M.A., Ishii, S.: On-line EM algorithm for the normalized gaussian network. Neural Computation 12(2), 407–432 (2000)
Alahakoon, D.: Controlling the spread of dynamic self-organising maps. Neural Comput. Appl. 13(2), 168–174 (2004)
Alahakoon, D., Halgamuge, S.K., Srinivasan, B.: Dynamic self-organizing maps with controlled growth for knowledge discovery. IEEE Transactions on Neural Networks 11(3), 601–614 (2000)
Amarasiri, R., Alahakoon, D., Smith, K., Premaratne, M.: Hdgsomr: A high dimensional growing self-organizing map using randomness for efficient web and text mining. wi, 215–221 (2005)
Amarasiri, R., Alahakoon, D., Smith, K.A.: Hdgsom: A modified growing self-organizing map for high dimensional data clustering. In: HIS 2004: Proceedings of the Fourth International Conference on Hybrid Intelligent Systems (HIS 2004), pp. 216–221. IEEE Computer Society, Washington (2004)
Asuncion, A., Newman, D.J.: UCI machine learning repository (2007)
Chow, T.W.S., Wu, S.: An online cellular probabilistic self-organizing map for static and dynamic data sets. IEEE Transactions on Circuits and Systems 51(4), 732–747 (2004)
Fritzke, B.: Growing cell structures-a self-organizing network for unsupervised and supervised learning. Neural Netw. 7(9), 1441–1460 (1994)
Fritzke, B.: A growing neural gas network learns topologies. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 625–632. MIT Press, Cambridge (1995)
Goerke, N., Kintzler, F., Eckmiller, R.: Multi-soms: A new approach to self organised classification. In: ICAPR (1), pp. 469–477 (2005)
Graepel, T., Obermayer, K.: A stochastic self-organizing map for proximity data. Neural Computation 11(1), 139–155 (1999)
Hebb, D.O.: The Organization of Behaviour. Wiley, New York (1949)
Hung, C., Wermter, S.: A dynamic adaptive self-organising hybrid model for text clustering. In: ICDM 2003: Proceedings of the Third IEEE International Conference on Data Mining, p. 75. IEEE Computer Society, Washington (2003)
Kiviluoto, K.: Topology preservation in self-organizing maps. In: IEEE International Conference on Neural Networks, 1996, Washington, DC, USA, vol. 1, pp. 294–299 (June 1996)
Kloppenburg, M., Tavan, P.: Deterministic annealing for density estimation by multivariate normal mixtures. Phys. Rev. E 55(3), R2089–R2092 (1997)
Kohonen, T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43(1), 59–69 (1982)
Kohonen, T.: Self organizing maps, 2nd edn. Springer, Heidelberg (1995)
Lang, R., Warwick, K.: The plastic self organising map. In: Proceedings of the 2002 International Joint Conference on Neural Networks, 2002. IJCNN 2002, Honolulu, HI, vol. 1, pp. 727–732 (May 2002)
Luttrell, S.P.: Self-organisation: a derivation from first principles of a class of learning algorithms. In: IJCNN: International Joint Conference on Neural Networks, vol. 2, pp. 495–498 (1989)
Luttrell, S.P.: Code vector density in topographic mappings: Scalar case. IEEE Transactions on Neural Networks 2(4), 427–436 (1991)
Luttrell, S.P.: A bayesian analysis of self-organizing maps. Neural Computation 6, 676–794 (1994)
Martinetz, T., Schulten, K.: A “neural-gas” network learns topologies. Artificial Neural Networks, 397–402 (1991)
Mcculloch, W., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 5, 115–133 (1943)
Menhaj, M.B., Jahanian, H.R.: An analytical alternative for som. In: International Joint Conference on Neural Networks, 1999. IJCNN 1999, vol. 3, pp. 1939–1942 (1999)
Merkl, D., Dittenbach, M., Rauber, A.: Uncovering hierarchical structure in data using the growing hierarchical self-organizing map. Neurocomputing 48(1-4), 199–216 (2002)
Rose, K.: Deterministic annealing for clustering, compression,classification, regression, and related optimization problems. Proceedings of the IEEE 86(11), 2210–2239 (1998)
Rose, K., Gurewitz, E., Fox, G.C.: Statistical mechanics and phase transitions in clustering. Phys. Rev. Lett. 65(8), 945–948 (1990)
Shannon, C.E.: A mathematical theory of communication. SIGMOBILE Mob. Comput. Commun. Rev. 5(1), 3–55 (2001)
Villmann, T., Der, R., Herrmann, M., Martinetz, T.M.: Topology preservation in self-organizing feature maps: Exact definition and measurement. IEEE Transactions on Neural Networks 8(2), 256–266 (1997)
von der Malsburg, C.: Self-organization of orientation sensitive cells in the striate cortex. Biological Cybernetics 14(2), 85–100 (1973)
Yu, Y., Alahakoon, D.: Batch implementation of growing self-organizing map. In: International Conference on Computational Intelligence for Modelling, Control and Automation, 2006 and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, p. 162 (November 2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Smith, T., Alahakoon, D. (2009). Growing Self-Organizing Map for Online Continuous Clustering. In: Abraham, A., Hassanien, AE., de Carvalho, A.P.d.L.F. (eds) Foundations of Computational Intelligence Volume 4. Studies in Computational Intelligence, vol 204. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01088-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-01088-0_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01087-3
Online ISBN: 978-3-642-01088-0
eBook Packages: EngineeringEngineering (R0)