Skip to main content

Growing Self-Organizing Map for Online Continuous Clustering

  • Chapter
Book cover Foundations of Computational Intelligence Volume 4

Part of the book series: Studies in Computational Intelligence ((SCI,volume 204))

Abstract

The internet age has fuelled an enormous explosion in the amount of information generated by humanity. Much of this information is transient in nature, created to be immediately consumed and built upon (or discarded). The field of data mining is surprisingly scant with algorithms that are geared towards the unsupervised knowledge extraction of such dynamic data streams. This chapter describes a new neural network algorithm inspired by self-organising maps. The new algorithm is a hybrid algorithm from the growing self-organising map (GSOM) and the cellular probabilistic self-organising map (CPSOM). The result is an algorithm which generates a dynamically growing feature map for the purpose of clustering dynamic data streams and tracking clusters as they evolve in the data stream.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sato, M.A., Ishii, S.: On-line EM algorithm for the normalized gaussian network. Neural Computation 12(2), 407–432 (2000)

    Article  Google Scholar 

  2. Alahakoon, D.: Controlling the spread of dynamic self-organising maps. Neural Comput. Appl. 13(2), 168–174 (2004)

    Google Scholar 

  3. Alahakoon, D., Halgamuge, S.K., Srinivasan, B.: Dynamic self-organizing maps with controlled growth for knowledge discovery. IEEE Transactions on Neural Networks 11(3), 601–614 (2000)

    Article  Google Scholar 

  4. Amarasiri, R., Alahakoon, D., Smith, K., Premaratne, M.: Hdgsomr: A high dimensional growing self-organizing map using randomness for efficient web and text mining. wi, 215–221 (2005)

    Google Scholar 

  5. Amarasiri, R., Alahakoon, D., Smith, K.A.: Hdgsom: A modified growing self-organizing map for high dimensional data clustering. In: HIS 2004: Proceedings of the Fourth International Conference on Hybrid Intelligent Systems (HIS 2004), pp. 216–221. IEEE Computer Society, Washington (2004)

    Chapter  Google Scholar 

  6. Asuncion, A., Newman, D.J.: UCI machine learning repository (2007)

    Google Scholar 

  7. Chow, T.W.S., Wu, S.: An online cellular probabilistic self-organizing map for static and dynamic data sets. IEEE Transactions on Circuits and Systems 51(4), 732–747 (2004)

    Article  Google Scholar 

  8. Fritzke, B.: Growing cell structures-a self-organizing network for unsupervised and supervised learning. Neural Netw. 7(9), 1441–1460 (1994)

    Article  Google Scholar 

  9. Fritzke, B.: A growing neural gas network learns topologies. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 625–632. MIT Press, Cambridge (1995)

    Google Scholar 

  10. Goerke, N., Kintzler, F., Eckmiller, R.: Multi-soms: A new approach to self organised classification. In: ICAPR (1), pp. 469–477 (2005)

    Google Scholar 

  11. Graepel, T., Obermayer, K.: A stochastic self-organizing map for proximity data. Neural Computation 11(1), 139–155 (1999)

    Article  Google Scholar 

  12. Hebb, D.O.: The Organization of Behaviour. Wiley, New York (1949)

    Google Scholar 

  13. Hung, C., Wermter, S.: A dynamic adaptive self-organising hybrid model for text clustering. In: ICDM 2003: Proceedings of the Third IEEE International Conference on Data Mining, p. 75. IEEE Computer Society, Washington (2003)

    Google Scholar 

  14. Kiviluoto, K.: Topology preservation in self-organizing maps. In: IEEE International Conference on Neural Networks, 1996, Washington, DC, USA, vol. 1, pp. 294–299 (June 1996)

    Google Scholar 

  15. Kloppenburg, M., Tavan, P.: Deterministic annealing for density estimation by multivariate normal mixtures. Phys. Rev. E 55(3), R2089–R2092 (1997)

    Article  Google Scholar 

  16. Kohonen, T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43(1), 59–69 (1982)

    Article  MATH  MathSciNet  Google Scholar 

  17. Kohonen, T.: Self organizing maps, 2nd edn. Springer, Heidelberg (1995)

    Google Scholar 

  18. Lang, R., Warwick, K.: The plastic self organising map. In: Proceedings of the 2002 International Joint Conference on Neural Networks, 2002. IJCNN 2002, Honolulu, HI, vol. 1, pp. 727–732 (May 2002)

    Google Scholar 

  19. Luttrell, S.P.: Self-organisation: a derivation from first principles of a class of learning algorithms. In: IJCNN: International Joint Conference on Neural Networks, vol. 2, pp. 495–498 (1989)

    Google Scholar 

  20. Luttrell, S.P.: Code vector density in topographic mappings: Scalar case. IEEE Transactions on Neural Networks 2(4), 427–436 (1991)

    Article  Google Scholar 

  21. Luttrell, S.P.: A bayesian analysis of self-organizing maps. Neural Computation 6, 676–794 (1994)

    Article  Google Scholar 

  22. Martinetz, T., Schulten, K.: A “neural-gas” network learns topologies. Artificial Neural Networks, 397–402 (1991)

    Google Scholar 

  23. Mcculloch, W., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 5, 115–133 (1943)

    Article  MATH  MathSciNet  Google Scholar 

  24. Menhaj, M.B., Jahanian, H.R.: An analytical alternative for som. In: International Joint Conference on Neural Networks, 1999. IJCNN 1999, vol. 3, pp. 1939–1942 (1999)

    Google Scholar 

  25. Merkl, D., Dittenbach, M., Rauber, A.: Uncovering hierarchical structure in data using the growing hierarchical self-organizing map. Neurocomputing 48(1-4), 199–216 (2002)

    Article  MATH  Google Scholar 

  26. Rose, K.: Deterministic annealing for clustering, compression,classification, regression, and related optimization problems. Proceedings of the IEEE 86(11), 2210–2239 (1998)

    Article  Google Scholar 

  27. Rose, K., Gurewitz, E., Fox, G.C.: Statistical mechanics and phase transitions in clustering. Phys. Rev. Lett. 65(8), 945–948 (1990)

    Article  Google Scholar 

  28. Shannon, C.E.: A mathematical theory of communication. SIGMOBILE Mob. Comput. Commun. Rev. 5(1), 3–55 (2001)

    Article  Google Scholar 

  29. Villmann, T., Der, R., Herrmann, M., Martinetz, T.M.: Topology preservation in self-organizing feature maps: Exact definition and measurement. IEEE Transactions on Neural Networks 8(2), 256–266 (1997)

    Article  Google Scholar 

  30. von der Malsburg, C.: Self-organization of orientation sensitive cells in the striate cortex. Biological Cybernetics 14(2), 85–100 (1973)

    Google Scholar 

  31. Yu, Y., Alahakoon, D.: Batch implementation of growing self-organizing map. In: International Conference on Computational Intelligence for Modelling, Control and Automation, 2006 and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, p. 162 (November 2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Smith, T., Alahakoon, D. (2009). Growing Self-Organizing Map for Online Continuous Clustering. In: Abraham, A., Hassanien, AE., de Carvalho, A.P.d.L.F. (eds) Foundations of Computational Intelligence Volume 4. Studies in Computational Intelligence, vol 204. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01088-0_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01088-0_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01087-3

  • Online ISBN: 978-3-642-01088-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics