Skip to main content
SpringerLink
Log in

A weighted voting summarization of SOM ensembles

  • Published:
Data Mining and Knowledge Discovery Aims and scope Submit manuscript

Abstract

Weighted Voting Superposition is a novel summarization algorithm for the results of an ensemble of Self-Organizing Maps. Its principal aim is to achieve the lowest topographic error in the map in order to obtain the best possible visualization of the internal structure of the data sets under study. This is done by means of a weighted voting process between the neurons of the ensemble maps in order to determine the characteristics of the neurons in the resulting map. The algorithm is applied in this case to the most widely known topology preserving mapping architecture: the Self- Organizing Map. A comparison is made between the novel fusion algorithm presented in this work and other previously devised fusion algorithms, along with a new variation of those algorithms, called Ordered Similarity. Although a practical example of the new algorithm was introduced in an earlier work, a rigorous description and analysis is presented here for the first time by comparing the performance of the aforementioned algorithms in relation to three well-known data sets (Iris, Wisconsin Breast Cancer and Wine) obtained from Internet repositories. The results show how this novel fusion algorithm outperforms the other fusion algorithms, yielding better visualization results for ensemble summarization of maps.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Asuncion A, Newman DJ (2007) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences

  • Aurenhammer F, Klein R (2000) Voronoi diagrams. In: Handbook of computational geometry, number 5. North-Holland, Amsterdam, Netherlands pp 201–290

  • Baruque B, Corchado E, Rovira J, Gonzalez J (2008) Application of topology preserving ensembles for sensory assessment in the food industry. In: Intelligent data engineering and automated learning (IDEAL 2008). Lecture notes in computer science, vol 5326. Springer, Berlin/Heidelberg, pp 491–497

  • Baruque B, Corchado E, Yin H (2007) ViSOM ensembles for visualization and classification. In: 9th international work-conference on artificial neural networks (IWANN’07), San Sebastian, Spain. Lecture notes in computer science, vol 4507. Springer, Berlin/Heidelberg, pp 235–243

  • Blackmore J, Miikkulainen R (1993) Incremental grid growing: encoding high-dimensional structure into a two-dimensional feature map. In: Proceedings of the IEEE international conference on neural networks, vol 1, pp 450–455, ISBN 0-7803-0999-5

  • Brassard G, Bratley P (1995) Fundamentals of Algorithmics. Prentice Hall; US ed edition, August 1995, p 524 ISBN 0133350681

  • Breiman L (1996) Bagging predictors. Mach Learn 24(2): 123–140

    MATH  MathSciNet  Google Scholar 

  • Corchado E, Baruque B, Yin H (2007) Boosting unsupervised competitive learning ensembles. In: Artificial neural networks (ICANN 2007), Porto, Portugal. Lecture notes in computer science, vol 4668. Springer, Berlin/Heidelberg, pp 339–348

  • Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. In: International conference on machine learning, pp 148–156

  • Georgakis A, Li H, Gordan M (2005) An ensemble of SOM networks for document organization and retrieval. In: International conference on adaptive knowledge representation and reasoning (AKRR’05). Espoo, Finland, pp 6–141

  • Gianniotis N, Tino P (2008) Visualization of tree-structured data through generative topographic mapping. IEEE T Neural Networ 19(8): 1468–1493

    Article  Google Scholar 

  • Heskes T (1997) Balancing between bagging and bumping. In: Mozer MC, Jordan MI, Petsche T (eds) Advances in neural information processing systems. MIT Press, Denver, CO, pp 466–472

    Google Scholar 

  • Hotelling H (1933) Analysis of a complex of statistical variables into principal components. J Educ Psychol 24: 417–444

    Article  Google Scholar 

  • Johansson U, Lofstrom T, Niklasson L (2006) Obtaining accurate neural network ensembles. In: Mohammadian M (ed) International conference on computational intelligence for modelling, control & automation jointly with international conference on intelligent agents, web technologies & internet commerce, vol 2, proceedings, pp 103–108

  • Kaski S, Lagus K (1996) Comparing self-organizing maps. In: von der Malsburg, von Seelen W, Vorbruggen JC, Sendhoff B (eds). In: ICANN 96: proceedings of the 1996 international conference on artificial neural networks, Lecture notes in computer science. Springer-Verlag, London, UK, pp 809–814

  • Kiviluoto K (1996) Topology preservation in self-organizing maps. In: IEEE international conference on neural networks (ICNN’96), vol 1, pp 294–299

  • Kohonen T (1988) An introduction to neural computing. Neural Networks 1(1): 3–16 ISSN 0893-6080

    Article  Google Scholar 

  • Kohonen T (1995) Self-organizing maps. In: Series in information sciences, vol 30. Springer, Berlin

    Google Scholar 

  • Kohonen T, Lehtio P, Rovamo J, Hyvarinen J, Bry K, Vainio L (1977) A principle of neural associative memory. Neuroscience 2(6): 1065–1076

    Article  Google Scholar 

  • Kohonen T, Oja E, Simula O, Visa A, Kangas J (1996) Engineering applications of the self-organizing map. In: Proceedings of the IEEE, vol 84, pp 1358–1384

  • Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New Jersey

    Book  MATH  Google Scholar 

  • Kuncheva LI, Skurichina M, Duin RPW (2002) An experimental study on diversity for bagging and boosting with linear classifiers. Inf Fusion 3(4): 245–258

    Article  Google Scholar 

  • Lampinen J, Oja E (1992) Clustering properties of hierarchical self-organizing maps. J Math Imaging Vis 2: 261–272

    Article  MATH  Google Scholar 

  • Ling CX (1995) Overfitting and generalization in learning discrete patterns. Neurocomputing 8(3): 341–347

    Article  Google Scholar 

  • Patra JC, Ang EL, Meher PK, Zhen Q (2006) A new SOM-based visualization technique for dna microarray data. In: International joint conference on neural networks (IJCNN’06), pp 4429–4434

  • Petrakieva L, Fyfe C (2003) Bagging and bumping self organising maps. Comput Inf Syst J 1352–9404

  • Polani D (2003) Measures for the organization of self-organizing maps. In: Seiffert U, Jain LC (eds) Self-organizing neural networks: recent advances and applications studies in fuzziness and soft computing, vol 16. Physica-Verlag, Heidelberg, pp 13–44

    Google Scholar 

  • Pozlbauer G (2004) Survey and comparison of quality measures for self-organizing maps. In: Rauber JP, Polzlbauer G, Andreas R (eds) 5th workshop on data analysis (WDA’04). Elfa Academic Press, Slovakia, pp 67–82

    Google Scholar 

  • Ruta D, Gabrys B (2005) Classifier selection for majority voting. Inf Fusion 6(1): 63–81

    Article  Google Scholar 

  • Saavedra C, Salas R, Moreno S, Allende H (2007) Fusion of self organizing maps. In: 9th international work-conference on artificial neural networks (IWANN 2007). Lecture notes in computer science. Springer, Berlin/Heidelberg, pp 227–234

  • Schwenk H, Bengio Y (2000) Boosting neural networks. Neu Compu 12(8): 1869–1887

    Article  Google Scholar 

  • Vesanto J, Sulkava M, Hollmen J (2003) On the decomposition of the self-organizing map distortion measure. In: Proceedings of the workshop on self-organizing maps (WSOM’03), pp 11–16

  • Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. International Journal of Forecasting 14(1): 35–62

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Civil Engineering, University of Burgos, Burgos, Spain

    Bruno Baruque

  2. Departamento de Informática y Automática, Universidad de Salamanca, Plaza de la Merced s/n, Salamanca, 37008, Spain

    Emilio Corchado

Authors
  1. Bruno Baruque
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emilio Corchado
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emilio Corchado.

Additional information

Responsible editor: M.J. Zaki.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baruque, B., Corchado, E. A weighted voting summarization of SOM ensembles. Data Min Knowl Disc 21, 398–426 (2010). https://doi.org/10.1007/s10618-009-0160-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10618-009-0160-3

Keywords

Search

Navigation