Skip to main content
SpringerLink
Log in

SOMwise regression: a new clusterwise regression method

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

We present a novel neural learning architecture for regression data analysis. It combines, at the high level, a self-organizing map (SOM) structure, and, at the low level, a multilayer perceptron at each unit of the SOM structure. The goal is to build a clusterwise regression model, that is, a model recognizing several clusters in the data, where the dependence between predictors and response is variable (typically within some parametric range) from cluster to cluster. The proposed algorithm, called SOMwise Regression, follows closely in the spirit of the standard SOM learning algorithm and has performed satisfactorily on various test problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Bauer H, Pawelzik K (1992) Quantifying the neighborhood preservation of self-organizing feature maps. IEEE Trans Neural Netw 4(3):570–579

    Article  Google Scholar 

  2. Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

    Google Scholar 

  3. Brusco MJ, Cradit JD, Tashchian A (2003) Multicriterion clusterwise regression for joint segmentation: an application to customer value. J Mark Res 40(2):225–234

    Article  Google Scholar 

  4. Chtourou S, Chtourou M, Hammami O (2008) A hybrid approach for training recurrent neural networks: application to multi-step-ahead prediction of noisy and large data sets. Neural Comput Appl 17(3):245–254

    Article  Google Scholar 

  5. DeSarbo W, Cron W (1988) A maximum likelihood methodology for clusterwise linear regression. J Classif 5:249–282

    Article  MathSciNet  MATH  Google Scholar 

  6. Hennig C (1999) Models and methods for clusterwise linear regression. In: Gaul W, Locarek-Junge H (eds) Classification in the information age. Springer, Berlin, pp 179–187

    Chapter  Google Scholar 

  7. Herrmann L, Ultsch A (2007) Label propagation for semi-supervised learning in self-organizing maps. In: 6th International workshop on self-organizing maps, Bielefeld, Germany

  8. Heskes T (1999) Energy functions for self-organizing maps. In: Oja E, Kaski S (eds) Kohonen maps. Elsevier, Amsterdam, pp 303–316

    Chapter  Google Scholar 

  9. Kathirvalavakumar T, Jeyaseeli Subavathi S (2009) Neighborhood based modified backpropagation algorithm using adaptive learning parameters for training feedforward neural networks. Neurocomputing 72(16–18):3915–3921

    Article  Google Scholar 

  10. Kohonen T (2001) Self-organizing maps. Springer, Berlin

    Book  MATH  Google Scholar 

  11. Kontkanen P, Lahtinen J, Myllymaki P, Silander T, Tirri H (2000) Supervised model-based visualization of high-dimensional data. Intell Data Analysis 4(3–4):213–227

    MATH  Google Scholar 

  12. Larrañaga P, Calvo B, Santana R, Bielza C, Galdiano J, Inza I, Lozano J, Armañanzas R, Santafé G, Pérez A, Robles V (2006) Machine learning in bioinformatics. Brief Bioinformat 7(1):86–112

    Article  Google Scholar 

  13. McCormick R (1993) Managerial economics. Prentice-Hall, Englewood Cliffs, NJ

    Google Scholar 

  14. Melssen W, Wehrens R, Buydens L (2006) Supervised Kohonen networks for classification problems. Chemom Intell Lab Syst 83(2):99–113

    Article  Google Scholar 

  15. Srivastava S, Zhang L, Jin R, Chan C (2008) A novel method incorporating gene ontology information for unsupervised clustering and feature selection. PLoS ONE 3(12):e3860

    Article  Google Scholar 

  16. Tokunaga K, Furukawa T (2009) Modular network SOM. Neural Netw 22(1):82–90

    Article  Google Scholar 

  17. Tsimboukakis N, Tambouratzis G (2007) Self-organizing word map for context-based document classification. In: 6th International workshop on self-organizing maps, Bielefeld, Germany

  18. Ultsch A (2003) Maps for the visualization of high-dimensional data spaces. In: Workshop on self-organizing maps, Kyushu, Japan, pp 225–230

  19. Ultsch A, Siemon H (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural networks conference, Kluwer Academic Press, Paris, pp 305–308

  20. Van Hulle MM (2000) Faithful representations and topographic maps: from distortion- to information-based self-organization. Wiley, New York

    Google Scholar 

  21. Vidaurre D, Muruzábal J (2007) A quick assessment of topology preservation for SOM structures. IEEE Trans Neural Netw 18(5):1524–1528

    Article  Google Scholar 

  22. Villmann T, Herrmann M, Martinetz T (1997) Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Trans Neural Netw 8(2):256–266

    Article  Google Scholar 

  23. Villmann T, Seiffert U, Schleif F, Brüß C, Geweniger T, Hammer B (2006) Fuzzy labeled self-organizing map with label-adjusted prototypes, LNAI, vol 4087. Springer, Ulm, Germany, pp 46–56

  24. Weiss GM (2004) Mining with rarity: a unifying framework. SIGKDD Explor Newsl 6(1):7–19

    Article  Google Scholar 

  25. Xiao Y, Clauset A, Harris R, Bayram E, Santago P, Schmitt J (2005) Supervised self-organizing maps in drug discovery: 1. Robust behavior with overdetermined data sets. J Chem Inf Model 45(6):1749–1758

    Article  Google Scholar 

Download references

Acknowledgments

This research was partially supported by projects TIN2007-62626 and Cajal Blue Brain. We are very grateful to Prof. Concha Bielza and Prof. Pedro Larrañaga for heir valuable support. Finally, we would like to express our very special gratitude in the memory of the first author, Prof. Jorge Muruzábal, who devised the idea and provided the inspiration for this and many others papers. It was a pleasure to work with him and share his enthusiastic attitude to the science.

Author information

Authors and Affiliations

  1. Universidad Rey Juan Carlos, Madrid, Spain

    Jorge Muruzábal & Julián Sánchez

  2. Computational Intelligence Group, Universidad Politécnica de Madrid, Madrid, Spain

    Diego Vidaurre

Authors
  1. Jorge Muruzábal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diego Vidaurre
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julián Sánchez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Diego Vidaurre.

Additional information

J. Muruzábal: Deceased

Rights and permissions

Reprints and permissions

About this article

Cite this article

Muruzábal, J., Vidaurre, D. & Sánchez, J. SOMwise regression: a new clusterwise regression method. Neural Comput & Applic 21, 1229–1241 (2012). https://doi.org/10.1007/s00521-011-0536-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0536-3

Keywords

Search

Navigation