Abstract
A Self-organizing Map (SOM) is a competitive learning neural network architecture that make available a certain amount of classificatory neurons, which self-organize spatially based on input patterns. In this paper we explore the use of complex network topologies, like small-world, scale-free or random networks; for connecting the neurons within a SOM, and apply them for Time Series Prediction. We follow the VQTAM model for function prediction, and consider several benchmarks to evaluate the quality of the predictions. Afterwards, we introduce the CASOM algorithm (Coalitions and SOM) that uses coalitions to temporarily extend the neighborhood of a neuron, and to provide more accuracy in prediction problems than classical SOM. The results presented in this work suggest that the most regular the network topology is, the better results it provides in prediction. Besides, we have found that not updating all the neurons at the same time provides much better results. Finally, we describe how the use of coalitions can enhance the capability of SOM for Time Series Prediction.
Similar content being viewed by others
References
Albert R, Barabási AL (2002) Statistical mechanics of complex networks. Rev Modern Phys 74:47–97
Axelrod R (1984) The evolution of Cooperation. Basic Books, New York
Boccaletti S, Latora V, Moreno Y, Chavez M, Hwang DU (2006) Complex networks: structure and dynamics. Phys Rep 424:175–308
Barabási AL, Albert R (1999) Emergence of scaling in random networks. Science 286(5439):509–512
Barreto GA, Araújo AFR (2004) Identification and control of dynamical systems using the self-organizing map. IEEE Trans Neural Netw 15(5):1244–1259
Barreto GA (2007) Time series prediction with the self-organizing map: a review. Perspect Neural Symb Integr Stud Comput Intell 77:135–158
Binmore K (1994) Game theory. Mc Graw Hill, New York
Burguillo JC (2009) A memetic framework for describing and simulating spatial prisoner’s dilemma with coalition formation. In: 8th International conference on autonomous agents and multiagent systems
Burguillo JC (2013) Playing with complexity: from cellular evolutionary algorithms with coalitions to self-organizing maps. Comput Math Appl 66:201–212
Dorronsoro B, Burguillo JC, Peleteiro A, Bouvry P (2013) Evolutionary algorithms based on game theory and cellular automata with coalitions. In: Handbook of optimization, intelligent systems, vol 38. Springer, Berlin, pp 481–503
Erdos P, Renyi A (1959) On random graphs. Publicationes Mathematicae 6:290–297
Jiang F, Berry H, Schoenauer M (2009) The impact of network topology on self-organizing maps. GEC09, Shanghai, China
Kohonen T (2001) Self-organizing maps, 3rd edn. Springer, Berlin (2001)
Langer P, Nowak MA, Hauert C (2008) Spatial invasion of cooperation. J Theor Biol 250:634–641
Mackey MC, Glass J (1977) Oscillation and chaos in physiological control systems. Science 197:287
Maynard Smith J (1982) Evolution and the theory of games. Cambridge University Press, Cambridge
Morgenstern O, von Neumann J (1947) The theory of games and economic behavior. Princeton University Press, Princeton
Nash J (1950) Equilibrium points in n-person games. Proc Natl Acad Sci USA 36(1):48–49
Nash J (1951) Non-cooperative games. Ann Math 54(2):286–295
Nowak MA, May RM (1992) Evolutionary games and spatial chaos. Nature 359:826–829
Palit AK, Popovic D (2005) Computational intelligence in time series forecasting: theory and engineering applications, 1st edn. Springer, Berlin
Van Hulle MM (2001) Self-organizing maps: theory, design, and application. Kaibundo, Tokyo
Watts DJ, Strogatz SH (1998) Collective dynamics of small-world networks. Nature 393:440–442
Weigend A, Gershefeld N (1993) Time series prediction: forecasting the future and understanding the past. Addison-Wesley, Boston
Yang S, Luo S, Li J (2006) An extended model on self-organizing map. In: Proceedings of the 13 international conference on Neural Information Processing (ICONIP’06)
Yang J, Luo Z (2007) Coalition formation mechanism in multi-agent systems based on genetic algorithms. Appl Soft Comput 7(2):561–568
Acknowledgments
The author thanks Bernabé Dorronsoro for his helpful collaboration in previous works, and anonymous reviewers for their hints and comments.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by I. Zelinka.
Rights and permissions
About this article
Cite this article
Burguillo, J.C. Using self-organizing maps with complex network topologies and coalitions for time series prediction. Soft Comput 18, 695–705 (2014). https://doi.org/10.1007/s00500-013-1171-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-013-1171-y