Abstract
We propose a novel population-based optimization algorithm, Chaotic Evolution (CE), which uses ergodic property of chaos to implement exploration and exploitation functions of an evolutionary algorithm. CE introduces a mathematical mechanism into an iterative process of evolution and simulates ergodic motion in a search space with a simple principle. A control parameter, direction factor rate, is proposed to guide search direction in CE. It is easy to extend its search capability by using different chaotic system in CE algorithm framework. The scalability of CE is higher than that of some other evolutionary computation algorithms. A series of comparative evaluations and investigations is conducted to analyse characteristics of the proposal. Our proposal can obtain better optimization performance by comparing with differential evolution and some of its variants. We point out that the chaos theory is used not only to describe and explain a non-linear system, but also to implement a variety of optimization algorithms based on its ergodic property.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Ali M, Pant M, Abraham A (2012) Improving differential evolution algorithm by synergizing different improvement mechanisms. ACM Trans Auton Adapt Syst 7(2):Article No. 20
Ammaruekarat P, Meesad P (2011) A chaos search for multi-objective memetic algorithm. In: 2011 International conference on information and electronics engineering, vol 6, pp 140–144
Back T, Fogel DB, Michalewicz Z (1997) Handbook of evolutionary computation. IOP Publishing Ltd., London
Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657
Caponetto R, Fortuna L, Fazzino S, Xibilia MG (2003) Chaotic sequences to improve the performance of evolutionary algorithms. IEEE Trans Evol Comput 7(3):289–304
Coelho LdS, Mariani VC (2006) Combining of chaotic differential evolution and quadratic programming for economic dispatch optimization with valve-point effect. IEEE Trans Power Syst 21(2):989–996
Coelho LdS, Mariani VC (2009) A novel chaotic particle swarm optimization approach using hénon map and implicit filtering local search for economic load dispatch. Chaos Solitons Fractals 39(2):510–518
Coelho LdS, Bora TC, Lebensztajn L (2012) A chaotic approach of differential evolution optimization applied to loudspeaker design problem. IEEE Trans Magn 48(2):751–754
Črepinšek M, Liu SH, Mernik M (2013) Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput Surv 45(3):Article No. 35
Diacu F, Holmes P (1996) Celestial encounters: the origins of chaos and stability. Princeton University Press, Princeton
Eiben AE, Schippers C (1998) On evolutionary exploration and exploitation. Fundam Inform 35(1):35–50
Fogel LJ (1962) Autonomous automata. Ind Res 4(2):14–19
Fogel DB (1991) System identification through simulated evolution: a machine learning approach to modeling. Ginn Press, Cambridge
Goldberg DE, Segrest P (1987) Finite markov chain analysis of genetic algorithms. In: The second international conference on genetic algorithms on genetic algorithms and their application. L. Erlbaum Associates Inc., Hillsdale, pp 1–8
Gong W, Cai Z, Ling CX, Li H (2011) Enhanced differential evolution with adaptive strategies for numerical optimization. IEEE Trans Syst Man Cybern B 41(2):397–413
Holland JH (1975) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. The University of Michigan Press, Ann Arbor
Huang X, Jia P, Liu B, Wang L (2010) Chaotic particle swarm optimization for synchronization of finite dimensional hénon dynamical system. In: 2010 Sixth international conference on natural computation, IEEE, vol 5, pp 2600–2604
Ingu T, Takagi H (1999) Accelerating a ga convergence by fitting a single-peak function. In: IEEE international conference on fuzzy systems, IEEE, vol 3, pp 1415–1420
Jahani R, Nejad HC, Zadeh HG (2011) Applying chaotic optimization algorithm for optimal power distribution. Aust J Basic Appl Sci 5(9):917–922
Koza JR (1994) Genetic programming as a means for programming computers by natural selection. Stat Comput 4(2):87–112
Liu B, Wang L, Jin YH, Tang F, Huang DX (2005) Improved particle swarm optimization combined with chaos. Chaos Solitons Fractals 25(5):1261–1271
Liu SH, Mernik M, Hrnčič D, Črepinšek M (2013) A parameter control method of evolutionary algorithms using exploration and exploitation measures with a practical application for fitting sovova’s mass transfer model. Appl Soft Comput 13(9):3792–3805
Lorenz EN (1963) Deterministic nonperiodic flow. J Atmos Sci 20(2):130–141
Mandelbrot BB (1983) The fractal geometry of nature. W.H. Freeman, New York
May RM (1976) Simple mathematical models with very complicated dynamics. Nat Biotechnol 261(5560):459–467
Nix AE, Vose MD (1992) Modeling genetic algorithms with markov chains. Ann Math Artif Intell 5(1):79–88
Pei Y (2013) A chaotic ergodicity based evolutionary computation algorithm. In: 2013 9th International conference on natural computation, IEEE, pp 454–459
Pei Y, Takagi H (2011a) Accelerating evolutionary computation with elite obtained in projected one-dimensional spaces. In: 2011 Fifth international conference on genetic and evolutionary computing, IEEE, pp 89–92
Pei Y, Takagi H (2011b) Comparative evaluations of evolutionary computation with elite obtained in reduced dimensional spaces. In: 2011 Third international conference on intelligent networking and collaborative systems, IEEE, pp 35–40
Pei Y, Takagi H (2011c) A novel traveling salesman problem solution by accelerated evolutionary computation with approximated cost matrix in an industrial application. In: 2011 International conference on soft computing and pattern recognition, IEEE, pp 39–44
Pei Y, Takagi H (2011d) A survey on accelerating evolutionary computation approaches. In: 2011 International conference on soft computing and pattern recognition, IEEE, pp 201–206
Pei Y, Takagi H (2012a) Comparative study on fitness landscape approximation with fourier transform. In: 2012 Sixth international conference on genetic and evolutionary computing, IEEE, pp 400–403
Pei Y, Takagi H (2012b) Fourier analysis of the fitness landscape for evolutionary search acceleration. In: 2012 IEEE congress on evolutionary computation, IEEE, pp 1–7
Pei Y, Takagi H (2013a) Accelerating IEC and EC searches with elite obtained by dimensionality reduction in regression spaces. Evol Intell 6(1):27–40
Pei Y, Takagi H (2013b) Triple and quadruple comparison-based interactive differential evolution and differential evolution. In: The twelfth workshop on foundations of genetic algorithms XII, ACM, pp 173–182
Pei Y, Chao K, Fu B, Lin YJ, Chen HY, Xu Y (2013) Method and system for determining recommended passage place sequence. CN patent 102158799(B)
Price KV, Storn RM, Lampinen JA (2005) Differential evolution a practical approach to global optimization. Springer, Heidelberg
Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417
Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5(1):96–101
Schwefel HP (1975) Evolutionsstrategie und numerische optimierung. PhD thesis, Technische Universität Berlin (in German)
Schwefel HP (1981) Numerical optimization of computer models. Wiley, New York
Schwefel HP (1993) Evolution and optimum seeking (Sixth generation computer technologies). Wiley, New York
Smith LA (2007) Chaos: a very short introduction. Oxford University Press, Oxford
Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359
Suganthan PN, Hansen N, Liang JJ, Deb K, Chen Y, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005: special session on real-parameter optimization. Technical report, KanGAL report no. 2005005
Sugihara G, May RM (1990) Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nat Biotechnol 344(6268):734–741
Zadeh LA (1994) Fuzzy logic, neural networks, and soft computing. Commun ACM 37(3):77–84
Zar JH (2007) Biostatistical analysis, 5th edn. Pearson Prentice-Hall, Upper Saddle River
Zhang J, Sanderson AC (2009) Jade: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
Acknowledgments
The author would like to thank Yoshida Scholarship Foundation for its support of his doctoral research. He is also grateful to the editor and anonymous reviewers for their valuable comments and suggestions on this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pei, Y. Chaotic Evolution: fusion of chaotic ergodicity and evolutionary iteration for optimization. Nat Comput 13, 79–96 (2014). https://doi.org/10.1007/s11047-013-9409-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11047-013-9409-2