Skip to main content
Log in

Modeling dynamics of a real-coded CHC algorithm in terms of dynamical probability distributions

  • Original Paper
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Some theoretical models have been proposed in the literature to predict dynamics of real-coded evolutionary algorithms. These models are often applied to study very simplified algorithms, simple real-coded functions or sometimes these make difficult to obtain quantitative measures related to algorithm performance. This paper, trying to reduce these simplifications to obtain a more useful model, proposes a model that describes the behavior of a slightly simplified version of the popular real-coded CHC in multi-peaked landscape functions. Our approach is based on predicting the shape of the search pattern by modeling the dynamics of clusters, which are formed by individuals of the population. This is performed in terms of dynamical probability distributions as a basis to estimate its averaged behavior. Within reasonable time, numerical experiments show that is possible to achieve accurate quantitative predictions in functions of up to 5D about performance measures such as average fitness, the best fitness reached or number of fitness function evaluations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Barnett L (1998) Collapsing the state space by applying markov analysis to evolutionary systems. In: Workshop presentation at the sixth international conference on artificial life, UCLA

  • Beyer H, Schwefel H (2002) Evolution strategies—a comprehensive introduction. Nat Comput 1(1):3–52

    Article  MATH  MathSciNet  Google Scholar 

  • Beyer HG, Schwefel HP, Wegener I (2002) How to analyse evolutionary algorithms. Theor Comput Sci 287(1):101–130

    Article  MATH  MathSciNet  Google Scholar 

  • Bornholdt S (1998) Genetic algorithm dynamics on a rugged landscape. Phys Rev E 57(4):3853–3860

    Article  Google Scholar 

  • Cano JR, Herrera F, Lozano M (2003) Using evolutionary algorithms as instance selection for data reduction in kdd: an experimental study. IEEE Trans Evol Comput 7(6):561–575

    Article  Google Scholar 

  • Cano JR, Herrera F, Lozano M (2005) Strategies for scaling up evolutionary instance reduction algorithms for data mining. In: Ghosh A, Jain L (eds) Evolutionary computation in data mining. Studies in fuzziness and soft computing, vol 163. Springer, Berlin, pp 21–39

  • Cervone G, Kaufman KK, Michalski RS (2000) Experimental validations of the learnable evolution model. In: Proceedings of the 2000 congress on evolutionary computation, pp 1064–1071

  • Chellapilla K, Fogel DB (1999) Fitness distributions in evolutionary computation: motivation and examples in the continuous domain. Biosystems 54(1-2):15–29

    Article  Google Scholar 

  • Cordón O, Damas S, Santamaría J (2006) Feature-based image registration by means of the chc evolutionary algorithm. Image Vis Comput 24(5):525–533

    Article  Google Scholar 

  • Delgado M, Pegalajar M, Pegalajar M (2006) Evolutionary training for dynamical recurrent neural networks: an application in finantial time series prediction. Mathware Soft Comput 13:89–110

    MATH  MathSciNet  Google Scholar 

  • Eiben AE, Rudolph G (1999) Theory of evolutionary algorithms: a bird’s eye view. Theor Comput Sci 229(1):3–9

    Article  MATH  MathSciNet  Google Scholar 

  • Eshelman L (1990) The chc adaptive search algorithm. In: Rawlins G (ed) Foundations of genetic algorithms. Morgan Kaufmann, San Francisco, pp 265–283

  • Eshelman L, Caruana A, Schaffer J (1993) Real-coded genetic algorithms and interval-schemata. Found Genetic Algorithms 2:187–202

    Google Scholar 

  • Eshelman LJ, Schaffer JD (1992) Real-coded genetic algorithms and interval-schemata. In: Foundation of genetic algorithms, pp 187–202

  • Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms in genetic algorithms by preventing incest. Foundation of genetic algorithms, vol 2, pp 187–202

  • Herrera F, Lozano M, Molina D (2010) Components and parameters of DE, real-coded CHC, and G-CMA-ES. Tech. rep., SCI2S, University of Granada, Spain. http://sci2s.ugr.es/eamhco/descriptions.pdf

  • Holland J (1992) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. 1st edn. MIT Press, Cambridge

    Google Scholar 

  • Huang W, Wang X (2007) An improved CHC algorithm for damage diagnosis of offshore platforms. J Ocean Univ China 6:85–89 (english edition)

    Article  Google Scholar 

  • Kesur KB (2009) Advances in genetic algorithm optimization of traffic signals. J Transport Eng 135(4):160–173

    Article  Google Scholar 

  • Lozano M, Herrera F, Krasnogor N, Molina D (2004) Real-coded memetic algorithms with crossover hill-climbing. Evol Comput 12(3):273–302

    Article  Google Scholar 

  • Luzón M, Barreiro E, Yeguas E, Joan-Arinyo R (2004) GA and CHC two evolutionary algorithms to solve the root identification problem in geometric constraint solving. In: Bubak M, van Albada GD, Sloot PMA, Dongarra JJ (eds) Computational science—ICCS 2004. Lecture notes in computer science, vol 3039. Springer, Berlin, pp 139–146

  • Marín J, Solé RV (1999) Macroevolutionary algorithms: a new optimization method on fitness landscapes. IEEE Trans Evol Comput 3(4):272–286

    Article  Google Scholar 

  • Nebro AJ, Alba E, Molina G, Chicano F, Luna F, Durillo JJ (2007) Optimal antenna placement using a new multi-objective chc algorithm. In: GECCO ’07: proceedings of the 9th annual conference on genetic and evolutionary computation. ACM, New York, NY, USA, pp 876–883

  • Nomura T (1997) An analysis on crossovers for real number chromosomes in an infinite population size. In: IJCAI’97: proceedings of the fifteenth international joint conference on artificial intelligence. Morgan Kaufmann, San Francisco, CA, USA, pp 936–941

  • Poli R, Langdon W, Clerc M, Stephens C (2007) Continuous optimisation theory made easy? Finite-element models of evolutionary strategies, genetic algorithms and particle swarm optimizers. In: Stephens C, Toussaint M, Whitley D, Stadler P (eds) Foundations of genetic algorithms. Lecture notes in computer science, vol 4436. Springer, Berlin, pp 165–193

  • Prügel-Bennett A, Rogers A (2001) Modelling GA dynamics. Nat Comput. Springer

  • Qi X, Palmieri F (1994) Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. Part I: basic properties of selection and mutation. IEEE Trans Neural Netw 5(1):102–119

    Article  Google Scholar 

  • Qi X, Palmieri F (1994) Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. Part II: analysis of the diversification role of crossover. IEEE Trans Neural Netw 5(1):120–129

    Article  Google Scholar 

  • Sánchez AM, Lozano M, García-Martínez C, Molina D, Herrera F (2008) Real-parameter crossover operators with multiple descendents: an experimental study. Int J Intell Syst 23:246–268

    Article  MATH  Google Scholar 

  • Santamaría J, Cordón O, Damas S, García-Torres JM, Quirin A (2009) Performance evaluation of memetic approaches in 3d reconstruction of forensic objects. Soft Comput 13:883–904. http://portal.acm.org/citation.cfm?id=1530043.1530048

    Google Scholar 

  • Schmitt LM (2004) Theory of genetic algorithms II: models for genetic operators over the string-tensor representation of populations and convergence to global optima for arbitrary fitness function under scaling. Theor Comput Sci 310(1–3):181–231

    Article  MATH  Google Scholar 

  • Stephens C, Waelbroeck H (1998) Schemata evolution and building blocks. Evol Comput 7:109–124

    Article  Google Scholar 

  • van Nimwegen E, Crutchfield JP, Mitchell M (1999) Statistical dynamics of the Royal Road genetic algorithm. Theor Comput Sci 229(1–2):41–102

    Article  MATH  Google Scholar 

  • Vose MD (1998) The simple genetic algorithm: foundations and theory. MIT Press, Cambridge

    Google Scholar 

  • Whitley D, Lunacek M, Sokolov A (2006) Comparing the niches of CMA-ES, CHC and pattern search using diverse benchmarks. In: Runarsson T, Beyer HG, Burke E, Merelo-Guervs J, Whitley L, Yao X (eds) Parallel problem solving from nature—PPSN IX. Lecture notes in computer science, vol 4193. Springer, Berlin, pp 988–997

  • Witt C (2008) Population size versus runtime of a simple evolutionary algorithm. Theor Comput Sci 403(1):104–120

    Article  MATH  MathSciNet  Google Scholar 

  • Wright AH, Rowe JE, Neil JR (2002) Analysis of the simple genetic algorithm on the single-peak and double-peak landscapes. In: Proceedings of the congress on evolutionary computation (CEC) 2002. IEEE Press, pp 214–219

  • Zhao X, Gao XS, Hu ZC (2007) Evolutionary programming based on non-uniform mutation. Appl Math Comput 192(1):1–11

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgments

This work is supported by the Ministerio de Ciencia e Innovación (Spain) under grant TEC2008-02754/TEC and TIN2008-05854.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jesús Marín.

Appendix: A formulation for hypersphere volumes

Appendix: A formulation for hypersphere volumes

The volume of a hypersphere \(V_{H}\) of radius \(r=d/2\) is given by \(V_{H}(r)= C_n r^n\) where \(n\) is the dimension, \(C_n=\pi^{n/2}/\Upgamma(1+n/2)\) is the unit sphere, and \(\Upgamma(.)\) is the Gamma function.

The volume for a hypersphere cap \(V_C\) of radius \(r\) and height \(h\) is given by

$$ V_C(r,h)=C_n r^n \left(\frac{1}{2} - \frac{r-h}{r}\frac{\Upgamma\left(1+\frac{n}{2}\right)}{\pi^{\frac{1}{2}} \Upgamma\left(\frac{n+1}{2}\right)} {}_{2}F_{1}(a,b;c;z) \right) $$
(31)

where \(a=\frac{1}{2}, b=\frac{1-n}{2}, c=\frac{3}{2}, z=( \frac{r-h}{r})^2. \, {}_2F_1\) is a hypergeometric function defined by the next series:

$$ _2F_1(a,b;c;z)= \sum_{i=0}^{\infty} \frac{ (a)_n (b)_n z^n}{(c)_n n!} $$
(32)

when it meets \(z<1,\) that in this case it is \(h>0.\) Therefore, \((x)_n\) is given as follows:

$$ (x)_n = \prod_{i=0}^{n-1} (x+i) $$
(33)

The volume of intersection of two hyperspheres \(V_I\) can be found by adding the volume of two hyperspherical caps. Let \(r1\) and \(r2\) be the radius of both hyperspheres that intersect, and \(\delta\) the distance between their centers. Then,

$$V_I(r1,r2,\delta) = V_C(r1,h1) + V_C(r2,h2) $$
(34)

where the heights of the caps \(h1\) and \(h2\) are

$$ h1=\frac{(r1+r2-\delta)(r2-r1+\delta)}{2 \delta} $$
(35)
$$ h2=\frac{(r1+r2-\delta)(r1-r2+\delta)}{2 \delta} $$
(36)
Table 6 Model predictions and average simulation data at each generation for the function F 1
Table 7 Model predictions and average simulation data at each generation for the function F 2
Table 8 Model predictions and average simulation data at each generation for the function F 2
Table 9 Model predictions and average simulation data at each generation for the function F 3
Table 10 Model predictions and average simulation data at each generation for the function F 4
Table 11 Model predictions and average simulation data at each generation for the function F 5
Table 12 Model predictions and average simulation data at each generation for the function \(F_5\) All values are normalized

Rights and permissions

Reprints and permissions

About this article

Cite this article

Marín, J., Molina, D. & Herrera, F. Modeling dynamics of a real-coded CHC algorithm in terms of dynamical probability distributions. Soft Comput 16, 331–351 (2012). https://doi.org/10.1007/s00500-011-0745-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-011-0745-9

Keywords

Navigation