Skip to main content

Advertisement

Log in

A rigorous analysis of the compact genetic algorithm for linear functions

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

Estimation of distribution algorithms (EDAs) solve an optimization problem heuristically by finding a probability distribution focused around its optima. Starting with the uniform distribution, points are sampled with respect to this distribution and the distribution is changed according to the function values of the sampled points. Although there are many successful experiments suggesting the usefulness of EDAs, there are only few rigorous theoretical results apart from convergence results without time bounds. Here we present first rigorous runtime analyses of a simple EDA, the compact genetic algorithm (cGA), for linear pseudo-Boolean functions on n variables. We prove a general lower bound for all functions and a general upper bound for all linear functions. Simple test functions show that not all linear functions are optimized in the same runtime by the cGA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Beyer H-G, Schwefel H-P, Wegener I (2002). ‘How to analyse evolutionary algorithms’. Theoretical Computer Science 287: 101–130

    Article  MathSciNet  MATH  Google Scholar 

  • Droste S (2005) Not all linear functions are equally difficult for the compact genetic algorithms. In: Beyer H-G et al. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference, pp. 679–686. ACM Press, Washington, DC

  • Droste S, Jansen T, Wegener I (2002). ‘On the analysis of the (1+1) EA’. Theoretical Computer Science 276: 51–81

    Article  MathSciNet  MATH  Google Scholar 

  • Harik GR, Lobo FG and Goldberg DE (1998) The compact genetic algorithm. In: Proceedings of the IEEE Conference on Evolutionary Computation, pp. 523–528. IEEE Press, Anchorage, AK

  • He J and Yao X (2004). ‘A study of drift analysis for estimating computation time of evolutionary algorithms’. Natural Computing 3: 21–35

    Article  MathSciNet  MATH  Google Scholar 

  • Larranaga P and Lozano JA (2002) Estimation of Distribution Algorithms. Kluwer Academic Publisher

  • Motwani R and Raghavan P (1995). Randomized Algorithms. Cambridge, Cambridge University Press

    MATH  Google Scholar 

  • Mühlenbein H and Mahnig T (1999). ‘Convergence theory and applications of the factorized distribution algorithm’. Journal of Computing and Information Technology 7: 19–32

    Google Scholar 

  • Rudolph G (1997). Convergence Properties of Evolutionary Algorithms. Verlag Dr., Kovač

    Google Scholar 

  • Wegener I (2002) Methods for the analysis of evolutionary algorithms on pseudo-boolean functions. In: Sarker R, Yao X and Mohammadian M (eds) Evolutionary Optimization, pp. 349 – 369. Kluwer

  • Wegener I (2005) Computational Complexity and EC. Tutorial at GECCO 2003, 2004, and 2005

Download references

Acknowledgements

I thank Jens Jägersküpper, Tobias Storch, Ingo Wegener, and Carsten Witt for valuable advice and discussions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stefan Droste.

Additional information

This research was partly supported by the Deutsche Forschungsgemeinschaft as part of the Collaborative Research Center “Computational Intelligence”(531).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Droste, S. A rigorous analysis of the compact genetic algorithm for linear functions. Nat Comput 5, 257–283 (2006). https://doi.org/10.1007/s11047-006-9001-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11047-006-9001-0

Keywords

Navigation