Abstract
This paper presents an analysis of the performance of the (μ/μ,λ)-ES with isotropically distributed mutations and cumulative step length adaptation on the noisy parabolic ridge. Several forms of dependency of the noise strength on the distance from the ridge axis are considered. Closed form expressions are derived that describe the mutation strength and the progress rate of the strategy in high-dimensional search spaces. It is seen that as for the sphere model, larger levels of noise present lead to cumulative step length adaptation generating increasingly inadequate mutation strengths, and that the problem can be ameliorated to some degree by working with larger populations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arnold DV (2002) Noisy Optimization with Evolution Strategies. Genetic Algorithms and Evolutionary Computation Series. Kluwer Academic Publishers, Boston
Arnold DV (2005) Optimal weighted recombination. In: Wright AH et al. (eds), Foundations of Genetic Algorithms 8. Springer Verlag, Heidelberg, pp 215–237
Arnold DV, Beyer H-G (2001) Local performance of the (μ/μ I ,λ)-ES in a noisy environment. In: Martin WN, Spears WM (eds), Foundations of Genetic Algorithms 6. Morgan Kaufmann Publishers, San Francisco, pp 127–141
Arnold DV, Beyer H-G (2003) A comparison of evolution strategies with other direct search methods in the presence of noise. Computational Optimization and Applications 24(1):135–159
Arnold DV, Beyer H-G (2004) Performance analysis of evolutionary optimization with cumulative step length adaptation. IEEE Transactions on Automatic Control 49(4):617–622
Arnold DV, Beyer H-G (2005) Expected sample moments of concomitants of selected order statistics. Statistics and Computing 15(3):241–250
Arnold DV and MacLeod A (2006)Hierarchically organised evolution strategies on the parabolic ridge. In: Cattolico M et al. (eds) GECCO ’06: Proceedings of the 2006 Genetic and Evolutionary Computation Conference, pp. 437–444. ACM Press, New York.
Balakrishnan N, Rao CR (1998) Order statistics: an introduction. In: Balakrishnan N, Rao CR (eds), Handbook of Statistics volume 16. Elsevier, Amsterdam, pp 3–24
Beyer H-G (1995) ward a theory of evolution strategies: on the benefit of sex – the (μ/μ,λ)-theory. Evolutionary Computation 3(1):81–111
Beyer H-G (1996) Toward a theory of evolution strategies: self-adaptation. Evolutionary Computation 3(3):311–347
Beyer H-G (2001a) On the performance of (1,λ)-evolution strategies for the ridge function class. IEEE Transactions on Evolutionary Computation 5(3):218–235
Beyer H-G (2001b) The Theory of Evolution Strategies. Natural Computing Series. Springer Verlag, Heidelberg
Beyer H-G, Arnold DV, Meyer-Nieberg S (2005) A new approach for predicting the final outcome of evolution strategy optimization under noise. Genetic Programming and Evolvable Machines 6(1):7–24
Beyer H-G, Meyer-Nieberg S (2006) Self-adaptation on the ridge functions class: First results for the sharp ridge. In: Runarsson TP et al. (eds), Parallel Problem Solving from Nature – PPSN IX. Springer Verlag, Heidelberg, pp 71–80
Beyer H-G, Schwefel H-P (2002) Evolution strategies – A comprehensive introduction. Natural Computing 1(1):3–52
David HA, Nagaraja HN (1998) Concomitants of order statistics. In Balakrishnan N, Rao CR (eds), Handbook of Statistics, vol. 16. Elsevier, Amsterdam, pp 487–513
Hansen N (1998) Verallgemeinerte Individuelle Schrittweitenregelung in der Evolutionsstrategie. Mensch & Buch Verlag, Berlin
Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation 9(2):159–195
Herdy M (1992) Reproductive isolation as strategy parameter in hierarchically organized evolution strategies. In Männer R, Manderick B (eds), Parallel Problem Solving from Nature – PPSN II. Elsevier, Amsterdam, pp 207–217
Ostermeier A, Gawelczyk A, Hansen N (1994) Step-size adaptation based on non-local use of selection information. In: Davidor Y et al. (eds), Parallel Problem Solving from Nature – PPSN III. Springer Verlag, Heidelberg, pp 189–198
Oyman AI, Beyer H-G (2000) Analysis of the (μ/μ,λ)-ES on the parabolic ridge. Evolutionary Computation 8(3):267–289
Oyman AI, Beyer H-G, Schwefel H-P (1998) Where elitists start limping: evolution strategies at ridge functions. In: Eiben AE et al. (eds), Parallel Problem Solving from Nature – PPSN V. Springer Verlag, Heidelberg, pp 109–118
Oyman AI, Beyer H-G, Schwefel H-P (2000) Analysis of the (1,λ)-ES on the parabolic ridge. Evolutionary Computation 8(3):249–265
Rechenberg I (1973) Evolutionsstrategie – Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Friedrich Frommann Verlag, Stuttgart
Rechenberg I (1994) Evolutionsstrategie ’94. Friedrich Frommann Verlag, Stuttgart
Salomon R (1998) Evolutionary algorithms and gradient search: similarities and differences. IEEE Transactions on Evolutionary Computation 2(2):45–55
Salomon R (2004) The curse of high-dimensional search spaces: observing premature convergence in unimodal functions. In: Proc. of the 2004 IEEE Congress on Evolutionary Computation, pp. 918–923. IEEE Press, Piscataway, NJ.
Whitley D, Lunacek M, Knight J (2004) Ruffled by ridges: How evolutionary algorithms can fail. In: Deb K et al. (eds), Genetic and Evolutionary Computation – GECCO 2004. Springer Verlag, Heidelberg, pp 294–306
Acknowledgements
This research has been supported by the Natural Sciences and Engineering Research Council of Canada (NSERC).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Arnold, D.V., Beyer, HG. Evolution strategies with cumulative step length adaptation on the noisy parabolic ridge. Nat Comput 7, 555–587 (2008). https://doi.org/10.1007/s11047-006-9025-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11047-006-9025-5