Abstract
Evolutionary programming (EP) has been widely used in numerical optimization in recent years. One of EP's key features is its self-adaptation scheme. In EP, mutation is typically the only operator used to generate new offspring. The mutation is often implemented by adding a random number from a certain distribution (e.g., Gaussian in the case of classical EP) to the parent. An important parameter of the Gaussian distribution is its standard deviation (or equivalently the variance). In the widely used self-adaptation scheme of EP, this parameter is evolved, rather than manually fixed, along with the objective variables. This paper investigates empirically how well the self-adaptation scheme works on a set of benchmark functions. Some anomalies have been observed in the empirical studies, which demonstrate that the self-adaptation scheme may not work as well as hoped for some functions. An experimental evaluation of an existing simple fix to the problem is also carried out in this paper.
Preview
Unable to display preview. Download preview PDF.
Reference
Fogel, D. B., System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling, Needham Heights, MA: Ginn Press, 1991.
Fogel, D. B., Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, New York: IEEE Press, 1995.
Yao, X. and Liu, Y., “Fast Evolutionary Programming,” in Proceedings of the Fifth Annual Conference on Evolutionary Programming, Cambridge, MA: The MIT Press, pp. 451–460, 1996.
Yao, X., Lin, G. and Liu, Y., “An Analysis of Evolutionary Algorithms Based on Neighbourhood and Step Sizes,” in Evolutionary Programming VI: 6th International Conference, Proceedings/EP97, Indianapolis, Indiana, USA, P. Angeline, R. Reynolds, J. McDonnell and R. Eberhart (eds), New York: Springer, Vol. 1213 of Lecture Notes in Computer Science, pp. 297–307, 1997.
Angeline, P., “The Effects of Noise on Self-Adaptive Evolutionary Optimization,” in Proceedings of the Fifth Annual Conference on Evolutionary Programming, Cambridge, MA: The MIT Press, pp. 433–439, 1996.
Fogel, D., “Applying Evolutionary Programming to Selected Control Problems,” Computers & Mathematics Applications, Vol. 27, No. 11, pp. 89–104, 1994.
Bäck, T., and Schwefel H.-P., “An Overview of Evolutionary Algorithms for Parameter Optimization,” Evolutionary Computation, Vol. 1, No. 1, pp. 1–23, 1993.
Schwefel, H.-P., Evolution and Optimum Seeking, New York: Wiley, 1995.
Angeline, P. J., “Adaptive and Self-Adaptive Evolutionary Computations,” In Computational Intelligence: A Dynamic System Perspective, M. Palaniswami, Y. Attikiouzel, R. Marks, D. Fogel and T. Fukuda (eds), Piscataway, NJ: IEEE Press, pp. 152–163, 1995.
Rechenberg, I., Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution, Stuttgart: Frommann-Holzberg Verlag, 1973.
Rosenberg, R. S., Simulation of Genetic Populations with Biochemical Properties Doctoral dissertation. University of Michigan, Dissertation Abstracts International, 28(7)2732B. (University Microfilms No. 67-17,836), 1967.
Bäck, T., Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms, New York: Oxford University Press, 1996.
Saravanan, N., Fogel, D.B. and Nelson, K.M., “A Comparison of Methods for Self-Adaptation in Evolutionary algorithm,” BioSystems, Vol. 36, pp. 157–166, 1995.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liang, KH., Yao, X., Liu, Y., Newton, C., Hoffman, D. (1998). An experimental investigation of self-adaptation in evolutionary programming. In: Porto, V.W., Saravanan, N., Waagen, D., Eiben, A.E. (eds) Evolutionary Programming VII. EP 1998. Lecture Notes in Computer Science, vol 1447. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0040782
Download citation
DOI: https://doi.org/10.1007/BFb0040782
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64891-8
Online ISBN: 978-3-540-68515-9
eBook Packages: Springer Book Archive