Abstract
In recent years, evolutionary computation (EC) techniques have became one of the most popular heuristic search methods successively applied to solve complex research and real-life problems. This chapter presents an overview of the field of EC. Main concepts of biological evolution and some biological paradigms are shown, their influence on EC is discussed, and a general computational scheme currently used in EC is presented. The best recognized classes of EC algorithms are described, such as Evolution Strategies, Genetic Algorithms, Genetic Programming, Evolutionary Programming, and Learning Classifier Systems. However, the main emphasise is on the class of Genetic Algorithms (GAs). Mechanisms of controlling evolutionary process in GAs are discussed, the most known variants of GAs are presented, and current issues of development of GAs are considered.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Ackley, M. Litman (1994): A case for Lamarckian evolution. In: Langton C (ed) Artificial Life III, Reading, MA, Addison Wesley.
R. K. Ahuja, J. B. Orlin (1997): Developing fitter GAs. Inform J. Computing, 9: 251–253.
J. Bacardit, J. M. Garrel (2003): Evolving multiple discretizations with adaptive intervals for a Pittsburgh rule-based learning classifier system. In: [21]: 1818–1831.
T. Bäck, D. B. Fogel, Z. Michalewicz (eds) (1997): Handbook of Evolutionary Computation, IOP Publishing Ltd. and Oxford University Press.
S. Bandyopadhyay, H. Kargupta, G. Wang (1998): Revisiting the GEMGA: scalable evolutionary optimization through linkage learning. Proc. of the Fourth Int. Conf. on Evolutionary Computation: pp. 603–608.
W. Banzhaf, et al. (eds) Proc. of the Genetic and Evolutionary Computation Conference GECCO’99, Morgan Kaufmann Publishers.
T. Bäck, M. Schütz (1996): Intelligent mutation rate control in canonical genetic algorithms. In: Ras Z W, Michalewicz M (eds) Foundations of Intelligent Systems, Springer, LNAI 1079: 158–167.
A. Barry (2003): Limits in long path learning with XCS. In: [21]: 1832–1843.
P. J. Bentley, D. W. Corne (eds.) (2002): Creative Evolutionary Systems, Morgan Kaufmann.
H. Beyer-G (2001): The theory of evolution strategies, Natural Computing Series, Springer, Heidelberg.
H. Beyer-G (2003): Introduction to evolution strategies. In: [44]: 384–426.
T. M. Blackwell (2003): Swarms in dynamic environments. In [20]: 1–12.
T. Blickle, L. Thiele (1996): A comparison of selection schemes used in evolutionary algorithms. Evolutionary Computation, 4: 361–394.
L. B. Booker, D. E. Goldberg, J. H. Holland (1989): Classifier systems and genetic algorithms. Artificial Intelligence 40: 235–282.
J. Branke (2002): Evolutionary Optimization in Dynamic Environments, Kluwer Academic Publishers.
M. V. Butz (2002): Biasing exploration in an anticipatory learning classifier system. In: Lanzi et al. (eds) Advances in Learning Classifier Systems, LNAI 2321, Springer: 3–22.
M. V. Butz, K. Sastry, D. E. Goldberg (2003): Tournament selection: stable fitness pressure in XCS. In: [21]: 1857–1869.
E. Cantu-Paz (2003): Parallel genetic algorithms. In: [44]: 241–257.
E. Cantu-Paz (1999): Topologies, migration rates, and multi-population parallel genetic algorithms. In: [6]: 91–98.
E. Cantu-Paz et al. (eds) (2003): Genetic and Evolutionary Computation-GECCO 2003, Part I, LNCS 2723, Springer.
E. Cantu-Paz et al. (eds) (2003): Genetic and Evolutionary Computation-GECCO 2003, Part II, LNCS 2724, Springer.
Z. S. H. Chan, H. W. Ngan, A. B. Rad (1999): Minimum-allele-reserve-keeper (MARK): a fast and effective mutation scheme for genetic algorithm. In: [6], 1: 106–113.
H. Choe, S-S. Choi, B-R. Moon (2003): A hybrid genetic algorithm for hexagonal tortoise problem. In: [20]: 850–861.
C. A. Coello Coello (1999): A comprehensive survey of evolutionary-based multiobjective optimization techniques. Knowledge and Information Systems 1(3):269–308.
C. A. Coello Coello, D. A. Van Veldhuizen, G. B. Lamont (2002): Evolutionary Algorithms for Solving Multi-objective Problems. Kluwer Academic.
D. Corn, M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999.
Y. Davidor, H-P. Schwefel, R. Manner (eds) (1994): Parallel Problem Solving from Nature—PPSN III, LNCS 866, Springer.
L. Davis (1991): Bit-climbing, representational bias, and test suite design. In: L. Booker, R. Belew (eds) Proc. of the 4th Int. Conf. on GAs, Morgan Kaufmann: 18–23.
L. D. Davis (1999): Commercial applications of evolutionary computation: some case studies. In: [43]: 38–51.
D. Dawson (2003): Improving performance in size-constrained extended classifier systems. In: [21]: 1870–1881.
L. N. De Castro, J. Timmis (2002): Artificial Immune Systems: A New Computational Intelligence Approach, Springer.
K. Deb, D. E. Goldberg (1989): An investigation on niche and species formation in genetic function optimization. In: Schaffer J D et al. (eds) Proc. of the Third Int. Conf. on Genetic Algorithms. Morgan Kaufmann Publishers: pp. 42–50.
I. De Falco, A. Iazzetta, E. Tarantino (1999): Towards a simulation of natural mutation. In: [6], 1: 156–163.
K. De Jong (1975): An Analysis of the Behavior of a Class of Genetic Adaptive Systems. Doctoral dissertation, University of Michigan, Ann Arbor, Michigan.
K. De Jong (2003): Evolutionary computation: a unified approach. In: [44]: 644–652.
L. J. Eshelman (1991): The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination. In: G. J. E. Rawlins (ed) Foundations of Genetic Algorithms, Morgan Kaufmann, San Mateo, CA: 265–283.
F. P. Espinoza, B. S. Minsker, D. E. Goldberg (2003): Performance evaluation and population reduction for a self adaptive hybrid genetic algorithm (SAHGA). In: [20]: 922–933.
L. J. Fogel, A. J. Owens, M. J. Walsh (1966): Artificial Intelligence Through Simulated Evolution. John Wiley, Chichister, UK.
D. B. Fogel (1993): Applying evolutionary programming to selected traveling salesman problems. Cybern. Syst., 24: 27–36.
D. B. Fogel (1995): Evolutionary Computation. Towards a New Philosophy of Machine Intelligence, IEEE Press.
G. B. Fogel, K. Chellapilla (1999): Simulated sequencing by hybridization using evolutionary programming. In: Proc. of the 1999 Congress on Evolutionary Computation, 1: 463–469.
A. S. Fukunaga (1998): Restart scheduling for genetic algorithms. In: A. E. Eiben et al. (eds) Parallel Problem Solving from Nature—PPSN V, Springer, LNCS 1498: 357–366.
GECCO-1999: 1999 Genetic and Evolutionary Computation Conference. Tutorial Program. Orlando, Florida, July 14, 1999.
GECCO-2003: 2003 Genetic and Evolutionary Computation Conference. Tutorial Program. Chicago, Illinois, July 13, 2003.
P. Gerard, O. Sigaud (2003): Designing efficient exploration with MACS: modules and function approximation. In: [21]: 1882–1893.
D. E. Goldberg (1989): Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Reading, Massachusets.
D. E. Goldberg (2002): The Design of Innovation. Lessons from and for Competent Genetic Algorithms. Kluwer Academic Publishers, Boston/Dordrecht/London.
D. E. Goldberg, K. Deb, J. H. Clark (1992): Genetic algorithms, noise and the sizing of population. Complex Systems, 6: 333–362.
D. E. Goldberg, K. Deb, H. Kargupta, G. Harik (1993): Rapid, accurate optimization of difficult problems using fast messy genetic algorithms. Proc. of the Fifth Int. Conf. on Genetic Algorithms: 56–64.
M. Gorges-Schleuter (1992): Comparison of local mating strategies in massively parallel genetic algorithms. In: B. Manderick (eds) (1992): Parallel Problem Solving from Nature, 2. North-Holland [78]: 553–562.
J. Grefenstette (1997): Efficient implementation of algorithms. In: D. B. Fogel, Z. Michalewicz (eds) (1997): Handbook of Evolutionary Computation, IOP Publishing Ltd. and Oxford University Press [4]: E2.1:1–E2.1:6.
G. R. Harik (1997): Learning gene linkage to efficiently solve problems of bounded difficulty using genetic algorithms. Unpublished doctoral dissertation, University of Michigan, Ann Arbor, also IlliGAL Report No. 97005.
G. R. Harik (1999): Linkage Learning via Probabilistic Modeling in the ECGA. IlliGAL Report No. 99010, Urbana, IL, University of Illinois at Urbana-Champaign.
W. Hart, R. Belew (1995): Optimization with genetic algorithm hybrids that use local search. In: R. Below and M. Mitchell (eds.) Adaptive Individuals in Evolving Populations: Models and Algorithms, Reading, MA, Addison Wesley.
R. Heckendorn (2003): An introduction to genetic algorithms: theory and practice. In: [44]: 225–240.
W. D. Hillis (1992): Co-evolving parasites improve simulated evolution as an optimization procedure. In: C. G. Langton et al. (eds) Artificial Life II. Addison-Wesley.
G. E. Hinton, S. J. Nowlan (1987): How learning can guide evolution. Complex Systems, 1: 495–502.
T. P. Hoehn, C. C. Pettey (1999): Parental and cyclic-rate mutation in genetic algorithms: an initial investigation. In: [6], 1: 297–304.
J. H. Holland (1985): Properties of the bucket brigade algorithm. In: J. J. Grefenstette (ed) Proc. of the 1st Int. Conf. on Genetic Algorithms and Their Applications: 1–7.
J. H. Holmes (1996): A genetics-based machine learning approach to knowledge discovery in clinical data. J. American Medical Informatics Association Supplement.
F. Hoffmeister, T. Bäck (1992): Genetic Algorithms and Evolution Strategies: Similarities and Differences. Technical Report No SYS-1/92, University of Dortmund.
G. Huang, A. Lim (2003): Designing a hybrid genetic algorithm for the linear ordering problem. In: [20]: 1053–1064.
P. Husbands (1994): Distributed coevolutionary genetic algorithms for multi-criteria and multi-constraint optimization. In: T. C. Fogarty (ed) Evolutionary Computing, LNCS 865, Springer: 150–165.
IEEE Trans. on Evolutionary Computation (2002). Special issue on artificial immune systems, 6, 3(1).
A. Iorio, X. Li (2002): Parameter control within a co-operative co-evolutionary genetic algorithm. In: M. Guervos et al. (eds) Proc. of the Seventh Conf. on Parallel Problem Solving from Nature (PPSN VII), Springer: pp. 247–256.
C. Z. Janikow (1996): A methodology for processing problem constraints in genetic programming. Computers and Mathematics with Applications, vol. 32, No 8: 97–113.
C. Z. Janikow, R. A. Deshpande (2003): Adaptation of representation in GP. In: C. H. Dagli et al. (eds) Smart Engineering System Design, 13: 45–50.
J. Kennedy, R. C. Eberhart (1999): The particle swarm: social adaptation in information-processing systems. In: M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999 [26]: 379–387.
D. Knjazew (2002): OmeGA. A Competent Genetic Algorithm for Solving Permutation and Scheduling Problems. Kluwer Academic Publishers, Boston/Dordrecht/London.
J. R. Koza (1992): Genetic programming: on the programming of computers by natural selection. MIT Press, Cambridge, MA.
J. R. Koza (2003): Introduction to genetic programming. In: [44]: 1–34.
W. B. Langdon, R. Poli (2003): Foundations of genetic programming. In: [44]: 53–105.
S.-C. Lin, E. D. Goodman, W. F. Punch, III (1997): Investigating parallel genetic algorithms on job shop scheduling problems. In: Evolutionary Programming VI, LNCS 1213, Springer: 383–393.
J. Lis, A. E. Eiben (1996): A multi-sexual genetic algorithm for multiobjective optimization. In: T. Fukuda, T. Furuhashi (eds) Proc. of the 1996 Int. Conf. on Evolutionary Computation. IEEE: 59–64.
A. J. Lotka (1925), Elements of Physical Biology, Williams and Wilkins, Baltimore.
S. W. Mahfoud (1992): Crowding and preselection revisited. In: B. Manderick (eds) (1992): Parallel Problem Solving from Nature, 2. North-Holland [78]: 27–36.
W. N. Martin, J. Lienig, J. P. Cohoon (1997): Island (migration) models: evolutionary algorithms based on punctuated equlibria. In: D. B. Fogel, Z. Michalewicz (eds) (1997): Handbook of Evolutionary Computation, IOP Publishing Ltd. and Oxford University Press [4]: C6.3:1–C6.3:16.
R. Männer, B. Manderick (eds) (1992): Parallel Problem Solving from Nature, 2. North-Holland.
M. McIlhagga, P. Husbands, R. Ives (1996): A comparison of optimization techniques for integrating manufacturing, planning and scheduling. In: [126]: 604–613.
O. J. Mengshoel, D. E. Goldberg (1999): Probabilistic crowding: deterministic crowding with probabilistic replacement. In: [6]: 409–416.
Z. Michalewicz (1996): Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, Berlin.
Z. Michalewicz (1995): Evolutionary computation: an overview. In: J. Komorowski (eds) Proc. of the 8th Scandinavian Conf. on Artificial Intelligence. IOS Press, 28: 322–337.
M. Mitchell, J. H. Holland, S. Forrest (1994): When will a genetic algorithm outperform hill climbing. In: J. D. Cowan et al. (eds) Advances in Neural Information Processing Systems, vol. 6, Morgan Kaufmann: 51–58.
M. Mitchel (1996): An Introduction to Genetic Algorithms. The MIT Press, Cambridge Massachusetts.
T. M. Mitchell (1997): Machine Learning. McGraw-Hill.
P. Moscato (1999): Memetic algorithms: a short introduction. In: M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999 [26]: 219–244.
H. Mühlenbein (1992): How genetic algorithms really work I. Mutation and hillclimbing. In: B. Manderick (eds) (1992): Parallel Problem Solving from Nature, 2. North-Holland [78]: 15–25.
H. Mühlenbein, D. Schlierkamp-Voosen (1994): The science of breeding and its application to the breeder genetic algorithm. Evolutionary Computation, 1: 335–360.
Y. Nagata, S. Kobayashi (1997): Edge assembly crossover: a high-power genetic algorithm for the traveling salesman problem. In: T. Bäck (ed) Proc. of 7th Int. Conf. on Genetic Algorithms, Morgan Kaufmann, San Francisco, CA: 450–457.
V. Nissen, J. Biethahn (1995): An introduction to evolutionary algorithms. In: J. Biethahn and V. Nissen (eds) Evolutionary Algorithms in Management Applications, Springer: 3–97.
G. Ochoa, I. Harvey, H. Buxton (1999): On recombination and optimal mutation rates. In: [6], 1: 488–496.
C. C. Palmer (1994): An Approach to a Problem in Network Design using Genetic Algorithms. Unpublished Ph.D. thesis, Polytechnic University, Troy, NY.
J. Paredis (1994): Co-evolutionary constraint satisfaction. In: H-P. Schwefel, R. Manner (eds) (1994): Parallel Problem Solving from Nature-PPSN III, LNCS 866, Springer [27]: 46–55.
J. Paredis (1996): Coevolutionary life-time learning. In: [126]: 72–80.
M. Pelikan, D. E. Goldberg, E. Cantu-Paz (1999): BOA: The Bayesian optimization algorithm. In: [6]: 525–532.
A. S. Perelson, R. Hightower, S. Forrest (1996): Evolution and somatic learning in V-Region genes. Research in Immunology, 147: 202–208.
C. C. Pettey (1997): Diffusion (cellular) models. In: D. B. Fogel, Z. Michalewicz (eds) (1997): Handbook of Evolutionary Computation, IOP Publishing Ltd. and Oxford University Press [4]: C6.4:1–C6.4:6.
M. A. Potter, K. A. De Yong (1994): A cooperative coevolutionary approach to function optimization. In: H-P. Schwefel, R. Manner (eds) (1994): Parallel Problem Solving from Nature-PPSN III, LNCS 866, Springer [27]: 249–257.
K. V. Price (1999) An introduction to differential evolution. In: M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999 [26]: 79–108.
C. R. Reeves (ed) (1993): Modern Heuristics Techniques for Combinatorial Problems. Blackwell Scientific, Oxford, UK.
N. Radcliffe (1992), Non-linear genetic representations. In: B. Manderick (eds) (1992): Parallel Problem Solving from Nature, 2. North-Holland [78]: 259–268.
C. R. Reeves, J. E. Rowe (2003): Genetic Algorithms: Principle and Perspectives: A Guide to GA Theory. Kluwer Academic Publishers.
S. Ronald (1997): Robust encoding in genetic algorithms: a survey of encoding issues. In: Proc. of the Forth Int. Conf. on Evolutionary Computation, Piscataway, NJ, IEEE: 43–48.
I. Rechenberg (1994): Evolutionsstrategie. Frommann-Holzboog Verlag, Stuttgart.
R. G. Reynolds (1999): Cultural algorithms: theory and applications. In: M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999 [26]: 367–377.
F. Rothlauf (2003): Population sizing for the redundant trivial voting mapping. In: [21]: 1307–1319.
F. Rothlauf (2003): Representations for genetic and evolutionary algorithms. In: [44]: 203–224.
R. Salustowicz, J. Schmidhuber (1999): From probabilities to programs with probabilistic incremental program evolution. In: M. Dorigo, F. Glover (eds) (1999): New Ideas in Optimization. McGraw-Hill, London, 1999 [26]: 433–450.
J. Sarma, K. A. De Jong (1996): An analysis of the effects of neighborhood size and shape on local selection algorithms. In: [126]: 236–244.
R. Schaefer, J. Kolodziej (2003): Genetic search reinforced by the population hierarchy. In: K. A. De Jong, R. Poli, J. E. Rove (eds) Foundations of Genetic Algorithms 7, Morgan Kaufmann: 383–399.
J. D. Schaffer (ed) (1989): Proc. of 3rd Int. Conf. on Genetic Algorithms, Morgan-Kaufmann, San Mateo, CA.
J. D. Schaffer, R. A. Caruana, L. J. Eshelman, R. Das (1989): A study of control parameters affecting online performance of genetic algorithms for function optimization. In: [111]: 51–60.
H-P. Schwefel (1995): Evolution and Optimum Seeking, Wiley, New York.
H-P. Schwefel, C. Rudolph (1995): Contemporary evolution strategies. In: Third Int. Conf. on Artificial Life, LNCS 929, Springer Verlag: 893–907.
R. E. Smith, C. Bonacina (2003): Mating restriction and niching pressure: results from agents and implications for general EC. In: [21]: 1382–1393.
D. Surry, N. Radcliffe (1996): Formal Algorithms + Formal Representations = Search Strategies. In: [126].
F. Seredynski (1994): Loosely coupled distributed genetic algorithms. In: H-P. Schwefel, R. Manner (eds) (1994): Parallel Problem Solving from Nature-PPSN III, LNCS 866, Springer [27]: 514–523.
F. Seredynski (1997): Competitive coevolutionary multi-agent systems: the application to mapping and scheduling problems. Journal of Parallel and Distributed Computing, 47: 39–57.
F. Seredynski (1998): New trends in parallel and distributed evolutionary computing. Fundamenta Informaticae 35, IOS Press: 211–230.
F. Seredynski, A. Y. Zomaya, P. Bouvry (2003): Function Optimization with Coevolutionary Algorithms. In: M. A. Klopotek et al. (eds) Intelligent Information Processing and Web Mining, Advances in Soft Computing, Springer: 13–22.
R. E. Smith, B. A. Dike, R. K. Mehra, B. Ravichandran, A. El-Fallah (1999): Classifier systems in combat: two-sided learning of maneuvers for advanced fighter aircraft. In: Computer Methods in Applied Mechanics and Engineering, Elsevier.
J. E. Smiths, F. Vavak (1999): Replacement strategies in steady state genetic algorithms: dynamic environments. Journal of Computing and Information Technology, 7(1): 49–59.
W. Stolzmann (2003): Anticipatory classifier systems. In: [44]: 493–517.
R. Tsang, P. Lajbcygier (2002): Optimizing technical trading strategies with split search genetic algorithms. In: S.-H. Chen (ed) Evolutionary Computation in Economic and Finance. Physica-Verlag, Heildeiberg, New York: 333–358.
F. Vavak, T. C. Fogarty, K. Jukes (1996): A genetic algorithm with variable range of local search for tracking changing environments. In: [126].
H-M. Voight et al. (eds) (1996): Parallel Problem Solving from Nature-PPSN IV, Springer, LNCS 1411.
V. Volterra (1926): Variazoni e Fluttuazioni Del Numero D’individui in Specie Animali Conviventi. Memorie della R. Accaddemia Nazionale dei Lincei, 2: 31–113.
M. D. Vose (1999): The Simple Genetic Algorithm. MIT Press.
I. Wegener, W. Carsten (2003): On the optimization of monotone polynomials by the (1 + 1) EA and randomized local search. In: [20]: 622–633.
D. Whitley, D. Garrett, J-P. Watson (2003): Quad search and hybrid genetic algorithms. In: [21]: 1469–1480.
D. Whitley, V. S. Gordon, K. Mathias (1994): Lamarckian evolution, the Baldwin effect and function optimization. In: H-P. Schwefel, R. Manner (eds) (1994): Parallel Problem Solving from Nature-PPSN III, LNCS 866, Springer [27]: 6–15.
D. Whitley (1999): A free lunch proof for Grey versus binary encoding. In: [6]: 726–733.
D. Whitley (2003): Evaluating search algorithms. In: [44]: 132–147.
D. Whitley (1989): The GENITOR algorithm and selection pressure: why rank-based allocation of reproductive trials is best. In: [111]: 116–121.
S. W. Wilson (1994): ZCS: A zeroth level classifier system. Evolutionary Computation 2(1): 1–18.
S. W. Wilson (1995): Classifier fitness based on accuracy. Evolutionary Computation 3: 149–175.
S. W. Wilson (2003): Structure and Function of the XCS classifier system. In: [44]: 547–555.
D. H. Wolpert, W. G. Macready (1997): No free lunch theorems for optimization. IEEE Trans. on Evolutionary Computation, 1: 67–82.
X. Yao (1996): An overview of evolutionary computation. Chinese Journal of Advanced Software Research, 3, 1:(1) 12–29.
X. Yao (1999): Evolutionary programming made faster. IEEE Trans. on Evolutionary Computation, 3, 2(1): 82–102.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Science+Business Media, Inc.
About this chapter
Cite this chapter
Seredynski, F. (2006). Evolutionary Paradigms. In: Zomaya, A.Y. (eds) Handbook of Nature-Inspired and Innovative Computing. Springer, Boston, MA. https://doi.org/10.1007/0-387-27705-6_4
Download citation
DOI: https://doi.org/10.1007/0-387-27705-6_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-40532-2
Online ISBN: 978-0-387-27705-9
eBook Packages: Computer ScienceComputer Science (R0)