Abstract
This chapter presents an overview of hybridization mechanisms in evolutionary algorithms. Such mechanisms are aimed to introducing problem knowledge in the optimization technique by means of the synergistic combination of general–purpose methods and problemspecific add-ons. This combination is presented in this work from two wide perspectives: memetic algorithms and cooperative optimization models. Memetic algorithms are based on the smart orchestration of global (population-based) and local (trajectorybased) techniques, using an algorithmic scheme in which the latter are often subordinated to the former. As to cooperative models, they are based on the collaboration of different optimization techniques that exchange information in order to boost their respective performances. Both approaches, memetic algorithms and cooperative models, provide a framework to achieve synergistic algorithmic combinations for the resolution of large-scale combinatorial problems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Abbreviations
- AI:
-
artificial intelligence
- BnB:
-
branch and bound
- CP:
-
constraint programming
- EA:
-
evolutionary algorithm
- EDA:
-
estimation of distribution algorithm
- ER:
-
edge recombination
- LS:
-
local search
- MA:
-
memetic algorithm
- MMA:
-
multimemetic algorithm
- NFL:
-
no free lunch
- OR:
-
operational research
- PMX:
-
partially-mapped crossover
- PSO:
-
particle swarm optimization
- SA:
-
simulated annealing
- TSP:
-
traveling salesman problem
- TS:
-
tabu search
- UCX:
-
uniform cycle crossover
- VNS:
-
variable neighborhood search
References
C. Blum, A. Roli: Metaheuristics in combinatorial optimization: Overview and conceptual comparison, ACM Comput. Surv. 35(3), 268–308 (2003)
D.H. Wolpert, W.G. Macready: No free lunch theorems for optimization, IEEE Trans. Evol. Comput. 1(1), 67–82 (1997)
J. Puchinger, G.R. Raidl: Combining metaheuristics and exact algorithms in combinatorial optimization: A survey and classification, Lect. Notes Comput. Sci. 3562, 113–124 (2005)
M. Milano, A. Roli: MAGMA: A multiagent architecture for metaheuristics, IEEE Trans. Syst. Man Cybern. Part B 34(2), 925–941 (2004)
E.-G. Talbi, V. Bachelet: COSEARCH: A parallel cooperative metaheuristic, J. Math. Model, Algorithms 5(1), 5–22 (2006)
P. Cowling, G. Kendall, E. Soubeiga: A hyperheuristic approach to scheduling a sales summit, Lect. Notes Comput. Sci. 2079, 176–190 (2001)
K. Chakhlevitch, P.I. Cowling: Hyperheuristics: Recent developments. In: Adaptive and Multilevel Metaheuristics, Studies in Computational Intelligence, Vol. 136, ed. by C. Cotta, M. Sevaux, K. Sörensen (Springer, Berlin 2008) pp. 3–29
R. Dawkins: The Selfish Gene (Clarendon, Oxford 1976)
P. Moscato: On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts: Towards Memetic Algorithms. Technical Report Caltech Concurrent Computation Program, Report. 826 (California Institute of Technology, Pasadena 1989)
R. Santana, C. Bielza, P. Larranaga: Network Measures for Re-using Problem Information in EDAs. Technical Report UPM-FI/DIA/2010-3 (Department of Artificial Intelligence, Faculty of Informatics, Technical University of Madrid 2010)
C. Cotta, E. Alba, J.M. Troya: Stochastic reverse hillclimbing and iterated local search, Proc. 1999 Congr. Evol. Comput. (IEEE Neural Network Council -- Evolutionary Programming Society -- Institution of Electrical Engineers, Washington 1999) pp. 1558–1565
C. Blum, J. Puchinger, G. Raidl, A. Roli: A brief survey on hybrid metaheuristics, 4th Int. Conf. Bioinspired Optim. Methods Appl. (BIOMA 2010), ed. by B. Filipic, J. Silc (Ljubljana, Slovenia 2010) pp. 3–16
E.-G. Talbi: A taxonomy of hybrid metaheuristics, J. Heuristics 8, 541–564 (2002)
C. Cotta, E.G. Talbi, E. Alba: Parallel hybrid metaheuristics. In: Parallel Metaheuristics, ed. by E. Alba (Wiley-Interscience, Hoboken 2005) pp. 347–370
M. El-Abd, M. Kamel: A taxonomy of cooperative search algorithms, Lect. Notes Comput. Sci. 3636, 32–41 (2005)
G. Raidl: A unified view on hybrid metaheuristics, Lect. Notes Comput. Sci. 4030, 1–12 (2006)
L. Jourdan, M. Basseur, E.-G. Talbi: Hybridizing exact methods and metaheuristics: A taxonomy, Eur. J. Oper. Res. 199(3), 620–629 (2009)
Z. Michalewicz: Decoders. In: Handbook of Evolutionary Computation, ed. by T. Bäck, D.B. Fogel, Z. Michalewicz (Institute of Physics Publishing and Oxford Univ. Press, Bristol 1997)
P.C. Chu, J.E. Beasley: A genetic algorithm for the multidimensional knapsack problem, J. Heuristics 4, 63–86 (1998)
R.H. Storer, S.D. Wu, R. Vaccari: New search spaces for sequencing problems with application to job-shop scheduling, Manag. Sci. 38, 1495–1509 (1992)
C. Cotta, J.M. Troya: A hybrid genetic algorithm for the 0-1 multiple knapsack problem. In: Artificial Neural Nets and Genetic Algorithms 3, ed. by G.D. Smith, N.C. Steele, R.F. Albrecht (Springer, Wien 1998) pp. 251–255
M.G. Norman, P. Moscato: A competitive and cooperative approach to complex combinatorial search, Proc. 20th Inf. Oper. Res. Meet., Buenos Aires (1989), pp. 3.15–3.29
S.W. Mahfoud, D.E. Goldberg: Parallel recombinative simulated annealing: A genetic algorithm, Parallel Comput. 21(1), 1–28 (1995)
C. Fleurant, J.A. Ferland: Genetic and hybrid algorithms for graph coloring, Ann. Oper. Res. 63, 437–461 (1996)
H. Kim, Y. Hayashi, K. Nara: The performance of hybridized algorithm of genetic algorithm simulated annealing and Tabu search for thermal unit maintenance scheduling, 2nd IEEE Conf. Evol. Comput. ICEC'95 (Perth, Australia 1995) pp. 114–119
J. Thiel, S. Voss: Some experiences on solving multiconstraint zero-one knapsack problems with genetic algorithms, INFOR 32(4), 226–242 (1994)
C.-F. Liaw: A hybrid genetic algorithm for the open shop scheduling problem, Eur. J. Oper. Res. 124, 28–42 (2000)
E.K. Burke, A.J. Smith: A memetic algorithm to schedule planned maintenance for the national grid, J. Exp. Algorithmics 4, 1–13 (1999)
J.E. Gallardo, C. Cotta, A.J. Fernández: Finding low autocorrelation binary sequences with memetic algorithms, Appl. Soft Comput. 9(4), 1252–1262 (2009)
F. Campelo, F.G. Guimaraes, J.A. Ramirez, H. Igarashi: Hybrid estimation of distribution algorithm using local function approximations, IEEE Trans. Magn. 45(3), 1558–1561 (2009)
M. Laguna, A. Duarte, R. Mart: Hybridizing the cross-entropy method: An application to the max-cut problem, Comput. Oper. Res. 36(2), 487–498 (2009)
R. Santana, P. Larrañaga, J.A. Lozano: Combining variable neighborhood search and estimation of distribution algorithms in the protein side chain placement problem, J. Heuristics 14, 519–547 (2008)
P. Hansen, N. Mladenović: Variable neighborhood search: Principles and applications, Eur. J. Oper. Res. 130(3), 449–467 (2001)
Q. Zhang, J. Sun, E. Tsang, J. Ford: Estimation of distribution algorithm with 2-opt local search for the quadratic assignment problem. In: Towards a New Evolutionary Computation, Studies in Fuzziness and Soft Computing, Vol. 192, ed. by J. Lozano, P. Larrañaga, I. Inza, E. Bengoetxea (Springer, Berlin, Heidelberg 2006) pp. 281–292
J.M. Peña, V. Robles, P. Larrañaga, V. Herves, F. Rosales, M.S. Prez: GA-EDA: Hybrid evolutionary algorithm using genetic and estimation of distribution algorithms, Lect. Notes Comput. Sci. 3029, 361–371 (2004)
Y. Zhou, J. Wang, J. Yin: A discrete estimation of distribution particle swarm optimization for combinatorial optimization problems, 3rd Int. Conf. Nat. Comput. (ICNC 2007) (2007) pp. 80–84
C.W. Ahn, J. An, J.-C. Yoo: Estimation of particle swarm distribution algorithms: Combining the benefits of PSO and EDAs, Inf. Sci. 192, 109–119 (2012)
C. Cotta, J.F. Aldana, A.J. Nebro, J.M. Troya: Hybridizing genetic algorithms with branch and bound techniques for the resolution of the TSP. In: Artificial Neural Nets and Genetic Algorithms 2, ed. by D.W. Pearson, N.C. Steele, R.F. Albrecht (Springer, Wien 1995) pp. 277–280
C. Cotta, J.M. Troya: Embedding branch and bound within evolutionary algorithms, Appl. Intell. 18(2), 137–153 (2003)
J. Puchinger, G.R. Raidl, G. Koller: Solving a real-world glass cutting problem, Lect. Notes Comput. Sci. 3004, 165–176 (2004)
K. Kostikas, C. Fragakis: Genetic programming applied to mixed integer programming, Lect. Notes Comput. Sci. 3003, 113–124 (2004)
J. Denzinger, T. Offermann: On cooperation between evolutionary algorithms and other search paradigms, 6th Int. Conf. Evol. Comput. IEEE (1999) pp. 2317–2324
J.E. Gallardo, C. Cotta, A.J. Fernández: Solving the multidimensional knapsack problem using an evolutionary algorithm hybridized with branch and bound, Lect. Notes Comput. Sci. 3562, 21–30 (2005)
J.E. Gallardo, C. Cotta, A.J. Fernández: A multi-level memetic/exact hybrid algorithm for the still life problem, Lect. Notes Comput. Sci. 4193, 212–221 (2006)
J.E. Gallardo, C. Cotta, A.J. Fernández: On the hybridization of memetic algorithms with branch-and-bound techniques, IEEE Trans. Syst. Man Cybern. Part B 37(1), 77–83 (2007)
J.E. Gallardo, C. Cotta, A.J. Fernández: Reconstructing phylogenies with memetic algorithms and branch-and-bound. In: Analysis of Biological Data: A Soft Computing Approach, ed. by S. Bandyopadhyay, U. Maulik, J.T.-L. Wang (World Scientific, Singapore 2007) pp. 59–84
P. Moscato: Memetic algorithms: A short introduction. In: New Ideas in Optimization, ed. by D. Corne, M. Dorigo, F. Glover (McGraw-Hill, Maidenhead 1999) pp. 219–234
G. Reinelt: The Traveling Salesman. Computational Solutions for TSP Applications (Springer, Berlin, Heidelberg 1994)
W.-C. Yeh: A memetic algorithm of the $\text{n}/2/$Flowshop/α$F{}+\beta C_{{\max}}$ scheduling problem, Int. J. Adv. Manuf. Technol. 20, 464–473 (2002)
R. Varela, J. Puente, C.R. Vela, A. Gómez: A knowledge-based evolutionary strategy for scheduling problems with bottlenecks, Eur. J. Oper. Res. 145(1), 57–71 (2003)
O. Rossi-Doria, B. Paechter: A memetic algorithm for university course timetabling. In: Combinatorial Optimisation 2004 Book of Abstracts, Lancaster 2004, p. 56, ed. by Lancaster University
A.E. Eiben, P.-E. Raue, Z. Ruttkay: Genetic algorithms with multi-parent recombination, Lect. Notes Comput. Sci. 866, 78–87 (1994)
B.R. Fox, M.B. McMahon: Genetic operators for sequencing problems. In: Foundations of Genetic Algorithms I, ed. by G.J.E. Rawlins (Morgan Kaufmann, San Mateo 1991) pp. 284–300
K. Mathias, L.D. Whitley: Genetic operators, the fitness landscape and the traveling salesman problem. In: Parallel Problem Solving From Nature II, ed. by R. Männer, B. Manderick (Elsevier Science B.V., Amsterdam 1992) pp. 221–230
D.E. Goldberg, R. Lingle Jr.: Alleles, loci and the traveling salesman problem, Proc. 1st Int. Conf. Genet. Algorithms, ed. by J.J. Grefenstette (Lawrence Erlbaum Associates, Hillsdale 1985) pp. 154–159
C. Cotta, J.M. Troya: Genetic forma recombination in permutation flowshop problems, Evol. Comput. 6(1), 25–44 (1998)
Y. Davidor: Epistasis variance: Suitability of a representation to genetic algorithms, Complex Syst. 4(4), 369–383 (1990)
Y. Davidor: Epistasis variance: A viewpoint on GA-hardness. In: Foundations of Genetic Algorithms I, ed. by G.J.E. Rawlins (Morgan Kaufmann, San Mateo 1991) pp. 23–35
N.J. Radcliffe, P.D. Surry: Fitness variance of formae and performance prediction. In: Foundations of Genetic Algorithms III, ed. by L.D. Whitley, M.D. Vose (Morgan Kaufmann, San Francisco 1994) pp. 51–72
B. Manderick, M. de Weger, P. Spiessens: The genetic algorithm and the structure of the fitness landscape, Proc. 4th Int. Conf. Genet. Algorithms, ed. by R.K. Belew, L.B. Booker (Morgan Kaufmann, San Mateo 1991) pp. 143–150
J. Dzubera, L.D. Whitley: Advanced correlation analysis of operators for the traveling salesman problem, Lect. Notes Comput. Sci. 866, 68–77 (1994)
L.J. Fogel, A.J. Owens, M.J. Walsh: Artificial Intelligence Through Simulated Evolution (Wiley, New York 1966)
C. Cotta, A.J. Fernández: Memetic algorithms in planning, scheduling, and timetabling. In: Evolutionary Scheduling, Studies in Computational Intelligence, Vol. 49, ed. by K. Dahal, K.C. Tan, P.I. Cowling (Springer, Berlin, Heidelberg 2007) pp. 1–30
C. Oğuz, M.F. Ercan: A genetic algorithm for hybrid flow-shop scheduling with multiprocessor tasks, J. Sched. 8, 323–351 (2005)
T. Ibaraki: Combination with dynamic programming. In: Handbook of Evolutionary Computation, ed. by T. Bäck, D. Fogel, Z. Michalewicz (Oxford Univ. Press, New York 1997), pp. D3.4:1–2
J.E. Gallardo, C. Cotta, A.J. Fernández: A memetic algorithm with bucket elimination for the still life problem, Lect. Notes Comput. Sci. 3906, 73–85 (2006)
P. Moscato, C. Cotta: A gentle introduction to memetic algorithms. In: Handbook of Metaheuristics, ed. by F. Glover, G. Kochenberger (Kluwer, Boston 2003) pp. 105–144
P. Moscato, C. Cotta, A.S. Mendes: Memetic algorithms. In: New Optimization Techniques in Engineering, ed. by G.C. Onwubolu, B.V. Babu (Springer, Berlin, Heidelberg 2004) pp. 53–85
Y. Nagata, S. Kobayashi: Edge assembly crossover: A high-power genetic algorithm for the traveling salesman problem, Proc. 17th Int. Conf. Genet. Algorithms (ICGA), ed. by T. Bäck (Morgan Kaufmann, San Mateo 1997) pp. 450–457
T.C. Jones: Evolutionary Algorithms, Fitness Landscapes and Search, Ph.D. Thesis (University of New Mexico, Albuquerque 1995)
F. Neri, C. Cotta: A primer on memetic algorithms. In: Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379, ed. by F. Neri, C. Cotta, P. Moscato (Springer, Berlin, Heidelberg 2012) pp. 43–52
F. Neri, C. Cotta: Memetic algorithms and memetic computing optimization: A literature review, Swarm Evol. Comput. 2, 1–14 (2012)
D. Sudholt: Parametrization and balancing local and global search. In: Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379, ed. by F. Neri, C. Cotta, P. Moscato (Springer, Berlin, Heidelberg 2012) pp. 55–72
N. Krasnogor, B.P. Blackburne, E.K. Burke, J.D. Hirst: Multimeme algorithms for protein structure prediction, Lect. Notes Comput. Sci. 2439, 769–778 (2002)
J.E. Smith: Co-evolution of memetic algorithms: Initial investigations, Lect. Notes Comput. Sci. 2439, 537–548 (2002)
N. Krasnogor: Self generating metaheuristics in bioinformatics: The proteins structure comparison case, Genet. Program. Evol. Mach. 5(2), 181–201 (2004)
N. Krasnogor, S.M. Gustafson: A study on the use of “self-generation” in memetic algorithms, Nat. Comput. 3(1), 53–76 (2004)
J.E. Smith: Coevolving memetic algorithms: A review and progress report, IEEE Trans. Syst. Man Cybern. Part B 37(1), 6–17 (2007)
J.E. Smith: Credit assignment in adaptive memetic algorithms, GECCO '07: Proc. 9th Annu. Conf. Genet. Evol. Comput. Conf., ed. by H. Lipson (2007) pp. 1412–1419
Y.-S. Ong, A.J. Keane: Meta-Lamarckian learning in memetic algorithms, IEEE Trans. Evol. Comput. 8(2), 99–110 (2004)
H.G. Cobb: An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments. Technical Report AIC-90-001 (Naval Research Laboratory, Washington, DC 1990)
J.J. Grefenstette: Genetic algorithms for changing environments. In: Parallel Problem Solving from Nature II, ed. by R. Männer, B. Manderick (Elsevier, Amsterdam 1992) pp. 137–144
L.J. Eshelman: The CHC adaptive search algorithm: How to have safe search when engaging in nontraditional genetic recombination. In: Foundations of Genetic Algorithms I, ed. by G.J.E. Rawlins (Morgan Kaufmann, San Mateo 1991) pp. 265–283
M. Laguna, R. Marti: Scatter search. In: Methodology and Implementations in C, Operations Research/Computer Science Interfaces, Vol. 24, ed. by R. Sharda, S. Voß (Kluwer, Boston 2003)
M. Sevaux, S. Dauzère-Pérés: Genetic algorithms to minimize the weighted number of late jobs on a single machine, Eur. J. Oper. Res. 151, 296–306 (2003)
E.K. Burke, J. Newall, R. Weare: A memetic algorithm for university exam timetabling, Lect. Notes Comput. Sci. 1153, 241–250 (1996)
P.M. França, J.N.D. Gupta, A.S. Mendes, P. Moscato, K.J. Veltnik: Evolutionary algorithms for scheduling a flowshop manufacturing cell with sequence dependent family setups, Comput. Ind. Eng. 48, 491–506 (2005)
M. Tomassini: Spatially Structured Evolutionary Algorithms: Artificial Evolution in Space and Time (Springer, New York 2005)
K. Sörensen, M. Sevaux: MA$|$PM: Memetic algorithms with population management, Comput. Oper. Res. 33(5), 1214–1225 (2006)
O.J. Mengshoel, D.E. Goldberg: The crowding approach to niching in genetic algorithms, Evol. Comput. 16(3), 315–354 (2008)
D.E. Goldberg, J. Richardson: Genetic algorithms with sharing for multimodal function optimization, Proc. 2nd Int. Conf. Genet. Algorithms Genet. Algorithms Appl. (L. Erlbaum Associates, Hillsdale 1987) pp. 41–49
Y.-S. Ong, M.-H. Lim, X. Chen: Memetic computation – Past, present and future, IEEE Comput. Intell. Mag. 5(2), 24–31 (2010)
M. Toulouse, T.G. Crainic, B. Sanso, K. Thulasiraman: Self-organization in cooperative Tabu search algorithms, IEEE Int. Conf. Syst. Man Cybern., Vol. 3 (1998) pp. 2379–2384
M. Toulouse, T.G. Crainic, B. Sans: Systemic behavior of cooperative search algorithms, Parallel Comput. 30(1), 57–79 (2004)
T.G. Crainic, M. Toulouse: Explicit and emergent cooperation schemes for search algorithms, Lect. Notes Comput. Sci. 5313, 95–109 (2008)
M. Toulouse, K. Thulasiraman, F. Glover: Multi-level cooperative search: A new paradigm for combinatorial optimization and an application to graph partitioning, Lect. Notes Comput. Sci. 1685, 533–542 (1999)
T.G. Crainic, M. Gendreau: Cooperative parallel tabu search for capacitated network design, J. Heuristics 8(6), 601–627 (2002)
T.G. Crainic, M. Gendreau, P. Hansen, N. Mladenović: Cooperative parallel variable neighborhood search for the p-median, J. Heuristics 10, 293–314 (2004)
D. Pelta, C. Cruz, A. Sancho-Royo, J. Verdegay: Using memory and fuzzy rules in a co-operative multi-thread strategy for optimization, Inf. Sci. 176, 1849–1868 (2006)
C. Cruz, D. Pelta: Soft computing and cooperative strategies for optimization, Appl. Soft Comput. 9(1), 30–38 (2009)
A. LeBouthillier, T.G. Crainic: A cooperative parallel meta-heuristic for the vehicle routing problem with time windows, Comput. Oper. Res. 32(7), 1685–1708 (2005)
D. Barbucha: Synchronous vs. asynchronous cooperative approach to solving the vehicle routing problem, Lect. Notes Comput. Sci. 6421, 403–412 (2010)
K.S. Leung, I. King, Y.B. Wong: A probabilistic cooperative-competitive hierarchical model for global optimization, Appl. Math. Comput. 175(2), 1092–1124 (2006)
S.T. Barnard, H.D. Simon: Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems, Concurr. Pract. Exp. 6(2), 101–117 (1994)
C. Walshaw: A multilevel approach to the travelling salesman problem, Oper. Res. 50(5), 862–877 (2002)
L. Hulianytskyi, S. Sirenko: Cooperative model-based metaheuristics, Electron. Notes Discret. Math. 36, 33–40 (2010)
J. Amaya, C. Cotta, A.J. Fernández-Leiva: Memetic cooperative models for the tool switching problem, Memetic Comput. 3, 199–216 (2011)
P. Moscato, C. Cotta: A modern introduction to memetic algorithms. In: Handbook of Metaheuristics, International Series in Operations Research and Management Science, Vol. 146, ed. by M. Gendreau, J.Y. Potvin (Springer, New York, Dordrecht, Heidelberg, London 2010) pp. 141–183
F. Neri, C. Cotta, P. Moscato: Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379 (Springer, Berlin, Heidelberg 2012)
J.-K. Hao: Memetic algorithms in discrete optimization. In: Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379, ed. by F. Neri, C. Cotta, P. Moscato (Springer, Berlin, Heidelberg 2012) pp. 73–95
P. Merz: Memetic algorithms and fitness landscapes in combinatorial optimization. In: Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379, ed. by F. Neri, C. Cotta, P. Moscato (Springer, Berlin, Heidelberg 2012) pp. 96–122
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Amaya, J.E., Cotta Porras, C., Fernández Leiva, A.J. (2015). Memetic and Hybrid Evolutionary Algorithms. In: Kacprzyk, J., Pedrycz, W. (eds) Springer Handbook of Computational Intelligence. Springer Handbooks. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43505-2_52
Download citation
DOI: https://doi.org/10.1007/978-3-662-43505-2_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-43504-5
Online ISBN: 978-3-662-43505-2
eBook Packages: EngineeringEngineering (R0)