Skip to main content

Advertisement

Log in

Search intensity versus search diversity: a false trade off?

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

An implicit tenet of modern search heuristics is that there is a mutually exclusive balance between two desirable goals: search diversity (or distribution), i.e., search through a maximum number of distinct areas, and, search intensity, i.e., a maximum search exploitation within each specific area. We claim that the hypothesis that these goals are mutually exclusive is false in parallel systems. We argue that it is possible to devise methods that exhibit high search intensity and high search diversity during the whole algorithmic execution. It is considered how distance metrics, i.e., functions for measuring diversity (given by the minimum number of local search steps between two solutions) and coordination policies, i.e., mechanisms for directing and redirecting search processes based on the information acquired by the distance metrics, can be used together to integrate a framework for the development of advanced collective search methods that present such desiderata of search intensity and search diversity under simultaneous coexistence. The presented model also avoids the undesirable occurrence of a problem we refer to as the ‘ergometric bike phenomenon’. Finally, this work is one of the very few analysis accomplished on a level of meta-meta-heuristics, because all arguments are independent of specific problems handled (such as scheduling, planning, etc.), of specific solution methods (such as genetic algorithms, simulated annealing, tabu search, etc.) and of specific neighborhood or genetic operators (2-opt, crossover, etc.).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. van Laarhoven PMJ, Aarts EHL (1988) Simulated annealing: theory and applications. Kluwer Academic, Norwell

    Google Scholar 

  2. Debuse JCW, Rayward-Smith VJ (1999) Discretisation of continuous database features for a simulated annealing data mining algorithm. Appl Intell 11:285–295

    Article  Google Scholar 

  3. Ansari N, Sarasa R, Wang GS (1993) An efficient annealing algorithm for global optimization in Boltzmann machines. Appl Intell 3:177–192

    Article  Google Scholar 

  4. Ombuki BM, Ventresca M (2004) Local search genetic algorithms for the job-shop scheduling problem. Appl Intell 21:99–109

    Article  MATH  Google Scholar 

  5. Ghosh S, Ghosh A, Pal SK (2003) Incorporating ancestors’ influence in genetic algorithms. Appl Intell 18:7–25

    Article  MATH  Google Scholar 

  6. Mendes A, Linhares A (2004) A multiple population evolutionary approach to gate matrix layout. Int J Syst Sci 35:13–23

    Article  MATH  Google Scholar 

  7. Beasley JE (2000) Population heuristics. In: Pardalos PM, Resende MGC (eds) Handbook of applied optimization. Oxford University Press, London

    Google Scholar 

  8. Goldberg DE, Richardon J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Grefenstette JJ (ed) Genetic algorithms and their applications (ICGA’87). Lawrence Erlbaum Associates, Hillsdale, pp 41–49

    Google Scholar 

  9. Ursem RK (2001) When sharing fails. In: Proc. of the third congress on evolutionary computation, pp 873–879

  10. Ursem RK (2002) Diversity-guided evolutionary algorithms. In: Proc. of parallel problem solving from nature VII, pp 462–471

  11. Glover F (1989) Tabu search—Part I. ORSA J Comput 1:190–206

    MATH  MathSciNet  Google Scholar 

  12. Glover F, Laguna M (1997) Tabu search. Kluwer Academic, Dordrecht

    MATH  Google Scholar 

  13. Laguna M, Barnes JW, Glover F (1993) Intelligent scheduling with tabu search—an application to jobs with linear delay penalties and sequence-dependent setup costs and times. Appl Intell 3:159–172

    Article  Google Scholar 

  14. Glover F (1977) Heuristics for integer programming using surrogate constraints. Decis Sci 8:156–166

    Article  Google Scholar 

  15. Cung V-D, Mautor T, Michelon P, Tavares A (1997) A scatter search based approach for the quadratic assignment problem. In: Proc of the IEEE international conference on evolutionary computation, pp 165–170

  16. Linhares A, Torreão JRA (1988) Microcanonical optimization applied to the traveling salesman problem. Int J Mod Phys C 9:133–146

    Article  Google Scholar 

  17. Linhares A, Yanasse HH, Torreão JRA (1999) Linear gate assignment: a fast statistical mechanics approach. IEEE Trans Comput-Aided Des Integr Circuits Syst 18:1750–1758

    Article  Google Scholar 

  18. Feo TA, Resende MGC (1995) Greedy randomized adaptive search procedures. J Glob Optim 6:109–133

    Article  MATH  MathSciNet  Google Scholar 

  19. Argüello MF, Bard JF, Yu G (1997) A GRASP for aircraft routing in response to groundings and delays. J Combin Optim 1:211–228

    Article  MATH  Google Scholar 

  20. Resende MGC, Ribeiro CC (1997) A GRASP for graph planarization. Networks 29:173–189

    Article  MATH  Google Scholar 

  21. Backhouse PG, Fotheringham AF, Allan G (1997) A comparison of a genetic algorithm with an experimental design technique in the optimization of a production process. J Oper Res Soc 48:247–254

    MATH  Google Scholar 

  22. Dowsland K (1996) Genetic algorithms: a tool for OR? J Oper Res Soc 47:550–561

    MATH  Google Scholar 

  23. Laguna M, Glover F (1993) Bandwidth packing: a tabu search approach. Manag Sci 39:492–500

    Article  MATH  Google Scholar 

  24. Rochat Y, Taillard ED (1995) Probabilistic intensification and diversification in local search for vehicle routing. J Heuristics 1:147–167

    Article  MATH  Google Scholar 

  25. Jain AS (1998) A multi-level hybrid framework for the deterministic job-shop scheduling problem, PhD thesis, University of Dundee, Dundee, Scotland, UK

  26. Glover F (1990) Tabu search: a tutorial. INTERFACES 20:74–94

    Article  Google Scholar 

  27. Colorni A, Dorigo M, Maffioli F, Manniezzo V, Righini G, Trubian M (1996) Heuristics from nature for hard combinatorial optimization problems. Int Trans Oper Res 3:1–21

    Article  MATH  Google Scholar 

  28. Christofides N (1994) The bionomic algorithm. In: Proc of the associazione Italiana di ricerca operativa conference, Savona, Italy

  29. Maniezzo V, Mingozzi A, Baldacci R (1998) A bionomic approach to the capacitated p-median problem. J Heuristics 4:263–280

    Article  MATH  Google Scholar 

  30. Jones T (1995) One operator, one landscape. Santa Fe Institute Technical Report 95-02-025. Santa Fe Institute, Santa Fe, NM 87501

  31. Boese KD, Kahng AB, Muddu S (1994) A new adaptive multi-start technique for combinatorial global optimizations. Oper Res Lett 16:101–113

    Article  MATH  MathSciNet  Google Scholar 

  32. Merz P, Freisleben B (1999) Fitness landscapes and memetic algorithm design. In: Corne D, Glover F, Dorigo M (eds) New ideas in optimization. McGraw-Hill, New York

    Google Scholar 

  33. Reeves CR (1999) Landscapes, operators, and heuristic search. Ann Oper Res 86:473–490

    Article  MATH  MathSciNet  Google Scholar 

  34. Mendes A, França P, Moscato P (2002) Fitness landscapes for the total tardiness single machine scheduling problem. Neural Netw World 2:165–180

    Google Scholar 

  35. Mak K-T, Morton AJ (1995) Distances between traveling salesman tours. Discrete Appl Math 58:281–291

    Article  MATH  MathSciNet  Google Scholar 

  36. Caprara A (1999) Sorting permutations by reversals and Eulerian cycle decompositions. SIAM J Discrete Math 12:91–110

    Article  MATH  MathSciNet  Google Scholar 

  37. Linhares A (2004) The structure of local search diversity. WSEAS Trans Math 3:216–220

    Google Scholar 

  38. Linhares A (2001) Industrial pattern-sequencing problems: some complexity results and new local search models. PhD thesis, National Institute of Space Research, São José dos Campos, Brazil

  39. Jelasitya M, Dombib J (1998) GAS, a concept on modeling species in genetic algorithms. Artif Intell 99:1–19

    Article  Google Scholar 

  40. Linhares A (2004) Minimization of open orders: a re-distribution coordination policy. Int J Prod Res 42:1189–1205

    Article  MATH  Google Scholar 

  41. Knuth D (1975) The art of computer programming, vol. 3. Sorting and searching. Addison-Wesley, New York

    Google Scholar 

  42. Aigner M, West DB (1987) Sorting by insertion of leading elements. J Combin Theory Ser A 45:306–309

    Article  MATH  MathSciNet  Google Scholar 

  43. Chen S, Smith SF (1996) Commonality and genetic algorithms. The Robotics Institute CMU-RI-TR-96-27, Carnegie Mellon University

  44. Orlowski M, Pachter M (1989) An algorithm for the determination of a longest increasing subsequence in a sequence. Comput Math Appl 17:1073–1075

    Article  MATH  MathSciNet  Google Scholar 

  45. Linhares A, Yanasse HH (2002) Connections between cutting-pattern sequencing, VLSI desing, and flexible machines. Comput Oper Res 29:1759–1772

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexandre Linhares.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Linhares, A., Yanasse, H.H. Search intensity versus search diversity: a false trade off?. Appl Intell 32, 279–291 (2010). https://doi.org/10.1007/s10489-008-0145-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-008-0145-8

Keywords

Navigation