Skip to main content

Hybrids of Constructive Metaheuristics and Constraint Programming: A Case Study with ACO

  • Chapter
Hybrid Metaheuristics

Part of the book series: Studies in Computational Intelligence ((SCI,volume 114))

A long-standing problem in combinatorial optimization with metaheuristics has been how to handle hard constraints effectively. Integrating metaheuristic methods with Constraint Programming (CP), an exact technique for solving hard constraints, promises a solution to this problem.

This chapter explores how such an integration can be achieved. We discuss possible types of couplings between the two algorithmic frameworks and define hybrid algorithms for each type. The central distinction is between tight coupling in which both components collaborate in an interleaved fashion and loose coupling where both components run in parallel, exchanging only (partial) solutions and bounds.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Allahverdi, J. N. D. Gupta, and T. Aldowaisan. A review of scheduling research involving setup considerations. Omega, 27(2):219–239, 1999.

    Article  Google Scholar 

  2. N. Ascheuer, M. Fischetti, and M. Grötschel. Solving the asymmetric travelling salesman problem with time windows by branch-and-cut. Mathematical Programming, 90(3):475–506, 2001.

    Article  MATH  MathSciNet  Google Scholar 

  3. S. Baluja and R. Caruana. Removing the genetics from the standard genetic algorithm. In Int. Conf. Machine Learning (ML-95), 1995.

    Google Scholar 

  4. A. Bauer, B. Bullnheimer, R. F. Hartl, and C. Strauss. An ant colony optimization approach for the single machine total tardiness problem. In Proceedings of the Congress on Evolutionary Computation, Washington/DC, July 1999.

    Google Scholar 

  5. C. Blum, November 2003. Personal Communication.

    Google Scholar 

  6. C. Blum. Ant colony optimization: Introduction and recent trends. Physics of Life Reviews, 2(4):353–373, 2005.

    Article  MathSciNet  Google Scholar 

  7. C. Blum and A. Roli. Metaheuristics in combinatorial optimization: Overview and conceptual comparison. ACM Computing Surveys, 35(3):268–308, 2003.

    Article  Google Scholar 

  8. C. Blum and M. Sampels. When model bias is stronger than selection pressure. In Parallel Problem Solving From Nature (PPSN-VII), Granada, September 2002.

    Google Scholar 

  9. P. A. Bosman and D. Thierens. Continuous iterated density estimation evolutionary algorithms within the IDEA framework. In Genetic and Evolutionary Computation Conference - GECCO, pages 197–200, Las Vegas, July 2000.

    Google Scholar 

  10. M. Carlsson, G. Ottosson, and B. Carlson. An open-ended finite domain constraint solver. In Proc. PLILP’97 Programming Languages: Implementations, Logics, and Programs, Southampton, September 1997.

    Google Scholar 

  11. Y. Caseau and F. Laburthe. Improved CLP scheduling with task intervals. In International Conference on Logic Programming, Santa Margherita Ligure, Italy, June 1994.

    Google Scholar 

  12. D. M. Chickering, D. Geiger, and D. Heckerman. Learning bayesian networks is NP-hard. Technical report, Microsoft Research, Redmont, WA, 1994. MSR-TR-94-17.

    Google Scholar 

  13. C. Coello and A. Carlos. A survey of constraint handling techniques used with evolutionary algorithms. Technical report, Laboratorio Nacional de Informtica Avanzada, 1999. Technical Report Lania-RI-9904.

    Google Scholar 

  14. C. A. Coello. Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art. Computer Methods in Applied Mechanics and Engineering, 191(11–12):1245–1287, 2002.

    Article  MATH  MathSciNet  Google Scholar 

  15. O. Cordón, F. Herrera, and T. Stützle. A review on the ant colony optimization metaheuristic: Basis, models and new trends. Mathware and Soft Computing, 9(2–3):141–175, 2002.

    MATH  MathSciNet  Google Scholar 

  16. P.-T. De Boer, D. P. Kroese, S. Mannor, and R. Y. Rubinstein. A tutorial on the cross-entropy method. Annals of Operations Research, 134(1):19–67, 2005.

    Article  MATH  MathSciNet  Google Scholar 

  17. R. Dechter. Constraint Processing. Morgan Kaufmann Publishers, San Francisco, CA, 2003.

    Google Scholar 

  18. M. den Besten, T. Stützle, and M. Dorigo. Ant colony optimization for the total weighted tardiness problem. In Parallel Problem Solving from Nature - PPSN VI, Paris, France, September 2000.

    Google Scholar 

  19. M. Dorigo, G. D. Di Caro, and L. M. Gambardella. Ant algorithms for discrete optimization. Artificial Life, 5:137–172, 1999.

    Article  Google Scholar 

  20. M. Dorigo and L. M. Gambardella. Ant colony system: A cooperative learning approach to the traveling salesman problem. Technical Report TR/IRIDIA/1996-5, Universite Libre de Bruxelles, 1996.

    Google Scholar 

  21. M. Dorigo and L. M. Gambardella. Ant colony system: A cooperative learning approach to the traveling salesman problem. IEEE Transactions on Evolutionary Computation, 1(1):53–66, 1997.

    Article  Google Scholar 

  22. M. Dorigo and T. Stützle. Ant Colony Optimization. MIT Press, Cambridge, 2004.

    MATH  Google Scholar 

  23. M. Dorigo, M. Zlocin, N. Meuleau, and M. Birattari. Updating ACO pheromones using stochastic gradient ascent and cross-entropy methods. In Proceedings of the Evo Workshops, Kinsale, Ireland, April 2002.

    Google Scholar 

  24. B. Efron. The Jackknife, the bootstrap and other resampling plans. SIAM, 1982.

    Google Scholar 

  25. R. Farmani and J. A. Wright. Self-adaptive fitness formulation for constrained optimization. IEEE Transactions on Evolutionary Computation, 7(5):445—455, 2003.

    Article  Google Scholar 

  26. F. Focacci, F. Laburthe, and A. Lodi. Local search and constraint programming. In F. Glover and G. Kochenberger, editors, Handbook of metaheuristics. Kluwer, Boston/MA, 2003.

    Google Scholar 

  27. F. Focacci, A. Lodi, and M. Milano. A hybrid exact algorithm for the TSPTW. INFORMS Journal on Computing, 14(4):403–417, 2003.

    Article  MathSciNet  Google Scholar 

  28. M. Gravel, W. L. Price, and C. Gagné. Scheduling continuous casting of aluminum using a multiple objective ant colony optimization metaheuristic. European Journal of Operational Research, 143(1):218–229, 2002.

    Article  MATH  Google Scholar 

  29. M. Held. Analysis and improvement of constraint handling in ant colony algorithms, November 2005. BCS Honours Thesis, Monash University.

    Google Scholar 

  30. P. Larrañaga and J. A. Lozano (eds.). Estimation of distribution algorithms: a new tool for evolutionary computation. Kluwer, Boston, 2002.

    MATH  Google Scholar 

  31. E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, and D. B. Shmoys. Sequencing and scheduling: algorithms and complexity. In S. C. Graves, A. H. G. Rinnooy Kan, and P. H. Zipkin, editors, Logistics of Production and Inventory, pages 445–522. North Holland, Amsterdam, Netherlands, 1993.

    Chapter  Google Scholar 

  32. J. A. Lozano, P. Larrañaga, I. Inza, and E. Bengoetxea (eds.). Towards a New Evolutionary Computation. Springer-Verlag, 2006.

    Google Scholar 

  33. K. Marriott and P. Stuckey. Programming With Constraints. MIT Press, Cambridge, MA, 1998.

    MATH  Google Scholar 

  34. B. Meyer. On the convergence behaviour of ant colony search. In Asia-Pacific Conference on Complex Systems, Cairns, December 2004.

    Google Scholar 

  35. B. Meyer. Constraint handling and stochastic ranking in ACO. In IEEE CEC – Congress on Evolutionary Computation, Edinburgh, September 2005.

    Google Scholar 

  36. B. Meyer and A. Ernst. Integrating ACO and constraint propagation. In Ant Colony Optimization and Swarm Intelligence (ANTS 2004), Brussels, September 2004.

    Google Scholar 

  37. Z. Michalewicz and D. B. Fogel. How to Solve It: Modern Heuristics. Springer-Verlag, Berlin, 2000.

    MATH  Google Scholar 

  38. H. Mühlenbein. The equation for response to selection and its use for prediction. Evolutionary Computation, 5:303–346, 1998.

    Article  Google Scholar 

  39. H. Mühlenbein and G. Paaß. From recombination of genes to the estimation of distributions I. binary parameters. In Parallel Problem Solving from Nature - PPSN IV, pages 178–187, Berlin, September 1996.

    Google Scholar 

  40. W. Nuijten and C. Le Pape. Constraint-based job scheduling with ILOG scheduler. Journal of Heuristics, 3:271–286, 1998.

    Article  MATH  Google Scholar 

  41. C. H. Papadimitriou and K. Steiglitz. Combinatorial Optimization. Dover Publications Inc., Mineola, NY, 2nd edition, 1998.

    MATH  Google Scholar 

  42. M. Pelikan. Hierarchial Bayesian Optimization Algorithm. Springer-Verlag, Berlin, 2005.

    Google Scholar 

  43. M. Pelikan, D. E. Goldberg, and F. G. Lobo. A survey of optimization by building and using probabilistic models. Computational Optimization and Applications, 21(1):5–20, 2002.

    Article  MATH  MathSciNet  Google Scholar 

  44. G. Pesant and M. Gendreau. A constraint programming framework for local search methods. Journal of Heuristics, 5(3):255–279, 1999.

    Article  MATH  Google Scholar 

  45. G. Pesant, M. Gendreau, J.-Y. Potvinand, and J.-M. Rousseau. An exact constraint logic programming algorithm for the traveling salesman problem with time windows. Transportation Science, 32(1):12–29, 1998.

    Article  MATH  Google Scholar 

  46. J. Puchinger and G. R. Raidl. Combining metaheuristics and exact algorithms in combinatorial optimization: A survey and classification. In J. Mira and J. R. Alvarez, editors, Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach. Springer-Verlag, 2005.

    Google Scholar 

  47. J.-F. Puget. Constraint programming next challenge: Simplicity of use. In Principles and Practice of Constraint Programming—CP’04, Toronto, September 2004.

    Google Scholar 

  48. R. Y. Rubinstein and D. P. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer-Verlag, Berlin, 2004.

    MATH  Google Scholar 

  49. T. P. Runarsson and X. Yao. Stochastic ranking for constrained evolutionary optimization. IEEE Transactions on Evolutionary Computation, 4(3):284—294, 2000.

    Article  Google Scholar 

  50. H.-P. Schwefel. Evolution and Optimum Seeking. Wiley, New York, 1995.

    Google Scholar 

  51. H. J. Shin, C.-O. Kim, and S. S. Kim. A tabu search algorithm for single machine scheduling with release times, due dates, and sequence-dependent set-up times. International Journal of Advanced Manufacturing Technology, 19(11):859–866, 2002.

    Article  Google Scholar 

  52. K. Socha, J. Knowels, and M. Sampels. A MAX-MIN ant system for the university course timetabling problem. In International Workshop on Ant Algorithms (ANTS 2002), Brussels, September 2002.

    Google Scholar 

  53. K. Socha, M. Sampels, and M. Manfrin. Ant algorithms for the university course timetabling problem with regard to the state-of-the-art. In European Workshop on Evolutionary Computation in Combinatorial Optimization (EvoCOP 2003), April 2003.

    Google Scholar 

  54. T. Stützle and H. H. Hoos. MAX-MIN ant system. Future Generation Computer Systems, 16(8):889–914, 2000.

    Article  Google Scholar 

  55. P. Van Hentenryck. The OPL Optimization Programming Language. MIT Press, Cambridge, MA, 1999.

    Google Scholar 

  56. P. Van Hentenryck and L. Michel. Synthesis of constraint-based local search algorithms from high-level models. In AAAI-07, Vancouver, July 2007.

    Google Scholar 

  57. V. C. S. Wiers. A review of the applicability of OR and AI scheduling techniques in practice. Omega, 25(2), 1997.

    Google Scholar 

  58. M. Zlochin, M. Birattari, N. Meuleau, and M. Dorigo. Model-based search for combinatorial optimization: A critical survey. Annals of Operations Research, 131:373–395, 2004.

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Meyer, B. (2008). Hybrids of Constructive Metaheuristics and Constraint Programming: A Case Study with ACO. In: Blum, C., Aguilera, M.J.B., Roli, A., Sampels, M. (eds) Hybrid Metaheuristics. Studies in Computational Intelligence, vol 114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78295-7_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-78295-7_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-78294-0

  • Online ISBN: 978-3-540-78295-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics