A long-standing problem in combinatorial optimization with metaheuristics has been how to handle hard constraints effectively. Integrating metaheuristic methods with Constraint Programming (CP), an exact technique for solving hard constraints, promises a solution to this problem.
This chapter explores how such an integration can be achieved. We discuss possible types of couplings between the two algorithmic frameworks and define hybrid algorithms for each type. The central distinction is between tight coupling in which both components collaborate in an interleaved fashion and loose coupling where both components run in parallel, exchanging only (partial) solutions and bounds.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. Allahverdi, J. N. D. Gupta, and T. Aldowaisan. A review of scheduling research involving setup considerations. Omega, 27(2):219–239, 1999.
N. Ascheuer, M. Fischetti, and M. Grötschel. Solving the asymmetric travelling salesman problem with time windows by branch-and-cut. Mathematical Programming, 90(3):475–506, 2001.
S. Baluja and R. Caruana. Removing the genetics from the standard genetic algorithm. In Int. Conf. Machine Learning (ML-95), 1995.
A. Bauer, B. Bullnheimer, R. F. Hartl, and C. Strauss. An ant colony optimization approach for the single machine total tardiness problem. In Proceedings of the Congress on Evolutionary Computation, Washington/DC, July 1999.
C. Blum, November 2003. Personal Communication.
C. Blum. Ant colony optimization: Introduction and recent trends. Physics of Life Reviews, 2(4):353–373, 2005.
C. Blum and A. Roli. Metaheuristics in combinatorial optimization: Overview and conceptual comparison. ACM Computing Surveys, 35(3):268–308, 2003.
C. Blum and M. Sampels. When model bias is stronger than selection pressure. In Parallel Problem Solving From Nature (PPSN-VII), Granada, September 2002.
P. A. Bosman and D. Thierens. Continuous iterated density estimation evolutionary algorithms within the IDEA framework. In Genetic and Evolutionary Computation Conference - GECCO, pages 197–200, Las Vegas, July 2000.
M. Carlsson, G. Ottosson, and B. Carlson. An open-ended finite domain constraint solver. In Proc. PLILP’97 Programming Languages: Implementations, Logics, and Programs, Southampton, September 1997.
Y. Caseau and F. Laburthe. Improved CLP scheduling with task intervals. In International Conference on Logic Programming, Santa Margherita Ligure, Italy, June 1994.
D. M. Chickering, D. Geiger, and D. Heckerman. Learning bayesian networks is NP-hard. Technical report, Microsoft Research, Redmont, WA, 1994. MSR-TR-94-17.
C. Coello and A. Carlos. A survey of constraint handling techniques used with evolutionary algorithms. Technical report, Laboratorio Nacional de Informtica Avanzada, 1999. Technical Report Lania-RI-9904.
C. A. Coello. Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art. Computer Methods in Applied Mechanics and Engineering, 191(11–12):1245–1287, 2002.
O. Cordón, F. Herrera, and T. Stützle. A review on the ant colony optimization metaheuristic: Basis, models and new trends. Mathware and Soft Computing, 9(2–3):141–175, 2002.
P.-T. De Boer, D. P. Kroese, S. Mannor, and R. Y. Rubinstein. A tutorial on the cross-entropy method. Annals of Operations Research, 134(1):19–67, 2005.
R. Dechter. Constraint Processing. Morgan Kaufmann Publishers, San Francisco, CA, 2003.
M. den Besten, T. Stützle, and M. Dorigo. Ant colony optimization for the total weighted tardiness problem. In Parallel Problem Solving from Nature - PPSN VI, Paris, France, September 2000.
M. Dorigo, G. D. Di Caro, and L. M. Gambardella. Ant algorithms for discrete optimization. Artificial Life, 5:137–172, 1999.
M. Dorigo and L. M. Gambardella. Ant colony system: A cooperative learning approach to the traveling salesman problem. Technical Report TR/IRIDIA/1996-5, Universite Libre de Bruxelles, 1996.
M. Dorigo and L. M. Gambardella. Ant colony system: A cooperative learning approach to the traveling salesman problem. IEEE Transactions on Evolutionary Computation, 1(1):53–66, 1997.
M. Dorigo and T. Stützle. Ant Colony Optimization. MIT Press, Cambridge, 2004.
M. Dorigo, M. Zlocin, N. Meuleau, and M. Birattari. Updating ACO pheromones using stochastic gradient ascent and cross-entropy methods. In Proceedings of the Evo Workshops, Kinsale, Ireland, April 2002.
B. Efron. The Jackknife, the bootstrap and other resampling plans. SIAM, 1982.
R. Farmani and J. A. Wright. Self-adaptive fitness formulation for constrained optimization. IEEE Transactions on Evolutionary Computation, 7(5):445—455, 2003.
F. Focacci, F. Laburthe, and A. Lodi. Local search and constraint programming. In F. Glover and G. Kochenberger, editors, Handbook of metaheuristics. Kluwer, Boston/MA, 2003.
F. Focacci, A. Lodi, and M. Milano. A hybrid exact algorithm for the TSPTW. INFORMS Journal on Computing, 14(4):403–417, 2003.
M. Gravel, W. L. Price, and C. Gagné. Scheduling continuous casting of aluminum using a multiple objective ant colony optimization metaheuristic. European Journal of Operational Research, 143(1):218–229, 2002.
M. Held. Analysis and improvement of constraint handling in ant colony algorithms, November 2005. BCS Honours Thesis, Monash University.
P. Larrañaga and J. A. Lozano (eds.). Estimation of distribution algorithms: a new tool for evolutionary computation. Kluwer, Boston, 2002.
E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, and D. B. Shmoys. Sequencing and scheduling: algorithms and complexity. In S. C. Graves, A. H. G. Rinnooy Kan, and P. H. Zipkin, editors, Logistics of Production and Inventory, pages 445–522. North Holland, Amsterdam, Netherlands, 1993.
J. A. Lozano, P. Larrañaga, I. Inza, and E. Bengoetxea (eds.). Towards a New Evolutionary Computation. Springer-Verlag, 2006.
K. Marriott and P. Stuckey. Programming With Constraints. MIT Press, Cambridge, MA, 1998.
B. Meyer. On the convergence behaviour of ant colony search. In Asia-Pacific Conference on Complex Systems, Cairns, December 2004.
B. Meyer. Constraint handling and stochastic ranking in ACO. In IEEE CEC – Congress on Evolutionary Computation, Edinburgh, September 2005.
B. Meyer and A. Ernst. Integrating ACO and constraint propagation. In Ant Colony Optimization and Swarm Intelligence (ANTS 2004), Brussels, September 2004.
Z. Michalewicz and D. B. Fogel. How to Solve It: Modern Heuristics. Springer-Verlag, Berlin, 2000.
H. Mühlenbein. The equation for response to selection and its use for prediction. Evolutionary Computation, 5:303–346, 1998.
H. Mühlenbein and G. Paaß. From recombination of genes to the estimation of distributions I. binary parameters. In Parallel Problem Solving from Nature - PPSN IV, pages 178–187, Berlin, September 1996.
W. Nuijten and C. Le Pape. Constraint-based job scheduling with ILOG scheduler. Journal of Heuristics, 3:271–286, 1998.
C. H. Papadimitriou and K. Steiglitz. Combinatorial Optimization. Dover Publications Inc., Mineola, NY, 2nd edition, 1998.
M. Pelikan. Hierarchial Bayesian Optimization Algorithm. Springer-Verlag, Berlin, 2005.
M. Pelikan, D. E. Goldberg, and F. G. Lobo. A survey of optimization by building and using probabilistic models. Computational Optimization and Applications, 21(1):5–20, 2002.
G. Pesant and M. Gendreau. A constraint programming framework for local search methods. Journal of Heuristics, 5(3):255–279, 1999.
G. Pesant, M. Gendreau, J.-Y. Potvinand, and J.-M. Rousseau. An exact constraint logic programming algorithm for the traveling salesman problem with time windows. Transportation Science, 32(1):12–29, 1998.
J. Puchinger and G. R. Raidl. Combining metaheuristics and exact algorithms in combinatorial optimization: A survey and classification. In J. Mira and J. R. Alvarez, editors, Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach. Springer-Verlag, 2005.
J.-F. Puget. Constraint programming next challenge: Simplicity of use. In Principles and Practice of Constraint Programming—CP’04, Toronto, September 2004.
R. Y. Rubinstein and D. P. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer-Verlag, Berlin, 2004.
T. P. Runarsson and X. Yao. Stochastic ranking for constrained evolutionary optimization. IEEE Transactions on Evolutionary Computation, 4(3):284—294, 2000.
H.-P. Schwefel. Evolution and Optimum Seeking. Wiley, New York, 1995.
H. J. Shin, C.-O. Kim, and S. S. Kim. A tabu search algorithm for single machine scheduling with release times, due dates, and sequence-dependent set-up times. International Journal of Advanced Manufacturing Technology, 19(11):859–866, 2002.
K. Socha, J. Knowels, and M. Sampels. A MAX-MIN ant system for the university course timetabling problem. In International Workshop on Ant Algorithms (ANTS 2002), Brussels, September 2002.
K. Socha, M. Sampels, and M. Manfrin. Ant algorithms for the university course timetabling problem with regard to the state-of-the-art. In European Workshop on Evolutionary Computation in Combinatorial Optimization (EvoCOP 2003), April 2003.
T. Stützle and H. H. Hoos. MAX-MIN ant system. Future Generation Computer Systems, 16(8):889–914, 2000.
P. Van Hentenryck. The OPL Optimization Programming Language. MIT Press, Cambridge, MA, 1999.
P. Van Hentenryck and L. Michel. Synthesis of constraint-based local search algorithms from high-level models. In AAAI-07, Vancouver, July 2007.
V. C. S. Wiers. A review of the applicability of OR and AI scheduling techniques in practice. Omega, 25(2), 1997.
M. Zlochin, M. Birattari, N. Meuleau, and M. Dorigo. Model-based search for combinatorial optimization: A critical survey. Annals of Operations Research, 131:373–395, 2004.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Meyer, B. (2008). Hybrids of Constructive Metaheuristics and Constraint Programming: A Case Study with ACO. In: Blum, C., Aguilera, M.J.B., Roli, A., Sampels, M. (eds) Hybrid Metaheuristics. Studies in Computational Intelligence, vol 114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78295-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-78295-7_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78294-0
Online ISBN: 978-3-540-78295-7
eBook Packages: EngineeringEngineering (R0)