Abstract
We propose a cooperative multi-search method for the Variable Neighborhood Search (VNS) meta-heuristic based on the central-memory mechanism that has been successfully applied to a number of difficult combinatorial problems. In this approach, several independent VNS meta-heuristics cooperate by asynchronously exchanging information about the best solutions identified so far, thus conserving the simplicity of the original, sequential VNS ideas. The p-median problem (PM) serves as test case. Extensive experimentations have been conducted on the classical TSPLIB benchmark problem instances with up to 11948 customers and 1000 medians, without any particular calibration of the parallel method. The results indicate that, compared to sequential VNS, the cooperative strategy yields significant gains in terms of computation time without a loss in solution quality.
Similar content being viewed by others
References
Aiex, R.M., S.L. Martins, C.C. Ribeiro, and N.R. Rodriguez. (1998). “Cooperative Multi-Thread Parallel Tabu Search with an Application to Circuit Partitioning.” In Proceedings of IRREGULAR'98-5th International Symposium on Solving Irregularly Structured Problems in Parallel, vol. 1457 of Lecture Notes in Computer Science, Springer-Verlag, pp. 310-331.
Avella, P. and A. Sassano. (2001). “On the p-Median Problem Polytope.” Mathematical Programming 89(3), 395–411.
Avella, P., A. Sassano, and I. Vasil'ev. (2003). “Computational Study on Large-Scale p-Median Problems.” Working paper, Dipartimento di Informatica e Sistemistica, Università di Roma “La Sapienza”, Roma, Italy.
Barr, R.S. and B.L. Hickman. (1993). “Reporting Computational Experiments with Parallel Algorithms: Issues, Measures, and Experts Opinions.” ORSA Journal on Computing 5(1), 2–18.
Beasley, J.E. (1985). “A Note on Solving Large p-Median Problems.” European Journal of Operational Research 21, 270–273.
Beasley, J.E. (1993). “Lagrangean Heuristics for Location Problems.” European Journal of Operational Research 65, 383–399.
Brandeau, M.L. and S.S. Chiu. (1989). “An Overview of Representative Problems in Location Research.” Management Science 35(6), 645–674.
Cantø-Paz, E. (1998). “A Survey of Parallel Genetic Algorithms.” Calculateurs Parallèles, Rèseaux et Systèmes répartis 10(2), 141–170.
Captivo, E.M. (1991). “Fast Primal and Dual Heuristics for the p-Median Location Problem.” European Journal of Operational Research 52, 65–74.
Cornuéjols, G., M.L. Fisher, and G.L. Nemhauser. (1977). “Location of Bank Accounts to Optimize Float: An Analytic Study of Exact and Approximate Algorithms.” Management Science 23, 789–810.
Crainic, T.G. (2002). “Parallel Computation, Co-operation, Tabu Search.” In C. Rego and B. Alidaee (eds.), Adaptive Memory and Evolution: Tabu Search and Scatter Search. Norwell, MA: Kluwer Academic Publishers.
Crainic, T.G. and M. Gendreau. (2002). “Cooperative Parallel Tabu Search for Capacitated Network Design.” Journal of Heuristics 8(6), 601–627.
Crainic, T.G. and M. Toulouse. (1998). “Parallel Metaheuristics.” In T.G. Crainic and G. Laporte (eds.), Fleet Management and Logistics. Norwell, MA: Kluwer Academic Publishers, pp. 205–251.
Crainic, T.G. and M. Toulouse. (2003). “Parallel Strategies for Meta-heuristics.” In F. Glover and G. Kochenberger (eds.), State-of-the-Art Handbook in Metaheuristics. Norwell, MA: Kluwer Academic Publishers, pp. 475–513.
Crainic, T.G., M. Toulouse, and M. Gendreau. (1995). “Parallel Asynchronous Tabu Search for Multicommodity Location-Allocation with Balancing Requirements.” Annals of Operations Research 63, 277–299.
Cung, V.-D., S.L. Martins, C.C. Ribeiro, and C. Roucairol. (2002). “Strategies for the Parallel Implementations of Metaheuristics.” In C. Ribeiro and P. Hansen (eds.), Essays and Surveys in Metaheuristics. Norwell, MA: Kluwer Academic Publishers, pp. 263–308.
Daskin, M.S. (1995). Network and Discrete Location. Models, Algorithms, and Applications. New York, NY: John Wiley & Sons.
de Farias, I.R., Jr. (2001). “A Family of Facets for the Uncapacitated p-Median Polytope.” Operations Research Letters 28(4), 161–167.
Drezner, Z. (ed.). (1995). Facility Location. A Survey of Applications and Methods. NewYork, NY: Springer-Verlag.
Erlenkotter, D. (1978). “A Dual-Based Procedure for Uncapacitated Facility Location.” Operations Research 26, 992–1009.
Galvaõ, R.D. (1980). “A Dual-Bounded Algorithm for the p-Median Problem.” Operations Research 28, 190–206.
García-López, F., B. Melín-Batista, J.A. Moreno-Pérez, and J.M. Moreno-Vega. (2002). “The Parallel Variable Neighborhood Search for the p-Median Problem.” Journal of Heuristics 8(3), 375–388.
Glover, F. and M. Laguna. (1997). Tabu Search. Norwell, MA: Kluwer Academic Publishers.
Hanjoul, P. and D. Peeters. (1985). “A Comparison of Two Dual-Based Procedures for Solving the p-Median Problem.” European Journal of Operational Research 20(3), 387–273.
Hansen P. and B. Jaumard. (1997). “Cluster Analysis and Mathematical Programming.” Mathematical Programming 79, 191–215.
Hansen, P. and N. Mladenovi?. (1997). “Variable Neighborhood Search for the p-Median.” Location Science 5(4), 207–226.
Hansen, P. and N. Mladenovi?. (1999). “An Introduction to Variable Neighborhood Search.” In S. Voß, S. Martello, C. Roucairol, and I.H. Osman (eds.), Meta-Heuristics 98: Theory & Applications. Norwell, MA: Kluwer Academic Publishers, pp. 433–458.
Hansen, P. and N. Mladenovi?. (2002). “Developments of Variable Neighborhood Search.” In C. Ribeiro and P. Hansen (eds.), Essays and Surveys in Metaheuristics, Norwell, MA: Kluwer Academic Publishers, pp. 415–439.
Hansen, P., N. Mladenovi?, and D. Pérez-Brito. (2001). “Variable Neighborhood Decomposition Search.” Journal of Heuristics 7(4), 335–350.
Hansen, P., N. Mladenovi?, and É. Taillard. (1998). “Heuristic Solution of the Multisource Weber Problem as a p-Median Problem.” Operations Research Letters 22(2-3), 55–62.
Holmqvist, K., A. Migdalas, and P.M. Pardalos. (1997). “Parallelized Heuristics for Combinatorial Search.” In A. Migdalas, P. Pardalos, and S. Storoy (eds.), Parallel Computing in Optimization. Norwell, MA: Kluwer Academic Publishers, pp. 269–294.
Kariv, O. and S.L. Hakimi. (1969). “An Algorithmic Approach to Network Location Problems; Part 2. The p-Medians.” SIAM Journal on Applied Mathematics 37, 539–560.
Kaufman, L. and P.J. Rousseeuw. (1990). Finding Groups in Data. An Introduction to Cluster Analysis. New York, NY: John Wiley & Sons.
Kuehn, A.A. and M.J. Hamburger. (1990). “A Heuristic Program for LocatingWarehouses.” Management Science 9, 643–666.
Labbé, M. and F.V. Louveaux. (1997). “Location Problems.” In M. Dell'Amico, F. Maffioli, and S. Martello (eds.), Annotated Bibliographies in Combinatorial Optimization. New York, NY: John Wiley & Sons, pp. 261–281.
Le Bouthillier, A. and T.G. Crainic. (2004). “A Cooperative Parallel Meta-Heuristic for the Vehicle Routing Problem with Time Windows.” Computers & Operations Research.
Maranzana, F.E. (1964). “On the Location of Supply Points to Minimize Transportation Costs.” Operations Research Quaterly 12, 138–139.
Mirchandani, P.S. and R.L. Francis (eds.) (1990). Discrete Location Theory. New York, NY: John Wiley & Sons.
Mladenovi?, N. and P. Hansen. (1997). “Variable Neighborhood Search.” Computers & Operations Research 24, 1097–1100.
Mladenovi?, N., J.P. Moreno, and J. Moreno-Vega. (1995). “Tabu Search in Solving p-Facility Location-Allocation Problems.” Les Cahiers du GERAD G-95-38, GERAD, Montréal, Canada.
Moreno, J., C. Rodríguez, and N. Jiménez. (1991). “Heuristic Cluster Algorithm for Multiple Facility Location-allocation Problem.” RAIRO-Recherche Operationnelle / Operations Research 25, 97–107.
Ng, B.T. and J. Han. (1994). “Efficient and Effective Clustering Methods for Spatial Data Mining.” In J. Bocca, M. Jarke, and O. Zaniolo (eds.), 20th International Conference on Very Large Data Bases. Los Altos, CA: Morgan Kaufmann, pp. 144–155.
Pizzolato N.D. (1994). “A Heuristic for Large-size p-Median Location Problems with Application to School Location.” Annals of Operations Research 50, 473–485.
Ram, D.J., T.H. Sreenivas, and K.G. Subramaniam. (1996). “Parallel Simulated Annealing Algorithms.” Journal of Parallel and Distributed Computing 37, 207–212.
Reinelt, G. (1991). “TSPLIB-A Traveling Salesman Problem Library.” ORSA Journal on Computing 3, 376–384.
Rolland, E., D.A. Schilling, and J.R. Current. (1996). “An Efficient Tabu Search Procedure for the p-Median Problem.” European Journal of Operational Research 96, 329–342.
Rosing, K.E. and M.J. Hodgson. (2002). “Heuristic Concentration for the p-Median: An Example Demonstrating How and Why it Works.” Computers & Operations Research 29(10), 1317–1330.
Taillard, É. (2003). “Heuristic Methods for Large Centroid Clustering Problems.” Journal of Heuristics (to appear).
Taillard, É.D., L.M. Gambardella, M. Gendreau, and J.-Y. Potvin. (1998). “Programmation àmémoire adaptative.” Calculateurs Paralléles, Réseaux et Systémes répar tis 10, 117–140.
Teitz, M.B. and P. Bart. (1968). “Heuristic Methods for Estimating the Generalized Vertex Median of a Weighted Graph.” Operations Research 16(5), 955–961.
Toulouse, M., T.G. Crainic, and M. Gendreau. (1996). “Communication Issues in Designing Cooperative Multi Thread Parallel Searches.” In I.H. Osman and J.P. Kelly (eds.), Meta-Heuristics: Theory & Applications, Norwell, MA: Kluwer Academic Publishers, pp. 501–522.
Toulouse, M., T.G. Crainic, and B. Sansó. (1999). “An Experimental Study of Systemic Behavior of Cooperative Search Algorithms.” In S. Voß, S. Martello, C. Roucairol, and I.H. Osman (eds.) Meta-Heuristics 98: Theory & Applications, Norwell, MA: Kluwer Academic Publishers, pp. 373–392.
Toulouse, M., T.G. Crainic, and B. Sansó. (2004). “Systemic Behavior of Cooperative Search Algorithms.” Parallel Computing 21(1), 57–79.
Toulouse, M., T.G. Crainic, and K. Thulasiraman. (2000). “Global Optimization Properties of Parallel Cooperative Search Algorithms: A Simulation Study.” Parallel Computing 26(1), 91–112.
Verhoeven, M.G.A. and E.H.L Aarts. (1995). “Parallel Local Search.” Journal of Heuristics 1(1), 43–65.
Voß, S. (1996). “A Reverse Elimination Approach for the p-Median Problem.” Studies in Locational Analysis 8, 49–58.
Whittaker, R. (1983). “A Fast Algorithm for the Greedy Interchange for Large-Scale Clustering and Median Location Problems.” INFOR 21, 95–108.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Crainic, T.G., Gendreau, M., Hansen, P. et al. Cooperative Parallel Variable Neighborhood Search for the p-Median. Journal of Heuristics 10, 293–314 (2004). https://doi.org/10.1023/B:HEUR.0000026897.40171.1a
Issue Date:
DOI: https://doi.org/10.1023/B:HEUR.0000026897.40171.1a