Abstract
In this paper we propose a novel heuristic search for solving combinatorial optimization problems which we call Diverse Search (DS). Like beam search, this constructive approach expands only a selected subset of the solutions in each level of the search tree. However, instead of selecting the solutions with the best values, we use an efficient method to select a diverse subset, after filtering out uninteresting solutions. DS also distinguishes solutions that do not produce better offspring, and applies a local search process to them. The intuition is that the combination of these strategies allows to reach more—and more diverse—local optima, increasing the chances of finding the global optima. We test DS on several instances of the Köerkel–Ghosh (KG) and K-median benchmarks for the Simple Plant Location Problem. We compare it with a state-of-the-art heuristic for the KG benchmark and the relatively old POPSTAR solver, which also relies on the idea of maintaining a diverse set of solutions and, surprisingly, reached a comparable performance. With the use of a Path Relinking post-optimization step, DS can achieve results of the same quality that the state-of-the-art in similar CPU times. Furthermore, DS proved to be slightly better on average for large scale problems with small solution sizes, proving to be an efficient algorithm that delivers a set of good and diverse solutions.





Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of Data and Materials
Not applicable.
References
Atta, S., Mahapatra, P.R.S., Mukhopadhyay, A.: Deterministic and randomized heuristic algorithms for uncapacitated facility location problem. In: Information and Decision Sciences, Springer, pp 205–216 (2018)
Barahona, F., Chudak, F.A.: Solving large scale uncapacitated facility location problems. In: Approximation and Complexity in Numerical Optimization, Springer, pp 48–62 (2000)
Beltran-Royo, C., Vial, J.P., Alonso-Ayuso, A.: Semi-lagrangian relaxation applied to the uncapacitated facility location problem. Comput. Optim. Appl. 51(1), 387–409 (2012)
Blum, C., Puchinger, J., Raidl, G., Roli, A., et al.: A brief survey on hybrid metaheuristics. In: Proceedings of Bioinspired Optimization Methods and their Applications (BIOMA) pp. 3–18 (2010)
Blum, C., Raidl, G.R.: Hybrid Metaheuristics: Powerful Tools for Optimization. Springer (2016)
Blum, C., Roli, A.: Metaheuristics in combinatorial optimization: overview and conceptual comparison. ACM Comput. Surv. 35(3), 268–308 (2003)
Browne, C.B., Powley, E., Whitehouse, D., Lucas, S.M., Cowling, P.I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., Colton, S.: A survey of Monte carlo tree search methods. IEEE Trans. Comput. Intell. AI Games 4(1), 1–43 (2012)
de Armas, J., Juan, A.A., Marquès, J.M.: A biased-randomized algorithm for the uncapacitated facility location problem. In: International Forum for Interdisciplinary Mathematics, Springer, pp. 287–298 (2015)
Deza, M.M., Deza, E.: Encyclopedia of Distances. Springer, Berlin (2009)
Edelkamp, S., Schroedl, S.: Heuristic Search: Theory and Applications. Elsevier (2011)
Erlenkotter, D.: A dual-based procedure for uncapacitated facility location. Oper. Res. 26(6), 992–1009 (1978)
Feo, T.A., Resende, M.G.: Greedy randomized adaptive search procedures. J. Global Optim. 6(2), 109–133 (1995)
Fischetti, M., Ljubić, I., Sinnl, M.: Redesigning benders decomposition for large-scale facility location. Manage. Sci. 63(7), 2146–2162 (2016)
Garcıa-López, F., Melián-Batista, B., Moreno-Pérez, J.A., Moreno-Vega, J.M.: Parallelization of the scatter search for the p-median problem. Parallel Comput. 29(5), 575–589 (2003)
Ghosh, J.B.: Computational aspects of the maximum diversity problem. Oper. Res. Lett. 19(4), 175–181 (1996)
Ghosh, D.: Neighborhood search heuristics for the uncapacitated facility location problem. Eur. J. Oper. Res. 150(1), 150–162 (2003)
Glover, F., Hao, J.K.: Diversification-based learning in computing and optimization. arXiv preprint arXiv:170307929 (2017)
Glover, F., Kuo, C.C., Dhir, K.: Heuristic algorithms for the maximum diversity problem. J. Inf. Optim. Sci. 19, (1998). https://doi.org/10.1080/02522667.1998.10699366
Glover, F.: Tabu search and adaptive memory programming—advances, applications and challenges. In: Barr, R.S., Helgason, R.V., Kennington, J.L. (eds) Interfaces in Computer Science and Operations Research: Advances in Metaheuristics, Optimization, and Stochastic Modeling Technologies, Springer US, Boston, pp. 1–75 (1997). https://doi.org/10.1007/978-1-4615-4102-8_1
Glover, F.: Pseudo-centroid clustering. Soft. Comput. 21(22), 6571–6592 (2017)
Glover, F., Laguna, M., Martí, R.: Fundamentals of scatter search and path relinking. Control. Cybern. 29(3), 653–684 (2000)
Goldengorin, B.: Maximization of submodular functions: theory and enumeration algorithms. Eur. J. Oper. Res. 198(1), 102–112 (2009)
Hakli, H., Ortacay, Z.: An improved scatter search algorithm for the uncapacitated facility location problem. Comput. Ind. Eng. 135, 855–867 (2019)
Hoefer, M. (2003) Ufllib, benchmark instances for the uncapacitated facility location problem. https://resources.mpi-inf.mpg.de/departments/d1/projects/benchmarks/UflLib/
Jakob, K., Pruzan, P.M.: The simple plant location problem: survey and synthesis. Eur. J. Oper. Res. 12, 36–81 (1983)
Jie, Z., Chaozan, F., Bo, L., Shi, F.G.: An improved particle swarm optimization based on repulsion factor. Open J Appl. Sci. 2, 112–115 (2012)
Karapetyan, D., Goldengorin, B.: Conditional markov chain search for the simple plant location problem improves upper bounds on twelve körkel–ghosh instances. In: Optimization Problems in Graph Theory, Springer, pp. 123–147 (2018a)
Karapetyan, D., Goldengorin, B.: Daniel karapetyan: Publications. http://www.cs.nott.ac.uk/~pszdk/?page=publications&key=SPLP-CMCS. Accessed 18 Dec 2020 (2018b)
Körkel, M.: On the exact solution of large-scale simple plant location problems. Eur. J. Oper. Res. 39(2), 157–173 (1989)
Kratica, J., ToŠiĆ, D., FilipoviĆ, V., LjubiĆ, I.: Comparing performances of several algorithms for solving simple plant location problem. In: Proceedings of the 10th Congress of Yugoslav Mathematicians, pp. 337–341 (2001a)
Kratica, J., Tošic, D., Filipović, V., Ljubić, I.: Solving the simple plant location problem by genetic algorithm. RAIRO-Oper. Res. 35(1), 127–142 (2001)
Letchford, A.N., Miller, S.J.: An aggressive reduction scheme for the simple plant location problem. Eur. J. Oper. Res. 234(3), 674–682 (2014)
Sobolev Institute of Mathematics (2017) Simple plant location problem. http://www.math.nsc.ru/AP/benchmarks/UFLP/Engl/uflp_eng.html. Accessed 11 Sept 2018
Mohsen, A.M.: Annealing Ant Colony Optimization with Mutation Operator for Solving TSP. Computational Intelligence and Neuroscience 2016, 1–13 (2016). https://doi.org/10.1155/2016/8932896
Neri, F., Cotta, C., Moscato, P.: Handbook of Memetic Algorithms, vol 379. Springer (2012)
NLHPC: Hardware disponible — nlhpc,. https://wiki.nlhpc.cl/index.php?title=Hardware_Disponible&oldid=442. Accessed 11 Sept 2018 (2020)
Posta, M., Ferland, J.A., Michelon, P.: An exact cooperative method for the uncapacitated facility location problem. Math. Program. Comput. 6(3), 199–231 (2014)
Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.: Opposition-based differential evolution. IEEE Trans. Evol. Comput. 12(1), 64–79 (2008)
Reese, J.: Solution methods for the p-median problem: an annotated bibliography. Netw.: Int. J. 48(3), 125–142 (2006)
Resende, M.G., Ribeiro, C.C., Glover, F., Martí, R.: Scatter search and path-relinking: fundamentals, advances, and applications. In: Gendreau, M., Potvin, J.Y. (eds.) Handbook of Metaheuristics, pp. 87–107. Switzerland, International Series in Operations Research and Management Science, Springer, Cham (2010)
Resende, M.G., Werneck, R.F.: Popstar. (2006b) http://mauricio.resende.info/popstar/index.html
Resende, M.G., Ribeiro, C.: Greedy randomized adaptive search procedures (grasp). AT&T Labs Res. Tech. Rep. 98(1), 1–11 (1998)
Resende, M.G., Werneck, R.F.: A hybrid heuristic for the p-median problem. J. Heuristics 10(1), 59–88 (2004)
Resende, M.G., Werneck, R.F.: A hybrid multistart heuristic for the uncapacitated facility location problem. Eur. J. Oper. Res. 174(1), 54–68 (2006)
Resende, M.G., Werneck, R.F.: A fast swap-based local search procedure for location problems. Ann. Oper. Res. 150(1), 205–230 (2007)
ReVelle, C.: Facility siting and integer-friendly programming. Eur. J. Oper. Res. 65(2), 147–158 (1993)
Roli, A.: Symmetry-breaking and local search: A case study. In: SymCon’04–4th International Workshop on Symmetry and Constraint Satisfaction Problems, Citeseer (2004)
Siarry, P.: Metaheuristics. Springer, Switzerland (2016)
Sörensen, K., Sevaux, M., Glover, F.: A history of metaheuristics. In: Martí, R., Pardalos, P.M., Resende, M.G.C. (eds) Handbook of Heuristics, Springer, Cham, Switzerland, pp. 791–808 (2018). https://doi.org/10.1007/978-3-319-07124-4_4
Sörensen, K., Sevaux, M.: Ma| pm: memetic algorithms with population management. Comput. Oper. Res. 33(5), 1214–1225 (2006)
Squillero, G., Tonda, A.: Divergence of character and premature convergence: a survey of methodologies for promoting diversity in evolutionary optimization. Inf. Sci. 329, 782–799 (2016)
Sun, M.: Solving the uncapacitated facility location problem using tabu search. Comput. Oper. Res 33(9), 2563–2589 (2006)
Taillard, É.D., Gambardella, L.M., Gendreau, M., Potvin, J.Y.: Adaptive memory programming: a unified view of metaheuristics. Eur. J. Oper. Res. 135(1), 1–16 (2001)
Teitz, M.B., Bart, P.: Heuristic methods for estimating the generalized vertex median of a weighted graph. Oper. Res. 16(5), 955–961 (1968)
Tizhoosh, H.R.: Opposition-based learning: a new scheme for machine intelligence. In: Computational Intelligence for Modelling, Control and Automation, 2005 and International Conference on Intelligent Agents, Web technologies and Internet Commerce (CIMCA-IAWTIC’06), International Conference on, IEEE, Vienna, Austria, vol 1., pp. 695–701 (2005)
Vondrák, J.: Symmetry and approximability of submodular maximization problems. SIAM J. Comput. 42(1), 265–304 (2013)
Wang, F., Lim, A.: A stochastic beam search for the berth allocation problem. Decis. Support Syst. 42(4), 2186–2196 (2007)
Whitaker, R.: A fast algorithm for the greedy interchange for large-scale clustering and median location problems. INFOR: Inf. Syst. Oper. Res. 21(2), 95–108 (1983)
Acknowledgements
This work was funded by ANID PIA/APOYO AFB180002, Centro Científico Tecnológico de Valparaíso - CCTVal, Universidad Técnica Federico Santa María, Valparaíso, Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02). F. Casas B. thanks CONICYT - PFCHA/Magister Nacional/2018 - folio 22182114, for funding his studies. We thank Dr. Stuart Rogers for providing advice and reporting errors during the development of our dc2 solver on which our experiments were executed, and for pointing us to the POPSTAR solver.
Funding
F. Casas B. thanks CONICYT - PFCHA/Magister Nacional/2018 - folio 22182114, for funding his studies. This work was funded by ANID PIA/APOYO AFB180002, Centro Científico Tecnológico de Valparaíso - CCTVal, Universidad Técnica Federico Santa María, Valparaíso, Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Code Availability
Both an implementation of the algorithm and the experiments code is available online (https://github.com/autopawn/ds-experiments).
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
A Alternative distance for SPLP solutions
In this section we propose an alternative distance to compare SPLP solutions when the mean geometric error described in Sect. 4.5.2 is inconvenient, which we call per-client delta.
This distance does not require a distance between facilities \(d_{\text {facs}}(\cdot ,\cdot )\). Instead, it compares the costs of connecting each client in both solutions as if they were a vector of size M:
where \(g_{Sj}\) corresponds to the cost of the most convenient facility assignment within solution S for client j, as defined in Eq. 3.
It satisfies the triangle inequality since it corresponds to the \(L^1\) distance between these two vectors.
Under the assumption that each solution S stores its \(g_{Sj}\) values, the computational cost of computing this distance is \(\varTheta (M)\), which may be more convenient than the mean geometric error if solutions are large.
B Implementation details
To test both DS and other search strategies we developed a SPLP and p-median solver called dc2 whose source code is available onlineFootnote 1.
dc2 can perform DS as described in Algorithm 1, but it also supports restarts, different selection operators and combinations of them, as well as specifying different branching factors b. These configurations allow using dc2 as a GRASP, sample greedy, beam search, or stochastic beam search method.
Additionally, dc2 has support for Whitaker’s local search (Whitaker 1983), Path Relinking, and different solution distances \(d(\cdot ,\cdot )\). In order to solve big problem instances faster, this solver is also parallelized, but we only reported total CPU times in this work.
Rights and permissions
About this article
Cite this article
Casas, F., Torres, C.E. & Araya, I. A heuristic search based on diversity for solving combinatorial problems. J Heuristics 28, 287–328 (2022). https://doi.org/10.1007/s10732-022-09494-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10732-022-09494-4