Skip to main content
Log in

A heuristic search based on diversity for solving combinatorial problems

  • Published:
Journal of Heuristics Aims and scope Submit manuscript

Abstract

In this paper we propose a novel heuristic search for solving combinatorial optimization problems which we call Diverse Search (DS). Like beam search, this constructive approach expands only a selected subset of the solutions in each level of the search tree. However, instead of selecting the solutions with the best values, we use an efficient method to select a diverse subset, after filtering out uninteresting solutions. DS also distinguishes solutions that do not produce better offspring, and applies a local search process to them. The intuition is that the combination of these strategies allows to reach more—and more diverse—local optima, increasing the chances of finding the global optima. We test DS on several instances of the Köerkel–Ghosh (KG) and K-median benchmarks for the Simple Plant Location Problem. We compare it with a state-of-the-art heuristic for the KG benchmark and the relatively old POPSTAR solver, which also relies on the idea of maintaining a diverse set of solutions and, surprisingly, reached a comparable performance. With the use of a Path Relinking post-optimization step, DS can achieve results of the same quality that the state-of-the-art in similar CPU times. Furthermore, DS proved to be slightly better on average for large scale problems with small solution sizes, proving to be an efficient algorithm that delivers a set of good and diverse solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Availability of Data and Materials

Not applicable.

Notes

  1. https://github.com/autopawn/dc2/releases/tag/v1.1.1.

References

  • Atta, S., Mahapatra, P.R.S., Mukhopadhyay, A.: Deterministic and randomized heuristic algorithms for uncapacitated facility location problem. In: Information and Decision Sciences, Springer, pp 205–216 (2018)

  • Barahona, F., Chudak, F.A.: Solving large scale uncapacitated facility location problems. In: Approximation and Complexity in Numerical Optimization, Springer, pp 48–62 (2000)

  • Beltran-Royo, C., Vial, J.P., Alonso-Ayuso, A.: Semi-lagrangian relaxation applied to the uncapacitated facility location problem. Comput. Optim. Appl. 51(1), 387–409 (2012)

    Article  MathSciNet  Google Scholar 

  • Blum, C., Puchinger, J., Raidl, G., Roli, A., et al.: A brief survey on hybrid metaheuristics. In: Proceedings of Bioinspired Optimization Methods and their Applications (BIOMA) pp. 3–18 (2010)

  • Blum, C., Raidl, G.R.: Hybrid Metaheuristics: Powerful Tools for Optimization. Springer (2016)

  • Blum, C., Roli, A.: Metaheuristics in combinatorial optimization: overview and conceptual comparison. ACM Comput. Surv. 35(3), 268–308 (2003)

    Article  Google Scholar 

  • Browne, C.B., Powley, E., Whitehouse, D., Lucas, S.M., Cowling, P.I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., Colton, S.: A survey of Monte carlo tree search methods. IEEE Trans. Comput. Intell. AI Games 4(1), 1–43 (2012)

    Article  Google Scholar 

  • de Armas, J., Juan, A.A., Marquès, J.M.: A biased-randomized algorithm for the uncapacitated facility location problem. In: International Forum for Interdisciplinary Mathematics, Springer, pp. 287–298 (2015)

  • Deza, M.M., Deza, E.: Encyclopedia of Distances. Springer, Berlin (2009)

    Book  Google Scholar 

  • Edelkamp, S., Schroedl, S.: Heuristic Search: Theory and Applications. Elsevier (2011)

  • Erlenkotter, D.: A dual-based procedure for uncapacitated facility location. Oper. Res. 26(6), 992–1009 (1978)

    Article  MathSciNet  Google Scholar 

  • Feo, T.A., Resende, M.G.: Greedy randomized adaptive search procedures. J. Global Optim. 6(2), 109–133 (1995)

    Article  MathSciNet  Google Scholar 

  • Fischetti, M., Ljubić, I., Sinnl, M.: Redesigning benders decomposition for large-scale facility location. Manage. Sci. 63(7), 2146–2162 (2016)

    Article  Google Scholar 

  • Garcıa-López, F., Melián-Batista, B., Moreno-Pérez, J.A., Moreno-Vega, J.M.: Parallelization of the scatter search for the p-median problem. Parallel Comput. 29(5), 575–589 (2003)

    Article  Google Scholar 

  • Ghosh, J.B.: Computational aspects of the maximum diversity problem. Oper. Res. Lett. 19(4), 175–181 (1996)

    Article  MathSciNet  Google Scholar 

  • Ghosh, D.: Neighborhood search heuristics for the uncapacitated facility location problem. Eur. J. Oper. Res. 150(1), 150–162 (2003)

    Article  MathSciNet  Google Scholar 

  • Glover, F., Hao, J.K.: Diversification-based learning in computing and optimization. arXiv preprint arXiv:170307929 (2017)

  • Glover, F., Kuo, C.C., Dhir, K.: Heuristic algorithms for the maximum diversity problem. J. Inf. Optim. Sci. 19, (1998). https://doi.org/10.1080/02522667.1998.10699366

  • Glover, F.: Tabu search and adaptive memory programming—advances, applications and challenges. In: Barr, R.S., Helgason, R.V., Kennington, J.L. (eds) Interfaces in Computer Science and Operations Research: Advances in Metaheuristics, Optimization, and Stochastic Modeling Technologies, Springer US, Boston, pp. 1–75 (1997). https://doi.org/10.1007/978-1-4615-4102-8_1

  • Glover, F.: Pseudo-centroid clustering. Soft. Comput. 21(22), 6571–6592 (2017)

    Article  Google Scholar 

  • Glover, F., Laguna, M., Martí, R.: Fundamentals of scatter search and path relinking. Control. Cybern. 29(3), 653–684 (2000)

    MathSciNet  MATH  Google Scholar 

  • Goldengorin, B.: Maximization of submodular functions: theory and enumeration algorithms. Eur. J. Oper. Res. 198(1), 102–112 (2009)

    Article  MathSciNet  Google Scholar 

  • Hakli, H., Ortacay, Z.: An improved scatter search algorithm for the uncapacitated facility location problem. Comput. Ind. Eng. 135, 855–867 (2019)

    Article  Google Scholar 

  • Hoefer, M. (2003) Ufllib, benchmark instances for the uncapacitated facility location problem. https://resources.mpi-inf.mpg.de/departments/d1/projects/benchmarks/UflLib/

  • Jakob, K., Pruzan, P.M.: The simple plant location problem: survey and synthesis. Eur. J. Oper. Res. 12, 36–81 (1983)

    Article  MathSciNet  Google Scholar 

  • Jie, Z., Chaozan, F., Bo, L., Shi, F.G.: An improved particle swarm optimization based on repulsion factor. Open J Appl. Sci. 2, 112–115 (2012)

  • Karapetyan, D., Goldengorin, B.: Conditional markov chain search for the simple plant location problem improves upper bounds on twelve körkel–ghosh instances. In: Optimization Problems in Graph Theory, Springer, pp. 123–147 (2018a)

  • Karapetyan, D., Goldengorin, B.: Daniel karapetyan: Publications. http://www.cs.nott.ac.uk/~pszdk/?page=publications&key=SPLP-CMCS. Accessed 18 Dec 2020 (2018b)

  • Körkel, M.: On the exact solution of large-scale simple plant location problems. Eur. J. Oper. Res. 39(2), 157–173 (1989)

    Article  MathSciNet  Google Scholar 

  • Kratica, J., ToŠiĆ, D., FilipoviĆ, V., LjubiĆ, I.: Comparing performances of several algorithms for solving simple plant location problem. In: Proceedings of the 10th Congress of Yugoslav Mathematicians, pp. 337–341 (2001a)

  • Kratica, J., Tošic, D., Filipović, V., Ljubić, I.: Solving the simple plant location problem by genetic algorithm. RAIRO-Oper. Res. 35(1), 127–142 (2001)

    Article  MathSciNet  Google Scholar 

  • Letchford, A.N., Miller, S.J.: An aggressive reduction scheme for the simple plant location problem. Eur. J. Oper. Res. 234(3), 674–682 (2014)

    Article  MathSciNet  Google Scholar 

  • Sobolev Institute of Mathematics (2017) Simple plant location problem. http://www.math.nsc.ru/AP/benchmarks/UFLP/Engl/uflp_eng.html. Accessed 11 Sept 2018

  • Mohsen, A.M.: Annealing Ant Colony Optimization with Mutation Operator for Solving TSP. Computational Intelligence and Neuroscience 2016, 1–13 (2016). https://doi.org/10.1155/2016/8932896

  • Neri, F., Cotta, C., Moscato, P.: Handbook of Memetic Algorithms, vol 379. Springer (2012)

  • NLHPC: Hardware disponible — nlhpc,. https://wiki.nlhpc.cl/index.php?title=Hardware_Disponible&oldid=442. Accessed 11 Sept 2018 (2020)

  • Posta, M., Ferland, J.A., Michelon, P.: An exact cooperative method for the uncapacitated facility location problem. Math. Program. Comput. 6(3), 199–231 (2014)

    Article  MathSciNet  Google Scholar 

  • Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.: Opposition-based differential evolution. IEEE Trans. Evol. Comput. 12(1), 64–79 (2008)

    Article  Google Scholar 

  • Reese, J.: Solution methods for the p-median problem: an annotated bibliography. Netw.: Int. J. 48(3), 125–142 (2006)

  • Resende, M.G., Ribeiro, C.C., Glover, F., Martí, R.: Scatter search and path-relinking: fundamentals, advances, and applications. In: Gendreau, M., Potvin, J.Y. (eds.) Handbook of Metaheuristics, pp. 87–107. Switzerland, International Series in Operations Research and Management Science, Springer, Cham (2010)

  • Resende, M.G., Werneck, R.F.: Popstar. (2006b) http://mauricio.resende.info/popstar/index.html

  • Resende, M.G., Ribeiro, C.: Greedy randomized adaptive search procedures (grasp). AT&T Labs Res. Tech. Rep. 98(1), 1–11 (1998)

    Google Scholar 

  • Resende, M.G., Werneck, R.F.: A hybrid heuristic for the p-median problem. J. Heuristics 10(1), 59–88 (2004)

    Article  Google Scholar 

  • Resende, M.G., Werneck, R.F.: A hybrid multistart heuristic for the uncapacitated facility location problem. Eur. J. Oper. Res. 174(1), 54–68 (2006)

    Article  MathSciNet  Google Scholar 

  • Resende, M.G., Werneck, R.F.: A fast swap-based local search procedure for location problems. Ann. Oper. Res. 150(1), 205–230 (2007)

    Article  MathSciNet  Google Scholar 

  • ReVelle, C.: Facility siting and integer-friendly programming. Eur. J. Oper. Res. 65(2), 147–158 (1993)

    Article  Google Scholar 

  • Roli, A.: Symmetry-breaking and local search: A case study. In: SymCon’04–4th International Workshop on Symmetry and Constraint Satisfaction Problems, Citeseer (2004)

  • Siarry, P.: Metaheuristics. Springer, Switzerland (2016)

    Book  Google Scholar 

  • Sörensen, K., Sevaux, M., Glover, F.: A history of metaheuristics. In: Martí, R., Pardalos, P.M., Resende, M.G.C. (eds) Handbook of Heuristics, Springer, Cham, Switzerland, pp. 791–808 (2018). https://doi.org/10.1007/978-3-319-07124-4_4

  • Sörensen, K., Sevaux, M.: Ma| pm: memetic algorithms with population management. Comput. Oper. Res. 33(5), 1214–1225 (2006)

    Article  Google Scholar 

  • Squillero, G., Tonda, A.: Divergence of character and premature convergence: a survey of methodologies for promoting diversity in evolutionary optimization. Inf. Sci. 329, 782–799 (2016)

    Article  Google Scholar 

  • Sun, M.: Solving the uncapacitated facility location problem using tabu search. Comput. Oper. Res 33(9), 2563–2589 (2006)

    Article  MathSciNet  Google Scholar 

  • Taillard, É.D., Gambardella, L.M., Gendreau, M., Potvin, J.Y.: Adaptive memory programming: a unified view of metaheuristics. Eur. J. Oper. Res. 135(1), 1–16 (2001)

    Article  MathSciNet  Google Scholar 

  • Teitz, M.B., Bart, P.: Heuristic methods for estimating the generalized vertex median of a weighted graph. Oper. Res. 16(5), 955–961 (1968)

    Article  Google Scholar 

  • Tizhoosh, H.R.: Opposition-based learning: a new scheme for machine intelligence. In: Computational Intelligence for Modelling, Control and Automation, 2005 and International Conference on Intelligent Agents, Web technologies and Internet Commerce (CIMCA-IAWTIC’06), International Conference on, IEEE, Vienna, Austria, vol 1., pp. 695–701 (2005)

  • Vondrák, J.: Symmetry and approximability of submodular maximization problems. SIAM J. Comput. 42(1), 265–304 (2013)

    Article  MathSciNet  Google Scholar 

  • Wang, F., Lim, A.: A stochastic beam search for the berth allocation problem. Decis. Support Syst. 42(4), 2186–2196 (2007)

    Article  Google Scholar 

  • Whitaker, R.: A fast algorithm for the greedy interchange for large-scale clustering and median location problems. INFOR: Inf. Syst. Oper. Res. 21(2), 95–108 (1983)

Download references

Acknowledgements

This work was funded by ANID PIA/APOYO AFB180002, Centro Científico Tecnológico de Valparaíso - CCTVal, Universidad Técnica Federico Santa María, Valparaíso, Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02). F. Casas B. thanks CONICYT - PFCHA/Magister Nacional/2018 - folio 22182114, for funding his studies. We thank Dr. Stuart Rogers for providing advice and reporting errors during the development of our dc2 solver on which our experiments were executed, and for pointing us to the POPSTAR solver.

Funding

F. Casas B. thanks CONICYT - PFCHA/Magister Nacional/2018 - folio 22182114, for funding his studies. This work was funded by ANID PIA/APOYO AFB180002, Centro Científico Tecnológico de Valparaíso - CCTVal, Universidad Técnica Federico Santa María, Valparaíso, Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Francisco Casas.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Code Availability

Both an implementation of the algorithm and the experiments code is available online (https://github.com/autopawn/ds-experiments).

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

A Alternative distance for SPLP solutions

In this section we propose an alternative distance to compare SPLP solutions when the mean geometric error described in Sect. 4.5.2 is inconvenient, which we call per-client delta.

This distance does not require a distance between facilities \(d_{\text {facs}}(\cdot ,\cdot )\). Instead, it compares the costs of connecting each client in both solutions as if they were a vector of size M:

$$\begin{aligned} d(A,B)&= \sum _{j \in J} \left| g_{Aj} - g_{Bj} \right| \, . \end{aligned}$$

where \(g_{Sj}\) corresponds to the cost of the most convenient facility assignment within solution S for client j, as defined in Eq. 3.

It satisfies the triangle inequality since it corresponds to the \(L^1\) distance between these two vectors.

Under the assumption that each solution S stores its \(g_{Sj}\) values, the computational cost of computing this distance is \(\varTheta (M)\), which may be more convenient than the mean geometric error if solutions are large.

B Implementation details

To test both DS and other search strategies we developed a SPLP and p-median solver called dc2 whose source code is available onlineFootnote 1.

dc2 can perform DS as described in Algorithm 1, but it also supports restarts, different selection operators and combinations of them, as well as specifying different branching factors b. These configurations allow using dc2 as a GRASP, sample greedy, beam search, or stochastic beam search method.

Additionally, dc2 has support for Whitaker’s local search (Whitaker 1983), Path Relinking, and different solution distances \(d(\cdot ,\cdot )\). In order to solve big problem instances faster, this solver is also parallelized, but we only reported total CPU times in this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Casas, F., Torres, C.E. & Araya, I. A heuristic search based on diversity for solving combinatorial problems. J Heuristics 28, 287–328 (2022). https://doi.org/10.1007/s10732-022-09494-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10732-022-09494-4

Keywords

Navigation