Skip to main content
Log in

Greedy and Local Search Heuristics for Unconstrained Binary Quadratic Programming

  • Published:
Journal of Heuristics Aims and scope Submit manuscript

Abstract

In this paper, a greedy heuristic and two local search algorithms, 1-opt local search and k-opt local search, are proposed for the unconstrained binary quadratic programming problem (BQP). These heuristics are well suited for the incorporation into meta-heuristics such as evolutionary algorithms. Their performance is compared for 115 problem instances. All methods are capable of producing high quality solutions in short time. In particular, the greedy heuristic is able to find near optimum solutions a few percent below the best-known solutions, and the local search procedures are sufficient to find the best-known solutions of all problem instances with n ≤ 100. The k-opt local searches even find the best-known solutions for all problems of size n ≤ 250 and for 11 out of 15 instances of size n = 500 in all runs. For larger problems (n = 500, 1000, 2500), the heuristics appear to be capable of finding near optimum solutions quickly. Therefore, the proposed heuristics—especially the k-opt local search—offer a great potential for the incorporation in more sophisticated meta-heuristics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alidaee, B., B.G. Kochenberger, and A. Ahmadian. (1994). “0-1 Quadratic Programming Approach for the Optimal Solution of Two Scheduling Problems.” International Journal of Systems Science 25, 401–408.

    Google Scholar 

  • Amini, M.M., B. Alidaee, and G.A. Kochenberger. (1999). “AScatter Search Approach to Unconstrained Quadratic Binary Programs.” In D. Corne, M. Dorigo, and F. Glover (eds.), New Ideas in Optimization. London: McGraw-Hill, pp. 317–329.

    Google Scholar 

  • Barahona, F., M. Jünger, and G. Reinelt. (1989). “Experiments in Quadratic 0-1 Programming.” Mathematical Programming 44, 127–137.

    Google Scholar 

  • Battiti, R. and A. Bertossi. (1998). “Differential Greedy for the 0-1 Equicut Problem.” In D. Du and P. Pardalos (eds.), Proceedings of the DIMACSWorkshop on Network Design: Connectivity and Facilities Location, Vol. 40 of DIMACS Series in Discrete Mathematics and Theoretical Computer Science. Providence, RI: American Mathematical Society, pp. 3–21.

    Google Scholar 

  • Beasley, J.E. (1990). “OR-Library: Distributing Test Problems by Electronic Mail.” Journal of the Operational Research Society 41(11), 1069–1072.

    Google Scholar 

  • Beasley, J.E. (1998). “Heuristic Algorithms for the Unconstrained Binary Quadratic Programming Problem.” Technical Report, Management School, Imperial College, London, UK.

    Google Scholar 

  • Billionnet, A. and A. Sutter. (1994). “Minimization of a Quadratic Pseudo-Boolean Function.” European Journal of Operational Research 78, 106–115.

    Google Scholar 

  • Corne, D., M. Dorigo, and F. Glover (eds.) (1999). New Ideas in Optimization. London: McGraw-Hill.

    Google Scholar 

  • Gallo, G., P.L. Hammer, and B. Simeone. (1980). “Quadratic Knapsack Problems.” Mathematical Programming 12, 132–149.

    Google Scholar 

  • Garey, M.R. and D.S. Johnson. (1979). Computers and Intractability: A Guide to the Theory of NP-Completeness. New York: Freeman.

    Google Scholar 

  • Glover, F., G.A. Kochenberger, and B. Alidaee. (1998a). “Adaptive Memory Tabu Search for Binary Quadratic Programs.” Management Science 44(3), 336–345.

    Google Scholar 

  • Glover, F., G. Kochenberger, B. Alidaee, and M. Amini. (1998b). “Tabu Search with Critical Event Memory: An Enhanced Application for Binary Quadratic Programs.” In S. Voss, S. Martello, I. Osman, and C. Roucairol (eds.), Meta-Heuristics—Advances and Trends in Local Search Paradigms for Optimization. Dordrecht: Kluwer Academic Publishers, pp. 83–109.

    Google Scholar 

  • Helmberg, C. and F. Rendl. (1998). “Solving Quadratic (0,1)-Problems by Semidefinite Programs and Cutting Planes.” Mathematical Programming 82, 291–315.

    Google Scholar 

  • Ivănescu, P.L. (1965). “Some Network Flow Problems Solved with Pseudo-Boolean Programming.” Operations Research 13, 388–399.

    Google Scholar 

  • Katayama, K. and H. Narihisa. (1999). “Performance of Simulated Annealing-Based Heuristic for the Unconstrained Binary Quadratic Programming Problem.” Technical Report, Dept. of Information and Computer Engineering, Okayama University of Science, Okayama, Japan.

    Google Scholar 

  • Katayama, K. and H. Narihisa. (2000). “Solving Large Binary Quadratic Programming Problems by Effective Genetic Local Search Algorithm.” In GECCO-2000: Proceedings of the Genetic and Evolutionary Computation Conference. San Mateo, CA: Morgan Kaufman, pp. 643–650.

    Google Scholar 

  • Kauffman, S.A. and S. Levin. (1987). “Towards a General Theory of Adaptive Walks on Rugged Landscapes.” Journal of Theoretical Biology 128, 11–45.

    Google Scholar 

  • Kernighan, B. and S. Lin. (1972). “An Efficient Heuristic Procedure for Partitioning Graphs.” Bell Systems Journal 49, 291–307.

    Google Scholar 

  • Krarup, J. and P.M. Pruzan. (1978). “Computer-Aided Layout Design.” Mathematical Programming Study 9, 75–94.

    Google Scholar 

  • Laughunn, D.J. (1970). “Quadratic Binary Programming.” Operations Research 14, 454–461.

    Google Scholar 

  • Lin, S. and B. Kernighan. (1973). “An Effective Heuristic Algorithm for the Traveling Salesman Problem.” Operations Research 21, 498–516.

    Google Scholar 

  • Lodi, A., K. Allemand, and T.M. Liebling. (1999). “An Evolutionary Heuristic for Quadratic 0-1 Programming.” European Journal of Operational Research 119, 662–670.

    Google Scholar 

  • McBride, R.D. and J.S. Yormark. (1980). “An Implicit Enumeration Algorithm for Quadratic Integer Programming.” Management Science 26(3), 282–296.

    Google Scholar 

  • Merz, P. (2000). “Memetic Algorithms for Combinatorial Optimization Problems: Fitness Landscapes and Effective Search Strategies.” Ph.D. Thesis, Department of Electrical Engineering and Computer Science, University of Siegen, Germany.

    Google Scholar 

  • Merz, P. and B. Freisleben. (1999a). “Genetic Algorithms for Binary Quadratic Programming.” In W. Banzhaf, J. Daida, A.E. Eiben, M.H. Garzon, V. Honavar, M. Jakiela, and R.E. Smith (eds.), GECCO-1999: Proceedings of the Genetic and Evolutionary Computation Conference. San Mateo, CA: Morgan Kaufman, pp. 417–424.

    Google Scholar 

  • Merz, P. and B. Freisleben. (1999b). “Fitness Landscapes and Memetic Algorithm Design.” In D. Corne, M. Dorigo, and F. Glover (eds.), New Ideas in Optimization. London: McGraw-Hill, pp. 245–260.

    Google Scholar 

  • Merz, P. and B. Freisleben. (2000). “Fitness Landscapes, Memetic Algorithms and Greedy Operators for Graph Bi-Partitioning.” Evolutionary Computation 8(1), 61–91.

    Google Scholar 

  • Moscato, P. (1989). “On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts: Towards Memetic Algorithms.” Technical Report No. 790, Caltech Concurrent Computation Program, California Institue of Technology.

  • Moscato, P. (1999). “Memetic Algorithms: A Short Introduction.” In D. Corne, M. Dorigo, and F. Glover (eds.), New Ideas in Optimization. London: McGraw-Hill, pp. 219–234.

    Google Scholar 

  • Pardalos, P.M. and G.P. Rodgers. (1990). “Computational Aspects of a Branch and Bound Algorithm for Unconstrained Quadratic Zero-One Programming.” Computing 45, 131–144.

    Google Scholar 

  • Pardalos, P.M. and G.P. Rodgers. (1992). “A Branch and Bound Algorithm for the Maximum Clique Problem.” Computers and Operations Research 19(5), 363–375.

    Google Scholar 

  • Pardalos, P.M. and J. Xue. (1994). “The Maximum Clique Problem.” Journal of Global Optimization 4, 301–328.

  • Phillips, A.T. and J.B. Rosen. (1994). “A Quadratic Assignment Formulation for the Molecular Conformation Problem.” Journal of Global Optimization 4, 229–241.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Merz, P., Freisleben, B. Greedy and Local Search Heuristics for Unconstrained Binary Quadratic Programming. Journal of Heuristics 8, 197–213 (2002). https://doi.org/10.1023/A:1017912624016

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1017912624016

Navigation