Skip to main content

Why adding more constraints makes a problem easier for hill-climbing algorithms: Analyzing landscapes of CSPs

  • Session 5b
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1330))

Abstract

It is well known that constraint satisfaction problems (CSPs) in the phase transition region are most difficult for complete search algorithms. On the other hand, for incomplete hill-climbing algorithms, problems in the phase transition region are more difficult than problems beyond the phase transition region, i.e., more constrained problems. This result seems somewhat unnatural since these more constrained problems have fewer solutions than the phase transition problems.

In this paper, we clarify the cause of this paradoxical phenomenon by exhaustively analyzing the state-space landscape of CSPs, which is formed by the evaluation values of states. The analyses show that by adding more constraints, while the number of solutions decreases, the number of local-minima also decreases, thus the number of states that are reachable to solutions increases. Furthermore, the analyses clarify that the decrease in local-minima is caused by a set of interconnected local-minima (basin) being divided into smaller regions by adding more constraints.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cheeseman, P., Kanefsky, B., and Taylor, W.: Where the really hard problems are, Proceedings of the Twelfth International Joint Conference on Artificial Intelligence (1991) 331–337

    Google Scholar 

  2. Clark, D. A., Frank, J., Gent, I. P., MacIntyre, E., Tomv, N., and Walsh, T.: Local Search and the Number of Solutions, Proceedings of the Second International Conference on Principles and Practice of Constraint Programming (Lecture Notes in Computer Science 1118), Springer-Verlag (1996) 119–133

    Google Scholar 

  3. Gent, I. P. and Walsh, T.: Towards an Understanding of Hill-climbing Procedures for SAT, Proceedings of the Eleventh National Conference on Artificial Intelligence (1993) 28–33

    Google Scholar 

  4. Hertz, A., Jaumard, B., and de Aragao, M. P.: Local optima topology for the k-coloring problem, Discrete Applied Mathematics, Vol. 49, (1994) 257–280

    Google Scholar 

  5. Hogg, T., Huberman, B. A., and Williams, C. P.: Phase transitions and the search problem, Artificial Intelligence, Vol. 81, No. 1–2, (1996) 1–16

    Google Scholar 

  6. Ishida, T.: Real-Time Bidirectional Search: Coordinated Problem Solving in Uncertain Situations, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No. 6, (1996) 617–628

    Google Scholar 

  7. Mitchell, D., Selman, B., and Levesque, H.: Hard and Easy Distributions of SAT Problem, Proceedings of the Tenth National Conference on Artificial Intelligence (1992) 459–465

    Google Scholar 

  8. Morris, P.: The Breakout Method for Escaping From Local Minima, Proceedings of the Eleventh National Conference on Artificial Intelligence (1993) 40–45

    Google Scholar 

  9. Selman, B. and Kautz, H.: Domain-Independent Extensions to GSAT: Solving Large Structured Satisfiability Problems, Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence (1993) 290–295

    Google Scholar 

  10. Selman, B., Levesque, H., and Mitchell, D.: A New Method for Solving Hard Satisfiability Problems, Proceedings of the Tenth National Conference on Artificial Intelligence (1992) 440–446

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Gert Smolka

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yokoo, M. (1997). Why adding more constraints makes a problem easier for hill-climbing algorithms: Analyzing landscapes of CSPs. In: Smolka, G. (eds) Principles and Practice of Constraint Programming-CP97. CP 1997. Lecture Notes in Computer Science, vol 1330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0017451

Download citation

  • DOI: https://doi.org/10.1007/BFb0017451

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-63753-0

  • Online ISBN: 978-3-540-69642-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics