Loading [a11y]/accessibility-menu.js
A Problem Case for UCT | IEEE Journals & Magazine | IEEE Xplore

A Problem Case for UCT


Abstract:

This paper examines a simple 5 × 5 Hex position that not only completely defeats flat Monte Carlo search, but also initially defeats plain upper confidence bounds for tre...Show More

Abstract:

This paper examines a simple 5 × 5 Hex position that not only completely defeats flat Monte Carlo search, but also initially defeats plain upper confidence bounds for trees (UCT) search until an excessive number of iterations are performed. The inclusion of domain knowledge during playouts significantly improves UCT performance, but a slight negative effect is shown for the rapid action value estimate (RAVE) heuristic under some circumstances. This example was drawn from an actual game during standard play, and highlights the dangers of relying on flat Monte Carlo and unenhanced UCT search even for rough estimates. A brief comparison is made with RAVE failure in Go.
Page(s): 69 - 74
Date of Publication: 21 September 2012

ISSN Information:


References

References is not available for this document.