Abstract
We describe an approach for producing exploitive and adaptive case-based strategies in adversarial games. We describe how adaptation can be applied to a precomputed, static case-based strategy in order to allow the strategy to rapidly respond to changes in an opponent’s playing style. The exploitive strategies produced by this approach tend to hover around a precomputed solid strategy and adaptation is applied directly to the precomputed strategy once enough information has been gathered to classify the current opponent type. The use of a precomputed, seed strategy avoids performance degradation that can take place when little is known about an opponent. This allows our approach an advantage over other exploitive strategies whose playing decisions rely on large, individual opponent models constructed from scratch. We evaluate the approach within the experimental domain of two-player Limit Texas Hold’em poker.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ontañón, S., Mishra, K., Sugandh, N., Ram, A.: On-line case-based planning. Computational Intelligence 26(1), 84–119 (2010)
Sugandh, N., Ontañón, S., Ram, A.: On-line case-based plan adaptation for real-time strategy games. In: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, AAAI 2008, pp. 702–707 (2008)
Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First International Florida Artificial Intelligence Research Society Conference, pp. 251–256 (2008)
Rubin, J., Watson, I.: Similarity-Based Retrieval and Solution Re-use Policies in the Game of Texas Hold’em. In: Bichindaritz, I., Montani, S. (eds.) ICCBR 2010. LNCS, vol. 6176, pp. 465–479. Springer, Heidelberg (2010)
Auslander, B., Lee-Urban, S., Hogg, C., Muñoz-Avila, H.: Recognizing the Enemy: Combining Reinforcement Learning with Strategy Selection Using Case-Based Reasoning. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 59–73. Springer, Heidelberg (2008)
Gillespie, K., Karneeb, J., Lee-Urban, S., Muñoz-Avila, H.: Imitating Inscrutable Enemies: Learning from Stochastic Policy Observation, Retrieval and Reuse. In: Bichindaritz, I., Montani, S. (eds.) ICCBR 2010. LNCS, vol. 6176, pp. 126–140. Springer, Heidelberg (2010)
Johanson, M., Zinkevich, M., Bowling, M.H.: Computing robust counter-strategies. In: Advances in Neural Information Processing Systems 20, Proceedings of the Twenty-First Annual Conference on Neural Information Processing Systems (2007)
Rubin, J., Watson, I.: On combining decisions from multiple expert imitators for performance. In: IJCAI 2011, Proceedings of the 22nd International Joint Conference on Artificial Intelligence, pp. 344–349 (2011)
Billings, D., Davidson, A., Schauenberg, T., Burch, N., Bowling, M., Holte, R.C., Schaeffer, J., Szafron, D.: Game-Tree Search with Adaptation in Stochastic Imperfect-Information Games. In: van den Herik, H.J., Björnsson, Y., Netanyahu, N.S. (eds.) CG 2004. LNCS, vol. 3846, pp. 21–34. Springer, Heidelberg (2006)
Schauenberg, T.: Opponent modelling and search in poker. Master’s thesis. University of Alberta (2006)
Hammond, K.J.: Case-based planning: A framework for planning from experience. Cognitive Science 14(3), 385–443 (1990)
Muñoz-Avila, H., Cox, M.T.: Case-based plan adaptation: An analysis and review. IEEE Intelligent Systems 23(4), 75–81 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rubin, J., Watson, I. (2012). Opponent Type Adaptation for Case-Based Strategies in Adversarial Games. In: Agudo, B.D., Watson, I. (eds) Case-Based Reasoning Research and Development. ICCBR 2012. Lecture Notes in Computer Science(), vol 7466. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32986-9_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-32986-9_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32985-2
Online ISBN: 978-3-642-32986-9
eBook Packages: Computer ScienceComputer Science (R0)