Abstract
The game of checkers can be played by machines running either heuristic search algorithms or complex decision making programs trained using machine learning techniques. The first approach has been used with remarkable success. The latter approach yielded encouraging results in the past, but later results were not so useful, partly because of the limitations of current machine learning algorithms. The focus of this work is the study of techniques for distributed decision making and learning by Multi-Agent DEcision Systems (MADES), by means of their application to the development of a checkers playing program. In this paper, we propose a new architecture for knowledge based systems dedicated to checkers playing. Our aim is to show how the combination of several known models for checkers playing can be integrated into a MADES, that learns how to combine individual decisions, so that the MADES plays better than any of them, without “a priori” knowledge of the quality or area of expertise of each model. In our MADES, we integrate well known search algorithms along standard machine learning algorithms. We present results that clearly show that the team as a single entity plays better than any of its components working in isolation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hans Berliner and Murray Campbell. Using chunking to solve chess pawn endgames. Artificial Intelligence Journal, 23:97–120, 1984.
Susan L. Epstein. Heuristic Programming in Artificial Intelligence, chapter The Intelligent Novice. Learning to Play Better, pages 273–284. Ellis Horwood, 1989.
Jos I. Girldez and Daniel Borrajo. The intelligent agents organization. In Eugnio Oliveira and Nick Jennings, editors, Proceedings of the Workshop on Multi-Agent Systems: Theory and Applications (MASTA’97), pages 43–56, Coimbra, Portugal, October 1997.
Jos I. Girldez and Daniel Borrajo. Distributed reinforcement learning in multiagent decision systems. In Helder Coelho, editor, Progress in Artificial Intelligence, Iberamia 98, number LNAI 1484 in Lecture Notes in Artificial Intelligence, pages 148–159, Lisboa, Portugal, October 1998. Springer-Verlag.
Kai-Fu Lee and Sanjoy Mahajan. A pattern classification approach to evaluation function learning. Artificial Intelligence Journal, 36:1–25, 1988.
J. Ross Quinlan. Learning efficient classifiation procedures and their application to chess end games. In R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, editors, Machine Learning, An Artificial Intelligence Approach, Volume I. Morgan Kaufman, 1983.
J. Ross Quinlan. Induction of decision trees. Machine Learning, 1(1):81–106, 1986.
J. Ross Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA, 1993.
L. De Raedt and M. Bruynooghe. Interactive concept-learning and constructive induction by analogy. Machine Learning, 8(2):107–150, March 1992.
D.E. Rummelhart, J.L. McClelland, and the PDP Research Group. Parallel Distributed Processing Foundations. The MIT Press, Cambridge, MA, 1986.
Arthur Samuel. Some studies in machine learning using the game of checkers. In E. Feigenbaum and J. Feldman, editors, Computers and Thought. McGraw-Hill, New York, NY, 1963.
Jonathan Schaeffer. DB5: Checkers endgames database. ftp://ftp.cs.ualberta.ca:/pub/chinook/DB5/, 1994.
Jonathan Schaeffer, Robert Lake, Paul Lu, and Martin Bryant. Chinook, the world man-machine checkers champion. AI Magazine, 17(1):21–29, Spring 1996.
J.Q. Smith. Decision Analysis, a Bayesian Approach. Chapman & Hall, 1988.
Gerald Tesauro. Practical issues in temporal difference learning. Machine Learning, 8(3/4):257–277, May 1992.
G. Weiss. Some studies in distributed machine learning and organizational design. Technical Report FKI-189-94, Institut fur Informatik, Technische Universität München, 1994.
M. A. Wiering. TD learning of game evaluation functions with hierarchical neural architectures. Master’s thesis, University of Amsterdam, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giráldez, J.I., Borrajo, D. (1999). Distributed Decision Making in Checkers. In: van den Herik, H.J., Iida, H. (eds) Computers and Games. CG 1998. Lecture Notes in Computer Science, vol 1558. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48957-6_11
Download citation
DOI: https://doi.org/10.1007/3-540-48957-6_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65766-8
Online ISBN: 978-3-540-48957-3
eBook Packages: Springer Book Archive