Abstract
We have developed a Soccer simulator in Java, which allows us to evaluate agent behavioral strategies for effectively collaborating with other team members while countering threats posed by the opposing team. Whereas action selection mechanisms to decide when to shoot, pass, dribble, guard opponent, tackle, etc. are important from a player's viewpoint, learning the capabilities of individual opponents from repeated encounters can provide critical information for the success of a team. Each agent is described by a set of skill levels for different soccer skills. A soccer agent uses its incomplete perceptions, model of the changing environment, knowledge of the skill levels of its own team players, and estimated skill levels of the opponent team players to select the most prudent action. In this paper, we identify learning opportunities for soccer agents, and investigate some of these possibilities in detail. Initial experimental results demonstrate the advantage of learning agents.
Preview
Unable to display preview. Download preview PDF.
References
M. Asada, E. Uchibe, S. Noda, S. Tawaratsumida, and K. Hosoda. Coordination of multiple behaviors acquired by vision-based reinforcement learning. In Proc. of International Conference on Intelligent Robots and Systems, pages 917–924, 1994.
Jerry Banks and II John S. Carson. Discrete-Event System Simulation. Prentice-Hall, 1984.
Anne Collinot, Alexis Drogoul, and Philippe Benhamou. Agent oriented design of a soccer robot team. In Proceedings of Second Internationa Conference on Multi-agents Systems (ICMAS'96), pages 41–47, Menlo Park, CA, 1996. AAAI Press.
David Flanagan. Java in Nutshell. O'Reilly, 1996.
Steve Hanks, Martha E. Pollack, and Paul R. Cohen. Benchmarks, test beds, controlled experimentation, and the design of agent architectures. AI Magazine, 14(4):17–42, Winter 1993.
William W. Hines and Douglas C. Montgomery. Probability and statistics in engneering and management science, 2nd ed. John Wiley & Sons, New York, NY, 1980.
L.P. Kaelbling, Michael L. Littman, and Andrew W. Moore. Reinforcement learning: A survey. Journal of AI Research, 4:237–285, 1996.
Hiroaki Kitano, Minora Asad, Yasuo Kuniyoshi, Itsuki Noda, and Eiichi Osawa. Robocup: The robot world cup initiative. In Working Notes of the IJCAI-95 Workshop on Adaptation and Learning in Multiagent Systems, August 1995.
Hitoshi Matsubara, Itsuki Noda, and Kazuo Hiraki. Learning of cooperative actions in multiagent systems: A case study of pass play in soccer. In Sandip Sen, editor, Working Notes for the AAAI Symposium on Adaptation, Co-evolution and Learning in Multiagent Systems, pages 63–67, Stanford University, CA, March 1996.
Robocup: The robot world cup. URL: http://www.csl.sony.co.jp/person/kitano/RoboCup/RoboCup.html. Announcement for the first RoboCup competition to be held at IJCAI-97.
D.E. Rumelhart, G.E. Hinton, and R.J. Williams. Learning internal representations by error propagation. In D.E. Rumelhart and J.L. McClelland, editors, Parallel Distributed Processing, volume 1. MIT Press, Cambridge, MA, 1986.
Peter Stone and Manuela Veloso. Collaborative and adversarial learning: A case study in robotic soccer. In Sandip Sen, editor, Working Notes for the AAAI Symposium on Adaptation, Co-evolution and Learning in Multiagent Systems, pages 88–92, Stanford University, CA, March 1996.
Philip D. Jr. Straffin. Topics in the theory of voting. The UMAP expository monograph series. Birkhauser, Boston, MA, 1980.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nadella, R., Sen, S. (1997). Correlating internal parameters and external performance: Learning Soccer Agents. In: Weiß, G. (eds) Distributed Artificial Intelligence Meets Machine Learning Learning in Multi-Agent Environments. LDAIS LIOME 1996 1996. Lecture Notes in Computer Science, vol 1221. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62934-3_46
Download citation
DOI: https://doi.org/10.1007/3-540-62934-3_46
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62934-4
Online ISBN: 978-3-540-69050-4
eBook Packages: Springer Book Archive