Abstract
Reinforcement learning has been successfully applied to several subtasks in the RoboCup simulated soccer domain. Keepaway is one such task. One notable success in the keepaway domain has been the application of SMDP Sarsa(λ) with tile-coding function approximation [9]. However, this success was achieved with the help of some significant task simplifications, including the delivery of complete, noise-free world-state information to the agents. Here we demonstrate that this task simplification was unnecessary and further extend the previous empirical results on this task.
Chapter PDF
References
Albus, J.S.: Brains, Behavior, and Robotics. Byte Books, Peterborough (1981)
Balch, T.: Teambots (2000), http://www.teambots.org
Balch, T.: Teambots domain: Soccerbots (2000), http://www-2.cs.cmu.edu/~trb/TeamBots/Domains/SoccerBots
RoboCup Soccer Simulator Maintenance Group. The robocup soccer simulator (2003), http://sserver.sourceforge.net
Hsu, W.H., Gustafson, S.M.: Genetic programming and multi-agent layered learning by reinforcements. In: Genetic and Evolutionary Computation Conference, New York, NY (July 2002)
Di Pietro, A., While, L., Barone, L.: Learning in RoboCup keepaway using evolutionary algorithms. In: Langdon, W.B., Cantú-Paz, E., Mathias, K., Roy, R., Davis, D., Poli, R., Balakrishnan, K., Honavar, V., Rudolph, G., Wegener, J., Bull, L., Potter, M.A., Schultz, A.C., Miller, J.F., Burke, E., Jonoska, N. (eds.) GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference, New York, July 9-13, pp. 1065–1072. Morgan Kaufmann Publishers, San Francisco (2002)
Riedmiller, M., Merke, A., Meier, D., Hoffman, A., Sinner, A., Thate, O., Ehrmann, R.: Karlsruhe brainstormers – a reinforcement learning approach to robotic soccer. In: Stone, P., Balch, T., Kraetzschmar, G.K. (eds.) RoboCup 2000. LNCS (LNAI), vol. 2019, p. 367. Springer, Heidelberg (2001)
Stone, P., Riley, P., Veloso, M.: The CMUnited-99 champion simulator team. In: Veloso, M.M., Pagello, E., Kitano, H. (eds.) RoboCup 1999. LNCS (LNAI), vol. 1856, pp. 35–48. Springer, Heidelberg (2000)
Stone, P., Sutton, R.S.: Scaling reinforcement learning toward RoboCup soccer. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 537–544. Morgan Kaufmann, San Francisco (2001)
Stone, P., Veloso, M.: Team-partitioned, opaque-transition reinforcement learning. In: Asada, M., Kitano, H. (eds.) RoboCup 1998. LNCS (LNAI), vol. 1604, pp. 261–272. Springer, Heidelberg (1999); Also in Proceedings of the Third International Conference on Autonomous Agents (1999)
Whiteson, S., Stone, P.: Concurrent layered learning. In: Second International Joint Conference on Autonomous Agents and Multiagent Systems (July 2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kuhlmann, G., Stone, P. (2004). Progress in Learning 3 vs. 2 Keepaway. In: Polani, D., Browning, B., Bonarini, A., Yoshida, K. (eds) RoboCup 2003: Robot Soccer World Cup VII. RoboCup 2003. Lecture Notes in Computer Science(), vol 3020. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25940-4_68
Download citation
DOI: https://doi.org/10.1007/978-3-540-25940-4_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22443-3
Online ISBN: 978-3-540-25940-4
eBook Packages: Springer Book Archive