Abstract
The RobuCup 2D Soccer Simulation has been used as the basis for successful international competitions and research challenges.When developing a soccer team for simulated soccer ,one has to deal with the RoboCup soccer simulator. In this simulation system, it is the Multiagents’ sensory perceptions and individual abilities which are received from the server, coupled with the cooperation strategies designed by researchers, that together determine whether the soccer team will win this game or not. In cooperation strategy designing, researchers often employ the method of Distributed Reinforcement Learning algorithms to optimize the simulation system. The paper is extended as follows: First, we will make a description of the characteristics about the RoboCup simulation system. Second, there is an analysis of the limitation about the traditonal application of Distributed Reinforcement Learning Algorithm, and a new solution will be advanced. Finally, Simulated results will be discussed and the paper comes to a conclusion.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Kitano, H., Asada, M., Osawa, E., Noda, I., Kuniyoshi, Y., Matsubara, H.: RoboCup: The Robot World Cup Initiative. In: First International Conference on Autonomous Agent (Agent 1997), pp. 26–28 (1997)
Kitano, H., Asada, M., Osawa, E., Noda, I., Kuniyoshi, Y., Matsubara, H.: RoboCup: A Challenge Problem for AI. J. AI Magazine 18(1), 11–15 (1997)
Kitano, H., Tambe, M., Stone, P., Veloso, M., Coradeschi, S., Osawa, E., Matsubara, H., Noda, I., Asada, M.: The RoboCup Synthetic Agent Challenge 97. In: Fifteenth International Joint Conference on Artificial Intelligence (IJCAI 1997), vol. 1, pp. 24–29 (1997)
Corten, E., Dorer, K., Heintz, F., Kostiadis, K., Kummeneje, J., Myritz, H., Noda, I., Riekki, J., Riley, P., Stone, P., Yeap, T.: Soccerserver Manual, http://ci.etl.go.jp/~noda/soccer/server/index.html
Noda, I.: Soccer Server: A Simulator for RoboCup. In: J. JSAI AI-Symposium 1995: Special Session on RoboCup, pp. 14–18 (December 1995)
Wu, B., Wu, M., Liu, X.D., Nie, Z.: A Hybrid Agent Architecture and Its Desision Algorithm. J. Shanghai: Computer Engineering, 33–36 (2004) (in Chinese)
Wu, M., Cao, W.H., Gui, W.H., Peng, J., She, J.H.: A New Multi-Agent System Architecture and Its Application in RoboCup. J. Beijing: Acta Automatica Sinica, 58–61 (2006) (in Chinese)
Zhong, Y., Gu, G.C., Zhang, R.B.: Survey Of Distributed Reinforcement Learning Algorithms in Multi-agent Systems. J. Guangzhou: Control Theory and Applications, 40–44 (2003) (in Chinese)
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, X., Chen, W., Zhai, Z., Wang, J. (2008). The Application of Hybrid Distributed Reinforcement Learning Algorithm in RoboCup 2D Soccer Simulation System. In: Xiong, C., Huang, Y., Xiong, Y., Liu, H. (eds) Intelligent Robotics and Applications. ICIRA 2008. Lecture Notes in Computer Science(), vol 5314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88513-9_70
Download citation
DOI: https://doi.org/10.1007/978-3-540-88513-9_70
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88512-2
Online ISBN: 978-3-540-88513-9
eBook Packages: Computer ScienceComputer Science (R0)