Abstract
Toward learning cooperative behavior for any number of agents, this paper proposes a multi-agent reinforcement learning method without communication, called PMRL-based Learning for Any number of Agents (PLAA). PLAA prevents from agents reaching the purpose for spending too many times, and to promote the local multi-agent cooperation without communication by PMRL as a previous method. To guarantee the effectiveness of PLAA, this paper compares PLAA with Q-learning, and two previous methods in 10 kinds of the maze for the 2 and 3 agents. From the experimental result, we revealed those things: (a) PLAA is the most effective method for cooperation among 2 and 3 agents; (b) PLAA enable the agents to cooperate with each other in small iterations.
This work was supported by JSPS KAKENHI Grant Number JP17J08724.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
de Cote, E.M., Lazaric, A., Restelli, M.: Learning to cooperate in multi-agent social dilemmas. In: AAMAS, pp. 783–785, May 2006
Iwashita, H., Ohori, K., Anai, H., Iwasaki, A.: Simplifying urban network security games with cut-based graph contraction. In: Proceedings of the 2016 International Conference on Autonomous Agents and #38; Multiagent Systems, AAMAS 2016, Richland, SC, pp. 205–213. International Foundation for Autonomous Agents and Multiagent Systems (2016)
Tuyls, K., Verbeeck, K., Lenaerts, T.: A selection-mutation model for q-learning in multi-agent systems. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 693–700. ACM, July 2003
Sen, S., Sekaran, M., Hale, J., et al.: Learning to coordinate without sharing information. In: AAAI, pp. 426–431 (1994)
Sutton, R.S., Barto, A.G.: Introduction to Reinforcement Learning, 1st edn. MIT Press, Cambridge (1998)
Tan, M.: Multi-agent reinforcement learning: independent vs. cooperative agents. In: Proceedings of the Tenth International Conference on Machine Learning, pp. 330–337. Morgan Kaufmann (1993)
Uwano, F., Takadama, K.: Comparison between reinforcement learning methods with different goal selections in multi-agent cooperation (special issue on cutting edge of reinforcement learning and its applications). J. Adv. Comput. Intell. Intell. Inf. 21(5), 917–929 (2017)
Watkins, C.J.C.H.: Learning from Delayed Rewards. Ph.D. thesis, King’s College (1989)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Uwano, F., Takadama, K. (2018). Strategy for Learning Cooperative Behavior with Local Information for Multi-agent Systems. In: Miller, T., Oren, N., Sakurai, Y., Noda, I., Savarimuthu, B.T.R., Cao Son, T. (eds) PRIMA 2018: Principles and Practice of Multi-Agent Systems. PRIMA 2018. Lecture Notes in Computer Science(), vol 11224. Springer, Cham. https://doi.org/10.1007/978-3-030-03098-8_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-03098-8_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03097-1
Online ISBN: 978-3-030-03098-8
eBook Packages: Computer ScienceComputer Science (R0)