Abstract
We describe the reciprocal agents that build virtual associations in accordance with past cooperative work in a bottom-up manner and that allocate tasks or resources preferentially to agents in the same associations in busy large-scale distributed environments. Models of multi-agent systems (MAS) are often used to express tasks that are done by teams of cooperative agents, so how each subtask is allocated to appropriate agents is a central issue. Particularly in busy environments where multiple tasks are requested simultaneously and continuously, simple allocation methods in self-interested agents result in conflicts, meaning that these methods attempt to allocate multiple tasks to one or a few capable agents. Thus, the system’s performance degrades. To avoid such conflicts, we introduce reciprocal agents that cooperate with specific agents that have excellent mutual experience of cooperation. They then autonomously build associations in which they try to form teams for new incoming tasks. We introduce the N-agent team formation (TF) game, an abstract expression of allocating problems in MAS by eliminating unnecessary and complicated task and agent specifications, thereby identifying the fundamental mechanism to facilitate and maintain associations. We experimentally show that reciprocal agents can considerably improve performance by reducing the number of conflicts in N-agent TF games with different N values by establishing association structures. We also investigate how learning parameters to decide reciprocity affect association structures and which structure can achieve efficient allocations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bardhan, R., Ghose, D.: Resource allocation and coalition formation for UAVs: a cooperative game approach. In: Proceedings of the 2013 IEEE International Conference on Control Applications, pp. 1200–1205 (2013)
Boloni, L., Khan, M., Turgut, D.: Agent-based coalition formation in disaster response applications. In: IEEE Workshop on Distributed Intelligent Systems: Collective Intelligence and Its Applications, pp. 259–264 (2006)
Bornstein, G., Yaniv, I.: Individual and group behavior in the ultimatum game: are groups more “rational” players? Exp. Econ. 1(1), 101–108 (1998)
Bowles, S., Choi, J.K., Hopfensitz, A.: The co-evolution of individual behaviors and social institutions. J. Theor. Biol. 223(2), 135–147 (2003)
Bowles, S., Fehr, E., Gintis, H.: Strong procity may evolve with or without group selection. Theor. Primatol. Proj. Newsl. 1(12), 1–25 (2003)
Chalkiadakis, G., Boutilier, C.: Sequentially optimal repeated coalition formation under uncertainty. Auton. Agent. Multi-Agent Syst. 24(3), 441–484 (2012)
Dunin-Keplicz, B.M., Verbrugge, R.: Teamwork in Multi-Agent Systems: A Formal Approach, 1st edn. Wiley Publishing, Hoboken (2010)
Faye, P., Aknine, S., Sene, M., Sheory, O.: Stabilizing agent’s interactions in dynamic contexts. In: Proceedings of the IEEE 28th International Conference on Advanced Information Networking and Applications, AINA 2014, pp. 925–932 (2014)
Fehr, E., Fischbacher, U.: Why social preferences matter - the impact of non-selfish motives on competition. Econ. J. 112(478), C1–C33 (2002)
Fehr, E., Fischbacher, U.: Third-party punishment and social norms. Evol. Hum. Behav. 25(2), 63–87 (2004)
Fehr, E., Fischbacher, U., Gächter, S.: Strong reciprocity, human cooperation, and the enforcement of social norms. Hum. Nat. 13(1), 1–25 (2002)
Gintis, H.: Strong reciprocity and human sociality. J. Theor. Biol. 206(2), 169–179 (2000)
Glinton, R., Scerri, P., Sycara, K.: Agent-based sensor coalition formation. In: 2008 11th International Conference on Information Fusion, pp. 1–7 (2008)
Güth, W., Schmittberger, R., Schwarze, B.: An experimental analysis of ultimatum bargaining. J. Econ. Behav. Organ. 3(4), 367–388 (1982)
Hayano, M., Hamada, D., Sugawara, T.: Role and member selection in team formation using resource estimation for large-scale multi-agent systems. Neurocomput. 146, 164–172 (2014)
Jones, C.L.D., Barber, K.S.: Combining job and team selection heuristics. In: Hübner, J.F., Matson, E., Boissier, O., Dignum, V. (eds.) COIN@AAMAS 2008. LNCS, vol. 5428, pp. 33–47. Springer, Heidelberg (2009)
Kahneman, D., Knetsch, J.L., Thaler, R.H.: Fairness and the assumptions of economics. J. Bus. 59(4), S285–300 (1986)
Klusch, M., Gerber, A.: Dynamic coalition formation among rational agents. Intell. Syst. IEEE 17(3), 42–47 (2002)
Miyashita, Y., Hayano, M., Sugawara, T.: Association formation based on reciprocity for conflict avoidance in allocation problems. In: Proceedings of the 19th International Workshop on Coordination, Organizations, Institutions, and Norms in Multiagent Systems (COIN@AAMAS), pp. 143–157 (2015)
Miyashita, Y., Hayano, M., Sugawara, T.: Self-organizational reciprocal agents for conflict avoidance in allocation problems. In: 2015 IEEE 9th International Conference on Self-Adaptive and Self-Organizing Systems (SASO), pp. 150–155 (2015)
Panchanathan, K., Boyd, R.: Indirect reciprocity can stabilize cooperation without the second-order free rider problem. Nature 432(7016), 499–502 (2004)
Ray, D.: A Game-Theoretic Perspective on Coalition Formation. The Lipsey lectures. Oxford University Press, Oxford (2007)
Sheholy, O., Kraus, S.: Methods for task allocation via agent coalition formation. J. Artif. Intell. 101, 165–200 (1998)
Shiba, Y., Sugawara, T.: Fair assessment of group work by mutual evaluation based on trust network. In: Proceedings of 2014 IEEE Frontiers in Education Conference, IEEE FIE 2014, pp. 821–827 (2014)
Shoham, Y., Leyton-Brown, K.: Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge University Press, Cambridge (2008)
Sims, M., Goldman, C.V., Lesser, V.: Self-organization through bottom-up coalition formation. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 867–874. ACM (2003)
Sless, L., Hazon, N., Kraus, S., Wooldridge, M.: Forming coalitions and facilitating relationships for completing tasks in social networks. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, AAMAS 2014, pp. 261–268. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2014)
Smith, J.M.: Group selection. Q. Rev. Biol. 51(2), 277–283 (1976)
Wessner, M., Pfister, H.R.: Group formation in computer-supported collaborative learning. In: Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work, GROUP 2001, pp. 24–31. ACM, New York (2001)
Ye, D., Zhang, M., Sutanto, D.: Self-adaptation-based dynamic coalition formation in a distributed agent network: a mechanism and a brief survey. IEEE Trans. Parallel Distrib. Syst. 24(5), 1042–1051 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Miyashita, Y., Hayano, M., Sugawara, T. (2016). Formation of Association Structures Based on Reciprocity and Their Performance in Allocation Problems. In: Dignum, V., Noriega, P., Sensoy, M., Sichman, J. (eds) Coordination, Organizations, Institutions, and Norms in Agent Systems XI. COIN 2015. Lecture Notes in Computer Science(), vol 9628. Springer, Cham. https://doi.org/10.1007/978-3-319-42691-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-42691-4_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42690-7
Online ISBN: 978-3-319-42691-4
eBook Packages: Computer ScienceComputer Science (R0)