Introduction
Game theory provides useful mathematical tools to understand the possible strategies that self-interested agents may follow when choosing an action. The context of evolution of cooperation has been extensively studied seeking general theoretical frameworks like the Prisoner’s Dilemma (PD) [2]. In his seminal work, Axelrod has shown that cooperation can emerge in a society of individuals with selfish motivations. Since that, Game Theory and the Prisoner’s Dilemma have been applied in biological, social, economical and ecological contexts. An interesting spatial version of the PD has been suggested and deeply analyzed in [22] trying to understand the role of local interactions in the emergence and maintenance of cooperation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aumman, Myerson: Endogenous formation of links between players and coalitions: An application of the Shapley value. Cambridge University Press, Cambridge (1988)
Axelrod, R.: The Evolution of Cooperation. Basic Books, New York (1984)
Axelrod, R.: The Complexity of Cooperation: Agent-based Models of Competition and Collaboration. Princeton University Press, Princeton (1997)
Axelrod, R.: On six advances in cooperation theory. In: Analyse und Kritik - Special Edition on the Evolution of Cooperation (2000)
Bazzan, A.L.C.: Joint learning in stochastic games: Playing coordination games within coalitions. In: Proc. of the Adaptive Learning Agents, ALA 2009 (2009)
Bellman, R., Berkovic, S.: Social Structure: A Network Approach. Cambridge University, Cambridge (1988)
Binmore, K.: Game theory and the social contract volume I: Playing fair. The MIT Press, Cambridge (1994)
Burguillo-Rial, J.C.: A memetic framework for describing and simulating spatial prisoner’s dilemma with coalition formation. In: AAMAS 2009: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, pp. 441–448 (2009)
d’Aspremont, C., Jacquemin, A., Gabszewicz, J.J.: On the stability of collusive price leadership. Canadian Journal of Economics 16(1), 17–25 (1983)
George, J.M., Pinto, J., Sujit, P.B., Sousa, J.B.: Multiple UAV coalition formation strategies. In: AAMAS 2010: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, pp. 1503–1504 (2010)
Gruszczyk, W., Kwaśnicka, H.: Coalition formation in multi-agent systems an evolutionary approach. In: International Multiconference on Computer Science and Information Technology, MCSIT 2008, pp. 125–130 (2008)
Hoffmann, R.: Twenty years on: The evolution of cooperation revisited. J. Artif. Societies and Social Simulation 3(2) (2000)
Jackson, M.O., Watts, A.: On the formation of interaction networks in social coordination games. Games and Economic Behavior 41, 265–291 (2000)
Jackson, M.O., Demange, G., Goyal, S., Van Den Nouwel, A.: A survey of models of network formation: stability and efficiency. In: Group Formation in Economics: Networks, Clubs and Coalitions. Cambridge University Press, Cambridge (2003)
Langer, P., Nowak, M.A., Hauert, C.: Spatial invasion of cooperation. Journal of Theoretical Biology 250(4), 634–641 (2008)
Lau, H.C., Zhang, L.: Task allocation via multi-agent coalition formation: Taxonomy, algorithms and complexity. In: IEEE International Conference on Tools with Artificial Intelligence, p. 346 (2003)
Lau, H.C., Zhang, L.: A two-level framework for coalition formation via optimization and agent negotiation. In: IAT 2004: Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology, pp. 441–445. IEEE Computer Society, Washington, DC, USA (2004)
Low, K.H., Leow, W.K., Ang, M.H.: Task allocation via self-organizing swarm coalitions in distributed mobile sensor network. In: AAAI 2004: Proceedings of the 19th national conference on Artifical intelligence, pp. 28–33. AAAI Press/The MIT Press (2004)
Michalak, T., Marciniak, D., Szamotulski, M., Rahwan, T., Wooldridge, M., McBurney, P., Jennings, N.: A logic-based representation for coalitional games with externalities. In: Autonomous Agents And MultiAgent Systems (AAMAS 2010), pp. 125–132 (2010)
Narendra, K.S., Thathachar, M.A.L.: Learning automata: an introduction. Prentice-Hall, Inc., Upper Saddle River (1989)
Nguyen, D., Ishida, Y.: Spatial dilemma strategies of intelligent agents: Coalition formation in environmental game. In: International Conference on Knowledge and Systems Engineering, pp. 126–129 (2009)
Nowak, M.A., May, R.M.: Evolutionary games and spatial chaos. Nature 359(6398), 826–829 (1992)
Osborne, M.J.: An Introduction to Game Theory. Oxford University Press, USA (2003)
Ramchurn, S.D., Polukarov, M., Farinelli, A., Jennings, N., Trong, C.: Coalition formation with spatial and temporal constraints. In: International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2010), pp. 1181–1188 (2010)
Sandholm, T., Larson, K., Andersson, K.M., Shehory, O., Tohme, F.: Coalition structure generation with worst case guarantees. Artificial Intelligence (1999)
Schweitzer, F., Behera, L., Muehlenbein, H.: Evolution of Cooperation in a Spatial Prisoner’s Dilemma. Advances in Complex systems 5(2-3), 269–299 (2002)
Selten, R.: A simple model of imperfect competition when 4 are few and 6 are many. International Journal of Game Theory 2, 141–201 (1973)
Seo, Y., Cho, S., Yao, X.: Emergence of cooperative coalition in NIPD game with localization of interaction and learning. In: Proc of Congress on Evolutionary Computation (CEC 1999), pp. 877–884. IEEE Press, Piscataway (1999)
Seo, Y., Cho, S., Yao, X.: Exploiting coalition in co-evolutionary learning. In: Proc. Congress Evol. Comput., pp. 1268–1275 (2000)
Shehory, O., Kraus, S.: Coalition formation among autonomous agents: Strategies and complexity. In: Castelfranchi, C., Muller, J.P. (eds.) From Reaction to Cognition, vol. 1, pp. 57–72 (1995)
Tanimoto, K.: Coalition formation interacted with transitional state of environment. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 6, pp. 6–9 (2002)
Watkins, C.J.C.H., Dayan, P.: Q-learning. Machine Learning 8(3), 279–292 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Peleteiro, A., Burguillo, J.C., Bazzan, A.L. (2011). Emerging Cooperation in the Spatial IPD with Reinforcement Learning and Coalitions. In: Bouvry, P., González-Vélez, H., Kołodziej, J. (eds) Intelligent Decision Systems in Large-Scale Distributed Environments. Studies in Computational Intelligence, vol 362. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21271-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-21271-0_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21270-3
Online ISBN: 978-3-642-21271-0
eBook Packages: EngineeringEngineering (R0)