Abstract
In multi-agent systems, complex and dynamic interactions often emerge among individual agents. The ability of each agent to learn adaptively is therefore important for them to survive in such changing environment. In this paper, we consider the effects of neighbourhood structure on the evolution of cooperative behaviour in the N-Player Iterated Prisoner’s Dilemma (NIPD). We simulate the NIPD as a bidding game on a two dimensional grid-world, where each agent has to bid against its neighbours based on a chosen game strategy. We conduct experiments with three different types of neighbourhood structures, namely the triangular neighbourhood structure, the rectangular neighbourhood structure and the random pairing structure. Our results show that cooperation does emerge under the triangular neighbourhood structure, but defection prevails under the rectangular neighbourhood structure as well as the random pairing structure.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Axelrod, R.: The Evolution of Cooperation. Basic Books, New York (1984)
Axelrod, R.: The Evolution of Strategies in the Iterated Prisoner’s Dilemma. In: Davis, L. (ed.) Genetic Algorithms and Simulated Annealing, pp. 32–41. Morgan Kaufmann, Los Altos, CA (1987)
Lindgren, K.: Evolution Phenomena in Simple Dynamics. In: Langton, C.G., Taylor, C., Farmer, J.D., Rasmussen, S. (eds.) Artificial Life II, pp. 295–312. Addison-Wesley, Reading, MA (1991)
Fogel, D.B.: Evolving Behaviors in the Iterated Prisoner’s Dilemma. Evolutionary Computation 1(1), 77–97 (1993)
Bankes, S.: Exploring the Foundations of Artificial Societies: Experiments in Evolving Solutions to Iterated N-player Prisoner’s Dilemma. In: Brooks, R.A., Maes, P. (eds.) Artificial Life IV, pp. 237–242. MIT Press, Cambridge, MA (1994)
Yao, X., Darwen, P.: An Experimental Study of N-person Iterated Prisoner’s Dilemma Games. Informatica 18(4), 435–450 (1994)
Seo, Y.G., Cho, S.B., Yao, X.: The Impact of Payoff Function and Local Interaction on the N-player Iterated Prisoner’s Dilemma. Knowledge and Information Systems: An International Journal 2(4), 178–461 (2000)
Seo, Y.G., Cho, S.B., Yao, X.: Emergence of Cooperative Coalition in NIPD Game with Localization of Interaction and Learning. In: Proceedings of the 1999 Congress on Evolutionary Computation, pp. 877–884. IEEE Press, Piscataway, NJ (1999)
Suzuki, R., Arita, T.: Evolutionary Analysis on Spatial Locality in N-Person Iterated Prisoner’s Dilemma. International Journal of Computational Intelligence and Applications 3(2), 177–188 (2003)
Yao, X.: Automatic Acquisition of Strategies by Co-evolutionary Learning. In: Proceedings of the International Conference on Computational Intelligence and Multimedia Applications, Gold Coast, Australia, pp. 23–29. Griffith University Press, Brisbane, Australia (1997)
O’Riordan, C., Griffith, J., Newell, J., Sorensen, H.: Co-evolution of Strategies for an N-player Dilemma. In: Proceedings of the 2004 Congress on Evolutionary Computation, pp. 1625–1630. IEEE Press, Piscataway, NJ (2004)
Birk, A.: Trust in an N-player Iterated Prisoner’s Dilemma. In: Proceedings of the International Conference on Autonomous Agents, 2 Workshop on Deception, Fraud and Trust in Agent Societies, Seattle, WA (1999)
O’Riordan, C., Griffith, J., Curran, D., Sorensen, H.: Norms and Cultural Learning in the N-player Prisoner’s Dilemma. In: Proceedings of the 2006 Congress on Evolutionary Computation, pp. 1105–1110. IEEE Press, Piscataway, NJ (2006)
Chong, S.Y., Yao, X.: Behavioral Diversity, Choices and Noise in the Iterated Prisoner’s Dilemma. IEEE Transactions on Evolutionary Computation 9(6), 540–551 (2005)
Davis, J.H., Laughlin, P.R., Komorita, S.S.: The Social Psychology of Small Groups. Annual Review of Psychology 27, 501–542 (1976)
Ishibuchi, H., Namikawa, N.: Evolution of Iterated Prisoner’s Dilemma Game Strategies in Structured Demes under Random Pairing in Game Playing. IEEE Transactions on Evolutionary Computation 9(6), 552–561 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chiong, R., Dhakal, S., Jankovic, L. (2007). Effects of Neighbourhood Structure on Evolution of Cooperation in N-Player Iterated Prisoner’s Dilemma. In: Yin, H., Tino, P., Corchado, E., Byrne, W., Yao, X. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2007. IDEAL 2007. Lecture Notes in Computer Science, vol 4881. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77226-2_95
Download citation
DOI: https://doi.org/10.1007/978-3-540-77226-2_95
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77225-5
Online ISBN: 978-3-540-77226-2
eBook Packages: Computer ScienceComputer Science (R0)