skip to main content
10.1145/3106426.3106458acmconferencesArticle/Chapter ViewAbstractPublication PageswiConference Proceedingsconference-collections
research-article

Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method

Published: 23 August 2017 Publication History

Abstract

This paper proposes an interaction strategy called the extended expectation-of-cooperation (EEoC) that is intended to spread cooperative activities in prisoner's dilemma situations over an entire agent network. Recently developed computer and communications applications run on the network and interact with each other as delegates of the owners, so they often encounter social dilemma situations. To improve social efficiency, they are required to cooperate, but one-sided cooperation is meaningless and loses some payoff due to a rip-off by defecting agents. The concept of EEoC is that when agents encounter mutual cooperation, they continue to cooperate a few times with the desire to see the emergence of cooperative behavior in their neighbors. EEoC is easy to implement in computer systems. We experimentally show that EEoC can effectively spread cooperative activities in dilemma situations in complete, Erdös-Rényi, and regular networks. We also clarify the robustness against defecting agents and the limitation of the EEoC strategy.

References

[1]
A. L. Barabasi and R. Albert. 1999. Emergence of scaling in random networks. Science 286 (1999), 509--512.
[2]
Paul Erdös and Alfréd Rényi. 1959. On random graphs I. Publicationes Mathematicae 6 (1959), 290--297.
[3]
James H. Fowler and Nicholas A. Christakis. 2010. Cooperative Behavior Cascades in Human Social Networks. Proc. of the National Academy of Sciences (PNAS) 107, 12 (2010), 5334 - 5338.
[4]
Jianye Hao and Ho-fung Leung. 2013. Achieving Social Optimality with Influencer Agents. In Complex Sciences: Second Int. Conf., COMPLEX 2012, Santa Fe, NM, USA, December 5--7, 2012, Revised Selected Papers, Springer, Cham, 140--151.
[5]
Jianye Hao and Ho-Fung Leung. 2013. Achieving Socially Optimal Outcomes in Multiagent Systems with Reinforcement Social Learning. ACM Trans. Auton. Adapt. Syst. 8, 3, Article 15 (Sept. 2013), 23 pages.
[6]
John H. Holland, Keith J. Holyoak, Richard E. Nisbett, and Paul R. Thagard. 1986. Induction: Processes of Inference, Learning, and Discovery. MIT Press, Cambridge, MA, USA.
[7]
Yichuan Jiang, Yifeng Zhou, and Yunpeng Li. 2015. Reliable Task Allocation with Load Balancing in Multiplex Networks. TAAS 10, 1 (2015), 3:1--3:32.
[8]
Naoki Masuda. 2012. Evolution of cooperation driven by zealots. Nature Scientific Reports 2, 646 (2012).
[9]
Matthew Matlock and Sandip Sen. 2007. Effective Tag Mechanisms for Evolving Coordination. In Proc. of the 6th Int. Joint Conf. on Autonomous Agents and Multiagent Systems (AAMAS '07). ACM, New York, NY, USA, Article 251, 8 pages.
[10]
Matt Matlock and Sandip Sen. 2009. Effective Tag Mechanisms for Evolving Cooperation. In Proc. of The 8th Int. Conf. on Autonomous Agents and Multiagent Systems - Volume 1 (AAMAS '09). IFAAMAS, Richland, SC, 489--496.
[11]
Koichi Moriyama. 2007. Utility Based Q-learning to Maintain Cooperation in Prisoner's Dilemma Games. In Proc. of the 2007 IEEE/WIC/ACM Int. Conf. on Intelligent Agent Technology (IAT '07). IEEE Computer Society, Washington, DC, USA, 146--152.
[12]
Koichi Moriyama, Satoshi Kurihara, and Masayuki Numao. 2011. Evolving Subjective Utilities: Prisoner's Dilemma Game Examples. In Proc. of the 10th Int. Conf. on Autonomous Agents and Multiagent Syst. - Vol. 1 IFAAMAS, 233--240.
[13]
Martin A. Nowak. 2006. Five Rules for the Evolution of Cooperation. Science 314, 5805 (2006), 1560--1563.
[14]
Martin A. Nowak and Karl Sigmund. 2005. Evolution of indirect reciprocity. Nature 437 (2005), 1291--1298.
[15]
Tetsushi Ohdaira and Takao Terano. 2009. Cooperation in the Prisoner's Dilemma Game Based on the Second-Best Decision. Journal of Artificial Societies and Social Simulation 12, 4 (2009).
[16]
Kengo Osaka, Fujio Toriumi, and Toshihauru Sugawara. 2017. Effect of direct reciprocity and network structure on continuing prosperity of social networking services. Computational Social Networks 4, 1, 2.
[17]
Bijan Ranjbar-Sahraei, Haitham Bou Ammar, Daan Bloembergen, Karl Tuyls, and Gerhard Weiss. 2014. Evolution of Cooperation in Arbitrary Complex Networks. In Proc. of the 2014 Int. Conf. on Autonomous Agents and Multi-agent Systems (AAMAS 14). IFAAMAS, Richland, SC, 677--684.
[18]
Bettina Rockenbach and Manfred Milinski. 2006. The efficient interaction of indirect reciprocity and costly punishment. Nature 444 (2006), 718--723.
[19]
Sandip Sen and Stéphan Airiau. 2007. Emergence of Norms Through Social Learning. In Int. Joint Conf. on Artificial Intelligence (IJCAI-07). 1507--1512.
[20]
Dong-Mei Shi, Han-Xin Yang, Mao-Bin Hu, Wen-Bo Du, Bing-Hong Wang, and Xian-Bin Cao. 2009. Preferential selection promotes cooperation in a spatial public goods game. Physica A: Statistical Mechanics and its Applications 388, 21 (2009), 4646 - 4650.
[21]
Ryosuke Shibusawa, Tomoaki Otsuka, and Toshiharu Sugawara. 2016. Spread of Cooperation in Complex Agent Networks Based on Expectation of Cooperation. In PRIMA 2016: Principles and Practice of Multi-Agent Systems, Springer, Cham, 76--91.
[22]
Ryosuke Shibusawa and Toshiharu Sugawara. 2014. Norm Emergence via Influential Weight Propagation in Complex Networks. In Proc. of the 2014 Europea Network Intelligence Conf. (ENIC). 30--37.
[23]
Toshiharu Sugawara. 2011. Emergence and Stability of Social Conventions in Conflict Situations. In Int. J. Conf. on Artificial Intelligence (IJCAI-11). 371--378.
[24]
Daniel Villatoro, Jordi Sabater-Mir, and Sandip Sen. 2011. Social Instruments for Robust Convention Emergence. In Proc. of the Twenty-Second Int. Joint Conf. on Artificial Intelligence - Volume One (IJCAI'11). AAAI Press, 420--425.
[25]
Daniel Villatoro, Jordi Sabater-Mir, and Sandip Sen. 2013. Robust Convention Emergence in Social Networks Through Self-reinforcing Structures Dissolution. ACM Trans. Auton. Adapt. Syst. 8, 1, Article 2 (April 2013), 21 pages.
[26]
Bo Xianyu. 2012. Prisoner's Dilemma Game on Complex Networks with Agents' Adaptive Expectations. Journal of Artificial Societies and Social Simulation 15, 3 (2012), 3.
[27]
Chao Yu, Zhen Wang, Hongtao Lv, Honglin Bao, and Yapeng Li. 2017. Collective Learning and Information Diffusion for Efficient Emergence of Social Norms. Springer Singapore, Singapore, 193--210.
[28]
Chao Yu, Minjie Zhang, Fenghui Ren, and Xudong Luo. 2013. Emergence of Social Norms through Collective Learning in Networked Agent Societies. In Proc. of the 12th Int. Joint Conf. on Autonomous Agents and Multi-Agent Systems. IFAAMAS, 475--482.

Cited By

View all
  • (2023)Cooperation: A Systematic Review of how to Enable Agent to Circumvent the Prisoner’s DilemmaSHS Web of Conferences10.1051/shsconf/202317803005178(03005)Online publication date: 23-Oct-2023
  • (2017)Promotion of Robust Cooperation Among Agents in Complex Networks by Enhanced Expectation-of-Cooperation StrategyComplex Networks & Their Applications VI10.1007/978-3-319-72150-7_66(815-828)Online publication date: 27-Nov-2017

Index Terms

  1. Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WI '17: Proceedings of the International Conference on Web Intelligence
      August 2017
      1284 pages
      ISBN:9781450349512
      DOI:10.1145/3106426
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 August 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. agent network
      2. cooperation
      3. prisoner's dilemma
      4. reinforcement learning

      Qualifiers

      • Research-article

      Conference

      WI '17
      Sponsor:

      Acceptance Rates

      WI '17 Paper Acceptance Rate 118 of 178 submissions, 66%;
      Overall Acceptance Rate 118 of 178 submissions, 66%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)6
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 17 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Cooperation: A Systematic Review of how to Enable Agent to Circumvent the Prisoner’s DilemmaSHS Web of Conferences10.1051/shsconf/202317803005178(03005)Online publication date: 23-Oct-2023
      • (2017)Promotion of Robust Cooperation Among Agents in Complex Networks by Enhanced Expectation-of-Cooperation StrategyComplex Networks & Their Applications VI10.1007/978-3-319-72150-7_66(815-828)Online publication date: 27-Nov-2017

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media