Skip to main content

Advertisement

Springer Nature Link
Log in

Impact of Decision Feedback on Networked Evolutionary Game with Delays in Control Channel

  • Published:
Dynamic Games and Applications Aims and scope Submit manuscript

Abstract

Cooperative behavior exists widely in nature and social life, and the delays generated during the transmission of information have an important effect on the dynamic evolution of cooperation. To this end, the effect of delays in the control channel (from decision-making to action) on network evolutionary games is explored, and the strategy synthesis problem is also investigated using semi-tensor products of matrices. Firstly, the dynamics of network evolutionary games with delays in control transmission can be converted into an algebraic expression. Secondly, a reachable set approach is introduced to analyze the closed-loop dynamics with control delay, and some sufficient and necessary conditions for the existence of strategy convergence are derived. Meanwhile, an improved algorithm is developed to design the feedback control law, which guarantees that all the strategy trajectories are stable to the desired profile. Finally, two illustrative examples are provided to demonstrate the effectiveness of the results obtained. The current method will help to devise a favorable framework for designing just-in-time strategies in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Alboszta J, Mie J et al (2004) Stability of evolutionarily stable strategies in discrete replicator dynamics with time delay. J Theor Biol 231(2):175–179

    MathSciNet  MATH  Google Scholar 

  2. Barfuss W, Donges JF, Kurths J (2019) Deterministic limit of temporal difference reinforcement learning for stochastic games. Phys Rev E 99(4):043305

    Google Scholar 

  3. Berger U (2005) Fictitious play in 2 \(\times \) n games. J Econ Theory 120(2):139–154

    MathSciNet  MATH  Google Scholar 

  4. Broom M, Erovenko IV, Rychtář J (2021) Modelling evolution in structured populations involving multiplayer interactions. Dyn Games Appl 11(2):270–293

    MathSciNet  MATH  Google Scholar 

  5. Cheng D (2014) On finite potential games. Automatica 50(7):1793–1801

    MathSciNet  MATH  Google Scholar 

  6. Cheng D, Xu T, Qi H (2013) Evolutionarily stable strategy of networked evolutionary games. IEEE Trans Neural Netw Learn Syst 25(7):1335–1345

    Google Scholar 

  7. Cheng D, He F, Qi H, Xu T (2015) Modeling, analysis and control of networked evolutionary games. IEEE Trans Autom Control 60(9):2402–2415

    MathSciNet  MATH  Google Scholar 

  8. Cheng D, Qi H, Li Z (2010) Analysis and control of Boolean networks: a semi-tensor product approach

  9. de Lamarck J-BM (1873) Philosophie zoologique ou exposition des considérations relatives à l’histoire naturelle des animaux, vol 1. F. Savy, Paris

    Google Scholar 

  10. Du J, Tang L (2018) Evolution of global contribution in multi-level threshold public goods games with insurance compensation. J Stat Mech Theory Exp 2018(1):013403

    MathSciNet  MATH  Google Scholar 

  11. Ellison G (1993) Learning, local interaction, and coordination. Econom J Econom Soc 61:1047–1071

    MathSciNet  MATH  Google Scholar 

  12. Fornasini E, Valcher ME (2012) Observability, reconstructibility and state observers of Boolean control networks. IEEE Trans Autom Control 58(6):1390–1401

    MathSciNet  MATH  Google Scholar 

  13. Friedman D (1998) On economic applications of evolutionary game theory. J Evol Econ 8(1):15–43

    MathSciNet  Google Scholar 

  14. Fu S, Wang Y, Zhao G (2017) A matrix approach to the analysis and control of networked evolutionary games with bankruptcy mechanism. Asian J Control 19(2):717–727

    MathSciNet  MATH  Google Scholar 

  15. Guo P, Wang Y, Li H (2013) Algebraic formulation and strategy optimization for a class of evolutionary networked games via semi-tensor product method. Automatica 49(11):3384–3389

    MathSciNet  MATH  Google Scholar 

  16. Guo H, Chu C, Shen C, Shi L (2018) Reputation-based coevolution of link weights promotes cooperation in spatial prisoner’s dilemma game. Chaos Solitons Fract 109:265–268

    MathSciNet  MATH  Google Scholar 

  17. Guo H, Li X, Hu K, Dai X, Jia D, Boccaletti S, Perc M, Wang Z (2020) The dynamics of cooperation in asymmetric sub-populations. New Jo Phys 22(8):083015

    MathSciNet  Google Scholar 

  18. Han WW, Zhang ZP, Sun JQ, Xia CY (2021) Emergence of cooperation with reputation–updating timescale in spatial public goods game. Phys Lett A 393:127173

    Google Scholar 

  19. Huang W, Haubold B, Hauert C, Traulsen A (2012) Emergence of stable polymorphisms driven by evolutionary games between mutants. Nat Commun 3(1):1–7

    Google Scholar 

  20. Izquierdo LR, Izquierdo SS, Gotts NM, Polhill JG (2007) Transient and asymptotic dynamics of reinforcement learning in games. Games Econ Behav 61(2):259–276

    MathSciNet  MATH  Google Scholar 

  21. Jackson MO, Zenou Y (2015) Chapter 3—games on networks. In: Handbook of game theory with economic applications, vol 4. Elsevier, pp 95–163

  22. Kupferschmid S, Helmert M (2006) A skat player based on Monte-Carlo simulation. In: International conference on computers and games. Springer, pp 135–147

  23. Lipowski A, Gontarek K, Ausloos M (2009) Statistical mechanics approach to a reinforcement learning model with memory. Physica A Stat Mech Appl 388(9):1849–1856

    Google Scholar 

  24. Mayr E (1991) One long argument: Charles Darwin and the genesis of modern evolutionary thought, vol 2. Harvard University Press, Cambridge, pp 51–61

    Google Scholar 

  25. Nowak MA, Sigmund K (2004) Evolutionary dynamics of biological games. Science 303(5659):793–799

    Google Scholar 

  26. Osborne MJ et al (2004) An introduction to game theory, vol 3(3). Oxford University Press, New York

    Google Scholar 

  27. Perc M, Jordan JJ, Rand DG, Wang Z, Boccaletti S, Szolnoki A (2017) Statistical physics of human cooperation. Phys Rep 687:1–51

    MathSciNet  MATH  Google Scholar 

  28. Sandholm TW, Crites RH (1996) Multiagent reinforcement learning in the iterated prisoner’s dilemma. Biosystems 37(1–2):147–166

    Google Scholar 

  29. Szabó G, Fath G (2007) Evolutionary games on graphs. Phys Rep 446(4–6):97–216

    MathSciNet  Google Scholar 

  30. Szabó G, Tőke C (1998) Evolutionary prisoner’s dilemma game on a square lattice. Phys Rev E 58(1):69

    Google Scholar 

  31. Szabó G, Vukov J, Szolnoki A (2005) Phase diagrams for an evolutionary prisoner’s dilemma game on two-dimensional lattices. Phys Rev E 72(4):047107

    Google Scholar 

  32. Szolnoki A, Perc M (2013) Decelerated invasion and waning-moon patterns in public goods games with delayed distribution. Phys Rev E 87(5):054801

    Google Scholar 

  33. Vukov J, Szabó G, Szolnoki A (2006) Cooperation in the noisy case: prisoner’s dilemma game on two types of regular random graphs. Phys Rev E 73(6):067103

    Google Scholar 

  34. Wang Y, Cheng D (2016) Dynamics and stability for a class of evolutionary games with time delays in strategies. Sci China Inf Sci 59(9):1–10

    MathSciNet  Google Scholar 

  35. Wang J, De Leone R, Fu S, Xia J, Qiao L (2021) Event-triggered control design for networked evolutionary games with time invariant delay in strategies. Int J Syst Sci 52(3):493–504

    MathSciNet  MATH  Google Scholar 

  36. Wang J, De Leone R, Fu S, Xia J (2021) Input-output decoupling for mix-valued logical control networks via the semi-tensor product method. Int J Control 94(9):2419–2427

    MathSciNet  MATH  Google Scholar 

  37. Wu Z-X, Guan J-Y, Xu X-J, Wang Y-H (2007) Evolutionary prisoner’s dilemma game on Barabási–Albert scale-free networks. Physica A Stat Mech Appl 379(2):672–680

    Google Scholar 

  38. Yan F, Chen X, Qiu Z, Szolnoki A (2021) Cooperator driven oscillation in a time-delayed feedback-evolving game. New J Phys 23(5):053017

    MathSciNet  Google Scholar 

  39. Yu Y-Y, Ni Y-C (2008) Network effects of animal conflicts. Physica A Stat Mech Appl 387(25):6379–6384

    Google Scholar 

  40. Zhang X, Wang Y, Cheng D (2019) Output tracking of Boolean control networks. IEEE Trans Autom Control 65(6):2730–2735

    MathSciNet  MATH  Google Scholar 

  41. Zhang Z, Xia C, Chen S, Yang T, Chen Z (2020) Reachability analysis of networked finite state machine with communication losses: a switched perspective. IEEE J Sel Areas Commun 38(5):845–853

    Google Scholar 

  42. Zhang Z, Chen Z, Han X, Liu Z (2020) Stabilization of probabilistic finite automata based on semi-tensor product of matrices. J Frankl Inst 357(9):5173–5186

    MathSciNet  MATH  Google Scholar 

  43. Zhang Z, Shu S, Xia C (2021) Networked opacity for finite state machine with bounded communication delays. Inf Sci 572:57–66

    MathSciNet  Google Scholar 

  44. Zhang J, Lou JG, Qiu JL, Lu JQ (2021) Dynamics and convergence of hyper-networked evolutionary games with time delay in strategies. Inf Sci 563:166–182

    MathSciNet  Google Scholar 

  45. Zhang Z, Xia C, Fu J, Chen Z (2022) Initial-state observability of mealy-based finite-state machine with nondeterministic output functions. IEEE Trans Syst Man Cybern Syst 52:6396–6405

    Google Scholar 

  46. Zhao G, Wang Y (2016) Formulation and optimization control of a class of networked evolutionary games with switched topologies. Nonlinear Anal Hybrid Syst 22:98–107

    MathSciNet  MATH  Google Scholar 

  47. Zhao Y, Li Z, Cheng D (2010) Optimal control of logical control networks. IEEE Trans Autom Control 56(8):1766–1776

    MathSciNet  MATH  Google Scholar 

  48. Zheng Y, Li C, Feng J (2021) Modeling and dynamics of networked evolutionary game with switched time delay. IEEE Trans Control Netw Syst 8:1778–1787

    MathSciNet  Google Scholar 

  49. Zhu R, Chen Z, Zhang J, Liu Z (2021) Strategy optimization of weighted networked evolutionary games with switched topologies and threshold. Knowl Based Syst 235:107644

    Google Scholar 

  50. Zimmermann MG, Eguíluz VM (2005) Cooperation, social networks, and the emergence of leadership in a prisoner’s dilemma with adaptive local interactions. Phys Rev E 72(5):056118

    MathSciNet  Google Scholar 

Download references

Acknowledgements

This project was partially funded by the National Natural Science Foundation of China Grant Nos. 62203328 and 62173247, Tianjin Natural Science Foundation of China Grant No. 21JCQNJC00840 and Tianjin Research Innovation Project for Postgraduate Students under Grant No. 2021YJSB251.

Author information

Authors and Affiliations

  1. Tianjin Key Laboratory of Intelligence Computing and Novel Software Technology, Tianjin University of Technology, Tianjin, 300384, People’s Republic of China

    Liangliang Chang

  2. School of Artificial Intelligence, Tiangong University, Tianjin, 300387, People’s Republic of China

    Zhipeng Zhang & Chengyi Xia

Authors
  1. Liangliang Chang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhipeng Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Chengyi Xia
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding authors

Correspondence to Zhipeng Zhang or Chengyi Xia.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chang, L., Zhang, Z. & Xia, C. Impact of Decision Feedback on Networked Evolutionary Game with Delays in Control Channel. Dyn Games Appl 13, 783–800 (2023). https://doi.org/10.1007/s13235-022-00486-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13235-022-00486-4

Keywords