Skip to main content
Log in

A Characterization of Sub-game Perfect Equilibria for SDEs of Mean-Field Type

  • Published:
Dynamic Games and Applications Aims and scope Submit manuscript

Abstract

We study a class of dynamic decision problems of mean-field type with time-inconsistent cost functionals and derive a stochastic maximum principle to characterize sub-game perfect equilibrium points. Subsequently, this approach is extended to a mean-field game to construct decentralized strategies and obtain an estimate of their performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Andersson D, Djehiche B (2010) A maximum principle for SDE’s of mean-field type. Appl Math Optim 63(3):341–356

    Article  MathSciNet  MATH  Google Scholar 

  2. Bardi M (2012) Explicit solutions of some linear-quadratic mean field games. Netw Heterog Media 7(2):243–261

    Article  MathSciNet  MATH  Google Scholar 

  3. Bensoussan A, Frehse J, Yam P (2013) Mean field games and mean field type control theory, Briefs in Mathematics. Springer, New York

  4. Bensoussan A, Sung KCJ, Yam SCP (2013) Linear–quadratic time-inconsistent mean field games. Dyn Games Appl 3(4):537–552

    Article  MathSciNet  MATH  Google Scholar 

  5. Bensoussan A, Sung KCJ, Yam SCP, Yung SP (2011) Linear-quadratic mean-field games (preprint). arXiv:1404.5741

  6. Björk T, Murgoci A, (2008) A general theory of Markovian time inconsistent stochastic control problems. SSRN:1694759

  7. Björk T, Murgoci A, Zhou XY (2014) Mean-variance portfolio optimization with state-dependent risk aversion. Math. Finance 24(1):1–24

    Article  MathSciNet  MATH  Google Scholar 

  8. Buckdahn R, Cardaliaguet P, Quincampoix M (2011) Some recent aspects of differential game theory. Dyn Games Appl 1(1):74–114

    Article  MathSciNet  MATH  Google Scholar 

  9. Buckdahn R, Li J, Peng S (2009) Mean-field backward stochastic differential equations and related partial differential equations. Stoch Proc Appl 119(10):3133–3154

    Article  MathSciNet  MATH  Google Scholar 

  10. Buckdahn R, Djehiche B, Li J (2011) A general stochastic maximum principle for SDEs of mean-field type. Appl Math Optim 64(2):197–216

    Article  MathSciNet  MATH  Google Scholar 

  11. Buckdahn R, Li J, Peng S, Rainer R (2014) Mean-field stochastic differential equations and associated PDEs (preprint). arXiv:1407.1215

  12. Carmona R, Delarue F (2013) Probabilistic analysis of mean-field games. SIAM J Control Optim 51(4):2705–2734

    Article  MathSciNet  MATH  Google Scholar 

  13. Carmona R, Delarue F (2013) Forward–backward stochastic differential equations and controlled Mckean–Vlasov dynamics (preprint). arXiv:1303.5835v1

  14. Ekeland I, Lazrak A, (2006) Being serious about non-commitment: subgame perfect equilibrium in continuous time. arXiv:math/0604264

  15. Ekeland I, Pirvu TA (2008) Investment and consumption without commitment. Math. Financ. Econ. 2:57–86

    Article  MathSciNet  MATH  Google Scholar 

  16. Elliott RJ, Li X, Ni Y-H (2013) Discrete time mean-field stochastic linear-quadratic optimal control problems. Automatica 49(11):3222–3233

    Article  MathSciNet  MATH  Google Scholar 

  17. Goldman SM (1980) Consistent plans. Rev Financ Stud 47:533–537

    MATH  Google Scholar 

  18. Gomes DA, Mohr J, Souza RR (2010) Discrete time, finite state space mean field games. J Math Pures Appl 93:308–328

    Article  MathSciNet  MATH  Google Scholar 

  19. Hu Y, Jin H, Zhou XY (2012) Time-inconsistent stochastic linear-quadratic control. SIAM J Control Optim 50(3):1548–1572

    Article  MathSciNet  MATH  Google Scholar 

  20. Huang M (2010) Large-population LQG games involving a major player: the Nash certainty equivalence principle. SIAM J Control Optim 48(5):3318–3353

    Article  MathSciNet  MATH  Google Scholar 

  21. Huang M, Caines PE, Malhamé RP (2003) Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions. In: Proceedings of the 42nd IEEE CDC, Maui, HI, 98–103

  22. Huang M, Malhamé RP, Caines PE (2006) Large population stochastic dynamic games: closed-loop McKean–Vlasov systems and the Nash certainty equivalence principle. Commun Inf Syst 6(3):221–251

    MathSciNet  MATH  Google Scholar 

  23. Huang M, Caines PE, Malhamé RP (2007) Large-population cost-coupled LQG problems with nonuniform agents: individual-mass behavior and decentralized \(\varepsilon \)-Nash equilibria. IEEE Trans Autom Control 52(9):1560–1571

    Article  MathSciNet  Google Scholar 

  24. Karatzas I, Shreve SE (1987) Brownian motion and stochastic calculus. Springer, New York

    MATH  Google Scholar 

  25. Kolokoltsov VN, Li J, Yang W (2011) Mean field games and nonlinear Markov processes (preprint). arXiv:1112.3744

  26. Lasry J-M, Lions P-L (2007) Mean field games. Jpn J Math 2(1):229–260

    Article  MathSciNet  MATH  Google Scholar 

  27. Li T, Zhang J-F (2008) Asymptotically optimal decentralized control for large population stochastic multiagent systems. IEEE Trans Autom Control 53(7):1643–1660

    Article  MathSciNet  Google Scholar 

  28. Nourian M, Caines PE (2013) \(\epsilon \)-Nash mean field game theory for nonlinear stochastic dynamical systems with major and minor agents. SIAM J Control Optim 51(4):3302–3331

    Article  MathSciNet  MATH  Google Scholar 

  29. Peleg B, Menahem EY (1973) On the existence of a consistent course of action when tastes are changing. Rev Financ Stud 40:391–401

    MATH  Google Scholar 

  30. Peng S (1990) A general stochastic maximum principle for optimal control problems. SIAM J Control Optim 28(4):966–979

    Article  MathSciNet  MATH  Google Scholar 

  31. Phelps ES, Pollak RA (1968) On second-best national saving and game-equilibrium growth. Rev Econ Stud 35:185–199

    Article  Google Scholar 

  32. Pollak RA (1968) Consistent planning. Rev Financ Stud 35:185–199

    Google Scholar 

  33. Strotz R (1955) Myopia and inconsistency in dynamic utility maximization. Rev Financ Stud 23:165–180

    Google Scholar 

  34. Tembine H, Zhu Q, Basar T (2011) Risk-sensitive mean-field stochastic differential games. In: Proceedings of the 18th IFAC world congress, Milan, Italy

  35. Weintraub GY, Benkard CL, Van Roy B (2008) Markov perfect industry dynamics with many firms. Econometrica 76(6):1375–1411

    Article  MathSciNet  MATH  Google Scholar 

  36. Yong J (2013a) Linear-quadratic optimal control problems for mean-field stochastic differential equations. SIAM J Control Optim 51(4):2809–2838

    Article  MathSciNet  MATH  Google Scholar 

  37. Yong J (2013b) Linear-quadratic optimal control problems for mean-field stochastic differential equations: time-consistent solutions (preprint). arXiv:1304.3964

  38. Yong J, Zhou XY (1999) Stochastic controls: Hamiltonian systems and HJB equations. Springer, New York

    Book  MATH  Google Scholar 

  39. Zaccour G (2008) Time consistency in cooperative differential games: a tutorial. INFOR 46(1):81–92

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minyi Huang.

Additional information

Boualem Djehiche received financial support from the Swedish Export Credit Corporation (SEK) which is gratefully acknowledged. Many thanks to Tomas Björk and Georges Zaccour for fruitful discussions and their insightful comments. Minyi Huang’s work was partially supported by Natural Sciences and Engineering Research Council (NSERC) of Canada.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Djehiche, B., Huang, M. A Characterization of Sub-game Perfect Equilibria for SDEs of Mean-Field Type. Dyn Games Appl 6, 55–81 (2016). https://doi.org/10.1007/s13235-015-0140-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13235-015-0140-8

Keywords

Navigation