Skip to main content
SpringerLink
Log in

Decentralized control of discrete-Time system with delay in mean field LQR problem

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

This paper studies the decentralized optimal control of discrete-time system with inputdelay, where a large number of agents with the identical decoupling dynamical equations and the coupling cost function through the mean field are considered. The decentralized and centralized optimal controllers are proposed by the optimal tracking control of LQR problem with delay. They are proved that the optimal controllers and the optimal cost function of the centralized and decentralized solutions are equivalent for the optimal control problem. An illustrative example is given to show the efficiency of the decentralized optimal controllers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pindyck R S, Optimal economic stabilization policies under decentralized control and conflictingobjectives, IEEE Trans. Automatic Control, 1977, 22(4): 517–530.

    Article  MATH  MathSciNet  Google Scholar 

  2. Erickson G M, Differential game models of advertising competition, European J. Oper. Res., 1995,83: 431–438.

    Article  MATH  Google Scholar 

  3. Famolari D, Mandayam N B, Goodman D, and Shah V, A new framework for power control inwireless data networks: Games, utility and pricing, Wireless Multimedia Network Technologies, ed. by Ganesh R, Pahlavan K, and Zvonar Z, 2002, 524: 289–310.

    Article  Google Scholar 

  4. Lasry J M and Lions P L, Mean field games, Japan. J. Math., 2007, 2(1): 229–260.

    Article  MATH  MathSciNet  Google Scholar 

  5. Breban R, Vardavas R, and Blower S, Mean-field analysis of an inductive reasoning game: Ap-plication to influenza vaccination, Phys. Rev. E Stat. Nonlin. Soft Matter. Phys., 2007, 76(3): 1–11.

    Article  Google Scholar 

  6. Tembine H, Boudec J Y L, Azouzi R E, and Altman E, Mean field asymptotics of Markov decisionevolutionary games and teams, Proc. Int. Conf. Game Theory for Netw., Istanbul, Turkey, 2009, 140–150.

    Google Scholar 

  7. Huang M Y, Caines P E, and Malham´e R P, Large-population cost-coupled LQG problems withnonuniform agents: Individual-mass behavior and decentralized e-Nash equilibria, IEEE Trans.Automatic Control, 2007, 52(9): 1560–1571.

    Article  MathSciNet  Google Scholar 

  8. Huang M Y, Caines P E, and Malham´e R P, The NCE (mean field) principle with locality dependentcost interactions, IEEE Trans. Automatic Control, 2010, 55(12): 2799–2805.

    Article  MathSciNet  Google Scholar 

  9. Huang M Y, Large-population LQG games involving a major player: The Nash certainty equivalenceprinciple, SIAM Journal on Control and Optimization, 2010, 48(5): 3318–3353.

    Article  MATH  Google Scholar 

  10. Nourian M, Malham´e R P, Huang M Y, and Caines P E, Mean field (NCE) formulation of estimationbased leader-follower collective dynamics, International Journal of Robotics and Automation, 2011, 26(1): 120–129.

    Article  MATH  Google Scholar 

  11. Huang M Y, Caines P E, and Malham´e R P, Social optima in mean field LQG control: Centralizedand decentralized strategies, IEEE Trans. Automatic Control, 2012, 57(7): 1736–1751.

    Article  MathSciNet  Google Scholar 

  12. Dziong Z and Mason L G, Fair-efficient call admission for broad-band networks—A game theoreticframework, IEEE/ACM Trans. Netw., 1996, 4: 123–136.

    Article  Google Scholar 

  13. Fudenberg D and Levine D K, The Theory of Learning in Games, Cambridge, MA: MIT Press,1998.

    MATH  Google Scholar 

  14. Li T and Zhang J F, Asymptotically optimal decentralized control for large population stochasticmultiagent systems, IEEE Trans. Automatic Control, 2008, 53(7): 1643–1660.

    Article  Google Scholar 

  15. Pindyck R S, The discrete-time tracking problem with a time delay in the control, IEEE Trans.Automatic Control, 1972, 17: 397–398.

    Article  MathSciNet  Google Scholar 

  16. Zhang H S, Duan G R, and Xie L H, Linear quadratic regulation for linear time-varying systemswith multiple input delays, Automatica, 2006, 42(9): 1465–1476.

    Article  MATH  MathSciNet  Google Scholar 

  17. Zhou J and Wang Q, Finite horizon linear quadratic regulation for linear discrete time-varyingsystems with single/multiple input delay(s), Joint 48th IEEE Conference on Decision and Controland 28th Chinese Control Conference, Shanghai, China, 2009, 4050–4055.

    Google Scholar 

  18. Ma C Q, Li T, and Zhang J F, Linear quadratic decentralized dynamic games for large populationdiscrete-time stochastic multi-agent systems, Journal of Systems Science and MathematicalSciences, 2007, 27(3): 464–480.

    MATH  MathSciNet  Google Scholar 

  19. Gupta V, Hassibi B, and Murray R M, A sub-optimal algorithm to synthesize control laws for anetwork of dynamic agents, International Journal of Control, 2005, 78(16): 1302–1313.

    Article  MATH  MathSciNet  Google Scholar 

  20. Naidu D S, Optimal Control System, Idaho State University, Pocatello, Idaho, USA, 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Control Science and Engineering, Shandong University, Jinan, 250061, China

    Fangfang Zhang & Wei Wang

Authors
  1. Fangfang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

This work is supported by the Taishan Scholar Construction Engineering by Shandong Government, the NationalNatural Science Foundation of China under Grant Nos. 61120106011, 61203029, 61104050, the NaturalScience Foundation of Shandong Province under Grant No. ZR2011FQ020, and the Research Fund for theDoctoral Program of Higher Education of China under Grant No. 20120131120058, the Scientific ResearchFoundation for Outstanding Young Scientists of Shandong Province under Grant No. BS2013DX008.

This paper was recommended for publication by Editor HONG Yiguang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, F., Wang, W. Decentralized control of discrete-Time system with delay in mean field LQR problem. J Syst Sci Complex 28, 755–772 (2015). https://doi.org/10.1007/s11424-015-3118-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-015-3118-0

Keywords

Search

Navigation