Skip to main content
Log in

Discrete-time mean-field stochastic H 2/H control

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

The finite horizon H 2/H control problem of mean-field type for discrete-time systems is considered in this paper. Firstly, the authors derive a mean-field stochastic bounded real lemma (SBRL). Secondly, a sufficient condition for the solvability of discrete-time mean-field stochastic linearquadratic (LQ) optimal control is presented. Thirdly, based on SBRL and LQ results, this paper establishes a sufficient condition for the existence of discrete-time stochastic H 2/H control of meanfield type via the solvability of coupled matrix-valued equations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Khargonekar P P and Rotea M A, Mixed H 2/H control: A convex optimization approach, IEEE Trans. Automatic Control, 1991, 36(7): 824–837.

    Article  MathSciNet  MATH  Google Scholar 

  2. Limebeer D J N, Anderson B D O, and Hendel B, A nash game approach to mixed H 2/H control, IEEE Trans. Automatic Control, 1994, 39(1): 69–82.

    Article  MathSciNet  MATH  Google Scholar 

  3. Wu C S and Chen B S, Adaptive attitude control of spacecraft: Mixed H 2/H approach, J. Guid. Control Dyn., 2001, 24(4): 755–766.

    Article  MathSciNet  Google Scholar 

  4. Doyle J C, Glover K, Khargonekar P P, et al., State-space solutions to standard H 2 and H control problems, IEEE Trans. Automatic Control, 1989, 34(8): 831–847.

    Article  MathSciNet  MATH  Google Scholar 

  5. Chen B S, Tseng C S, and Uang H J, Mixed H 2/H fuzzy output feedback control design for nonlinear dynamic systems: An LMI approach, IEEE Trans. Fuzzy Syst., 2000, 8(3): 249–265.

    Article  Google Scholar 

  6. Chen B S and Zhang W, Stochastic H 2/H control with state-dependent noise, IEEE Trans. Automatic Control, 2004, 49(1): 45–57.

    Article  MathSciNet  Google Scholar 

  7. Zhang W and Chen B S, State feedback H control for a class of nonlinear stochastic systems, SIAM J. Control Optim., 2006, 44(6): 1973–1991.

    Article  MathSciNet  MATH  Google Scholar 

  8. Gershon E and Shaked U, Stochastic H 2 and H output-feedback of discrete-time LTI systems with state multiplicative noise, Syst. Control Lett., 2006, 55(3): 232–239.

    Article  MATH  Google Scholar 

  9. EL Bouhtouri A, Hinrichsen D, and Pritchard A J, H -type control for discrete-time stochastic systems, Int. J. Robust Nonlinear Control, 1999, 9(13): 923–948.

    Article  MathSciNet  MATH  Google Scholar 

  10. Muradore R and Picci G, Mixed H 2/H control: The discrete-time case, Syst. Control Lett., 2005, 54(1): 1–13.

    Article  MathSciNet  MATH  Google Scholar 

  11. Zhang W, Huang Y, and Zhang H, Stochastic H 2/H control for discrete-time systems with state and disturbance dependent noise, Automatica, 2007, 43(3): 513–521.

    Article  MathSciNet  MATH  Google Scholar 

  12. Zhang W, Huang Y, and Xie L, Infinite horizon stochastic H 2/H control for discrete-time systems with state and disturbance dependent noise, Automatica, 2007, 44(9): 2306–2316.

    Article  MathSciNet  MATH  Google Scholar 

  13. Hou T, Zhang W, and Ma H, Finite horizon H 2/H control for discrete-time stochastic systems with Markovian jumps and multiplicative noise, IEEE Trans. Automatic Control, 2010, 55(5): 1185–1191.

    Article  MathSciNet  Google Scholar 

  14. Lasry J M and Lions P L, Mean-field games, Jpn. J. Math., 2007, 2(1): 229–260.

    Article  MathSciNet  MATH  Google Scholar 

  15. Elliott R, Li X, and Ni Y H, Discrete-time mean-field stochastic linear-quadratic optimal control problems, Automatica, 2013, 49(11): 3222–3233.

    Article  MathSciNet  MATH  Google Scholar 

  16. Kac M, Fundations of kinetic theory, Proceedings of 3rd Berkeley Symposium on Mathematical Statistics and Probability, 1956, 3: 171–197.

    Google Scholar 

  17. Buckdahn R, Djehiche B, Li J, et al., Mean-field backward stochastic differential equations: A limit approach, Ann. Probab., 2009, 37(4): 1524–1565.

    Article  MathSciNet  MATH  Google Scholar 

  18. Buckdahn R, Li J, and Peng S, Mean-field backward stochastic differential equations and related partial differential equations, Stoch. Proc. their Appl., 2009, 119(10): 3133–3154.

    Article  MathSciNet  MATH  Google Scholar 

  19. Crisan D and Xiong J, Approximate Mckean-Vlasov representations for a class of SPDE, Stoch.: Int. J. Probab. Stoch. Process., 2010, 82(1): 53–68.

    MathSciNet  MATH  Google Scholar 

  20. Buckdahn R, Djehiche B, and Li J, A general maximum principle for SDEs of mean-field type, Appl. Math. Optim., 2011, 64(2): 197–216.

    Article  MathSciNet  MATH  Google Scholar 

  21. Li J, Stochastic maximum principle in the mean-field controls, Automatica, 2012, 48(2): 366–373.

    Article  MathSciNet  MATH  Google Scholar 

  22. Shen Y and Siu T K, The maximum principle for a jump-diffusion mean-field model and its application to the mean-variance problem, Nonlinear Analysis, 2013, 86: 58–73.

    Article  MathSciNet  MATH  Google Scholar 

  23. Andersson D and Djehiche B, A maximum principle for SDEs of mean-field type, Appl. Math. Optim., 2011, 63(3): 341–356.

    Article  MathSciNet  MATH  Google Scholar 

  24. Huang M, Caines P E, and Malhamé R P, Large-population cost-coupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized e-Nash equilibria, IEEE Trans. Automatic Control, 2007, 52(9): 1560–1571.

    Article  MathSciNet  Google Scholar 

  25. Huang M, Caines P E, and Malhamé R P, Social optima in mean field LQG control: Centralized and decentralized strategies, IEEE Trans. Automatic Control, 2012, 57(7): 1736–1751.

    Article  MathSciNet  Google Scholar 

  26. Yong J M, Linear-quadratic optimal control problems for mean-field stochastic differential equations, SIAM J. Control Optim., 2013, 51(4): 2809–2838.

    Article  MathSciNet  MATH  Google Scholar 

  27. Du C, Xie L, Teoh J N, and Guo G, An improved mixed H 2/H control design for hard disk drives, IEEE Trans. Control Syst. Technol., 2005, 13(5): 832–839.

    Article  Google Scholar 

  28. Ma H, Zhang W, and Hou T, Infinite horizon H 2/H control for discrete-time time-varying Markov jump systems with multiplicative noise, Automatica, 2012, 48(7): 1447–1454.

    Article  MathSciNet  MATH  Google Scholar 

  29. Chen X and Zhou K, Multiobjective H 2/H control design, SIAM J. Control Optim., 2001, 40(2): 628–660.

    Article  MathSciNet  MATH  Google Scholar 

  30. Lin C and Chen B S, Achieving pareto optimal power tracking control for interference limited wireless systems via multi-objective H 2/H optimization, IEEE Trans. Wireless Commun., 2013, 12(12): 6154–6165.

    Article  Google Scholar 

  31. Hafayed M, Singular mean-field optimal control for forward-backward stochastic systems and applications to finance, Int. J. Dynam. Control, 2014, 2(4): 542–554.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weihai Zhang.

Additional information

This paper was supported by the National Natural Science Foundation of China under Grant Nos. 61573227, 61633014, the Research Fund for the Taishan Scholar Project of Shandong Province of China, the SDUST Research Fund under Grant No. 2015TDJH105, and the State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources under Grant No. LAPS16011

This paper was recommended for publication by Editor CHEN Jie

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, W., Ma, L. & Zhang, T. Discrete-time mean-field stochastic H 2/H control. J Syst Sci Complex 30, 765–781 (2017). https://doi.org/10.1007/s11424-017-5010-6

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-017-5010-6

Keywords

Navigation