Skip to main content

Advertisement

Springer Nature Link
Log in

An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Mohammed, S.E.A.: Stochastic differential equations with memory: theory, examples and applications. Ustunel Prog. Prob. Birkhauser 42, 1–77 (1998)

    MATH  Google Scholar 

  2. Arriojas, M., Hu, Y., Mohammed, S.E.A., Pap, G.: A delayed black and scholes formula. Stoch. Anal. Appl. 25(2), 471–492 (2007)

    Article  MathSciNet  Google Scholar 

  3. Chen, L., Wu, Z.: Maximum principle for the stochastic optimal control problem with delay and application. Automatica 46(6), 1074–1080 (2010)

    Article  MathSciNet  Google Scholar 

  4. Peng, S., Yang, Z.: Anticipated backward stochastic differential equations. Ann. Prob. 37(3), 877–902 (2009)

    Article  MathSciNet  Google Scholar 

  5. Mohammed, S.E.A.: Stochastic functional differential equations. Pitman Adv. Pub. 18(2), 63–64 (1984)

    MathSciNet  Google Scholar 

  6. Richard, J.P.: Time-delay systems: an overview of some recent advances and open problems. Automatica 39(10), 1667–1694 (2003)

    Article  MathSciNet  Google Scholar 

  7. Swishchuk, A.: Modeling and pricing of variance swaps for stochastic volatilities with delay. Wilmott Mag. 19(9), 63–73 (2005)

    Google Scholar 

  8. Øksendal, B., Sulem, A., Zhang, T.: Optimal control of stochastic delayed equations and time-advanced backward stochastic differential equations. Adv. Appl. Prob. 43(2), 572–596 (2011)

    Article  Google Scholar 

  9. Lv, S., Tao, R., Wu, Z.: Maximum principle for optimal control of anticipated forward–backward stochastic differential delayed systems with regime switching. Optimal Control Appl. Methods 37(1), 154–175 (2016)

    Article  MathSciNet  Google Scholar 

  10. Yu, Z.: The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls. Automatica 48(10), 2420–2432 (2012)

    Article  MathSciNet  Google Scholar 

  11. Peng, S.: New development in stochastic maximum principle and related backward stochastic differential equations. In: Proceedings of 31st CDC Conference, Tucson (1992)

  12. Chen, S., Li, X., Zhou, X.Y.: Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J. Control Optim. 36(5), 1685–1702 (1998)

    Article  MathSciNet  Google Scholar 

  13. Rami, M.A., Zhou, X.Y., Moore, J.B.: Well-posedness and attainability of indefinite stochastic linear quadratic control in infinite time horizon. Syst. Control Lett. 41(2), 123–133 (2000)

    Article  MathSciNet  Google Scholar 

  14. Rami, M., Chen, X., Moore, J., Zhou, X.: Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls. IEEE Trans. Autom. Control 46(3), 428–440 (2001)

    Article  MathSciNet  Google Scholar 

  15. Qian, Z., Zhou, X.Y.: Existence of solutions to a class of indefinite stochastic Riccati equations. SIAM J. Control Optim. 51(1), 221–229 (2013)

    Article  MathSciNet  Google Scholar 

  16. Ivanov, I.: The LMI approach for stabilizing of linear stochastic systems. Int. J. Stoch. Anal. 2013, 1–5 (2013)

    Article  MathSciNet  Google Scholar 

  17. Yu, Z.: Equivalent cost functionals and stochastic linear quadratic optimal control problems. ESAIM Control Optim. Calc. Var. 19(1), 78–90 (2013)

    Article  MathSciNet  Google Scholar 

  18. Huang, J., Yu, Z.: Solvability of indefinite stochastic Riccati equations and linear quadratic optimal control problems. Syst. Control Lett. 68(1), 68–75 (2014)

    Article  MathSciNet  Google Scholar 

  19. Li, N., Wu, Z., Yu, Z.: An indefinite stochastic linear quadratic optimal control problem for the FBSDE system with jumps. In: The 34th Chinese Control Conference, pp. 1682–1686 (2015)

  20. Li, N., Wu, Z., Yu, Z.: Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations. Sci. China Math. (2017). https://doi.org/10.1007/s11425-015-0776-6

    Article  MATH  Google Scholar 

  21. Hu, Y., Peng, S.: Solution of forward–backward stochastic differential equations. Prob. Theory Relat. Fields 103(2), 273–283 (1995)

    Article  MathSciNet  Google Scholar 

  22. Peng, S., Wu, Z.: Fully coupled forward–backward stochastic differential equations and applications to optimal control. SIAM J. Control Optim. 37(3), 825–843 (1999)

    Article  MathSciNet  Google Scholar 

  23. Zhang, H., Li, L., Xu, J., Fu, M.: Linear quadratic regulation and stabilization of discrete-time systems with delay and multiplicative noise. IEEE Trans. Autom. Control 60(10), 2599–2613 (2015)

    Article  MathSciNet  Google Scholar 

  24. Zhang, H., Xu, J.: Control for Itô stochastic systems with input delay. IEEE Trans. Autom. Control 62(1), 350–365 (2017)

    Article  Google Scholar 

  25. Ramsey, F.P.: A mathematical theory of saving. Econ. J. 38(152), 543–559 (1928)

    Article  Google Scholar 

  26. Huang, J., Wang, G., Wu, Z.: Optimal premium policy of an insurance firm: full and partial information. Insur. Math. Econ. 47, 208–215 (2010)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

Na Li is supported by the National Natural Science Foundation of China (Grant No. 11626142), the Natural Science Foundation of Shandong Province (Grant No. ZR2016AB08), the Colleges and Universities Science and Technology Plan Project of Shandong Province (Grant No. J16LI55), Key Laboratory of Oceanographic Big Data Mining and Application of Zhejiang Province (OBDMA201604), and the Fostering Project of Dominant Discipline and Talent Team of Shandong University of Finance and Economics. Zhen Wu is supported by the National Natural Science Foundation of China (Grant No. 61573217), the National High-level personnel of special support program and the Chang Jiang Scholar Program of Chinese Education Ministry. The authors would like to thank the associated editor and the anonymous referees for their constructive and insightful comments to improve the quality of this work. And we would like to thank Prof. Zhiyong Yu for many helpful discussions and suggestions.

Author information

Authors and Affiliations

  1. School of Statistics, Shandong University of Finance and Economics, Jinan, Shandong, China

    Na Li

  2. School of Mathematics, Shandong University, Jinan, Shandong, China

    Yuan Wang & Zhen Wu

Authors
  1. Na Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yuan Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Zhen Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zhen Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, N., Wang, Y. & Wu, Z. An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations. J Optim Theory Appl 179, 722–744 (2018). https://doi.org/10.1007/s10957-018-1237-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-018-1237-1

Keywords

Mathematics Subject Classification