Skip to main content
Log in

Necessary Optimality Conditions in Discrete Nonsmooth Optimal Control

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

In this paper, we provide a simple proof of the maximum principle for a nonsmooth discrete-time optimal control problem. The methodology is general and encompasses all generalized derivatives for which the Lagrange multiplier rule and the chain rule hold. This includes, but is not limited to, limiting (Mordukhovich) and Michel–Penot subdifferentials.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Boltyanskii, V.G.: The Maximum Principle in the Theory of Optimal Processes. Dokl. Akad. Nauk SSSR 119, 1070–1073 (1958)

    MathSciNet  Google Scholar 

  2. Fan, L.-T., Wang, C.-S.: The Discrete-Time Maximum Principle: A Study of Multistage Systems Optimization. Wiley, New York (1964)

    Google Scholar 

  3. Halkin, H.: On the necessary conditions for the optimal control of nonlinear systems. J. Anal. Math. 12, 1–82 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  4. Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation. Springer, Berlin (2005)

    MATH  Google Scholar 

  5. Clarke, F., de Pinho, M.R.: Optimal control problems with mixed constraints. SIAM J. Control Optim. 48(7), 4500–4524 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  6. Mordukhovich, B.S.: Approximation Methods in Problems of Optimization and Control. Nauka, Moscow (1988). English translation published by Wiley (2010)

    MATH  Google Scholar 

  7. Mordukhovich, B.S.: Discrete approximations and refined Euler–Lagrange conditions for nonconvex differential inclusions. SIAM J. Control Optim. 33, 882–915 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  8. Vinter, R.B.: Optimal Control. Birkhäuser, Boston (2000)

    MATH  Google Scholar 

  9. Mordukhovich, B.S., Shvartsman, I.: Discrete maximum principle for nonsmooth optimal control problems with delays. Cybern. Syst. Anal. 2, 245–254 (2002)

    MathSciNet  Google Scholar 

  10. Shvartsman, I.: Necessary optimality conditions in discrete nonsmooth optimal control. In: Proceedings of the 50th IEEE Conference on Decision and Control, Orlando, FL (2011)

    Google Scholar 

  11. Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)

    Book  MATH  Google Scholar 

  12. Ioffe, A.D.: A Lagrange multiplier rule with small convex valued subdifferentials for nonsmooth problems of mathematical programming involving equality and nonfunctional constraints. Math. Program. 58, 137–145 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  13. Shvartsman, I.: New approximation method in the proof of the maximum principle for nonsmooth optimal control problems with state constraints. J. Math. Anal. Appl. 326(2), 974–1000 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  14. Clarke, F.: Optimization and Nonsmooth Analysis. Wiley, New York (1983)

    MATH  Google Scholar 

  15. Vinter, R.B., Zheng, H.: Some finance problems solved with nonsmooth optimization techniques. J. Optim. Theory Appl. 119(1), 1–18 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  16. Zhu, Q.J.: Mathematical analysis of investment systems. J. Math. Anal. Appl. 326(1), 708–720 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  17. Arutyunov, A.A., Vinter, R.B.: A simple ‘finite approximations’ proof of the Pontryagin maximum principle under reduced differentiability hypotheses. Set-Valued Anal. 12, 5–24 (2004)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ilya Shvartsman.

Additional information

Communicated by Boris Vexler.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shvartsman, I. Necessary Optimality Conditions in Discrete Nonsmooth Optimal Control. J Optim Theory Appl 153, 578–586 (2012). https://doi.org/10.1007/s10957-011-9978-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-011-9978-0

Keywords

Navigation