Abstract
In this paper, we provide a simple proof of the maximum principle for a nonsmooth discrete-time optimal control problem. The methodology is general and encompasses all generalized derivatives for which the Lagrange multiplier rule and the chain rule hold. This includes, but is not limited to, limiting (Mordukhovich) and Michel–Penot subdifferentials.
Similar content being viewed by others
References
Boltyanskii, V.G.: The Maximum Principle in the Theory of Optimal Processes. Dokl. Akad. Nauk SSSR 119, 1070–1073 (1958)
Fan, L.-T., Wang, C.-S.: The Discrete-Time Maximum Principle: A Study of Multistage Systems Optimization. Wiley, New York (1964)
Halkin, H.: On the necessary conditions for the optimal control of nonlinear systems. J. Anal. Math. 12, 1–82 (1964)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation. Springer, Berlin (2005)
Clarke, F., de Pinho, M.R.: Optimal control problems with mixed constraints. SIAM J. Control Optim. 48(7), 4500–4524 (2010)
Mordukhovich, B.S.: Approximation Methods in Problems of Optimization and Control. Nauka, Moscow (1988). English translation published by Wiley (2010)
Mordukhovich, B.S.: Discrete approximations and refined Euler–Lagrange conditions for nonconvex differential inclusions. SIAM J. Control Optim. 33, 882–915 (1995)
Vinter, R.B.: Optimal Control. Birkhäuser, Boston (2000)
Mordukhovich, B.S., Shvartsman, I.: Discrete maximum principle for nonsmooth optimal control problems with delays. Cybern. Syst. Anal. 2, 245–254 (2002)
Shvartsman, I.: Necessary optimality conditions in discrete nonsmooth optimal control. In: Proceedings of the 50th IEEE Conference on Decision and Control, Orlando, FL (2011)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)
Ioffe, A.D.: A Lagrange multiplier rule with small convex valued subdifferentials for nonsmooth problems of mathematical programming involving equality and nonfunctional constraints. Math. Program. 58, 137–145 (1993)
Shvartsman, I.: New approximation method in the proof of the maximum principle for nonsmooth optimal control problems with state constraints. J. Math. Anal. Appl. 326(2), 974–1000 (2007)
Clarke, F.: Optimization and Nonsmooth Analysis. Wiley, New York (1983)
Vinter, R.B., Zheng, H.: Some finance problems solved with nonsmooth optimization techniques. J. Optim. Theory Appl. 119(1), 1–18 (2003)
Zhu, Q.J.: Mathematical analysis of investment systems. J. Math. Anal. Appl. 326(1), 708–720 (2007)
Arutyunov, A.A., Vinter, R.B.: A simple ‘finite approximations’ proof of the Pontryagin maximum principle under reduced differentiability hypotheses. Set-Valued Anal. 12, 5–24 (2004)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Boris Vexler.
Rights and permissions
About this article
Cite this article
Shvartsman, I. Necessary Optimality Conditions in Discrete Nonsmooth Optimal Control. J Optim Theory Appl 153, 578–586 (2012). https://doi.org/10.1007/s10957-011-9978-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-011-9978-0