Skip to main content

Discrete Optimal Control

  • Living reference work entry
  • First Online:
Encyclopedia of Systems and Control
  • 834 Accesses

Synonyms

DOC

Definition

Discrete optimal control is a branch of mathematics which studies optimization procedures for controlled discrete-time models, that is, the optimization of a performance index associated to a discrete-time control system.

Motivation

Optimal control theory is a mathematical discipline with innumerable applications in both science and engineering. Recently, in discrete optimal control theory, a great interest has appeared in developing numerical methods to optimally control real mechanical systems, as for instance, autonomous robotic vehicles in natural environments such as robotic arms, spacecrafts, or underwater vehicles.

During the last years, a huge effort has been made for the comprehension of the fundamental geometric structures appearing in dynamical systems, including control systems and optimal control systems. This new geometric understanding of those systems has made possible the construction of suitable numerical techniques for integration. A...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Bibliography

  • Bock HG, Plitt KJ (1984) A multiple shooting algorithm for direct solution of optimal control problems. In: 9th IFAC world congress, Budapest. Pergamon Press, pp 242–247

    Google Scholar 

  • Bloch AM, Hussein I, Leok M, Sanyal AK (2009) Geometric structure-preserving optimal control of a rigid body. J Dyn Control Syst 15(3):307–330

    Article  MATH  MathSciNet  Google Scholar 

  • Bloch AM, Crouch PE, Nordkvist N (2013) Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. J Geom Mech 5(1):1–38

    Article  MATH  MathSciNet  Google Scholar 

  • Bonnans JF, Laurent-Varin J (2006) Computation of order conditions for symplectic partitioned Runge-Kutta schemes with application to optimal control. Numer Math 103:1–10

    Article  MATH  MathSciNet  Google Scholar 

  • Bou-Rabee N, Marsden JE (2009) Hamilton-Pontryagin integrators on Lie groups: introduction and structure-preserving properties. Found Comput Math 9(2):197–219

    Article  MATH  MathSciNet  Google Scholar 

  • Cadzow JA (1970) Discrete calculus of variations. Int J Control 11:393–407

    Article  MATH  Google Scholar 

  • de León M, Martí’n de Diego D, Santamaría-Merino A (2007) Discrete variational integrators and optimal control theory. Adv Comput Math 26(1–3):251–268

    Article  MATH  MathSciNet  Google Scholar 

  • Hager WW (2001) Numerical analysis in optimal control. In: International series of numerical mathematics, vol 139. Birkhäuser Verlag, Basel, pp 83–93

    Google Scholar 

  • Hairer E, Lubich C, Wanner G (2002) Geometric numerical integration, structure-preserving algorithms for ordinary differential equations’. Springer series in computational mathematics, vol 31. Springer, Berlin

    Google Scholar 

  • Hussein I, Leok M, Sanyal A, Bloch A (2006) A discrete variational integrator for optimal control problems on SO(3)’. In: Proceedings of the 45th IEEE conference on decision and control, San Diego, pp 6636–6641

    Google Scholar 

  • Hwang CL, Fan LT (1967) A discrete version of Pontryagin’s maximum principle. Oper Res 15:139–146

    Article  MATH  MathSciNet  Google Scholar 

  • Jordan BW, Polak E (1964) Theory of a class of discrete optimal control systems. J Electron Control 17:697–711

    Article  MathSciNet  Google Scholar 

  • Jiménez F, Martín de Diego D (2010) A geometric approach to Discrete mechanics for optimal control theory. In: Proceedings of the IEEE conference on decision and control, Atlanta, pp 5426–5431

    Google Scholar 

  • Jiménez F, Kobilarov M, Martín de Diego D (2013) Discrete variational optimal control. J Nonlinear Sci 23(3):393–426

    Article  MATH  MathSciNet  Google Scholar 

  • Junge O, Ober-Blöbaum S (2005) Optimal reconfiguration of formation flying satellites. In: IEEE conference on decision and control and European control conference ECC, Seville

    Google Scholar 

  • Junge O, Marsden JE, Ober-Blöbaum S (2006) Optimal reconfiguration of formation flying spacecraft- a decentralized approach. In: IEEE conference on decision and control and European control conference ECC, San Diego, pp 5210–5215

    Google Scholar 

  • Kobilarov M (2008) Discrete geometric motion control of autonomous vehicles. Thesis, Computer Science, University of Southern California

    Google Scholar 

  • Kobilarov M, Marsden JE (2011) Discrete geometric optimal control on Lie groups. IEEE Trans Robot 27(4):641–655

    Article  Google Scholar 

  • Leok M (2004) Foundations of computational geometric mechanics, control and dynamical systems. Thesis, California Institute of Technology. Available in http://www.math.lsa.umich.edu/~mleok

  • Leyendecker S, Ober-Blobaum S, Marsden JE, Ortiz M (2007) Discrete mechanics and optimal control for constrained multibody dynamics. In: 6th international conference on multibody systems, nonlinear dynamics, and control, ASME international design engineering technical conferences, Las Vegas

    Google Scholar 

  • Marrero JC, Martín de Diego D, Martínez E (2006) Discrete Lagrangian and Hamiltonian mechanics on Lie groupoids. Nonlinearity 19:1313–1348. Corrigendum: Nonlinearity 19

    Google Scholar 

  • Marrero JC, Martín de Diego D, Stern A (2010) Lagrangian submanifolds and discrete constrained mechanics on Lie groupoids. Preprint, To appear in DCDS-A 35-1, January 2015.

    Google Scholar 

  • Marsden JE, West M (2001) Discrete mechanics and variational integrators. Acta Numer 10: 357–514

    Article  MATH  MathSciNet  Google Scholar 

  • Marsden JE, Pekarsky S, Shkoller S (1999a) Discrete Euler-Poincaré and Lie-Poisson equations. Nonlinearity 12:1647–1662

    Article  MATH  MathSciNet  Google Scholar 

  • Marsden JE, Pekarsky S, Shkoller S (1999b) Symmetry reduction of discrete Lagrangian mechanics on Lie groups. J Geom Phys 36(1–2):140–151

    MathSciNet  Google Scholar 

  • Ober-Blöbaum S (2008) Discrete mechanics and optimal control. Ph.D. Thesis, University of Paderborn

    Google Scholar 

  • Ober-Blöbaum S, Junge O, Marsden JE (2011) Discrete mechanics and optimal control: an analysis. ESAIM Control Optim Calc Var 17(2):322–352

    Article  MATH  MathSciNet  Google Scholar 

  • Pytlak R (1999) Numerical methods for optimal control problems with state constraints. Lecture Notes in Mathematics, 1707. Springer-Verlag, Berlin, xvi+215 pp.

    Google Scholar 

  • Wendlandt JM, Marsden JE (1997a) Mechanical integrators derived from a discrete variational principle. Phys D 106:2232–2246

    Article  MathSciNet  Google Scholar 

  • Wendlandt JM, Marsden JE (1997b) Mechanical systems with symmetry, variational principles and integration algorithms. In: Alber M, Hu B, Rosenthal J (eds) Current and future directions in applied mathematics, (Notre Dame, IN, 1996), Birkhäuser Boston, Boston, MA, pp 219–261

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Martin De Diego .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag London

About this entry

Cite this entry

Diego, D. (2014). Discrete Optimal Control. In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, London. https://doi.org/10.1007/978-1-4471-5102-9_47-1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-5102-9_47-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, London

  • Online ISBN: 978-1-4471-5102-9

  • eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering

Publish with us

Policies and ethics