Loading [a11y]/accessibility-menu.js
Stochastic Differential Dynamic Programming | IEEE Conference Publication | IEEE Xplore

Stochastic Differential Dynamic Programming


Abstract:

Although there has been a significant amount of work in the area of stochastic optimal control theory towards the development of new algorithms, the problem of how to con...Show More

Abstract:

Although there has been a significant amount of work in the area of stochastic optimal control theory towards the development of new algorithms, the problem of how to control a stochastic nonlinear system remains an open research topic. Recent iterative linear quadratic optimal control methods iLQG handle control and state multiplicative noise while they are derived based on first order approximation of dynamics. On the other hand, methods such as Differential Dynamic Programming expand the dynamics up to the second order but so far they can handle nonlinear systems with additive noise. In this work we present a generalization of the classic Differential Dynamic Programming algorithm. We assume the existence of state and control multiplicative process noise, and proceed to derive the second-order expansion of the cost-to-go. We find the correction terms that arise from the stochastic assumption. Despite having quartic and cubic terms in the initial expression, we show that these vanish, leaving us with the same quadratic structure as standard DDP.
Date of Conference: 30 June 2010 - 02 July 2010
Date Added to IEEE Xplore: 29 July 2010
ISBN Information:

ISSN Information:

Conference Location: Baltimore, MD, USA

References

References is not available for this document.