Discrete-Time Stochastic LQR via Path Integral Control and Its Sample Complexity Analysis | IEEE Journals & Magazine | IEEE Xplore

Discrete-Time Stochastic LQR via Path Integral Control and Its Sample Complexity Analysis


Abstract:

In this letter, we derive the path integral control algorithm to solve a discrete-time stochastic Linear Quadratic Regulator (LQR) problem and carry out its sample comple...Show More

Abstract:

In this letter, we derive the path integral control algorithm to solve a discrete-time stochastic Linear Quadratic Regulator (LQR) problem and carry out its sample complexity analysis. While the stochastic LQR problem can be efficiently solved by the standard backward Riccati recursion, our primary focus in this letter is to establish the foundation for a sample complexity analysis of the path integral method when the analytical expressions of optimal control law and the cost are available. Specifically, we derive a bound on the error between the optimal LQR input and the input computed by the path integral method as a function of the sample size. Our analysis reveals that the sample size required exhibits a logarithmic dependence on the dimension of the control input. Lastly, we formulate a chance-constrained optimization problem whose solution quantifies the worst-case control performance of the path integral approach.
Published in: IEEE Control Systems Letters ( Volume: 8)
Page(s): 1595 - 1600
Date of Publication: 13 June 2024
Electronic ISSN: 2475-1456

References

References is not available for this document.