Loading [a11y]/accessibility-menu.js
Dual Effect, Certainty Equivalence, and Separation Revisited: A Counterexample and a Relaxed Characterization for Optimality | IEEE Journals & Magazine | IEEE Xplore

Dual Effect, Certainty Equivalence, and Separation Revisited: A Counterexample and a Relaxed Characterization for Optimality


Abstract:

In this article, we study the optimality of control policies admitting certainty equivalence or separation (of estimation and control) in discrete-time stochastic control...Show More

Abstract:

In this article, we study the optimality of control policies admitting certainty equivalence or separation (of estimation and control) in discrete-time stochastic control, with the following two main contributions. We first revisit the influential theorem given in the seminal 1974 paper by Bar-Shalom and Tse, which studies the equivalence between certainty equivalence (CE) and no-dual-effect (NDE) properties in discrete-time stochastic control problems involving a linear dynamic system with a possibly nonlinear measurement function. We show that there is a subtle error in Bar-Shalom and Tse’s proof of the claim that CE implies NDE. Moreover, we prove that the claim does not hold by providing a counterexample. As our second and primary contribution, we introduce an alternative and a more relaxed notion of dual freeness and establish that this new notion is sufficient to guarantee the separation of estimation and control and CE in the same control problem considered by Bar-Shalom and Tse.
Published in: IEEE Transactions on Automatic Control ( Volume: 68, Issue: 2, February 2023)
Page(s): 1259 - 1266
Date of Publication: 14 February 2022

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.