Loading [a11y]/accessibility-menu.js
Control of Markov decision processes from PCTL specifications | IEEE Conference Publication | IEEE Xplore

Control of Markov decision processes from PCTL specifications


Abstract:

We address the problem of controlling a Markov Decision Process (MDP) such that the probability of satisfying a temporal logic specification over a set of properties asso...Show More

Abstract:

We address the problem of controlling a Markov Decision Process (MDP) such that the probability of satisfying a temporal logic specification over a set of properties associated to its states is maximized. We focus on specifications given as formulas of Probabilistic Computation Tree Logic (PCTL) and show that controllers can be synthesized by adapting existing PCTL model checking algorithms. We illustrate the approach by applying it to the automatic deployment of a mobile robot in an indoor-like environment with respect to a PCTL specification.
Date of Conference: 29 June 2011 - 01 July 2011
Date Added to IEEE Xplore: 18 August 2011
ISBN Information:

ISSN Information:

Conference Location: San Francisco, CA, USA

References

References is not available for this document.