Abstract:
We address the problem of controlling a Markov Decision Process (MDP) such that the probability of satisfying a temporal logic specification over a set of properties asso...Show MoreMetadata
Abstract:
We address the problem of controlling a Markov Decision Process (MDP) such that the probability of satisfying a temporal logic specification over a set of properties associated to its states is maximized. We focus on specifications given as formulas of Probabilistic Computation Tree Logic (PCTL) and show that controllers can be synthesized by adapting existing PCTL model checking algorithms. We illustrate the approach by applying it to the automatic deployment of a mobile robot in an indoor-like environment with respect to a PCTL specification.
Published in: Proceedings of the 2011 American Control Conference
Date of Conference: 29 June 2011 - 01 July 2011
Date Added to IEEE Xplore: 18 August 2011
ISBN Information: