Abstract
The objective of this study is to introduce an abstraction procedure that applies to a general class of dynamical systems, that is to discrete-time stochastic hybrid systems (dt-SHS). The procedure abstracts the original dt-SHS into a Markov set-chain (MSC) in two steps. First, a Markov chain (MC) is obtained by partitioning the hybrid state space, according to a controllable parameter, into non-overlapping domains and computing transition probabilities for these domains according to the dynamics of the dt-SHS. Second, explicit error bounds for the abstraction that depend on the above parameter are derived, and are associated to the computed transition probabilities of the MC, thus obtaining a MSC. We show that one can arbitrarily increase the accuracy of the abstraction by tuning the controllable parameter, albeit at an increase of the cardinality of the MSC. Resorting to a number of results from the MSC literature allows the analysis of the dynamics of the original dt-SHS. In the present work, the asymptotic behavior of the dt-SHS dynamics is assessed within the abstracted framework.
This work was partially supported by European Commission under Project IST NoE HYCON contract n. 511368, STREP project n. TREN/07/FP6AE/S07.71574/ 037180 IFLY, and by the NSF grant CCR-0225610.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abate, A., Prandini, M., Lygeros, J., Sastry, S.: Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems. Automatica (accepted, 2007)
Alur, R., Henzinger, T., Lafferriere, G., Pappas, G.: Discrete abstractions of hybrid systems. Proceedings of the IEEE 88(2), 971–984 (2000)
Aziz, A., Sanwal, K., Singhal, V., Brayton, R.: Model-checking continuous time markov chains. ACM Trans. on Comp. Logic 1(1), 162–170 (2000)
Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. The MIT Press, Cambridge (2002)
Davis, M.H.A.: Markov Models and Optimization. Chapman & Hall/CRC Press, London (1993)
D’Innocenzo, A., Julius, A.A., Di Benedetto, M.D., Pappas, G.J.: Approximate timed abstractions of hybrid automata. In: Proceedings of the 46th IEEE Conference on Decision and Control. New Orleans, Louisiana, USA, 12–14 December (2007)
Girard, A., Pappas, G.J.: Approximation metrics for discrete and continuous systems. IEEE Transactions on Automatic Control 52(5), 782–798 (2007)
Hartfiel, H.J.: Markov Set-Chains. Lecture Notes in Mathematics, vol. 1695. Springer, Heidelberg (1998)
Julius, A.A., Pappas, G.J.: Approximate abstraction of stochastic hybrid systems. IEEE Trans. Automatic Control (provisionally accepted)
Kushner, H.J.: Approximation and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory. MIT Press, Cambridge (1984)
Øksendal, B.: Stochastic Differential Equations: An Introduction with Applications, 6th edn. Springer, Heidelberg (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abate, A., D’Innocenzo, A., Di Benedetto, M.D., Sastry, S.S. (2008). Markov Set-Chains as Abstractions of Stochastic Hybrid Systems. In: Egerstedt, M., Mishra, B. (eds) Hybrid Systems: Computation and Control. HSCC 2008. Lecture Notes in Computer Science, vol 4981. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78929-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-78929-1_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78928-4
Online ISBN: 978-3-540-78929-1
eBook Packages: Computer ScienceComputer Science (R0)