Abstract
In this paper we prove that every finite Markov chain can be decomposed into a cascade product of a Bernoulli process and several simple permutation-reset deterministic automata. The original chain is a statehomomorphic image of the product. By doing so we give a positive answer to an open question stated in [Paz71] concerning the decomposability of probabilistic systems. Our result is based on the surprisingly-original observation that in probabilistic transition systems, “randomness” and “memory” can be separated in such a way that allows the non-random part to be treated using common deterministic automata-theoretic techniques. The same separation technique can be applied as well to other kinds of non-determinism.
The results presented in this paper have been obtained while the author was with INRIA/IRISA, Rennes, France.
Preview
Unable to display preview. Download preview PDF.
References
M.A. Arbib, Theories of Abstract Automata, Prentice-Hall, Englewood Cliffs, 1968.
S. Eilenberg, Automata, Languages and Machines, Vol. B, Academic Press, New York, 1976.
A. Ginzburg, Algebraic Theory of Automata, Academic Press, New York, 1968.
J.G. Kemeny and J.L. Snell, Finite Markov Chains, Van Nostrand, New York, 1960.
K. Krohn and J.L. Rhodes, Algebraic Theory of Machines, I Principles of Finite Semigroups and Machines, Transactions of the American Mathematical Society 116, 450–464, 1965.
G. Lallement, Semigroups and Combinatorial Applications, Wiley, New York, 1979.
O. Maler and A. Pnueli, Tight Bounds on the Complexity of Cascaded Decomposition of Automata, Proc. 31st FOCS, 672–682, 1990.
A. Paz, Introduction to Probabilistic Automata, Academic Press, New York, 1970.
J.-E. Pin, Varieties of Formal Languages, Plenum, New York, 1986.
P.H. Starke, Abstract Automata, North-Holland, Amsterdam, 1972.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maler, O. (1993). A decomposition theorem for probabilistic transition systems. In: Enjalbert, P., Finkel, A., Wagner, K.W. (eds) STACS 93. STACS 1993. Lecture Notes in Computer Science, vol 665. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-56503-5_33
Download citation
DOI: https://doi.org/10.1007/3-540-56503-5_33
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-56503-1
Online ISBN: 978-3-540-47574-3
eBook Packages: Springer Book Archive