Abstract
Let E be a denumerable state space and X be a homogeneous Markov chain on E with kernel P. Then the chain X verifies a weak Sanov's theorem, i.e., a weak large deviation principle holds for the law of the pair empirical measure. This LDP holds for any discrete state space Markov chain, not necessarily ergodic or irreducible. It is also known that a strong LDP cannot hold in the present framework. The result is obtained by a new method, which allows us to extend the LDP from a finite state space setting to a denumerable one, somehow like the projective limit approach. The analysis presented here offers some by-products, among which there are a contraction principle for the weak LDP, leading directly to a weak Sanov's theorem for the one-dimensional empirical measure. A refined analysis of the ubiquitous entropy function H proves to be useful in other frameworks, e.g., continuous time or stochastic networks, and allows us to improve the sharpness of asymptotics.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Bryc, W. and Dembo, A., Large Deviations and Strong Mixing, Ann. Inst. H. Poincaré, Probab. Statist., 1996, vol. 32, no. 4, pp. 549-569.
de La Fortelle, A., Large Deviation Principle for Markov Chains in Continuous Time, Probl. Peredachi Inf., 2001, vol. 36, no. 2, 40-61 [Probl. Inf. Trans. (Engl. Transl.), 2001, vol. 36, no. 2, pp. 120-139].
Delcoigne, F. and de La Fortelle, A., Large Deviations Rate Function for Polling Systems, Queueing Syst. Theory Appl., 2002, vol. 41, no. 1, pp. 13-44.
Delcoigne, F. and de La Fortelle, A., Large Deviations Problems for Star Networks: the Min Policy, Part 1: Finite Time, Preprint of INRIA, Rocquencourt, 2001, no. RR-4143.
Ellis, R.S., Large Deviations for a General Class of Random Vectors, Ann. Probab., 1984, vol. 12, no. 1, pp. 1-12.
Ellis, R.S., Entropy, Large Deviations, and Statistical Mechanics, Grundlehren der Mathematischen Wissenschaften (Fundamental Principles of Mathematical Science), vol. 271, New York: Springer, 1985.
Ellis, R.S., Large Deviations for the Empirical Measure of a Markov Chain with an Application to the Multivariate Empirical Measure. Ann. Probab., 1988, vol. 16, no. 4, pp. 1496-1508.
Sanov, I.N., On the Probability of Large Deviations of Random Variables, Select. Transl. Math. Statist. and Probability, vol. 1, Providence: Inst. Math. Statist. and AMS, 1961, pp. 213-244.
Miller, H.D., A Convexivity Property in the Theory of Random Variables Defined on a Finite Markov Chain, Ann. Math. Statist., 1961, vol. 32, pp. 1260-1270.
Csiszár, I., Cover, T.M., and Choi, B.S., Conditional Limit Theorems under Markov Conditioning, IEEE Trans. Inform. Theory, 1987, vol. 33, no. 6, pp. 788-801.
Dembo, A. and Zeitouni, O., Large Deviations Techniques and Applications, New York: Springer, 1998.
Deuschel, J.-D. and Stroock, D.W., Large Deviations, Pure Appl. Math., vol. 137, Boston: Academic, 1989.
Gallager, R., Information Theory and Reliable Communication, New York: Wiley, 1968.
Kullback, S. and Leibler, R.A., On Information and Sufficiency, Ann. Math. Statist., 1951, vol. 22, pp. 79-86.
Lewis, J. and Pfister, C., Thermodynamic Probability Theory: Some Aspects of Large Deviations, Usp. Mat. Nauk, 1995, vol. 50, no. 2 (302), pp. 47-88.
O'Brien, G.L. and Vervaat, W., Capacities, Large Deviations and Loglog Laws, in Stable Processes and Related Topics, Ithaca, USA, 1990, Boston: Birkhäuser, 1991, pp. 43-83.
Liptser, R.S., Large Deviations for Empirical Measures of Markov Processes (Discrete Time, the Noncompact Case), Teor. Veroyatn. Primen., 1996, vol. 41, no. 1, pp. 65-88.
Wu, L.M., Grandes déviations pour les processus de Markov essentiellement irréductibles. I. Temps discret, C. R. Acad. Sci. Paris, Sér. I Math., 1991, vol. 312, no. 8, pp. 609-614.
Dinwoodie, I.H. and Ney, P., Occupation Measures for Markov Chains, J. Theor. Probab., 1995, vol. 8, no. 3, pp. 679-691.
de Acosta, A. and Ney, P., Large Deviation Lower Bounds for Arbitrary Additive Functionals of a Markov Chain, Ann. Probab., 1998, vol. 26, no. 4, pp. 1660-1682.
Dinwoodie, I.H., Identifying a Large Deviation Rate Function, Ann. Probab., 1993, vol. 21, no. 1, pp. 216-231.
de Acosta, A., Upper Bounds for Large Deviations of Dependent Random Vectors, Z. Wahrsch. Verw. Geb., 1985, vol. 69, no. 4. pp. 551-565.
Fayolle, G. and de La Fortelle, A., Large Deviation Principle for Markov Chains in Discrete Time, Preprint of INRIA, Rocquencourt, 1999, no. RR-3791.
Berge, C., Graphs, North-Holland Mathematical Library, vol. 6, Amsterdam: North-Holland, 1985, 2nd rev. ed.
Rockafellar, R.T., Convex Analysis, Princeton Math. Series, vol. 28, Princeton: Princeton Univ. Press, 1970.
Barbu, V. and Precupanu, T., Convexity and Optimization in Banach Spaces, Mathematics and Its Applications (East European Series), vol. 10, Dordrecht: Reidel, 1986, 2nd ed.
Lay, S.R., Convex Sets and Their Applications, Malabar: Krieger, 1992, rev. reprint.
Bourbaki, N., Éléments de mathématique, fasc. 15, livre 5: Espaces vectoriels topologiques, Ch. 1: Espaces vectoriels topologiques sur un corps valué, Ch. 2: Ensembles convexes et espaces localement convexes, Actualités Scientifiques et Industrielles, vol. 1189, Paris: Hermann, 1966, 2nd ed.
Rights and permissions
About this article
Cite this article
Fayolle, G., de La Fortelle, A. Entropy and Large Deviations for Discrete-Time Markov Chains. Problems of Information Transmission 38, 354–367 (2002). https://doi.org/10.1023/A:1022006130735
Issue Date:
DOI: https://doi.org/10.1023/A:1022006130735