Skip to main content
SpringerLink
Log in

Generalization of a Pinsker problem

  • Information Theory
  • Published:
Problems of Information Transmission Aims and scope Submit manuscript

Abstract

A generalization of a Pinsker problem [1] on estimation of mutual information via variation is considered. We obtain some upper and lower bounds for the maximum of the absolute value of the difference between the mutual information of several random variables via variational distance between the probability distributions of these random variables. In some cases, these bounds are optimal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pinsker, M.S., On Estimation of Information via Variation, Probl. Peredachi Inf., 2005, vol. 41, no. 2, pp. 3–8 [Probl. Inf. Trans. (Engl. Transl.), 2005, vol. 41, no. 2, pp. 71–75].

    MathSciNet  Google Scholar 

  2. Csiszár, I. and Körner, J., Information Theory: Coding Theorems for Discrete Memoryless Systems, New York: Academic; Budapest: Akad. Kiadó, 1981. Translated under the title Teoriya informatsii: teoremy kodirovaniya dlya diskretnykh sistem bez pamyati, Moscow: Mir, 1985.

  3. Csiszár, I., Almost Independence and Secrecy Capacity, Probl. Peredachi Inf., 1996, vol. 32, no. 1, pp. 48–57 [Probl. Inf. Trans. (Engl. Transl.), 1996, vol. 32, no. 1, pp. 40–47].

    Google Scholar 

  4. Pinsker, M.S., Informatsiya i informatsionnaya ustoichivost’ sluchainykh velichin i protsessov, Probl. Peredachi Inf., issue 7, Moscow: Akad. Nauk SSSR, 1960. Translated under the title Information and Information Stability of Random Variables and Processes, San Francisco: Holden-Day, 1964.

    Google Scholar 

  5. Prelov, V.V., On Inequalities between Mutual Information and Variation, Probl. Peredachi Inf., 2007, vol. 43, no. 1, pp. 15–27 [Probl. Inf. Trans. (Engl. Transl.), 2007, vol. 43, no. 1, pp. 12–23].

    MathSciNet  Google Scholar 

  6. Prelov, V.V., Mutual Information of Several Random Variables and Its Estimation via Variation, Probl. Peredachi Inf., 2009, vol. 45, no. 4, pp. 3–17 [Probl. Inf. Trans. (Engl. Transl.), 2009, vol. 45, no. 4, pp. 295–308].

    MathSciNet  Google Scholar 

  7. Zhang, Z., Estimating Mutual Information via Kolmogorov Distance, IEEE Trans. Inform. Theory, 2007, vol. 53, no. 9, pp. 3280–3282.

    Article  MathSciNet  Google Scholar 

  8. Prelov, V.V. and van der Meulen, E.C., Mutual Information, Variation, and Fano’s Inequality, Probl. Peredachi Inf., 2008, vol. 44, no. 3, pp. 19–32 [Probl. Inf. Trans. (Engl. Transl.), 2008, vol. 44, no. 3, pp. 185–197].

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia

    V. V. Prelov

Authors
  1. V. V. Prelov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. V. Prelov.

Additional information

Original Russian Text © V.V. Prelov, 2011, published in Problemy Peredachi Informatsii, 2011, Vol. 47, No. 2, pp. 17–37.

Supported in part by the Russian Foundation for Basic Research, project no. 09-01-00536.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Prelov, V.V. Generalization of a Pinsker problem. Probl Inf Transm 47, 98–116 (2011). https://doi.org/10.1134/S0032946011020037

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0032946011020037

Keywords

Search

Navigation