Skip to main content
Log in

Remarks on Reverse Pinsker Inequalities

  • INFORMATION THEORY
  • Published:
Problems of Information Transmission Aims and scope Submit manuscript

Abstract

In this note we propose a simplified approach to recent reverse Pinsker inequalities due to O. Binette. More precisely, we give direct proofs of optimal variational bounds on f-divergence with possible constraints on relative information extrema. Our arguments are closer in spirit to those of Sason and Verdú.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Binette, O., A Note on Reverse Pinsker Inequalities, IEEE Trans. Inform. Theory, 2019, vol. 65, no. 7, pp. 4094–4096. https://doi.org/10.1109/TIT.2019.2896192

    Article  MathSciNet  MATH  Google Scholar 

  2. Prelov, V.V., On the Maximum Values of f-Divergence and Rényi Divergence under a Given Variational Distance, Probl. Peredachi Inf., 2020, vol. 56, no. 1, pp. 3–15 [Probl. Inf. Transm. (Engl. Transl.), 2020, vol. 56, no. 1, pp. 1–12]. https://doi.org/10.1134/S0032946020010019

    MathSciNet  MATH  Google Scholar 

  3. Prelov, V.V., On the Maximum \(f\)-Divergence of Probability Distributions Given the Value of Their Coupling Probl. Peredachi Inf., 2021, vol. 57, no. 4, pp. 24–33 [Probl. Inf. Transm.] (Engl. Transl.), 2021, vol. 57, no. 4, pp. 321–330. https://doi.org/10.1134/S0032946021040025

    MathSciNet  MATH  Google Scholar 

  4. Sason, I. and Verdú, S., \(f\)-Divergence Inequalities, IEEE Trans. Inform. Theory, 2016, vol. 62, no. 11, pp. 5973–6006. https://doi.org/10.1109/TIT.2016.2603151

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

The second author would like to thank Prof. Yang Yang (NJUST) for helpful communications on information theory and its applications in learning theory.

Funding

The research of Y.C. Huang was partially supported by the National NSF grant of China, no. 11801274. This note was completed while Y.C. Huang was on leave, funded by the CSC Postdoctoral/Visiting Scholar Program no. 202006865011, at LAGA, Université Sorbonne Paris Nord.

Author information

Authors and Affiliations

Authors

Additional information

Translated from Problemy Peredachi Informatsii, 2022, Vol. 58, No. 4, pp. 3–5. https://doi.org/10.31857/S0555292322040015

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gui, X., Huang, Y. Remarks on Reverse Pinsker Inequalities. Probl Inf Transm 58, 297–299 (2022). https://doi.org/10.1134/S0032946022040019

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0032946022040019

Keywords

Navigation