Skip to main content
Log in

Asymptotic form of the bias of entropy estimator for Bernoulli measures

  • Published:
Automatic Control and Computer Sciences Aims and scope Submit manuscript

Abstract

The exact asymptotic form for the bias of entropy estimator [8] for Bernoulli measures is found.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gradshtein, I.S., and Ryzhik, I.M., Tablitsy integralov, summ, ryadov i proizvedenii (Tables of Integrals, Sums, Series, and Products), Moscow: Nauka, 1971.

    Google Scholar 

  2. Flajolet, P., and Sedgewick, R., Analytic Combinatorics, New York: Cambridge Univ. Press, 2008.

    Google Scholar 

  3. Kaltchenko, A., and Timofeeva, N., Entropy Estimators with Almost Sure Convergence and an O(n−1) Variance, Adv. Math. Commun., 2008, vol. 2, no. 1, pp. 1–13.

    Article  MATH  MathSciNet  Google Scholar 

  4. Kaltchenko, A., and Timofeeva, N., Rate of Convergence of the Nearest Neighbor Entropy Estimator, AEU-Int. J. Electron. Commun., 2010, vol. 64, no. 1, pp. 75–79.

    Article  Google Scholar 

  5. Knuth, D., Iskusstvo programmirovaniya dlya EVM (The Art of Computer Programming), Moscow: Mir, 1978, vol. 3.

    Google Scholar 

  6. Martin, N., and England, J., Matematicheskaya teoriya entropii (Mathematical Theory of Entropy), Moscow: Mir, 1988.

    Google Scholar 

  7. Szpankowski, W., Average Case Analysis of Algorithms on Sequences, New York: Wiley, 2001.

    MATH  Google Scholar 

  8. Timofeev, E.A., Statistically Estimated Measure Invariants, Algebra Analiz, 2005, vol. 17, no. 3, pp. 204–236.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to E. A. Timofeev.

Additional information

Original Russian Text © E.A. Timofeev, 2009, published in Avtomatika i Vychislitel’naya Tekhnika, 2009, No. 4, pp. 96–108.

About this article

Cite this article

Timofeev, E.A. Asymptotic form of the bias of entropy estimator for Bernoulli measures. Aut. Conrol Comp. Sci. 44, 467–475 (2010). https://doi.org/10.3103/S014641161007014X

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S014641161007014X

Keywords

Navigation