Abstract
An entropy estimator constructed with respect to specially selected metrics is studied. It is shown that the estimator converges almost everywhere and the decrease in its variance is of an power order. For symmetric Bernoulli measures, the bias of the estimator is found.
Similar content being viewed by others
References
Gradshtein, I.S., and Ryzhik, I.M., Tablitsy integralov, summ, ryadov i proizvedenii (Tables of Integrals, Sums, Series, and Products), Moscow: Nauka, 1971.
Devroye, L., Exponential Inequalities in Nonparametric Estimation, Nonparametric Functional Estimation and Related Topics, Roussas, G., Ed., NATO ASI Series, Series C: Mathematical and Physical Sciences, vol. 335, Dordrecht, Netherlands: Kluwer Academic, 1991, pp. 31–44.
McDiarmid, C., On the Method of Bounded Differences, in Surveys in Combinatorics, Cambridge: Cambridge Univ. Press, 1989, pp. 148–188.
Kaltchenko, A., and Timofeeva, N., Entropy Estimators with Almost Sure Convergence and an \( \mathcal{O} \)(n −1) Variance, Adv. Math. Computat., 2008, vol. 2, no. 1, pp. 1–13.
Kaltchenko, A., and Timofeeva, N., Rate of Convergence of the Nearest Neighbor Entropy Estimator, AEU-Int. J. Electron. Commun., 2010, vol. 64, no. 1, pp. 75–79.
Timofeev, E.A., Statistically Estimated Measure Invariants, Algebra Analiz, 2005, vol. 17, no. 3, pp. 204–236.
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © N.E. Timofeeva, 2009, published in Modelirovanie i Analiz Informatsionnykh Sistem, 2009, No. 1, pp. 44–53.
About this article
Cite this article
Timofeeva, N.E. Linear metrics for entropy estimation. Aut. Conrol Comp. Sci. 44, 426–433 (2010). https://doi.org/10.3103/S0146411610070096
Received:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S0146411610070096