A new derivation of the entropy expressions | IEEE Journals & Magazine | IEEE Xplore

A new derivation of the entropy expressions


Abstract:

In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" (\log p_1,...Show More

Abstract:

In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" (\log p_1, \log p_2, \cdots, \log p_n). In the continuous case, the continuous analog of information density is integrated to obtain the entropy expression for continuous probability distributions.
Published in: IRE Transactions on Information Theory ( Volume: 7, Issue: 3, July 1961)
Page(s): 166 - 167
Date of Publication: 31 July 1961

ISSN Information:


Contact IEEE to Subscribe