Abstract:
In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" (\log p_1,...Show MoreMetadata
Abstract:
In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" (\log p_1, \log p_2, \cdots, \log p_n). In the continuous case, the continuous analog of information density is integrated to obtain the entropy expression for continuous probability distributions.
Published in: IRE Transactions on Information Theory ( Volume: 7, Issue: 3, July 1961)