Skip to main content

Advertisement

Log in

Determination of a discrete distribution with given entropy

  • Published:
Operational Research Aims and scope Submit manuscript

Abstract

This paper gives an algorithm to determine a discrete distribution with specified entropy. Givenn andH n , the entropy, the distribution found is close to a discrete finite uniform distribution. Finally, the relative errors of the distribution found using this algorithm are compared to the ones of the discrete distribution obtained from the Lagrange multipliers method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Chung, K-L. (1997). Efficient Huffman Decoding. Information Processing Letters 61, 97–99.

    Article  Google Scholar 

  • Guiasu, S. (1977). Information Theory with Applications. McGraw Hill, New York.

    Google Scholar 

  • Huffman, D. A. (1952). A Method for the Construction of Minimum-redundancy Codes. Proceedings IRE 40 (Sept. 1952), 1098–1101.

    Article  Google Scholar 

  • Swaszek, P. F. and Wali, S. (2000). Generating Probabilities with a Specified Entropy. Journal of the Franklin Institute vol. 337 (2–3), 97–103.

    Article  Google Scholar 

  • Wali, S. (1997). Generating Discrete Memoryless Sources for Testing Variable Length Codes. M. S. E. E. thesis, Department of Electrical Engineering, University of Rhode Island.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Romica Trandafir.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Trandafir, R. Determination of a discrete distribution with given entropy. Oper Res Int J 3, 41–46 (2003). https://doi.org/10.1007/BF02940277

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02940277

Keywords

Navigation