Skip to main content
SpringerLink
Log in

Entropy Optimization: Shannon Measure of Entropy and its Properties

  • Reference work entry
Encyclopedia of Optimization

  • 773 Accesses

Article Outline

Keywords

See also

References

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 2,500.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 2,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baierlein R (1992) How entropy got its name. Amer J Phys 60:1151

    Article  Google Scholar 

  2. Ben-Tal A, Teboulle M, Charnes A (1988) The role of duality in optimization problems involving entropy functionals with applications to information theory. J Optim Th Appl 58:209–223

    Article  MATH  MathSciNet  Google Scholar 

  3. Burch SF, Gull SF, Skilling JK (1983) Image restoration by a powerful maximum entropy method. Computer Vision, Graphics, and Image Processing 23:113–128

    Article  Google Scholar 

  4. Clausius R (1865) Ueber Verschiedene fur die Anwendung Bequeme Formen der Hauptgleichungen der Mechanischen Warmetheorie. Ann Physik und Chemie 125:353–400

    Article  Google Scholar 

  5. Cozzolino JM, Zahner MJ (1973) The maximum entropy distribution of the future market price of a stock. Oper Res 21:1200–1211

    MATH  MathSciNet  Google Scholar 

  6. Erlander S (1981) Entropy in linear programming. Math Program 21:137–151

    Article  MATH  MathSciNet  Google Scholar 

  7. Fang S-C, Rajasekera JR, Tsao H-SJ (1997) Entropy optimization and mathematical programming. Kluwer, Dordrecht

    MATH  Google Scholar 

  8. Golan A, Judge G, Miller D (1996) Maximum entropy econometrics: robust estimation with limited data. Wiley, New York

    MATH  Google Scholar 

  9. Guiasu S (1977) Information theory with applications. McGraw-Hill, New York

    MATH  Google Scholar 

  10. Guiasu S (1986) Maximum entropy condition in queueing theory. J Oper Res Soc 37:293–301

    Article  MATH  Google Scholar 

  11. Hobson A (1987) Concepts in statistical mechanics. Gordon and Breach, New York

    Google Scholar 

  12. Jaynes ET (1957) Information theory and statistical mechanics II. Phys Rev 108:171–190

    Article  MathSciNet  Google Scholar 

  13. Jaynes ET (1968) Prior probabilities. IEEE Trans Syst, Sci Cybern SSC-4:227–241

    Article  Google Scholar 

  14. Johnson RW (1979) Axiomatic characterization of the directed divergence and their linear combinations. IEEE Trans Inform Theory 25:709–716

    Article  MATH  MathSciNet  Google Scholar 

  15. Kapur JN, Kesavan HK (1992) Entropy optimization principles with applications. Acad. Press, New York

    Google Scholar 

  16. Khinchin AI (1957) Mathematical foundations of information theory. Dover, Mineola, NY

    MATH  Google Scholar 

  17. Kullback S (1968) Information theory and statistics. Dover, Mineola, NY

    Google Scholar 

  18. Scott CH, Jefferson TR (1977) Entropy maximizing models of residential location via geometric programming. Geographical Anal 9:181–187

    Google Scholar 

  19. Shannon CE (1948) A mathematical theory of communication. Bell System Techn J 27:379–423; 623–656

    MathSciNet  MATH  Google Scholar 

  20. Shannon CE, Weaver W (1962) The mathematical theory of communication. Univ. Illinois Press, Champaign

    Google Scholar 

  21. Shore JE (1981) Minimum cross-entropy spectral analysis. IEEE Trans Acoustics, Speech and Signal Processing 29:230–237

    Article  MATH  MathSciNet  Google Scholar 

  22. Shore JE, Johnson RW (1980) Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans Inform Theory 26:26–37

    Article  MATH  MathSciNet  Google Scholar 

  23. Shore JE, Johnson RW (1981) Properties of cross-entropy minimization. IEEE Trans Inform Theory 27:472–482

    Article  MATH  MathSciNet  Google Scholar 

  24. Tribus M (1969) Rational descriptions, decisions, and designs. Pergamon, Oxford

    Google Scholar 

  25. Tribus M (1988) An engineer looks at Bayes. In: Erickson GJ, Smith CR (eds) Maximum-Entropy and Bayesian Methods in Sci. and Engineering: Foundations. 1, Kluwer, Dordrecht, pp 31–52

    Google Scholar 

  26. Wilson AG (1970) Entropy in urban and regional modeling. Pion, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. North Carolina State University, Raleigh, USA

    Shu-Cherng Fang

  2. San Jose State University, San Jose, USA

    Jacob H.-S. Tsao

Authors
  1. Shu-Cherng Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jacob H.-S. Tsao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Chemical Engineering, Princeton University, Princeton, NJ, 08544-5263, USA

    Christodoulos A. Floudas

  2. Center for Applied Optimization, Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, 32611-6595, USA

    Panos M. Pardalos

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag

About this entry

Cite this entry

Fang, SC., Tsao, J.HS. (2008). Entropy Optimization: Shannon Measure of Entropy and its Properties . In: Floudas, C., Pardalos, P. (eds) Encyclopedia of Optimization. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-74759-0_161

Download citation

Publish with us

Policies and ethics

Search

Navigation