Skip to main content
SpringerLink
Log in
Book cover

International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems

IPMU 2018: Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations pp 332–343Cite as

Entropy and Monotonicity

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 854))

Abstract

Measuring the information provided by the observation of events has been a challenge for seventy years, since the simultaneous inception of entropy by Claude Shannon and Norbert Wiener in 1948. Various definitions have been proposed, depending on the context, the point of view and the chosen knowledge representation. We show here that one of the most important common feature in the choice of an entropy is its behavior with regard to the refinement of information and we analyse various definitions of monotonicity.

A homage to Claude Shannon and Norbert Wiener for the 70th anniversary of their inception of entropy.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    In the following, for the sake of simplicity, \(w_{x_i}\) will be denoted \(w_i\) when the meaning of i is clear.

References

  1. Aczél, J., Daróczy, Z.: On Measures of Information and their Characterizations, Mathematics in Science and Engineering, vol. 115. Academic Press, New York (1975)

    MATH  Google Scholar 

  2. Aczél, J., Daróczy, Z.: A mixed theory of information. I: symmetric, recursive and measurable entropies of randomized systems of events. R.A.I.R.O. Informatique théorique/Theoret. Comput. Sci. 12(2), 149–155 (1978)

    MathSciNet  MATH  Google Scholar 

  3. Atanassov, K.T.: Intuitionistic fuzzy sets. Fuzzy Sets Syst. 20, 87–96 (1986)

    Article  Google Scholar 

  4. Bouchon, B.: Entropic models. Cybern. Syst.: Int. J. 18(1), 1–13 (1987)

    Article  MathSciNet  Google Scholar 

  5. Bouchon-Meunier, B., Marsala, C.: Entropy measures and views of information. In: Kacprzyk, J., Filev, D., Beliakov, G. (eds.) Granular, Soft and Fuzzy Approaches for Intelligent Systems. SFSC, vol. 344, pp. 47–63. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-40314-4_3

    Chapter  MATH  Google Scholar 

  6. Burillo, P., Bustince, H.: Entropy on intuitionistic fuzzy sets and on interval-valued fuzzy sets. Fuzzy Sets Syst. 78, 305–316 (1996)

    Article  MathSciNet  Google Scholar 

  7. de Luca, A., Termini, S.: A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory. Inf. Control 20, 301–312 (1972)

    Article  MathSciNet  Google Scholar 

  8. Guiaşu, S.: Weighted entropy. Report Math. Phys. 2(3), 165–179 (1971)

    Article  MathSciNet  Google Scholar 

  9. Guo, K., Song, Q.: On the entropy for Atanassov’s intuitionistic fuzzy sets: an interpretation from the perspective of amount of knowledge. Appl. Soft Comput. 24, 328–340 (2014)

    Article  Google Scholar 

  10. Kampé de Fériet, J.: Mesures de l’information par un ensemble d’observateurs. In: Gauthier-Villars (ed.) Comptes Rendus des Scéances de l’Académie des Sciences, série A, Paris, vol. 269, pp. 1081–1085, Décembre 1969

    Google Scholar 

  11. Kampé de Fériet, J.: Mesure de l’information fournie par un événement (1971). séminaire sur les questionnaires

    Google Scholar 

  12. Klir, G., Wierman, M.J.: Uncertainty-Based Information. Elements of Generalized Information Theory. Studies in Fuzziness and Soft Computing. Springer, Heidelberg (1998). https://doi.org/10.1007/978-3-7908-1869-7

    Book  MATH  Google Scholar 

  13. Montes, I., Montes, S., Pal, N.: On the use of divergences for defining entropies for atanassov intuitionistic fuzzy sets. In: Kacprzyk, J., Szmidt, E., Zadrożny, S., Atanassov, K.T., Krawczak, M. (eds.) IWIFSGN/EUSFLAT -2017. AISC, vol. 642, pp. 554–565. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-66824-6_49

    Chapter  Google Scholar 

  14. Mugur-Schächter, M.: The general relativity of descriptions. Analyse de Systèmes 11(4), 40–82 (1985)

    Google Scholar 

  15. Rényi, A.: On measures of entropy and information. In: Proceedings of 4th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 547–561 (1960)

    Google Scholar 

  16. Shannon, C.E.: The Mathematical Theory of Communication. University of Illinois Press, Urbana (1948). Ed. by C.E. Shannon, W. Weaver

    Google Scholar 

  17. Szmidt, E., Kacprzyk, J.: New measures of entropy for intuitionistic fuzzy sets. In: Proceedings of the Ninth International Conference on Intuitionistic Fuzzy Sets (NIFS), Sofia, Bulgaria, vol. 11, pp. 12–20, May 2005

    Google Scholar 

  18. Wiener, N.: Cybernetics, Or Control and Communication in the Animal and the Machine. Hermann & Cie, Cambridge. (MIT Press), Paris, 2nd revised edn. 1961 (1948)

    Google Scholar 

  19. Yager, R.R.: Entropy measures under similarity relations. Int. J. Gen. Syst. 20(4), 341–358 (1992)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sorbonne Université, CNRS, Laboratoire d’Informatique de Paris 6, LIP6, 75005, Paris, France

    Bernadette Bouchon-Meunier & Christophe Marsala

Authors
  1. Bernadette Bouchon-Meunier
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christophe Marsala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christophe Marsala .

Editor information

Editors and Affiliations

  1. Universidad de Cádiz, Cádiz, Cadiz, Spain

    Jesús Medina

  2. Universidad de Málaga, Málaga, Málaga, Spain

    Manuel Ojeda-Aciego

  3. Universidad de Granada, Granada, Spain

    José Luis Verdegay

  4. Universidad de Granada, Granada, Spain

    David A. Pelta

  5. Universidad de Málaga, Málaga, Málaga, Spain

    Inma P. Cabrera

  6. LIP6, Université Pierre et Marie Curie, CNRS, Paris, France

    Bernadette Bouchon-Meunier

  7. Iona College, New Rochelle, New York, USA

    Ronald R. Yager

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bouchon-Meunier, B., Marsala, C. (2018). Entropy and Monotonicity. In: Medina, J., et al. Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations. IPMU 2018. Communications in Computer and Information Science, vol 854. Springer, Cham. https://doi.org/10.1007/978-3-319-91476-3_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-91476-3_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-91475-6

  • Online ISBN: 978-3-319-91476-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation