Skip to main content
SpringerLink
Log in

A Hybrid Decision Tree Model Based on Credibility Theory

  • Conference paper
Book cover Fuzzy Information and Engineering

Part of the book series: Advances in Soft Computing ((AINSC,volume 40))

Abstract

Decision-Tree (DT) is a widely-used approach to retrieve new interesting knowledge. Fuzzy decision trees (FDT) can handle symbolic domains flexibly, but its preprocess and tree-constructing are much costly. In this paper, we propose a hybrid decision tree (HDT) model by introducing credibility entropy into FDT. Entropy of multi-valued and continuous-valued attributes are both calculated with credibility theory, while entropy of other attributes is dealt with general Shannon method. HDT can decrease the cost of preprocess and tree-constructing significantly. We apply the model into geology field to find out the factors which cause landslide. Experiment results show that the proposed model is more effective and efficient than fuzzy decision tree and C4.5.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Quinlan, Induction on decision trees.Machine Learning 1(1), 81-106 (1986)

    Google Scholar 

  2. Bouchon-Meunier, B., Marsala, C., Ramdani, M.: Learning from imperfect data. In: Dubois, D., Prade, H., Yager, R.R. (eds.) Fuzzy Information Engineering: a Guided Tour of Applications, pp. 139–148. John Wiley and Sons, Chichester (1997)

    Google Scholar 

  3. Bouchon-Meunicr, B., Marsala, C.: Learning fuzzy decision rules. In: Dubois, D., Bczdek, J., Prade, H. (eds.) Fuzzy Sets in Approximate Reasoning and Information Systems. Handbook of Fuzzy Sets, vol. 3, Kluwer Academic Publishers, Dordrecht (1999)

    Google Scholar 

  4. Lent, B., Swami, A., Widom, J.: Clustering association rule. In: Proceedinds of the 13th International Conference on Data Engineering, Birmingham, UK, pp. 220–231. IEEE Computer Society Press, Los Alamitos (1997)

    Chapter  Google Scholar 

  5. Liu, B.: Uncertainty Theory: An Introduction to its Axiomatic Foundations. Springer, Berlin (2004)

    MATH  Google Scholar 

  6. Zadeh, L.A.: Fuzzy sets. Information and Control 8, 338–353 (1965)

    Article  MATH  MathSciNet  Google Scholar 

  7. Zadeh, L.A.: Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems 1, 3–28 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  8. Liu, B., Liu, Y.K.: Expected value of fuzzy variable and fuzzy expected value models. IEEE Transactions on Fuzzy Systems 10(4), 445–450 (2002)

    Article  Google Scholar 

  9. Li, X., Liu, B.: New independence definition of fuzzy random variable and random fuzzy variable. World Journal of Modelling and Simulation (2006)

    Google Scholar 

  10. Loo, S.G.: Measures of fuzziness. Cybernetica 20, 201–210 (1977)

    MATH  Google Scholar 

  11. Yager, R.R.: On measures of fuzziness and negation, Part I: Membership in the unit interval. International Journal of General Systems 5, 221–229 (1979)

    Article  MATH  MathSciNet  Google Scholar 

  12. Yager, R.R.: On measures of fuzziness and negation, Part II: Lattices. Information and Control 44, 236–260 (1980)

    Article  MATH  MathSciNet  Google Scholar 

  13. Yager, R.R.: Entropy and specificity in a mathematical theory of evidence. International Journal of General Systems 9, 249–260 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  14. Yager, R.R.: Measures of entropy and fuzziness related to aggregation operators. Information Sciences 82, 147–166 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  15. Liu, X.C.: Entropy, distance measure and similarity measure of fuzzy sets and their relations. Fuzzy Sets and Systems 52, 305–318 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  16. Pal, N.R., Pal, S.K.: Higher order fuzzy entropy and hybrid entropy of a set. Information Sciences 61, 211–231 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  17. Pal, N.R., Bezdek, J.C.: Measuring fuzzy uncertainty. IEEE Transactions on Fuzzy Systems 2, 107–118 (1994)

    Article  Google Scholar 

  18. De Luca, A., Termini, S.: A definition of nonprobabilistic entropy in the setting of fuzzy sets theory. Information and Control 20, 301–312 (1972)

    Article  MathSciNet  MATH  Google Scholar 

  19. Li, P., Liu, B.: Entropy of credibility distributions for fuzzy variables, Technical Report (2005)

    Google Scholar 

  20. Umano, M., et al.: Fuzzy decision trees by fuzzy ID3 algorithm and its application to diagnosis systems. In: Proceedings of the 3rd IEEE Conference on Fuzzy Systems, vol. 3, Orlando, pp. 2113–2118. IEEE, Los Alamitos (1994)

    Chapter  Google Scholar 

  21. Civanlar, M.R., Trussell, H.J.: Constructing membership functions using statistical data. Fuzzy Sets and Systems 18, 1–14 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  22. Kohonen, T.: Self-Organization and Association Memory. Springer, Berlin (1988)

    Google Scholar 

  23. Yuan, Y., Shaw, M.J.: Induction of fuzzy decision trees. Fuzzy Sets and Systems 69, 125–139 (1995)

    Article  MathSciNet  Google Scholar 

  24. Cios, K.J., Sztandera, L.M.: Continuous ID3 algorithm with fuzzy entropy measures. In: Proc. IEEE Int. Conf. Fuzzy Syst., pp. 469–476. IEEE Computer Society Press, Los Alamitos (1992)

    Chapter  Google Scholar 

  25. Breiman, L., et al.: Classification and Regression Frees. Wadsworth International Group, Behnont (1984)

    Google Scholar 

  26. Mingers, J.: An empirical comparison of pruning methods for decision-tree induction. Machine Learning 4, 227–243 (1989)

    Article  Google Scholar 

  27. Fürnkranz, J.: Pruning algorithms for rule learning. Machine Learning 27, 139–172 (1997)

    Article  Google Scholar 

  28. Catlett, J.: On changing continuous attributes into ordered discrete attributes. In: Kodratoff, Y. (ed.) Machine Learning - EWSL-91. LNCS, vol. 482, pp. 164–178. Springer, Heidelberg (1991)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Automation, Beijing Union University, 100101, China

    Chengming Qi

Authors
  1. Chengming Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Bing-Yuan Cao

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Qi, C. (2007). A Hybrid Decision Tree Model Based on Credibility Theory. In: Cao, BY. (eds) Fuzzy Information and Engineering. Advances in Soft Computing, vol 40. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71441-5_101

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-71441-5_101

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-71440-8

  • Online ISBN: 978-3-540-71441-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation