Skip to main content

Making Decision Trees More Accurate by Losing Information

  • Conference paper
  • First Online:
Foundations of Information and Knowledge Systems (FoIKS 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1762))

Abstract

In this investigation we discuss how to improve the quality of decision trees, one of the classification techniques in compensation for small loss of amount of information. To do that, we assume a semantic hierarchy among classes which is ignored in conventional stories. The basic idea comes from relaxing class membership by using the hierarchy and we explore how to preserve the precision of classification in a sense of entropy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agrawal, R., Srikant, R.: Fast Algorithms for Mining Association Rules, VLDB (1994), 487–499.

    Google Scholar 

  2. Diettrich, T.: Overfitting and Undercomputing in Machine Learning, ACM Comp.Survey 27-3 (1995), pp. 326–327

    Article  Google Scholar 

  3. Fayyad, U.M., Piatetsky-Shapiro, G., Smyth, P. and Uthurusamy, R. (Eds).: Advances in Knowledge Discovery and Data Mining, MIT Press (1996)

    Google Scholar 

  4. Han, J., Cai, Y. and Cercone, N.: Knowledge Discovery in Databases: An Attribute Oriented Approach, VLDB (1992), 547–559

    Google Scholar 

  5. Han, J. and Fu, Y.: Discovery of Multiple-Level Association Rules from Large Databases, VLDB (1995), 420–431.

    Google Scholar 

  6. Imielinski, T. and Mannila, H.: A Database Perspective on Knowledge Discovery, CACM 39-11 (1996), 58–64.

    Google Scholar 

  7. Kietz, J.U. and Morik, K.: A Polynomial Approach to the Constructive Induction of Structural Knowledge, Machine Learning 14 (1994), pp.193–217.

    Article  MATH  Google Scholar 

  8. Mannila, H.: Methods and Problems in Data Mining, Intn’l Conf. on Database Theory (ICDT), pp.41–55 (1997).

    Google Scholar 

  9. Miura, T. and Shioya, I.: Mining Type Schemes in Databases, Conference and Workshop of DEXA (1996), 369–384

    Google Scholar 

  10. Miura, T. and Shioya, I.: Knowledge Acquisition for Classification Systems, proc. ICTAI (1996), pp.110–115.

    Google Scholar 

  11. Miura, T. and Shioya, I.: Paradigm for Scheme Discovery, proc.CODAS (1996), pp.101–108.

    Google Scholar 

  12. Miura, T. and Shioya, I.: On Complex Type Hierarchy, Conference and Workshop of DEXA (1997)

    Google Scholar 

  13. Miura, T. and Shioya, I.: Learning Concepts from Databases, Conference and Workshop of DEXA (1998)

    Google Scholar 

  14. Miura, T. and Shioya, I.: Incremental Update of Decision Trees for Temporal Information, Proc. KRDB (1999)

    Google Scholar 

  15. Ng, R. and Han, J.: Efficient and Effective Clustering Methods for Spatial Data Mining, VLDB (1994), pp.144–155.

    Google Scholar 

  16. Quinlan, J.R: Induction of Decision Trees, Machine Learning 1-1 (1986), pp.81–106.

    Google Scholar 

  17. Quinlan, J.R.: C4.5-Programs for Machine Learning, Morgan Kauffman (1993)

    Google Scholar 

  18. Piatetsky-Shapiro, G. and Frawley, W.J. (ed.): Knowledge Discovery in Databases, MIT Press (1991)

    Google Scholar 

  19. Shioya, I. and Miura, T.: Clustering Concepts from Databases, proc. ICTAI (1998), pp.95–102

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Miura, T., Shioya, I., Mori, M. (2000). Making Decision Trees More Accurate by Losing Information. In: Schewe, KD., Thalheim, B. (eds) Foundations of Information and Knowledge Systems. FoIKS 2000. Lecture Notes in Computer Science, vol 1762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46564-2_13

Download citation

  • DOI: https://doi.org/10.1007/3-540-46564-2_13

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67100-8

  • Online ISBN: 978-3-540-46564-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics