Abstract
In this paper, a hybrid learning approach named Flexible NBTree is proposed. Flexible NBTree uses Bayes measure δ to select proper test and applies post-discretization strategy to construct decision tree. The finial decision tree nodes contain univariate splits as regular decision trees, but the leaf nodes contain General Naive Bayes, which is a variant of standard Naive Bayesian classifier. Empirical studies on a set of natural domains show that Flexible NBTree has clear advantages with respect to the generalization ability when compared against its counterpart, NBTree.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Quinlan, J.R.: Discovering rules from large collections of examples: A case study. In: Expert Systems in the Micro Electronic Age, Edinburgh University Press, Edinburgh (1979)
Baldwin, J., Sachin, B.K.: Asymmetric Triangular Fuzzy Sets for Classification Models. Proceedings of the 7th International Conference on Knowledge-Based Intelligent Information and Engineering Systems, KES 2003, Oxford, UK, pp. 364–370 (2003)
Tsang, E., Wang, X., Yeung, Y.: Improving learning accuracy of fuzzy decision trees by hybrid neural networks. IEEE Transactions on Fuzzy Systems 8, 601–614 (2000)
Zhang, L., Ye-Yun, M., Yu, S., Ma-Fan, Y.: A New Multivariate Decision Tree Construction Algorithm Based on Variable Precision Rough Set. Advances in Web-Age Information Management, 238–246 (2003)
Kohavi, R.: Scaling up the accuracy of naive-bayes classifiers: A decision-tree hybrid. In: Proceedings of the 2th International Conference on Knowledge Discovery and Data Mining, Menlo Park, CA, pp. 202–207 (1996)
Cestnik, B.: Estimating probabilities: A crucial task in machine learning. In: Proceedings of the 9th European Conference on Artificial Intelligence, pp. 147–149 (1990)
Chen, H., Meer, P.: Robust Computer Vision through Kernel Density Estimation. In: Proceedings of the 7th European Conference on Computer Vision, Copenhagen, Denmark, pp. 236–246 (2002)
Smyth, P., Gray, A., Fayyad, U.: Retrofitting decision tree classifiers using kernel density estimation. In: Proceedings of the 12th International Conference on Machine Learning, pp. 506–514. Morgan Kaufmann Publishers, San Francisco (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, L., Yuan, S., Li, L., Li, H. (2004). Improving the Performance of Decision Tree: A Hybrid Approach. In: Atzeni, P., Chu, W., Lu, H., Zhou, S., Ling, TW. (eds) Conceptual Modeling – ER 2004. ER 2004. Lecture Notes in Computer Science, vol 3288. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30464-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-30464-7_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23723-5
Online ISBN: 978-3-540-30464-7
eBook Packages: Springer Book Archive