Abstract
Decision Tree (DT) technology with its sequential decision process composed of hard thresholds applied to individual features is often not an optimal choice. But DTs are typically credited with being predictive structures that a domain specialist can interpret as opposed to a ‘black-box’ neural network, for example. There are two anticipated classes of benefit when Artificial Intelligence technology is applied to medicine: automation of decision making and enhancement of medical knowledge. In this paper we present the use of Bayes-ian averaging as a principled approach to optimal classifier systems using DT technology in which a confidence rating can be associated with every predicted result. However, averaging over an ensemble of DTs causes the problem that such an ensemble becomes uninterpretable. Thus we also present a procedure for extracting interpretable ‘archetype’ DTs. We demonstrate these innovations by application to Trauma data.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Bel-mont, Wadsworth (1984)
Galant, S.: Neural Network Learning and Expert Systems. MIT Press, Cambridge (1993)
Buntine, W.: Learning Classification Trees. Statistics and Computing 2, 63–73 (1992)
Quinlan, J.: C4.5. In: Programs for Machine Learning, Morgan Kaufmann, San Francisco (1993)
Duda, R.O., Hart, P.E.: Pattern Classification. Wiley Interscience, Chichester (2001)
Boyd, C.R., Tolson, M.A., Copes, W.S.: Evaluating Trauma Care: The TRISS Method. J. Trauma 27, 370–378 (1988)
Chipman, H., George, E., McCullock, R.: Bayesian CART Model Search. J. American Statistics 93, 935–960 (1998)
Denison, D., Holmes, C., Malick, B., Smith, A.: Bayesian Methods for Nonlinear Classifica-tion and Regression. Wiley, Chichester (2002)
Kuncheva, A.: Combining Pattern Classifiers: Methods and Algorithms. Wiley, Chichester (2004)
Green, P.: Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination. Biometrika 82, 711–732 (1995)
Chipman, H., George, E., McCulloch, R.: Making Sense of a Forest of Trees. In: Weisberg, S. (ed.) Proceedings of the 30th Symposium on the Interface, Interface Foundation of North America, pp. 84–92 (1998)
Domingos, P.: Knowledge Discovery via Multiple Models. Intelligent Data Analysis 2, 187–202 (1998)
Schetinin, V., Partridge, D., Krzanowski, W.J., Everson, R.M., Fieldsend, J.E., Bailey, T.C., Hernandez, A.: Experimental Comparison of Classification Uncertainty for Randomized and Bayesian Decision Tree Ensembles. J. Math. Modeling and Algorithms 4 (forthcoming, 2006)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Datasets. Irvine, University of California (1998), cs.uci.edu/mlearn/MLRepository
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Partridge, D. et al. (2006). Interpretability of Bayesian Decision Trees Induced from Trauma Data. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Żurada, J.M. (eds) Artificial Intelligence and Soft Computing – ICAISC 2006. ICAISC 2006. Lecture Notes in Computer Science(), vol 4029. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11785231_102
Download citation
DOI: https://doi.org/10.1007/11785231_102
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35748-3
Online ISBN: 978-3-540-35750-6
eBook Packages: Computer ScienceComputer Science (R0)