Abstract
We develop a Bayesian procedure for classification with trees by switching between different model structures. For classification trees with overlap we use a Markov chain Monte Carlo procedure to produce an ensemble of trees which allow the assessment of prediction uncertainty and the value of new information. The approach is applied to a large credit scoring application.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
J.O. Berger. Statistical Decision Theory, Foundations, Concepts and Methods. Springer, New York. 1980.
L. Breiman, J.H. Friedman, R. Olshen, and C.J. Stone. Classification and Regression Trees. Wadsworth International Group, Belmont, California, 1984.
W. Buntine. Learning classification trees. Statistics and Computing. 2:63–73, 1992.
H. Chipman, E. George, and R. McCulloch. Bayesian CART. Technical report, Department of Statistics, University of Texas at Austin, 1995.
L. Devroye, L. Györfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer, new York, 1996.
J. H. Friedman. Multivariate adaptive regression splines. Annals of Statistics. 19(1):1–67, 1991.
J.H. Friedman. Local learning based on recursive covering. Technical report, Stanford Uni, August 1996.
J. Graf and G. Nakhaeizadeh. Recent development in solving the credit-scoring problem. In V.L. Plantamura, editor, Logistic and Learning for Quality Software, Managment and Manufacturing?, New York, 1993.
P. J. Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Technical report, Bristol Univ., 1995.
W.K. Hastings. Monte Carlo sampling methods using Markov chains and their application. Biometrika, 57:97–109, 1970.
G. Paass and J. Kindermann. Bayesian query construction for neural network models. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems 7, pages 443–450. The MIT Press, 1995.
B.D. Ripley. Pattern Recognition and Neural Networks. Cambridge University Press, Cambrideg, 1996.
L. Tierney. Markov chains for exploring posterior distributions. Technical Report 560, School of Statistics, Univ. of Minnesota, 1994.
J. Wallrafen. Kreditwürdigkeitsprüfung von Unternehmen mit neuronalen Klassifikationsverfahren (credit scoring of enterprises with neural classification procedures). Master's thesis, University of Erlangen-Nürnberg, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Paass, G., Kindermann, J. (1998). Bayesian classification trees with overlapping leaves applied to credit-scoring. In: Wu, X., Kotagiri, R., Korb, K.B. (eds) Research and Development in Knowledge Discovery and Data Mining. PAKDD 1998. Lecture Notes in Computer Science, vol 1394. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64383-4_20
Download citation
DOI: https://doi.org/10.1007/3-540-64383-4_20
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64383-8
Online ISBN: 978-3-540-69768-8
eBook Packages: Springer Book Archive