Abstract
This paper is devoted to the problem of learning to predict ordinal (i.e., ordered discrete) classes using classification and regression trees. We start with S-CART, a tree induction algorithm, and study various ways of transforming it into a learner for ordinal classification tasks. These algorithm variants are compared on a number of benchmark data sets to verify the relative strengths and weaknesses of the strategies and to study the trade-off between optimal categorical classification accuracy (hit rate) and minimum distance-based error. Preliminary results indicate that this is a promising avenue towards algorithms that combine aspects of classification and regression.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Breiman, L., Friedman, J.H., Olshen, R.A., & Stone, C.J. (1984). Classification and Regression Trees. Belmont, CA: Wadsworth International Group.
Dzeroski, S., Blockeel, H., Kompare, B., Kramer, S., Pfahringer, B., Van Laer, W. (1999). Experiments in Predicting Biodegradability, in: ILP-99: Proceedings Ninth International Workshop on Inductive Logic Programming, Springer, 1999.
Kramer, S. (1996). Structural Regression Trees. In Proceedings of the Thirteenth National Conference on Arti_cial Intelligence (AAAI-96). Cambridge, MA: AAAI Press/MIT Press.
Kramer, S. (1999). Relational Learning vs. Propositionalization: Investigations in Inductive Logic Programming and Propositional Machine Learning. Ph.D. Thesis, Vienna University of Technology.
Mathieson, M. (1996). Ordered Classes and Incomplete Examples in Classification. In M. Mozer et al. (eds.), Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press.
McCullagh, P. (1980). Regression Models for Ordinal Data. Journal of the Royal Statistical Society Series B 42, 109–142.
Mosteller, F. & Tukey, J.W. (1977). Data Analysis and Regression-A Second Course in Statistics. Reading, MA: Addison-Wesley.
Potharst, R. and Bioch, J.C. (1999). A Decision Tree Algorithm for Ordinal Classification. In Proceedings of the Third Symposium on Intelligent Data Analysis (IDA-99). Berlin: Springer Verlag.
Quinlan, J.R. (1992). Learning with Continuous Classes. In Proceedings AI’92. Singapore: World Scientific.
Quinlan, J.R. (1993). C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann.
Schiffers, J. (1997). A Classification Approach Incorporating Misclassification Costs. Intelligent Data Analysis 1(1).
Silverstein, G. & Pazzani, M.J. (1991). Relational Clich’es: Constraining Constructive Induction During Relational Learning. In Proceedings of the 8th International Workshop on Machine Learning (ML-91). San Mateo, CA: Morgan Kaufmann.
Srinivasan, A., Muggleton, S., and King, R.D. (1995). Comparing the use of background knowledge by Inductive Logic Programming systems. In Proceedings ILP-95, Katholieke Universiteit Leuven, Belgium.
Turney, P.D. (1995). Cost-Sensitive Classification: Empirical Evaluation of a Hybrid Genetic Decision Tree Induction Algorithm. Journal of Artificial Intelligence Research 2, 369–409.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kramer, S., Widmer, G., Pfahringer, B., de Groeve, M. (2000). Prediction of Ordinal Classes Using Regression Trees. In: Raś, Z.W., Ohsuga, S. (eds) Foundations of Intelligent Systems. ISMIS 2000. Lecture Notes in Computer Science(), vol 1932. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-39963-1_45
Download citation
DOI: https://doi.org/10.1007/3-540-39963-1_45
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41094-2
Online ISBN: 978-3-540-39963-6
eBook Packages: Computer ScienceComputer Science (R0)