Abstract
Multiple classifier systems fall into two types: classifier combination systems and classifier choice systems. The former aggregate component systems to produce an overall classification, while the latter choose between component systems to decide which classification rule to use. We illustrate each type applied in a real context where practical constraints limit the type of base classifier which can be used. In particular, our context – that of credit scoring – favours the use of simple interpretable, especially linear, forms. Simple measures of classification performance are just one way of measuring the suitability of classification rules in this context.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hand, D.J.: Construction and Assessment of Classification Rules. Chichester: Wiley (1997)
Kelly, M.G., Hand, D.J., Adams, N.M.: The impact of changing populations on classifier performance. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ed. Chaudhuri, S., Madigan, D., New York: ACM (1999) 367–371
Kelly, M.G., Hand, D.J., Adams, N.M.: Defining the goals to optimise data mining performance. Proceedings of the Fourth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ed. Agrawal, R., Stolorz, P., Piatetsky-Shapiro, G., Menlo Park: AAAI Press (1998) 234–238
Kelly, M.G., Hand, D.J.: Credit scoring with uncertain class definitions. IMA Journal of Mathematics Applied in Business and Industry 10 (1998) 331–345
Breiman, L.: Bagging predictors. Machine Learning 24 (1996) 123–140
Buntine, W.L.: Learning in classification trees. Statistics and Computing 2(1992) 63–73 1992
Oliver, J.J., Hand, D.J.: Averaging over decision trees. Journal of Classification, 13 (1996) 281–297
Genest, C., McConway, K.J.: Allocating the weights in the linear opinion pool. Journal of Forecasting 9 (1990) 53–73
von Winterfeld, D., Edwards, D.: Costs and payoffs in perceptual research. Psychological Bulletin 91 (1982) 213–217
Kittler, J., Duin, R.P.W.: Combining classifiers. Proceedings of the International Conference on Pattern Recognition, IEEE (1996) 897–900
Mertens, B.J.A, Hand, D.J.: Adjusted estimation for the combination of classifiers. Intelligent Data Analysis 4 (2000) 165–179
Wolpert, D.H.: Stacked generalisation. Neural Networks 5 (1992) 241–259
Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Annals of Statistics 28 (2000) 337–374
Hand, D.J., Henley, W.E.: Statistical classification methods in consumer credit scoring: a review. Journal of the Royal Statistical Society, Series A 169 (1997) 523–541
Hand, D.J., Yu, K.: Idiot’s Bayes–not so stupid after all? To appear in International Statistical Review (2001)
Hand, D.J., Adams, N.M.: Defining attributes for scorecard construction. Journal of Applied Statistics 27 (2000) 527–540
Hand, D.J.: Modelling consumer credit risk. Submitted to IMA Journal of Management Mathematics (2000)
Hand, D.J., Kelly, M.G.: Superscorecards. Technical Report, Department of Mathematics, Imperial College, London.
Hand, D.J.: How and why to choose a better scorecard. Technical Report, Department of Mathematics, Imperial College, London.
Scott, M.J.: PARCEL: feature selection in variable cost domains. Doctoral dissertation, Engineering Department, Cambridge University, UK (1999)
Provost, F.J., Fawcett, T.: Robust classification systems for imprecise environments. Proceedings of the Fifteenth National Conference on Artificial Intelligence, Madison, WI: AAAI press (1998) 706–713
Adams, N.M., Hand D.J.: Comparing classifiers when the misallocation costs are uncertain. Pattern Recognition 32 (1999) 1139–1147
Adams, N.M., Hand D.J.: Improving the practice of classifier performance assessment. Neural Computation 12 (2000) 300–311
Holmes, C.C., Adams, N.M.: A probabilistic nearest neighbor method for statistical pattern recognition. Journal of the Royal Statistical Society, Series, B (2001) in press
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hand, D.J., Adams, N.M., Kelly, M.G. (2001). Multiple Classifier Systems Based on Interpretable Linear Classifiers. In: Kittler, J., Roli, F. (eds) Multiple Classifier Systems. MCS 2001. Lecture Notes in Computer Science, vol 2096. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48219-9_14
Download citation
DOI: https://doi.org/10.1007/3-540-48219-9_14
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42284-6
Online ISBN: 978-3-540-48219-2
eBook Packages: Springer Book Archive