Abstract
Error Correcting Output Coding is a well established technique to decompose a multi-class classification problem into a set of two-class problems. However, a point not yet considered in the research is how to apply this method to a cost- sensitive classification that represents a significant aspect in many real problems. In this paper we propose a novel method for building cost-sensitive ECOC multi-class classifiers. Starting from the cost matrix for the multi-class problem and from the code matrix employed, a cost matrix is extracted for each of the binary subproblems induced by the coding matrix. As a consequence, it is possible to tune the single two-class classifier according to the cost matrix obtained and achieve an output from all the dichotomizers which takes into account the requirements of the original multi-class cost matrix. To evaluate the effectiveness of the method, a large number of tests has been performed on real data sets. The first experimental results show that the proposed approach is suitable for future developments in cost-sensitive application.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kong, E., Dietterich, T.G.: Error Correcting Output Coding Corrects Bias and Variance. In: Proc. 12th Int. Conf. on Machine Learning, San Francisco, CA (1995)
Schapire, R.E., Freund, Y., Bartlett, P., Lee, W.: Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods. The Annals of Statistics 26, 1651–1686 (1998)
Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers. Journal of Machine Learning Research 1, 113–141 (2000)
Dietterich, T.G., Bakiri, G.: Solving Multiclass Learning Problems via Error Correcting Output Codes. Journal of Artificial Intelligence Research 2, 263–286 (1995)
Masulli, F., Valentini, G.: Effectiveness of Error Correcting Output Coding Methods in Ensemble and Monolithic Learning Machines. Pattern Analysis and Applications (to appear)
Alpaydin, E., Mayoraz, E.: Learning Error Correcting Output Codes from Data. In: Proc. Int. Conf. on Artificial Neural Networks, Edinburgh, UK (1999)
Windeatt, T., Ghaderi, R.: Coding and Decoding Strategies for Multi Class Learning Problems. Information Fusion 4, 11–21 (2003)
Elkan, C.: The Foundations of Cost-Sensitive Learning. In: Proc. 17th IJCAI (2001)
Blake, C., Keogh, E., Merz, C.J.: UCI Repository of Machine Learning Databases (1998), www.ics.uci.edu/~mlearn/MLRepository.html
Joachims, T.: Making Large-Scale SVM Learning Practical. In: Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.) Advances in Kernel Methods, pp. 169–184. MIT Press, Cambridge (1999)
Tortorella, F.: An Empirical Comparison of In-Learning and Post-Learning Optimization Schemes for Tuning the Support Vector Machines in Cost-Sensitive Applications. In: Proc. 12th Int. Conf. on Image Anal. and Proc., pp. 560–565. IEEE Computer Society Press, Los Alamitos (2003)
Weiss, G., Provost, F.: The Effect of Class Distribution on Classifier Learning: An Empirical Study. Tech. Rep. ML-TR-44, Dept. of Comp. Sci., Rutgers University (2001)
Walpole, R.E., Myers, R.H., Myers, S.L.: Probability and Statistics for Engineers and Scientists, 6th edn. Prentice Hall Int., London (1998)
Margineantu, D.D., Dietterich, T.G.: Bootstrap Methods for the Cost-Sensitive Evaluation of Classifiers. In: Proc. Int. Conf. Machine Learning ICML 2000, pp. 582–590 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marrocco, C., Tortorella, F. (2004). A Method for Designing Cost-Sensitive ECOC. In: Roli, F., Kittler, J., Windeatt, T. (eds) Multiple Classifier Systems. MCS 2004. Lecture Notes in Computer Science, vol 3077. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25966-4_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-25966-4_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22144-9
Online ISBN: 978-3-540-25966-4
eBook Packages: Springer Book Archive