Abstract
Error Correction Output Codes (ECOC) can improve generalization performance when applied to multiclass problems. In this paper, we compared various criteria used to design codematrices. We also investigated how loss functions affect the results of ECOC. We found that there was no clear evidence of difference between the various criteria used to design codematrices. The One Per Class (OPC) codematrix with Hamming loss yields a higher error rate. The error rate from margin based decoding is lower than from Hamming decoding. Some comments on ECOC are made, and its efficacy is investigated through empirical study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aha, D.W., Bankert, R.L.: Cloud classification using error correcting output codes. Artificial Intelligence Applications: Natural Resources, Agriculture and Environmental Science 11, 13–28 (1997)
Berger, A.: Error-correcting output coding for text classification. In: Proceedings of Int. Joint Conf. Artificial Intelligence, IJCAI 1999, Stockholm, Sweden (1999)
Breiman, L.: Bagging predictors. Machine Learning 24, 123–140 (1997)
Dietterich, T.G., Bakiri, G.: Error-correcting output codes: A general method for improving multi-class inductive learning programs. In: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI 1991), pp. 572–577 (1991)
Dietterich, T.G., Bakiri, G.: Solving multi-class learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2, 263–286 (1995)
Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multi-class to binary: A unifying approach for margin classifiers. Machine learning research 1, 113–141 (2000)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and application to boosting. Journal of computer and system science 55, 119–139 (1997)
Kittler, J., Ghaderi, R., Windeatt, T., Matas, G.: Face verification using error correcting output codes. In: Computer Vision and Pattern Recognition CVPR 2001, Hawaii, IEEE Press, Los Alamitos (2001)
Kuncheva, L.I., Whitaker, C.J.: Measures of diversity in classifier ensembles. Mach. Learn. 51, 181–207 (2003)
Kuncheva, L.I.: Using diversity measures for generating error -correcting output codes in classifier ensembles. Pattern Recognition Letters 26, 83–90 (2005)
Schapire, R.E.: Using output codes to boost multi-class learning problems. In: 14th International Conf. on Machine Learning, pp. 313–321. Morgan Kaufmann, San Francisco (1997)
Vapnik, V.: Statistical Learning Theory. Springer, New York (1998)
Windeatt, T., Ghaderi, R.: Coding and decoding strategies for multi-class learning problems. Information Fusion 4, 11–21 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Seok, K.H., Cho, D. (2006). Some Comments on Error Correcting Output Codes. In: Wang, L., Jiao, L., Shi, G., Li, X., Liu, J. (eds) Fuzzy Systems and Knowledge Discovery. FSKD 2006. Lecture Notes in Computer Science(), vol 4223. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11881599_44
Download citation
DOI: https://doi.org/10.1007/11881599_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45916-3
Online ISBN: 978-3-540-45917-0
eBook Packages: Computer ScienceComputer Science (R0)