Abstract
The error-correcting output coding (ECOC) method reduces the multiclass learning problem into a series of binary classifiers. In this paper, we consider the dense ECOC methods, combining an economical number of base learners. Under the criteria of row separation and column diversity, we suggest the use of Hadamard matrices to design output codes and show them better than other codes of the same size. Comparative experiments based on the support vector machines are made for some real datasets from the UCI machine learning repository.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. Journal of Machine Learning Research 1, 113–141 (2000)
Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Box, G.E.P., Hunter, W.G., Hunter, J.S.: Statistics for Experiments. Wiley, New York (1978)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001), Software available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines (and other kernel-based learning methods). Cambridge University Press, Cambridge (2000)
Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via errorcorrecting output codes. Journal of Artificial Intelligence Research 2, 263–286 (1995)
Hastie, T., Tibshirani, R.: Classification by pariwise coupling. The Annals of Statistics 26(2), 451–471 (1998)
MacWilliams, F.J., Sloane, N.J.A.: The Theory of Error-Correcting Codes. Elsevier Science Publishers, Amsterdam (1977)
Schapire, R.E.: The strength of weak learnability. Machine Learning 5, 197–227 (1990)
Sloane, N.J.A.: A Library of Hadamard Matrices, AT&T (1999), http://www.research.att.com/~njas/hadamard/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, A., Wu, ZL., Li, CH., Fang, KT. (2003). On Hadamard-Type Output Coding in Multiclass Learning. In: Liu, J., Cheung, Ym., Yin, H. (eds) Intelligent Data Engineering and Automated Learning. IDEAL 2003. Lecture Notes in Computer Science, vol 2690. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45080-1_51
Download citation
DOI: https://doi.org/10.1007/978-3-540-45080-1_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40550-4
Online ISBN: 978-3-540-45080-1
eBook Packages: Springer Book Archive