Abstract
For a complex multiclass problem, it is common to construct the multiclass classifier by combining the outputs of several binary ones. The two basic methods for this purpose are known as one-per-class (OPC) and pairwise coupling (PWC) and their general form is error correcting output code (ECOC). In this paper, we review basic decomposition methods and introduce a new sequential fusion method based on OPC and PWC according to their properties. In the experiments, we compare our proposed method with each basic method and ECOC method. The experimental results show that our proposed method can improve significantly the classification accuracy on the real dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Valentini G.: Upper bounds on the training error of ECOC-SVM ensembles. Technical Report TR-00-17, DISI-Dipartimento di Informatica Scienze dell Informazione (2000)
Hastie T., Tibshirani R.: Classification by Pairwise Coupling. Advances in Neural Information Processing Systems, Vol. 10, MIT Press (1998)
Dietterich T. G., Bakiri G.: Solving Multiclass Learning Problems via Error-Correcting Output Codes. Journal of Artificial Intelligence Research, Vol. 2 (1995) 263–286
Moreira M., Mayoraz E.: Improved Pairwise Coupling Classification with Correcting Classifiers. Proc. of European Conference on Machine Learning (1998) 160–171
Vapnik, V. N.: Statistical Learning Theory. John Wiley & Sons, New York (1998)
Masulli F., Valentini G.: Comparing Decomposition Methods for Classification. Proc. of International Conference on Knowledge-based Intelligent Engineering Systems & Allied Technologies, Vol. 2 (2000) 788–791
Klautau A., Jevtic N., Orlisky A.: Combined Binary Classifiers with Applications to Speech Recognition. Proc. of International Conference on Spoken Language Processing (2002) 2469–2472
Allwein E. L., Schapire R. E., Singer Y.: Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers. Proc. of International Conference on Machine Learning (2000) 9–16
Guo G., Li S. Z., and Chan K. L.: Support vector machines for face recognition. Image and Vision Computing, Vol. 19 (2001) 631–638
Merz C. J. and Murphy P. M.: UCI repository of machine learning databases. Department of Computer Science, University of California at Irvine, (1998). http://ics.uci.edu/~mlearn/mlrepository.html
Phillips P. J., Moon H., Rizvi S. A., Rauss P. J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. PAMI, Vol. 22, No. 10 (2000) 1090–1104
Almedia M. B.: SMOBR-A SMO program for training SVM. Univ. of Minas Gerais, Dept. of Electrical Engineering. http://www.cpdee.ufmg.br/~barros/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ko, J., Byun, H. (2003). Binary Classifier Fusion Based on the Basic Decomposition Methods. In: Windeatt, T., Roli, F. (eds) Multiple Classifier Systems. MCS 2003. Lecture Notes in Computer Science, vol 2709. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44938-8_15
Download citation
DOI: https://doi.org/10.1007/3-540-44938-8_15
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40369-2
Online ISBN: 978-3-540-44938-6
eBook Packages: Springer Book Archive