Abstract
In this paper, a novel structure is proposed to extend standard support vector classifier to multi-class cases. For a K-class classification task, an array of K optimal pairwise coupling classifier (O-PWC) is constructed, each of which is the most reliable and optimal for the corresponding class in the sense of cross entropy or square error. The final decision will be produced through combining the results of these K O-PWCs. The accuracy rate is improved while the computational cost will not increase too much. Our approach is applied to two applications: handwritten digital recognition on MNIST database and face recognition on Cambridge ORL face database, experimental results reveal that our method is effective and efficient.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
B. Scholkopf, C. Burges, and V. Vapnik, ”Extracting support data for a given task”, In Proceedings, First International Conference on Knowledge Discovery and Data Mining. AAAI Press, Menlo Park, CA, 1995.
B. Scholkopf, K. Sung, C. Burges,etc, ”Comparing Support Vector Machines with Gaussian Kernels to Radial Bias Function Classifiers”, A. I. Memo No.1599 C. B. C. L. Paper No.142.
Christopher J. C. Burges, ”A Tutorial On Support Vector Machines for Pattern Recognition”, Data Mining and Knowledge Discovery, 2, 121–167(1998).
Chih-Jen Lin, web site, http://csie.ntu.edu.tw/cjlin/
C.-W. Hsu and C.-J. Lin. ”A comparison of methods for multi-class support vector machines”, April 2001. To appear in IEEE Transactions on Neural Networks.
Erin L. Allwein, Singer. Y, ”Reducing multiclass to binary: A unifying approach to margin classifiers”, Journal of Machine Research, 1:113–141.
Fukunaga L., ”Introduction to Statistical Pattern Reognition”, Academic Press, INC, 2nded, 1990.
James Tin-Yau Kwok, ”The Evidence Framework Applied to Support Vector Machines”, IEEE Trans. On Neural Network, Vol.?, No.?, 2000.
K. Goh, E. Chang and T. Cheng, ”Support Vector Machine Pairwise Classifiers with Error Reduction for Image Classification”, Proceedings of ACM International Conference on Multimedia (MIR Workshop), Ottawa, October 2001.
M. Moreira and E. Mayoraz, ”Inproving pairwise coupling classification with error correcting classifiers”, Proceeding of Tenth Eruopean Conference on Machine Learning, April 1998.
Platt J., ”Probabilistic outputs for SVMs and comparisons to regularized likehood methods”, In Advances in Large Margin Classifiers. MIT Press, 1999.
Platt J, Cristianini N, Shawe-Taylor J. ”Large margin DAGs for multiclass classification”, In: Advances in Neural Information Processing Systems, Vol. 12, pp547–553. MIT Press, 2000.
T. Dietterich and G. Bakiri. ”Solving multiclass learning problems via error-correcting output codes”, Journal of Artifical Intelligence Research, 2, 1995.
Trevir Hastie, Robert Tibshirani, ”Classification by pairwise coupling”, Technical report, stanford Univ and Univ. of Toronto, 1996. in Proceeding of NIPS*97.
U. Krebel. ”Pairwise classification and support vector machines”, In ”Advance in Kernel Methods — Support Vector Learning”, pages 255–268, Cambridge, MA, 1999. MIT Press.
Vapnik V., ”The Nature of Statistical Learning Theory”, New York: Springer-Verlag, 1995.
Vapnik V., ”Statistical Learning Theory”, Wiley, 1998.
Volker Rothm, Koji Tsuda, ”Pairwise Coupling for Machine Recognition of Hand-Printed Japanese Characters”, Accepted for CVPR01.
Weston, J. and Watkins, C., Multi-class support vector machines. Technical Report CSD-TR-98-04, Dept. of Computer Science, Royal Holloway, University of London, Egham, Surrey TW20 0EX, England, 1998.
Yann LeCun’s website, http://www.research.att.com/yann/exdb/mnist/index.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, Z., Tang, S., Yan, S. (2002). Multi-Class SVM Classifier Based on Pairwise Coupling. In: Lee, SW., Verri, A. (eds) Pattern Recognition with Support Vector Machines. SVM 2002. Lecture Notes in Computer Science, vol 2388. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45665-1_25
Download citation
DOI: https://doi.org/10.1007/3-540-45665-1_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44016-1
Online ISBN: 978-3-540-45665-0
eBook Packages: Springer Book Archive