Abstract
The authors propose a coded output support vector machine (COSVM) by introducing the idea of information coding to solve multi-class classification problems for large-scale datasets. The COSVM is built based on the support vector regression (SVR) machine that is implemented by the sequential minimal optimization (SMO) algorithm. The paper first introduces the soft ε-tube SVR’s basic principles, next shows the idea and procedure of the SMO algorithm, and then gives the idea and topology of the COSVM. To study a number system’s (NS) impact on the COSVM’s performance, three experiments are performed with the Character Trajectories dataset, in which output labels are coded with the natural NS, decimal NS, and binary NS, respectively. Some useful results are obtained in these experiments. The final section concludes the paper and gives some further research visions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Boser, B.E., Guyon, I.M., Vapnik, V.N.: A Training Algorithm for Optimal Margin Classifiers. In: Haussler, D. (ed.) 5th Annual ACM Workshop on Computational Learning Theory, pp. 144–152. ACM Press, Pittsburgh (1992)
Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2(2), 121–167 (1998)
Cortes, C., Vapnik, V.N.: Support Vector Networks. Machine Learning 20, 273–297 (1995)
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge University Press, Cambridge (2000)
Deng, N.Y., Tian, Y.J.: A New Method in Data Mining: Support Vector Machine. China Science Press, Beijing (2004) (in Chinese)
Dietterich, T.G., Bakiri, G.: Solving Multi-class Learning Problems via Error-Correcting Output Codes. Journal of Artificial Intelligent Research 2, 263–286 (1995)
Joachims, T.: Making Large-scale SVM Learning Practical. In: Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.) Advances in Kernel Methods - Support Vector Learning, pp. 169–184. MIT Press, Cambridge (1999)
Meynet, J., Popovici, V., Thiran, J.P.: Mixture of SVMs for Face Class Modeling. In: Bengio, S., Bourlard, H. (eds.) MLMI 2004. LNCS, vol. 3361, pp. 173–181. Springer, Heidelberg (2005)
Newman, D.J., Hettich, S., Blake, C.L., et al.: UCI Repository of Machine Learning Databases University of California, Irvine (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Osuna, E., Freund, R., Girosi, F.: An Improved Training Algorithm for Support Vector Machines. In: Principe, J., Gile, L., Morgan, N. (eds.) Neural Networks for Signal Processing VII - The 1997 IEEE Workshop, pp. 276–285. IEEE Press, Piscataway (1997)
Platt, J.C.: Sequential minimal optimization: A Fast Algorithm for Training Support Vector Machines. Technical report, MSR-TR-98-14, Microsoft Research (1998)
Schölkopf, B., Smola, A.J., Williamson, R., et al.: New support vector algorithms. Neural Computation 12, 1207–1245 (2000)
Smola, A.J., Schölkopf, B., Müller, K.R.: General cost functions for support vector regression. In: Downs, T., Frean, M., Gallagher, M. (eds.) 9th Australian Conference on Neural Network, pp. 79–83. University of Queensland, Brisbane (1998)
Smola, A.J.: Learning with Kernels. PhD dissertation. Technische Universität Berlin, Berlin (1998)
Smola, A.J., Schölkopf, B.: A tutorial on support vector regression. Statistics and Computing 14, 199–222 (2004)
Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Processing Letters 9(3), 293–300 (1999)
Vapnik, V.N.: Statistical Learning Theory. John Wiley & Sons, New York (1998)
Vapnik, V.N.: An overview of statistical learning theory. IEEE Transactions on Neural Networks 10(5), 988–999 (1999)
Vapnik, V.N., Chervonenkis, A.: On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and its Applications 16(2), 264–280 (1971)
Yang, Q.S., Guo, C.A.: A Parallel Implementation of Error Correction SVM with Applications to Face Recognition. In: Yu, W., He, H., Zhang, N. (eds.) ISNN 2009. LNCS, vol. 5552, pp. 327–336. Springer, Heidelberg (2009)
Ye, T., Zhu, X.F.: The bridge relating process neural networks and traditional neural networks. Neurocomputing 74(6), 906–915 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ye, T., Zhu, X. (2012). Coded Output Support Vector Machine. In: Huang, DS., Ma, J., Jo, KH., Gromiha, M.M. (eds) Intelligent Computing Theories and Applications. ICIC 2012. Lecture Notes in Computer Science(), vol 7390. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31576-3_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-31576-3_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31575-6
Online ISBN: 978-3-642-31576-3
eBook Packages: Computer ScienceComputer Science (R0)