Abstract
Support vector machine (SVM), proposed by Vapnik based on statistical learning theory, is a novel machine learning method. However, there are two problems to be solved in this field: one is the multi-class classification problem, and the other is the sensitivity to the noisy data. In order to overcome these difficulties, a novel method of fuzzy compensation multi-class support vector machine, named as FC-SVM, is proposed in this paper. This method imports a fuzzy compensation function to the penalty in the straightly construction multi-class SVM classification problem proposed by Weston and Watkins. Aim at the dual affects to classification results by each input data, this method has punish item be fuzzy, compensates weight to classification, reconstructs the optimization problem and its restrictions, reconstructs Langrage formula, and presents the theories deduction. This method is applied to the benchmark data sets. The experiment presents our method is feasible.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Burges, J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)
Hsu, C.W., Lin, C.J.: A Comparison of Methods for Multi-class Support Vector Machines. IEEE Transactions on Neural Networks 2, 415–425 (2002)
Xu, J.H., Zhang, X.G., Li, Y.D.: Advances in Support Vector Machines. Control and Decision 5, 481–484 (2004)
Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large Margin DAG’s for Multiclass Classification. In: Advances in Neural Information Processing Systems, vol. 12, pp. 547–553. MIT Press, Cambridge (2000)
Weston, J., Watkins, C.: Multi-class Support Vector Machines. Department of Computer Science, Royal Holloway University of London Technical Report, SD2TR298204 (1998)
Platt, J.C.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Advances in Kernel Methods –Support Vector Learning, pp. 185–208. MIT Press, Cambridge (1999)
Vapnik, V.N.: The Nature of Statistical Learning Theory, 2nd edn. Springer, Heidelberg (1999)
Suykens, J., Vandewalle, J.: Least Squares Support Vector Machines. Neural Processing Letters 3, 293–300 (1999)
Scholkopf, B., Smola, A.J., Williamson, R.C., et al.: New Support Vector Algorithms. Neural Computation 5, 1207–1245 (2000)
Huang, H.P., Liu, Y.H.: Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems 4, 826–835 (2002)
Inoue, T., Abe, S.: Fuzzy Support Vector Machines for Pattern Classification. In: Proceedings of International Joint Conference on Neural Networks, pp. 1449–1454 (2001)
Lin, C.F., Wang, S.D.: Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks 2, 464–471 (2002)
Sun, Z.H., Sun, Y.X.: Fuzzy Support Vector Machine for Regression Estimation. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3336–3341 (2003)
Hong, D.H., Hwang, C.: Support Vector Fuzzy Regression Machines. Fuzzy Sets and Systems 2, 271–281 (2003)
Huang, Z., Chen, H.C., Hsu, C.J., Chen, W.H., Wu, S.S.: Credit Rating Analysis with Support Vector Machines and Neural Networks: a Market Comparative Study. Decision Support Systems 37, 543–558 (2004)
Kecman, V.: Learning and Soft Computing. In: Support Vector Machines, Neural Networks and Fuzzy Logic Models, The MIT Press, Cambridge (2001)
Xie, Z.X., Hu, Q.H., Yu, D.: Fuzzy Output Support Vector Machines for Classification. In: Wang, L., Chen, K., S. Ong, Y. (eds.) ICNC 2005. LNCS, vol. 3612, pp. 1190–1197. Springer, Heidelberg (2005)
Wang, L.P. (ed.): Support Vector Machines: Theory and Application. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Chi, Z., Sun, Y. (2006). A Novel Multi-class Support Vector Machine Based on Fuzzy Theories. In: Huang, DS., Li, K., Irwin, G.W. (eds) Intelligent Computing. ICIC 2006. Lecture Notes in Computer Science, vol 4113. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11816157_5
Download citation
DOI: https://doi.org/10.1007/11816157_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37271-4
Online ISBN: 978-3-540-37273-8
eBook Packages: Computer ScienceComputer Science (R0)