Abstract
Support Vector Machines (SVMs) are efficient tools, which have been widely studied and used in many fields. However, original SVM (C-SVM) only focuses on the scatter between classes, but neglects the global information about the data which are also vital for an optimal classifier. Therefore, C-SVM loses some robustness. To solve this problem, one approach is to translate (i.e., to move without rotation or change of shape) the hyperplane according to the global characteristics of the data. However, parts of existing work using this approach are based on specific distribution assumptionĀ (S-SVM), while the rest fail to utilize the global informationĀ (GS-SVM). In this paper, we propose a simple but efficient method based on weighted scatter degreeĀ (WSD-SVM) to embed the global information into GS-SVM without any distribution assumptions. A comparison of WSD-SVM, C-SVM and GS-SVM is conducted, and the results on several data sets show the advantages of WSD-SVM.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, 1st edn. Cambridge University Press, Cambridge (2000)
Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)
Gunn, S.R.: Support vector machines for classification and regression. Technical report, ISIS (1998)
Smola, A.J., Schƶlkopf, B.: A Tutorial on Support Vector Regression. Technical report, Statistics and Computing (2003)
Tong, S., Chang, E.: Support vector machine active learning for image retrieval. In: Proceedings of the Ninth ACM International Conference on Multimedia, pp. 107ā118. ACM, New York (2001)
Feng, J., Williams, P.: The generalization error of the symmetric and scaled support vector machines. IEEE Transactions on Neural NetworksĀ 12, 1255ā1260 (1999)
Liu, X., Ding, Y.: General Scaled Support Vector Machines. In: International Conference on Machine Learning and Computing (2011)
Shivaswamy, P.K., Jebara, T.: Relative Margin Machines. In: Advances in Neural Information Processing SystemsĀ 21 (2009)
Xiong, T., Cherkassky, V.: A combined SVM and LDA approach for classification. In: Proceedings of International Joint Conference on Neural Networks (2005)
Wang, D., Yeung, D., Tsang, E.: Probabilistic Large Margin Machine. In: International Conference on Machine Learning and Cybernetics, pp. 2190ā2195 (2006)
Huang, K., Yang, H., King, I., Lyu, M.R.: Learning large margin classifiers locally and globally. In: Proceedings of Twenty-First International Conference on Machine Learning, pp. 401ā408 (2004)
Yeung, D., Wang, D., Ng, W., Tsang, E., Wang, X.: Structured large margin machines: sensitive to data distributions. Machine LearningĀ 68, 171ā200 (2007)
Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001), Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Frank, A., Asuncion, A.: UCI Machine Learning Repository (2010), http://archive.ics.uci.edu/ml
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jin, AL., Zhou, X., Ye, CZ. (2011). Support Vector Machines Based on Weighted Scatter Degree. In: Deng, H., Miao, D., Lei, J., Wang, F.L. (eds) Artificial Intelligence and Computational Intelligence. AICI 2011. Lecture Notes in Computer Science(), vol 7004. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23896-3_77
Download citation
DOI: https://doi.org/10.1007/978-3-642-23896-3_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23895-6
Online ISBN: 978-3-642-23896-3
eBook Packages: Computer ScienceComputer Science (R0)