Abstract
A multi-class classification algorithm based on geometric support vector machine (SVM) is proposed. For each class of training samples, a convex hull is constructed in the sample space using the Schlesinger-Kozinec (SK) algorithm. For a sample to be classified, the class label is determined according to the convex hull in which it is located. If this sample is in more than one convex hull, or is not in any convex hull, the nearest neighbor rule is further employed. Subsequently, its class label is identified by the class of centroid closest to the sample. The experimental results show that compared with the existing multi-class SVM methods, the proposed algorithm can improve the classification accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Mohammad, A.B., Gholam, A.M., Ehsanollah, K.: A subspace approach to error correcting output codes. Pattern Recogn. Lett. 34(1), 176–184 (2013)
Forestier, G., Wemmert, C.: Semi-supervised learning using multiple clusterings with limited labeled data. Inf. Sci. 361(C), 48–65 (2016)
Lee, Y., Lee, J.: Binary tree optimization using genetic algorithm for multiclass support vector machine. Expert Syst. Appl. 42(8), 3843–3851 (2015)
Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: Proceeding of 29th AAAI Conference on Artificial Intelligence, pp. 2267–2273. AAAI, Menlo Park (2015)
Liu, S.M., Chen, J.H.: A multi-label classification based approach for sentiment classification. Expert Syst. Appl. 42(3), 1083–1093 (2015)
Xu, H., Yang, W., Wang, J.: Hierarchical emotion classification and emotion component analysis on Chinese micro-blog posts. Expert Syst. Appl. 42(22), 8745–8752 (2015)
Omid, D., Bin, M.: Discriminative feature extraction for speech recognition using continuous output codes. Pattern Recogn. Lett. 33(13), 1703–1709 (2012)
Gu, Y., Jin, Z., Chiu, S.C.: Active learning combining uncertainty and diversity for multi-class image classification. Iet Comput. Vis. 9(3), 400–407 (2015)
Wu, Q., Tan, M., Song, H., Chen, J.: ML-FOREST: a multi-label tree ensemble method for multi-label classification. IEEE Trans. Knowl. Data Eng. 28(10), 2665–2680 (2016)
Vapnik, V.: An overview of statistical learning theory. IEEE Trans. Neural Netw. 10(5), 988–999 (1999)
Weston, J., Watkins, C.: Support vector machines for multi-class pattern recognition. In: Proceeding of 7th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pp. 219–224. IEEE, Piscataway (1999)
Hsu, C., Lin, C.J.: A comparison of methods for multi-class support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)
Bennett, K.P.: Combining support vector and mathematical programming methods for classification. In: Advances in Kernel Methods: Support Vector Learning, pp. 307–326. MIT Press, Massachusetts (1999)
Xu, J.H.: An extended one-versus-rest support vector machine for multi-label classification. Neurocomputing 74(17), 3114–3124 (2011)
Krebel, U.G.: Pairwise classification and support vector machines. In: Advances in Kernel Methods: Support Vector Learning, pp. 255–268. MIT Press, Massachusetts (1999)
Chen, Z.J., Jiang, G., Cai, Y.: Research of secondary subdivision method for one-versus-one multi-classification algorithm based on SVM. Transducer Microsystem Technol. 32(4), 44–47 (2013)
Platt, J., Cristianini, N., Shawe-Taylor, J.: Large margin DAGs for multiclass classification. In: Advances in Neural Information Processing Systems, pp. 547–553. MIT Press, Massachusetts (2000)
Shen, J., Jiang, Y., Zou, L.: DAG-SVM multi-class classification based on nodes selection optimization. Comput. Eng. 41(6), 143–146 (2015)
Miao, Z., Gandelin, M.H., Baozong, Y.: Fourier transform based image shape analysis and its Application to flower recognition. In: Proceeding of 6th International Conference on Signal Processing, pp. 1087–1090. IEEE, Piscataway (2002)
Lu, S.X., Wang, X.Z.: Margin and duality in support vector machines. J. Hebei Univ. (Nat. Sci. Edn.) 27(5), 449–452 (2007)
Franc, V., Hlaváč, V.: An iterative algorithm learning the maximal margin classifier. Pattern Recogn. 36(9), 1985–1996 (2003)
Frank, A., Asuncion, A.: UCI Machine Learning Repository (2010). http://archive.ics.uci.edu/ml
Brazdil, P., Gama, J.: Statlog Datasets (1999). http://www.liacc.up.pt/ml/old/statlog/datasets.html
Lewis, D.: Reuters-21578 text categorization test collection, Distribution 1.0, AT&T Labs-Research (1997)
Kostin, A.: A simple and fast multi-class piecewise linear pattern classifier. Pattern Recogn. 39(11), 1949–1962 (2006)
Fan, R.E., Chang, K.W., Hsieh, C.J.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9(9), 1871–1874 (2008)
Acknowledgements
This work is supported by the National Natural Science Foundation of China under Grant 61602056, “Xingliao Yingcai Project” of Liaoning, China under Grant XLYC1906015, Natural Science Foundation of Liaoning, China under Grant 20180550525 and 201601348, Education Committee Project of Liaoning, China under Grant LZ2016005.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Qin, Y., Cheng, X., Leng, Q. (2020). A Multi-class Classification Algorithm Based on Geometric Support Vector Machine. In: Huang, DS., Premaratne, P. (eds) Intelligent Computing Methodologies. ICIC 2020. Lecture Notes in Computer Science(), vol 12465. Springer, Cham. https://doi.org/10.1007/978-3-030-60796-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-60796-8_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60795-1
Online ISBN: 978-3-030-60796-8
eBook Packages: Computer ScienceComputer Science (R0)