Qing Ai
ABSTRACT
Multiple Birth Support Vector Machine (MBSVM) is widely used in various engineering fields due to its fast learning efficiency. However, MBSVM does not consider the prior structure information of samples when constructing each sub-classifier, which often has a strong impact on classification. For the disadvantage, we introduce the prior structure information of samples into MBSVM, and propose a novel MBSVM with structure information in this paper, which is called Structural MBSVM (S-MBSVM). The S-MBSVM inherits the advantage of fast learning speed of MBSVM, and fully utilizes the prior structure information of samples, thus improving the generalization performance. Experimental results show that the algorithm has better classification performance than the classical MBSVM.
- Cortes C and Vapnik V (1995). Support-vector networks. Machine Learning, 20(3), 273--297.Google Scholar
Cross Ref
- Xia S, Zhang Z, Li W, Wang G, Giem E and Chen Z (2020). GBNRS: A Novel Rough Set Algorithm for Fast Adaptive Attribute Reduction in Classification. In IEEE Transactions on Knowledge and Data Engineering, doi: 10.1109/TKDE.2020.2997039.Google Scholar
- Xia S, Wang G, Chen Z and Duan Y (2018). Complete random forest based class noise filtering learning for improving the generalizability of classifiers. IEEE Transactions on Knowledge and Data Engineering, 31(11), 2063--2078.Google ScholarCross Ref
- Xia S, Liu Y, Ding X, Wang G, Yu H and Luo Y (2019). Granular ball computing classifiers for efficient, scalable and robust learning. Information Sciences, 483, 136--152.Google ScholarDigital Library
- Liang X, Xia S, Liu Q, et al. (2018). A Multi-Granular Relative Density Model for Class Noise Detection]. 2018 IEEE International Conference on Big Data (Big Data). IEEE, 2018, 2651--2656.Google ScholarCross Ref
- Xia S, Xiong Z, Luo Y, Dong L and Zhang G (2015). Location difference of multiple distances based k-nearest neighbors algorithm. Knowledge-Based Systems, 90, 99--110.Google ScholarDigital Library
- Xia S, Xiong Z, Luo Y, Dong L and Xing C (2015). Relative density based support vector machine. Neurocomputing, 149, 1424--1432.Google ScholarCross Ref
- Mangasarian O L and Wild E W (2006). Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1), 69--74.Google ScholarDigital Library
- Jayadeva, Khemchandani R and Chandra S (2007). Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5), 905--910.Google ScholarDigital Library
- Li K and Li H (2019). Structural fuzzy twin support vector machine with pinball loss. Acta Electronica Sinica, 47(10), 2221--2227.Google Scholar
- Hua X, Xu S, Gao J and Ding S (2019). L1-norm loss-based projection twin support vector machine for binary classification. Soft Computing, 23(21), 10649--10659.Google ScholarDigital Library
- Wang H and Zhou Z (2017). An improved rough margin-based v-twin bounded support vector machine. Knowledge-Based Systems, 128, 125--138.Google ScholarDigital Library
- Sartakhti J S, Afrabandpey H and Ghadiri N (2019). Fuzzy least squares twin support vector machines. Engineering Applications of Artificial Intelligence, 85, 402--409.Google ScholarCross Ref
- Ai Q, Wang A, Wang Y and Sun H (2018). Improvements on twin-hypersphere support vector machine using local density information.Progress in Artificial Intellegence, 7(3), 167--175.Google Scholar
- Guo J, Yi P, Wang R, Ye Q and Zhao C (2014). Feature selection for least squares projection twin support vector machine. Neurocomputing, 144, 174--183.Google ScholarDigital Library
- Xie J, Hone K, Xie W, Gao X, Shi Y and Liu X (2013). Extending twin support vector machine classifier for multi-category classification problems. Intelligent Data Analysis, 17(4), 649--664.Google ScholarDigital Library
- Ding S, Zhang J, Zhang X and An Y (2018). Survey on multi class twin support vector machines. Journal of Software, 29(1), 89--108.Google Scholar
- Gu H, Niu B and Gao Z (2014). A directed acyclic graph algorithm for multi-class classification based on twin support vector machine[J]. Journal of Information & Computational Science, 11(18), 6529--6536.Google ScholarCross Ref
- Xu Y, Guo R and Wang L (2013). A twin multi-class classification support vector machine. Cognitive Computation, 5(4), 580--588.Google ScholarCross Ref
- Angulo C, Parra X and Andreu Català (2003). K-SVCR: a support vector machine for multi-class classification. Neurocomputing, 55(1-2), 57--77.Google ScholarCross Ref
- Yang Z, Shao Y and Zhang X (2013). Multiple birth support vector machine for multi-class classification. Neural Computing and Applications, 22(1 Supplement), 153--161.Google ScholarCross Ref
- Chen S and Wu X (2016). Multiple birth least squares support vector machine for multi-class classification. International Journal of Machine Learning and Cybernetics, 8(6), 1731--1742.Google ScholarCross Ref
- Ding S, Zhang X, An Y and Xue Y (2017). Weighted linear loss multiple birth support vector machine based on information granulation for multi-class classification. Pattern Recognition, 67, 32--46.Google ScholarDigital Library
- Qi Z, Tian Y and Shi Y (2013). Structural twin support vector machine for classification. Knowledge-Based Systems, 43, 74--81.Google ScholarDigital Library
Index Terms
- A Novel Structural Multiple Birth Support Vector Machine for Pattern Recognition
Recommendations
An improved multiple birth support vector machine for pattern classification
Multiple birth support vector machine is a novel machine learning algorithm for multi-class classification, which is considered as an extension of twin support vector machine. Compared with training speeds of other multi-class classifiers based on twin ...
Structural nonparallel support vector machine for pattern recognition
It has been widely accepted that the underlying structural information in the training data within classes is significant for a good classifier in real-world problems. However, existing structural classifiers do not balance structural information's ...
Structural least square twin support vector machine for classification
The least square twin support vector machine (LS-TSVM) obtains two non-parallel hyperplanes by directly solving two systems of linear equations instead of two quadratic programming problems (QPPs) as in the conventional twin support vector machine (TSVM)...
Comments