Abstract
In this paper, we propose a new classifier termed as an improved ν-twin bounded support vector machine (Iν-TBSVM) which is motivated by ν-twin support vector machine (ν-TSVM). Similar to the ν-TSVM, Iν-TBSVM determines two nonparallel hyperplanes such that they are closer to their respective classes and are at least ρ + or ρ − distance away from the other class. The significant advantage of Iν-TBSVM over ν-TSVM is that Iν-TBSVM skillfully avoids the expensive matrix inverse operation when solving the dual problems. Therefore, the proposed classifier is more effective when dealing with large scale problem and has comparable generalization ability. Iν-TBSVM also implements structural risk minimization principle by introducing a regularization term into the objective function. More importantly, the kernel trick can be applied directly to the Iν-TBSVM for nonlinear case, so the nonlinear Iν-TBSVM is superior to the nonlinear ν-TSVM theoretically. In addition, we also prove that ν-SVM is the special case of Iν-TBSVM. The property of parameters in Iν-TBSVM is discussed and testified by two artificial experiments. Numerical experiments on twenty-two benchmarking datasets are performed to investigate the validity of our proposed algorithm in both linear case and nonlinear case. Experimental results show the effectiveness of our proposed algorithm.
Similar content being viewed by others
References
Vapnik V (1995) The nature of statistical learning theory. Springer, New York
Ripley BD (1996) Pattern recognition and neural networks. Cambridge University Press, Cambridge
Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, Cambridge
Brown MPS, Grundy WN, Lin D, Cristianini N, Sugnet C, Furey TS, Ares JM, Haussler D (2000) Knowledge-based analysis of microarray gene expression data by using support vector machine. Proc Natl Acad Sci USA 97:262–267
Cao XB, Xu YW, Chen D, Qiao H (2009) Associated evolution of a support vector machine-based classifier for pedestrian detection. Inf Sci 179:1070–1077
Ghosh S, Mondal S, Ghosh B (2014) A comparative study of breast cancer detection based on SVM and MLP BPN classifier. In: First international conference on automation, control, energy & systems (ACES-14), pp 87–90
Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297
Osuna E, Freund R, Girosi F (1997) Support vector machines: training and applications. Technical Report, MIT Artificial Intelligence Laboratory, Cambridge, MA
Platt J (1998) Sequential minimal optimization: a fast algorithm for training support vector machines. In: Scholkopf et al. (eds.), Technical report MSR-TR-98-14, Microsoft research, pp 185– 208
Schölkopf B, Burges CJC, Smola AJ (eds.) (1999) Advances in kernel methods: support vector learning. MIT Press, Cambridge
Keerthi SS, Shevade SK, Bhattacharyya C, Murthy K (2001) Improvements to platts SMO algorithm for SVM classifier design. Neural Comput 13(3):637–649
Schölkopf B, Smola AJ, Bartlett P, Williamson R C (2000) New support vector algorithms. Neural Comput 12(5):1207–1245
Lee Y, Mangasarian OL (2001) Ssvm: a smooth support vector machine for classification. Comput Optim Appl 20(1):5– 22
Schölkopf B, Bartlett P L, Smola A J, Williamson R (1999) Shrinking the tube: a new support vector regression algorithm. Advances in neural information processing systems, pp 330–336
Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9 (3):293–300
Mangasarian OL, Wild EW (2001) Proximal support vector machine classifiers. In: Proceedings KDD-2001: knowledge discovery and data mining. Citeseer
Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74
Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910
Tian Y, Qi Z (2014) Review on: twin support vector machines. Annals Data Sci 1(2):253–277
Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29:1842–1848
Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36:7535–7543
Peng XJ (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23(3):365–372
Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22:962–968
Peng X, Wang Y, Xu D (2013) Structural twin parametric-margin support vector machine for binary classification. Knowl-Based Syst 49:63–72
Tian Y, Ju X, Qi Z, Shi Y (2014) Improved twin support vector machine. Sci China (Mathematics) 57:417–432
Peng XJ (2010) A ν-twin support vector machine (ν-TSVM) classifier and its geometric algorithms. Inf Sci 180(20):3863– 3875
Xu Y, Guo R (2014) An improved ν-twin support vector machine. Appl Intell 41:42–54
Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Appl 21:1307–1317
Xu Y, Yu J, Zhang Y (2014) KNN-based weighted rough ν-twin support vector machine. Knowl-Based Syst 71:303–313
Khemchandani R, Saigal P, Chandra S (2016) Improvements on ν-twin support vector machine. Neural Netw 79:97–107
Duncan WJ (1944) Some devices for the solution of large sets of simultaneous linear equations. The London, Edinburgh and Dublin Philosophical Magazine and Journal of Science, Seventh Series 35(249):660–670
Sherman J, Morrison WJ (1949) Adjustment of an inverse matrix corresponding to changes in the elements of a given column or a given row of the original matrix. Ann Math Stat 20:621
Woodbury M (1950) Inverting modified matrices. Memorandum Report 42. Statistical Research Group Princeton University, Princeton
Lin CJ, Hsu CW, Chang CC (2003) A practical guide to support vector classification. National Taiwan U., www.csie.ntu.edu.tw/cjlin/papers/guide/guide.pdf
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6(2):65–70
Dems~ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
García S, Fernández A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inform Sci 180:2044–2064
Acknowledgements
The authors gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation. This work was supported in part by National Natural Science Foundation of China (No.11671010) and Beijing Natural Science Foundation (No.4172035).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, H., Zhou, Z. & Xu, Y. An improved ν-twin bounded support vector machine. Appl Intell 48, 1041–1053 (2018). https://doi.org/10.1007/s10489-017-0984-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-017-0984-2