Abstract
In this paper, we propose a matrix version extension for linear regularization projection twin support vector machine presented by Shao et al. (Knowl Based Syst 37:203–210, 2013), named as linear projection twin support matrix machine [linear projection twin support matrix machine (PTSMM)], for 2d image data classification. In order to discuss the nonlinear version of PTSMM, a new matrix kernel function is introduced and based on which, we provide a nonlinear PTSMM algorithm with a detailed theoretical derivation. To examine the effectiveness of the presented linear and nonlinear PTSMM, we perform comparative experiments with three linear classifiers support tensor machines, twin support tensor machine and proximal support tensor machine on ORL, YALE and AR databases. Experimental results show that our methods are effective and efficient.
Similar content being viewed by others
References
Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297
Vapnik V (1998) The nature of statistical learning, 2nd edn. Springer, New York
Jayadeva Khemchandani R, Chandra S (2007) Twin support vector machine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910
Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recognit Lett 29(13):1842–1848
Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543
Peng X (2011) TPMSVM: a novel twin parametric-margin support vector for pattern recognition. Pattern Recognit 44(10–11):2678–2692
Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968
Chen X, Yang J, Ye Q, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recognit 44(10–11):2643–2655
Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210
Wei LY, Yang YY, Nishikawa RM, Wernick MN, Edwards A (2005) Relevance vector machine for automatic detection of clustered microcalcifications. IEEE Trans Med Imaging 24(10):1278–1285
Naqa IE, Yang YY, Wernick MN, Galatsanos NP, Nishikawa RM (2002) A support vector machine approach for detection of microcalcifications. IEEE Trans Med Imaging 21(12):1552–1563
Cai D, He X, Wen JR, Han J, Ma WY (2006) Support tensor machines for text categorization. Technical Report, Department of Computer Science, UIUC, UIUCDCS-R-2006-2714
Tao D, Li X, Hu W, Maybank S (2005) Supervised tensor learning, In Proceedings of the 5th IEEE International Conference on Data Mining, 450–457
Khemchandani R, Karpatne A, Chandra S (2013) Proximal support tensor machines. Int J Mach Learn Cybern 4(6):703–712
Zhang XS, Gao XB, Wang Y (2009) Twin support tensor machines for mcs detection. J Electron (China) 26(3):318–325
Hou C, Nie F, Zhang C, Yi D, Wu Y (2014) Multiple rank multi-linear SVM for matrix data classification. Pattern Recognit 47:454–469
Tao DC, Li XL, Wu XD, Hu WM, Maybank SJ (2007) Supervised tensor learning. Knowl Inf Syst 13(1):1–42
Sun J, Tao D, Papadimitriou S, Yu PS, Faloutsos C (2008) Incremental tensor analysis: theory and applications. ACM Transactions on Knowledge Discovery from Data 2 (3), Article no. 11
Zhang Z, Ye N (2011) Learning a tensor subspace for semi-supervised dimensionality reduction. Soft Comput 15(2):383–395
Hao Z, He L, Chen B, Yang X (2013) A linear support higher-order tensor machine for classification. IEEE Trans Image Process 22(7):2911–2920
Luo ZQ, Tseng P (1993) Error bounds and convergence analysis of feasible descent methods: a general approach. Ann Oper Res 46–47(1):157–178
Mangasarian OL, Musicant DR (1999) Successive overrelaxation for support vector machines. IEEE Trans Neural Netw 10(5):1032–1037
MathWorks (2013) [Online]. Available: http://www.mathworks.com
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Xu, H., Fan, L. & Gao, X. Projection twin SMMs for 2d image data classification. Neural Comput & Applic 26, 91–100 (2015). https://doi.org/10.1007/s00521-014-1700-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-014-1700-3
Keywords
- Projection twin support matrix machine
- Twin support tensor machine
- Projection support tensor machine
- Matrix kernel function
- Iterative algorithm