Abstract
In classification tasks, deep learning methods yield high performance. However, owing to lack of enough annotated data, deep learning methods often underperformed. Therefore, we propose an advance version of least squares twin multi-class classification support vector machine (ALST-KSVC) which leads to low computational complexity and comparable accuracy based on LST-KSVC for few-shot classification. In ALST-KSVC, we modified optimization problems to construct a new “1-versus-1-versus-1” structure, proposed a new decision function, and constructed smaller number of classifiers than our baseline LST-KSVC. We empirically demonstrate that the proposed method has better classification accuracy than LST-KSVC. Especially, ALST-KSVC achieves the state-of-the-art performance on MNIST, USPS, Amazon, Caltech image datasets and Iris, Teaching evaluation, Balance, Wine, Transfusion UCI datasets.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations, May 2015
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on International Conference on Machine Learning. JMLR.org (2015)
He, K., Zhang, X., Ren, S., et al.: Deep residual learning for image recognition (2015)
Huang, G., Liu, Z., Laurens, V.D.M., et al.: Densely connected convolutional networks (2016)
Kumar, M.A., Gopal, M.: Least squares twin support vector machines for pattern classification. Expert Syst. Appl. 36(4), 7535–7543 (2009)
Shao, Y.H., Deng, N.Y., Yang, Z.M.: Least squares recursive projection twin support vector machine for classification. Int. J. Mach. Learn. Cybern. 45(6), 2299–2307 (2012)
Lecun, Y., Bottou, L., Bengio, Y., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Wu, Y.C., Lee, Y.S., Yang, J.C.: Robust and efficient multiclass SVM models for phrase pattern recognition. Pattern Recogn. 41(9), 2874–2889 (2008)
Liu, R., Wang, Y., Baba, T., et al.: SVM-based active feedback in image retrieval using clustering and unlabeled data. Pattern Recogn. 41(8), 2645–2655 (2008)
Jayadeva, Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)
Shao, Y.H., Zhang, C.H., Wang, X.B., et al.: Improvements on twin support vector machines. IEEE Trans. Neural Netw. 22(6), 962–968 (2011)
Bottou, L., Cortes, C., Denker, J.S., et al.: Comparison of classifier methods: a case study in handwritten digit recognition. In: International Conference on Pattern Recognition (1994)
Krebel, U.: Pairwise classification and support vector machines. In: Advances in Kernel Methods. MIT Press (1999)
Angulo, C., Parra, X., Català, A.: K-SVCR. A support vector machine for multi-class classification. Neurocomputing 55(1–2), 57–77 (2003)
Xu, Y., Guo, R., Wang, L.: A twin multi-class classification support vector machine. Cogn. Comput. 5(4), 580–588 (2013)
Nasiri, J.A., Charkari, N.M., Jalili, S.: Least squares twin multi-class classification support vector machine. Pattern Recogn. 48(3), 984–992 (2015)
Cristianini, N.: An introduction to support vector machines and other kernel-based learning methods. Kybernetes 32(1), 1–28 (2001)
Moore, B.C.: Principal component analysis in linear systems: controllability, observability, and model reduction. IEEE Trans. Autom. Control 26(1), 17–32 (2003)
Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_16
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Y., Liu, Z., Pan, H., Yin, J., Zhang, X. (2019). An Advanced Least Squares Twin Multi-class Classification Support Vector Machine for Few-Shot Classification. In: Cui, Z., Pan, J., Zhang, S., Xiao, L., Yang, J. (eds) Intelligence Science and Big Data Engineering. Big Data and Machine Learning. IScIDE 2019. Lecture Notes in Computer Science(), vol 11936. Springer, Cham. https://doi.org/10.1007/978-3-030-36204-1_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-36204-1_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36203-4
Online ISBN: 978-3-030-36204-1
eBook Packages: Computer ScienceComputer Science (R0)