Abstract
In this paper, we propose a reduction method for the multiobjective multiclass support vector machine (MMSVM) which can maintain the discrimination ability and reduce the computational complexity of the original MMSVM. The proposed method finds some centroids of each class by a k-means clustering and obtains a classifier based on the centroids where the normal vectors of the corresponding separating hyperplanes are given by weighted sums of the centroids, while the geometric margins are exactly maximized between class pairs. Through some numerical experiments for benchmark problems, we observed that the proposed method can reduce the computational complexity without decreasing its generalization ability widely.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alizadeh, F., Goldfarb, D.: Second-order cone programming, mathematical programming. Ser. B 95, 3–51 (2003)
Bottou, L., Cortes, C., Denker, J., Drucker, H., Guyon, I., Jackel, L., LeCun, Y., Muller, U., Sackinger, E., Simard, P., Vapnik, V.: Comparison of classifier methods: a case study in handwriting digit recognition. In: Proceedings of International Conference on Pattern Recognition, pp. 77–87 (1994)
Boyang, L., Qiangwei, W., Jinglu, H.: A fast SVM training method for very large datasets. In: Proceedings of International Joint Conference on Neural Networks, pp. 14–19 (2009)
Ehrgott, M.: Multicriteria Optimization. Springer, Berlin (2005). doi:10.1007/3-540-27659-9
MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Fifth Berkeley Symposium on Mathematics, Statistics and Probability, pp. 281–297 (1967)
Tatsumi, K., Tanino, T., Hayashida, K.: Multiobjective multiclass support vector machines maximizing geometric margins. Pacific J. Optim. 6(1), 115–140 (2010)
Tatsumi, K., Kawachi, R., Tanino, T.: Nonlinear extension of multiobjective multiclass support vector machine. In: Proceedings of in IEEE SMC, pp. 1338–1343 (2010)
Tatsumi, K., Tanino, T.: Support vector machines maximizing geometric margins for multi-class classification. Official J. Span. Soc. Stat. Oper. Res.h 22(3), 815–840 (2014)
UCI benchmark Repository of Artificial and Real Data Sets, University of California Irvine. http://archive.ics.uci.edu/ml/datasets.html
Weston, J., Watkins, C.: Multi-class support vector machines. In: Verleysen, M. (ed.) ESANN99. Belgium, Brussels (1999)
Vapnik, V.N.: Statistical Learning Theory. Wiley, NewYork (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Tatsumi, K., Kawashita, Y., Sugimoto, T. (2017). A Multiobjective Multiclass Support Vector Machine Restricting Classifier Candidates Based on k-Means Clustering. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10634. Springer, Cham. https://doi.org/10.1007/978-3-319-70087-8_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-70087-8_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70086-1
Online ISBN: 978-3-319-70087-8
eBook Packages: Computer ScienceComputer Science (R0)