Abstract
In recent years, more and more scholars have begun to study the problem of multi-label learning. In this paper, we propose a multi-label learning method called KM\(^{3}\)SVM based on Clustering idea. First, for each label, KM\(^{3}\)SVM method selects positive samples and negative samples, then uses clustering method to gain a number of training subsets. By using these relatively smaller and more balanced training subsets, we can get a group of classifiers. Given an unseen sample, we can obtain a series of outputs and combine them by two simple principles. Experimental results on two datasets demonstrate the superiority of the proposed method KM\(^{3}\)SVM over several state-of-the-art multi-label learning algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Schapire, R.E., Singer, Y.: BoosTexter: a boosting-based system for text categorization. Mach. Learn. 39(2–3), 135–168 (2000)
Yu, K., Yu, S., Tresp, V.: Multi-label informed latent semantic indexing. In: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 258–265. ACM (2005)
Chen, K., Lu, B.L., Kwok, J.T.: Efficient classification of multi-label and imbalanced data using min-max modular classifiers. In: International Joint Conference on Neural Networks, IJCNN 2006, pp. 1770–1775. IEEE (2006)
Kang, F., Jin, R., Sukthankar, R.: Correlated label propagation with application to multi-label learning. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1719–1726. IEEE (2006)
Zhang, M.L., Zhou, Z.H.: ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)
Barutcuoglu, Z., Schapire, R.E., Troyanskaya, O.G.: Hierarchical multi-label prediction of gene function. Bioinformatics 22(7), 830–836 (2006)
Pavlidis, P., Grundy, W.N.: Combining microarray expression data and phylogenetic profiles to learn gene functional categories using support vector machines (2000)
Murthy, V.S.V.S., et al.: Application of hierarchical and K-means techniques in content based image retrieval. Int. J. Eng. Sci. Technol. 2(5), 749–755 (2010)
Ma, J.: Based on the Fourier transform and the wavelet transformation of the digital image processing. In: 2012 International Conference on Computer Science and Information Processing (CSIP), pp. 1232–1234. IEEE (2012)
Kazawa, H., Izumitani, T., Taira, H., et al.: Maximal margin labeling for multi-topic text categorization. In: Advances in Neural Information Processing Systems, pp. 649–656 (2004)
Liu, F.Y., Wu, K., Zhao, H., et al.: Fast text categorization with min-max modular support vector machines. In: Proceedings of 2005 IEEE International Joint Conference on Neural Networks, IJCNN 2005, vol. 1, pp. 570–575. IEEE (2005)
Lu, B.L., Ito, M.: Task decomposition and module combination based on class relations: a modular neural network for pattern classification. IEEE Trans. Neural Netw. 10(5), 1244–1256 (1999)
Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123–140 (1996)
Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26, 1819–1837 (2013)
Boutell, M.R., Luo, J., Shen, X., et al.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)
Boser, B., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152. ACM, Pittsburgh (1992)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New-York (1995). https://doi.org/10.1007/978-1-4757-2440-0
Shi, J., Zhang, Z., Li, Y., Wang, R., Shi, H., Li, X.: New method for computer identification through electromagnetic radiation. CMC: Comput. Mater. Continua 57(1), 69–80 (2018)
Wang, B., et al.: Research on hybrid model of garlic short-term price forecasting based on big data. CMC: Comput. Mater. Continua 57(2), 283–296 (2018)
Yuan, C., Li, X., Wu, Q.M.J., Li, J., Sun, X.: Fingerprint Liveness detection from different fingerprint materials using convolutional neural network and principal component analysis. CMC: Comput. Mater. Continua 53(3), 357–371 (2017)
Gurusamy, R., Subramaniam, V.: A machine learning approach for MRI brain tumor classification. CMC: Comput. Mater. Continua 53(2), 91–108 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, X., Fang, X., Tan, Y., Meng, L., Zhang, H. (2019). KM\(^{3}\)SVM: A Efficient Min-Max Modular Support Vector Machine Based on Clustering. In: Sun, X., Pan, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2019. Lecture Notes in Computer Science(), vol 11634. Springer, Cham. https://doi.org/10.1007/978-3-030-24271-8_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-24271-8_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24270-1
Online ISBN: 978-3-030-24271-8
eBook Packages: Computer ScienceComputer Science (R0)