Abstract
In multi-label classification problems, some samples belong to multiple classes simultaneously and thus the classes are not mutually exclusive. How to characterize this kind of correlations between labels has been a key issue for designing a new multi-label classification approach. In this paper, we define two objective functions, i.e., the number of relevant and irrelevant label pairs which are ranked incorrectly, and the model regularization term, which depict the correlations between labels and the model complexity respectively. Then a new kernel machine for multi-label classification is constructed using two-objective minimization and solved by fast and elitist multi-objective genetic algorithm, i.e., NSGA-II. Experiments on the benchmark data set Yeast illustrate that our multi-label method is a competitive candidate for multi-label classification, compared with several state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tsoumakas, G., Katakis, I.: Multi-label Classification: an Overview. International Journal of Data Warehousing and Mining 3(3), 1–13 (2007)
Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning Multi-label Scene Classification. Pattern Recognition 37(9), 1757–1771 (2004)
Elisseeff, A., Weston, J.: A Kernel Method for Multi-labelled Classification. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems (NIPS 2002), vol. 14, pp. 681–687. MIT Press, Cambridge (2002)
Cheng, W.W., Hullermeier, E.: Combining Instance-based Learning and Logistic Regression for Multi-label Classification. Machine Learning 76(2/3), 211–225 (2009)
Zhang, M.L., Pena, J.M., Robles, V.: Feature Selection for Multi-label Naïve Bayes Classification. Information Science 179(19), 3218–3229 (2009)
Wan, S.P., Xu, J.H.: A Multi-label Classification Algorithm Based on Triple Class Support Vector Machine. In: The 2007 International Conference on Pattern Recognition and Wavelet Analysis (ICPRWA 2007), pp. 1447–1452. IEEE Press, New York (2007)
Li, J.Y., Xu, J.H.: A Fast Multi-Label Classification Algorithm Based on Double Label Support Vector Machine. In: The 2009 International Conference on Computational Intelligence and Security (CIS 2009), vol. 2, pp. 30–35. IEEE Press, New York (2009)
Clare, A., King, R.D.: Knowledge Discovery in Multi-label Phenotype Data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS(LNAI), vol. 2168, pp. 42–53. Springer, Heidelberg (2001)
Schapire, R.E., Singer, Y.: Boostexer: a Boosting-based System for Text Categorization. Machine Learning 39(1/2), 135–168 (2000)
Comite, F.D., Gilleron, R., Tommasi, M.: Learning Multi-label Alternative Decision Tree from Texts and Data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS, vol. 2734, pp. 35–49. Springer, Heidelberg (2003)
Zhang, M.L., Zhou, Z.H.: A k-nearest Neighbor Based Algorithm for Multi-label Classification. In: The 1st IEEE International Conference on Granular Computing (GrC 2005), pp. 718–721. IEEE Press, New York (2005)
Zhang, M.L., Zhou, Z.H.: ML-kNN: a Lazy Learning Approach to Multi-label Learning. Pattern Recognition 40(5), 2038–2048 (2007)
Zhang, M.L., Zhou, Z.H.: Multi-label Neural Networks with Application to Functional Genomics and Text Categorization. IEEE Transactions on Knowledge and Data Engineering 18(10), 1338–1351 (2006)
Konak, A., Coit, D.W., Smith, A.E.: Multi-objective Optimization Using Genetic Algorithms: a Tutorial. Reliability Engineering and System Safety 91(9), 992–1007 (2006)
Handl, J., Kell, D.B., Knowles, J.: Multiobjective Optimization in Bioinformatics and Computational Biology. IEEE/ACM Transactions on Computational Biology and Bioinformatics 4(2), 279–292 (2007)
Srinivas, N., Deb, K.: Multiobjective Fucntion Optimization Using Nondominated Sorting Genetic Algorithms. Evolutional Computation 2(3), 221–248 (1995)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multi-Objective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)
Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, New York (1998)
Free NSGA-II Software, http://www.lania.mx/~ccoello/EMOO/EMOOsoftware.html
Tahir, M.A., Kittler, J., Mikolajczyk, K., Yan, F.: Improving Multi-Label Classification Performance by Using Ensemble of Multi-label Classifiers. In: El Gayar, N., Kittler, J., Roli, F. (eds.) MCS 2010. LNCS, vol. 5997, pp. 11–21. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xu, H., Xu, J. (2010). Designing a Multi-label Kernel Machine with Two-Objective Optimization. In: Wang, F.L., Deng, H., Gao, Y., Lei, J. (eds) Artificial Intelligence and Computational Intelligence. AICI 2010. Lecture Notes in Computer Science(), vol 6319. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16530-6_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-16530-6_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16529-0
Online ISBN: 978-3-642-16530-6
eBook Packages: Computer ScienceComputer Science (R0)