Abstract
Multi-label learning has attracted more attention recently due to many real-world applications (e.g., text categorization and scene annotation). As the dimensionality of label space increases, it becomes more difficult to deal with this kind of applications. Therefore, dimensionality reduction techniques originally for feature space is also applied to label space, one of which is label embedding strategy which converts the high-dimensional label space into a low-dimensional reduced one. So far, existing label embedding methods mainly investigate the global recoverability between original labels and reduced labels, dependency between original features and reduced labels, or both. It is widely recognized that local label correlations could improve multi-label classification performance effectively. In this paper, we construct a trace ratio minimization problem as a novel label embedding criterion, which not only includes the global label recoverability and dependency, but also exploits the local label correlations as a local recoverability factor. Experiments on four benchmark data sets with more than 100 labels demonstrate that our proposed method is superior to four state-of-the-art techniques, according to two performance metrics for high-dimensional label space.
This work was supported by the Natural Science Foundation of China (NSFC) under grants 61273246 and 61703096.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Balasubramanian, K., Lebanon, G.: The landmark selection method for multiple output prediction. In: 29th International Conference on Machine Learning, pp. 983–990. OmniPress, Madison (2012)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Singapore (2006)
Cao, L., Xu, J.: A label compression coding approach through maximizing dependence between features and labels for multi-label classification. In: 27th International Joint Conference on Neural Networks, pp. 1–8. IEEE Press, New York (2015)
Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: LI-MLC: a label inference methodology for addressing high dimensionality in the label space for multilabel classification. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1842–1854 (2014)
Chen, Y., Lin, H.: Feature-aware label space dimension reduction for multi-label classification. In: 26th Annual Conference on Neural Information Processing Systems, pp. 1538–1546. MIT Press, Cambridge (2012)
Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)
Gretton, A., Bousquet, O., Smola, A., Schölkopf, B.: Measuring statistical dependence with Hilbert-Schmidt norms. In: Jain, S., Simon, H.U., Tomita, E. (eds.) ALT 2005. LNCS (LNAI), vol. 3734, pp. 63–77. Springer, Heidelberg (2005). https://doi.org/10.1007/11564089_7
Herrera, F., Charte, F., Rivera, A.J., del Jesus, M.J.: Multilabel Classification: Problem Analysis, Metrics and Techniques. Springer, Switzerland (2016). https://doi.org/10.1007/978-3-319-41111-8
Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. In: 23rd Annual Conference on Neural Information Processing Systems, pp. 772–780. MIT Press, Cambridge (2009)
Huang, S.J., Zhou, Z.H.: Multi-label learning by exploting label correlations locally. In: 26th AAAI Conference on Artificial Intelligence, pp. 949–955. AAAI Press, New York (2012)
Wicker, J., Pfahringer, B., Kramer, S.: Multi-label classification using Boolean matrix decomposition. In: 27th Annual ACM Symposium on Applied Computing, pp. 179–186. ACM Press, New York (2012)
Jain, H., Prabhu, Y., Varma, M.: Extreme multi-label loss functions for recommendation, tagging, ranking and other missing label applications. In: 22nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 435–944. ACM Press, New York (2016)
Jia, Y., Nie, F., Zhang, C.: Trace ratio problem revisited. IEEE Trans. Neural Netw. 20(4), 729–735 (2009)
Lin, Z., Ding, G., Han, J., Shao, L.: End-to-end feature-aware label space encoding for multilabel classification with many classes. IEEE Trans. Neural Netw. Learn. Syst. 29(6), 2472–2487 (2018)
Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: 31st International Conference on Machine Learning, pp. 325–333. JMLR Website (2014)
Luo, J., Cao, L., Xu, J.: A non-linear label compression coding method based on five-layer auto-encoder for multi-label classification. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds.) ICONIP 2016. LNCS, vol. 9949, pp. 415–424. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46675-0_45
Tai, F., Lin, H.: Multilabel classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)
Wang, H., Nie, F., Huang, H.: Globally and locally consistent unsupervised projection. In: 28th AAAI Conference on Artificial Intelligence, pp. 1328–1333. AAAI Press, New York (2014)
Xu, J., Mao, Z.H.: Multilabel feature extraction algorithm via maximizing approximated and symmetrized normalized cross-covariance operator. IEEE Trans. Cybern. 1–14 (2019, in press)
Zhang, J.J., Feng, M., Wang, H., Li, X.: Depedence maximization based label space dimension reduction for multi-label classification. Eng. Appl. Artif. Intell. 45, 453–463 (2015)
Zhang, M.L., Zhang, K.: Multi-label learning by exploiting label dependency. In: 16th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 999–1007. ACM Press, New York (2010)
Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1–2), 69–126 (2012)
Zhou, W.J., Yu, Y., Zhang, M.L.: Binary linear compression for multi-label classification. In: 26th International Joint Conference on Artificial Intelligence, pp. 3546–3552. IJCAI Website (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, X., Li, J., Xu, J. (2019). A Label Embedding Method for Multi-label Classification via Exploiting Local Label Correlations. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Communications in Computer and Information Science, vol 1143. Springer, Cham. https://doi.org/10.1007/978-3-030-36802-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-36802-9_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36801-2
Online ISBN: 978-3-030-36802-9
eBook Packages: Computer ScienceComputer Science (R0)