Abstract
This paper is devoted to the multi-label classification problem. We propose two new methods for reduction from ranking to multi-label case. In existing methods complex threshold functions are being defined on the input feature space, while in our approach we propose to construct simple linear multi-label classification functions on the class relevance space using the output of ranking algorithms as an input. In our first method we estimate the linear threshold function defined on the class relevance space. In the second method we define the linear operator mapping class ranks into the set of values of binary decision functions. In comparison to existing methods our methods are less computationally expensive and in the same time they demonstrate competitive and in some cases significantly better accuracy results in experiments on well-known multi-label benchmarks datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Machine Learning 37(3), 297–336 (1999)
Comite, F.D., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision tree from texts and data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS, vol. 2734, pp. 35–49. Springer, Heidelberg (2003)
McCallum, A.: Multi-label text classification with a mixture model trained by EM. In: Working Notes of the AAAI 1999 Workshop on Text Learning, Orlando, FL (1999)
Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recognition 37, 1757–1771 (2004)
Crammer, C., Singer, Y.: A family of additive online algorithms for category ranking. Journal of Machine Learning Research 3, 1025–1058 (2003)
Cao, M.D., Gao, X.: Combining Content and Citation for Scientific Document Classification. In: Zhang, S., Jarvis, R. (eds.) AI 2005. LNCS (LNAI), vol. 3809, pp. 143–152. Springer, Heidelberg (2005)
Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. In: Proceedings NIPS14, Cambridge (2002)
Zhang, M.-L., Zhou, Z.-H.: A k-nearest neighbor based algorithm for multi-label classification. In: Proceedings of IEEE International Conference GrC 2005, pp. 718–721 (2005)
Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001), Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Petrovskiy, M., Glazkova, V. (2006). Linear Methods for Reduction from Ranking to Multilabel Classification. In: Sattar, A., Kang, Bh. (eds) AI 2006: Advances in Artificial Intelligence. AI 2006. Lecture Notes in Computer Science(), vol 4304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11941439_139
Download citation
DOI: https://doi.org/10.1007/11941439_139
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49787-5
Online ISBN: 978-3-540-49788-2
eBook Packages: Computer ScienceComputer Science (R0)