Skip to main content

A Multi-label Learning Approach Based on Mapping from Instance to Label

  • Conference paper
Book cover Pervasive Computing and the Networked World (ICPCA/SWS 2013)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 8351))

Abstract

Multi-label classification approaches deal with ambiguous instances that may belong to several concepts simultaneously. In these learning frameworks, the inherent ambiguity of each instance is explicitly expressed in the output space where it is associated with multiple class labels. Recognizing the label sets for unseen instances becomes difficult because of the concept ambiguity. To handle with the multi-label learning problems, we propose a novel multi-label classification approach based on the assumption that, the relationship among instances in the feature space represents the relationship among their labels. We reconstruct a newly coming instance using the training data, and obtain a weight vector for it. This weight vector represents the relationship between the instance and the training instances, and its label vector can be obtained by the weighted sum of the label vectors of the training data. Experiments on real-world multi-label data sets show that, the approach achieves highly competitive performance compared with other well-established multi-label learning algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gao, S., Wu, W., Lee, C.-H., Chua, T.-S.: AMFoM learning approach to robust multiclass multi-label text categorization. In: Proceedings of the 21st International Conference on Machine Learning (ICML 2004), Banff, Canada, pp. 329–336 (2004)

    Google Scholar 

  2. Qi, G.-J., Hua, X.-S., Rui, Y., Tang, J., Mei, T., Zhang, H.-J.: Correlative multi-label video annotation. In: Proceedings of the 15th ACM International Conference on Multimedia (ACM Multimedia 2007), Augsburg, Germany, pp. 17–26 (2007)

    Google Scholar 

  3. Barutcuoglu, Z., Schapire, R.E., Troyanskaya, O.G.: Hierarchical multi-label prediction of gene function. Bioinformatics 22(7), 830–836 (2006)

    Article  Google Scholar 

  4. Yang, B., Sun, J.-T., Wang, T., Chen, Z.: Effective multi-label active learning for text classification. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2009), Paris, France, pp. 917–926 (2009)

    Google Scholar 

  5. Gopal, S., Yang, Y.: Multilabel classification with meta-level features. In: Proc. of the 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2010), Geneva, Switzerland, pp. 315–322 (2010)

    Google Scholar 

  6. Ozonat, K., Young, D.: Towards a universal marketplace over the web: Statistical multi-label classification of service provider forms with simulated annealing. In: Proc. of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2009), Paris, France, pp. 1295–1303 (2009)

    Google Scholar 

  7. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining Multi-label Data. In: Maimon, O., Rokach, L. (eds.) Mining and Knowledge Discovery Handbook, 2nd edn., Springer (2010)

    Google Scholar 

  8. Frnkranz, J., Hllermeier, E., Lozamenca, E., Brinker, K.: Multilabel classification via calibratedlabel ranking. Machine Learning 73(2), 133–153 (2008)

    Article  Google Scholar 

  9. Schapire, R.E., Singer, Y.: BoosTexter: A boosting-based system for text categorization. Machine Learning 39(2/3), 135–168 (2000)

    Article  MATH  Google Scholar 

  10. Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems (NIPS 2001), vol. 14, pp. 681–687. MIT Press, Cambridge (2002)

    Google Scholar 

  11. Zhang, M.-L., Zhou, Z.-H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)

    Article  MATH  Google Scholar 

  12. Zhang, M.-L., Zhou, Z.-H.: Multi-label neural networks with applications to functional genomics and text categorization. IEEE Transactions on Knowledge and Data Engineering 18(10), 1338–1351 (2009)

    Article  Google Scholar 

  13. Zhang, M.-L., Zhang, K.: Multi-label learning by exploiting label dependency. In: Proc. of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2010), Washington, D. C, pp. 999–1007 (2010)

    Google Scholar 

  14. Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. In: ECML/PKDD 2009, pp. 254–269 (2009)

    Google Scholar 

  15. Tsoumakas, G., Vlahavas, I.P.: Random k-Labelsets: An Ensemble Method for Multilabel Classification. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladenič, D., Skowron, A. (eds.) ECML 2007. LNCS (LNAI), vol. 4701, pp. 406–417. Springer, Heidelberg (2007)

    Google Scholar 

  16. Comite, F., Gilleron, R., Tommasi, M.: Learning Multi-Label Alternating Decision Tree from Texts and Data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS, vol. 2734, pp. 35–49. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  17. Godbole, S., Sarawagi, S.: Discriminative Methods for Multi-labeled Classification. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 22–30. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  18. Luo, X., Zincir-Heywood, A.N.: Evaluation of Two Systems on Multi-Class Multi-Label Document Classification. In: Hacid, M.-S., Murray, N.V., Raś, Z.W., Tsumoto, S. (eds.) ISMIS 2005. LNCS (LNAI), vol. 3488, pp. 161–169. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  19. Brinker, K., Frnkranz, J., Hllermeier, E.: A unified model for multilabel classification and ranking. In: Proc. of the 17th European Conference on Artificial Intelligence (ECAI 2006), Riva del Garda, Italy, pp. 489–493 (2006)

    Google Scholar 

  20. Spyromitros, E., Tsoumakas, G., Vlahavas, I.P.: An empirical study of lazy multilabel classification algorithms. In: Darzentas, J., Vouros, G.A., Vosinakis, S., Arnellos, A. (eds.) SETN 2008. LNCS (LNAI), vol. 5138, pp. 401–406. Springer, Heidelberg (2008)

    Google Scholar 

  21. Tsoumakas, G., Katakis, I.: Multi label classification: An overview. International Journal of Data Warehousing and Mining 3(3), 1–13 (2007)

    Article  Google Scholar 

  22. Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recognition 37(9), 1757–1771 (2004)

    Article  Google Scholar 

  23. Comit, D., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision treefrom textsand data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS, vol. 2734, pp. 35–49. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  24. Tang, X., Wang, X.: Face Sketch Synthesis and Recognition. In: Proc. of the Ninth IEEE International Conference on Computer Vision (ICCV 2003) 2-Volume Set (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhang, H., Hu, B., Feng, X. (2014). A Multi-label Learning Approach Based on Mapping from Instance to Label. In: Zu, Q., Vargas-Vera, M., Hu, B. (eds) Pervasive Computing and the Networked World. ICPCA/SWS 2013. Lecture Notes in Computer Science, vol 8351. Springer, Cham. https://doi.org/10.1007/978-3-319-09265-2_75

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-09265-2_75

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-09264-5

  • Online ISBN: 978-3-319-09265-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics