Skip to main content

Robust Multi-label Image Classification with Semi-Supervised Learning and Active Learning

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8936))

Abstract

Most existing work on multi-label learning focused on supervised learning which requires manual annotation samples that is labor-intensive, time-consuming and costly. To address such a problem, we present a novel method that incorporates active learning into the semi-supervised learning for multi-label image classification. What’s more, aiming at the curse of dimensionality existing in high-dimensional data, we explore a dimensionality reduction technique with non-negative sparseness constraint to extract a group of features that can completely describe the data and hence make the learning model more efficiently. Experimental results on common data sets validate that the proposed algorithm is relatively effective to improve the performance of the learner in multi-label classification, and the obtained learner is with reliability and robustness after data dimensionality using NNS-DR (Non-Negative Sparseness for Dimensionality Reduction).

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Schapire, R.E., Singer, Y.: BoosTexter: A boosting-based system for text categorization. Machine Learning 39(2-3), 135–168 (2000)

    Article  MATH  Google Scholar 

  2. Boutell, M.R., Luo, J., Shen, X.: Learning multi-label scene classification. Pattern Recognition 37(9), 1757–1771 (2004)

    Article  Google Scholar 

  3. Elisseeff, A., Weston, J.: A kernal method for multi-labeled classification. In: Dietterich, T.G., Becker, S., Ghahrarnani, Z. (eds.) Advances in Neural Information Processing Systems, vol. 14, pp. 681–687. MIT Press, Cambridge (2002)

    Google Scholar 

  4. Qi, G., Hua, X., Rui, Y., Tang, J., Mei, T., Zhang, H.: Correlative multi-label video annotation. In: Proc. of ACM Multimedia, pp. 17–26 (2007)

    Google Scholar 

  5. Zhang, M.-L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)

    Article  MATH  Google Scholar 

  6. Comite, F.D., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision trees from texts and data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS (LNAI), vol. 2734, pp. 35–49. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  7. Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory (COLT 1998), Wisconsin, Ml (1998)

    Google Scholar 

  8. Zhou, Z.H., Li, M.: Semi-Supervised Regression with Co-Training Style Algorithms. In: Pro. of the 19th International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, pp. 908–913 (2005)

    Google Scholar 

  9. Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: Proceedings of the IEEE Workshop on Applications of Computer Vision, pp. 29–36 (2005)

    Google Scholar 

  10. Zhang, T., Oles, F.J.: A probability analysis on the value of unlabeled data for classification problems. In: Proceedings of the International Conference on Machine Learning (2000)

    Google Scholar 

  11. Liu, Y., Jin, R., Yang, L.: Semi-supervised multi-label learning by constrained Non-Negative matrix factorization. In: Proc. of AAAL, pp. 421–426. AIAA, USA (2006)

    Google Scholar 

  12. Chen, G., Song, Y., Wang, F., Zhang, C.: Semi-supervised multi-label learning by solving a Sylvester equation. In: Proc. of SDM, pp. 410–429. AAAI, Boston (2008)

    Google Scholar 

  13. Zha, Z.J., Mei, T., Wang, J., Hua, A.S.: Graph-based semi-supervised learning with multi-label. In: Proc. of ICME, pp. 1321–1324. Computer Society, Hannover (2009)

    Google Scholar 

  14. Guo, Y., Schuurmans, D.: Semi-supervised multi-label classification. In: Flach, P.A., De Bie, T., Cristianini, N. (eds.) ECML PKDD 2012, Part II. LNCS, vol. 7524, pp. 355–370. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  15. Tang, J.H., Zha, Z.J., et al.: Semantic-gap oriented active learning for multi-Label image annotation. IEEE Trans. Image Processing 21(4), 2354–2360 (2012)

    Article  MathSciNet  Google Scholar 

  16. Tian, X.M., Tao, D.C., et al.: Active reranking for web image search. IEEE Trans. Image Processing 19(1), 805–820 (2010)

    Article  MathSciNet  Google Scholar 

  17. Zhang, X., Cheng, J., Xu, C., Lu, H., Ma, S.: Multi-view multi-label active learning for image classification. In: Proceedings of the IEEE International Conference on Multimedia and Expo., pp. 258–261 (2009)

    Google Scholar 

  18. Chakraborty, S., Balasubramanian, V., Panchanathan, S.: Optimal batch selection for active learning in multi-label classification. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1413–1416 (2011)

    Google Scholar 

  19. Qi, G.-J., Hua, X.S., Rui, Y., et al.: Two-dimensional active learning for image classification. In: CVPR, pp. 1–8 (2008)

    Google Scholar 

  20. Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples (2014)

    Google Scholar 

  21. Kong, X.N., Michael, K., Zhou, Z.H.: Transductive Multi-Label Learning via Label Set Propagation. IEEE Trans. Knowledge and Data Engineering 25(3), 704–719 (2013)

    Article  Google Scholar 

  22. Zhang, M.L., Pena, J.M., Robles, V.: Feature Selection for Multi-Label Naive Bayes Classification. Information Sciences 179(19), 3218–3229 (2009)

    Article  MATH  Google Scholar 

  23. Huang, K., Aviyente, S.: Sparsity representation and signal classification. In: The 19th Annual Conference on Nerual Information Processing System, Vancouver, pp. 609–616 (2006)

    Google Scholar 

  24. Yu, J., Wang, M., Tao, D.: Semi-supervised Multiview Distance Metric Learning for Cartoon Synthesis. IEEE Trans. Image Processing 21(11), 4636–4648 (2012)

    Article  MathSciNet  Google Scholar 

  25. Yu, J., Rui, Y., Tao, D.: Click Prediction for Web Image Reranking using Multimodal Sparse Coding. IEEE Trans. Image Processing 23(5), 2019–2032 (2014)

    Article  MathSciNet  Google Scholar 

  26. Liu, B.-D., Wang, Y.-X., Zhang, Y.-J., Shen, B.: learning dictionary on manifolds for image classification. Pattern Recognition 46(7), 1879–1890 (2013)

    Article  Google Scholar 

  27. Liu, B.-D., Wang, Y.-X., Shen, B., Zhang, Y.-J., Hebert, M.: Self-explanatory sparse representation for image classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part II. LNCS, vol. 8690, pp. 600–616. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  28. Liu, W., Tao, D.: Multiview Hessian Regularization for Image Annotation. IEEE Trans. Image Processing 22(7), 2676–2687 (2013)

    Article  MathSciNet  Google Scholar 

  29. Liu, W., Li, Y., Lin, X., Tao, D., Wang, Y.: Hessian regularized co-training for social activity recognition. PLoS ONE 9(9), e108474, doi:10.1371/journal.pone.0108474

    Google Scholar 

  30. Doloho, D.L.: Compressed sensing. IEEE Trans. Information Theory 52(4), 1289–1306 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Sun, F., Xu, M., Jiang, X. (2015). Robust Multi-label Image Classification with Semi-Supervised Learning and Active Learning. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8936. Springer, Cham. https://doi.org/10.1007/978-3-319-14442-9_56

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14442-9_56

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14441-2

  • Online ISBN: 978-3-319-14442-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics