Abstract
Most existing work on multi-label learning focused on supervised learning which requires manual annotation samples that is labor-intensive, time-consuming and costly. To address such a problem, we present a novel method that incorporates active learning into the semi-supervised learning for multi-label image classification. What’s more, aiming at the curse of dimensionality existing in high-dimensional data, we explore a dimensionality reduction technique with non-negative sparseness constraint to extract a group of features that can completely describe the data and hence make the learning model more efficiently. Experimental results on common data sets validate that the proposed algorithm is relatively effective to improve the performance of the learner in multi-label classification, and the obtained learner is with reliability and robustness after data dimensionality using NNS-DR (Non-Negative Sparseness for Dimensionality Reduction).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Schapire, R.E., Singer, Y.: BoosTexter: A boosting-based system for text categorization. Machine Learning 39(2-3), 135–168 (2000)
Boutell, M.R., Luo, J., Shen, X.: Learning multi-label scene classification. Pattern Recognition 37(9), 1757–1771 (2004)
Elisseeff, A., Weston, J.: A kernal method for multi-labeled classification. In: Dietterich, T.G., Becker, S., Ghahrarnani, Z. (eds.) Advances in Neural Information Processing Systems, vol. 14, pp. 681–687. MIT Press, Cambridge (2002)
Qi, G., Hua, X., Rui, Y., Tang, J., Mei, T., Zhang, H.: Correlative multi-label video annotation. In: Proc. of ACM Multimedia, pp. 17–26 (2007)
Zhang, M.-L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)
Comite, F.D., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision trees from texts and data. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS (LNAI), vol. 2734, pp. 35–49. Springer, Heidelberg (2003)
Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory (COLT 1998), Wisconsin, Ml (1998)
Zhou, Z.H., Li, M.: Semi-Supervised Regression with Co-Training Style Algorithms. In: Pro. of the 19th International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, pp. 908–913 (2005)
Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: Proceedings of the IEEE Workshop on Applications of Computer Vision, pp. 29–36 (2005)
Zhang, T., Oles, F.J.: A probability analysis on the value of unlabeled data for classification problems. In: Proceedings of the International Conference on Machine Learning (2000)
Liu, Y., Jin, R., Yang, L.: Semi-supervised multi-label learning by constrained Non-Negative matrix factorization. In: Proc. of AAAL, pp. 421–426. AIAA, USA (2006)
Chen, G., Song, Y., Wang, F., Zhang, C.: Semi-supervised multi-label learning by solving a Sylvester equation. In: Proc. of SDM, pp. 410–429. AAAI, Boston (2008)
Zha, Z.J., Mei, T., Wang, J., Hua, A.S.: Graph-based semi-supervised learning with multi-label. In: Proc. of ICME, pp. 1321–1324. Computer Society, Hannover (2009)
Guo, Y., Schuurmans, D.: Semi-supervised multi-label classification. In: Flach, P.A., De Bie, T., Cristianini, N. (eds.) ECML PKDD 2012, Part II. LNCS, vol. 7524, pp. 355–370. Springer, Heidelberg (2012)
Tang, J.H., Zha, Z.J., et al.: Semantic-gap oriented active learning for multi-Label image annotation. IEEE Trans. Image Processing 21(4), 2354–2360 (2012)
Tian, X.M., Tao, D.C., et al.: Active reranking for web image search. IEEE Trans. Image Processing 19(1), 805–820 (2010)
Zhang, X., Cheng, J., Xu, C., Lu, H., Ma, S.: Multi-view multi-label active learning for image classification. In: Proceedings of the IEEE International Conference on Multimedia and Expo., pp. 258–261 (2009)
Chakraborty, S., Balasubramanian, V., Panchanathan, S.: Optimal batch selection for active learning in multi-label classification. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1413–1416 (2011)
Qi, G.-J., Hua, X.S., Rui, Y., et al.: Two-dimensional active learning for image classification. In: CVPR, pp. 1–8 (2008)
Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples (2014)
Kong, X.N., Michael, K., Zhou, Z.H.: Transductive Multi-Label Learning via Label Set Propagation. IEEE Trans. Knowledge and Data Engineering 25(3), 704–719 (2013)
Zhang, M.L., Pena, J.M., Robles, V.: Feature Selection for Multi-Label Naive Bayes Classification. Information Sciences 179(19), 3218–3229 (2009)
Huang, K., Aviyente, S.: Sparsity representation and signal classification. In: The 19th Annual Conference on Nerual Information Processing System, Vancouver, pp. 609–616 (2006)
Yu, J., Wang, M., Tao, D.: Semi-supervised Multiview Distance Metric Learning for Cartoon Synthesis. IEEE Trans. Image Processing 21(11), 4636–4648 (2012)
Yu, J., Rui, Y., Tao, D.: Click Prediction for Web Image Reranking using Multimodal Sparse Coding. IEEE Trans. Image Processing 23(5), 2019–2032 (2014)
Liu, B.-D., Wang, Y.-X., Zhang, Y.-J., Shen, B.: learning dictionary on manifolds for image classification. Pattern Recognition 46(7), 1879–1890 (2013)
Liu, B.-D., Wang, Y.-X., Shen, B., Zhang, Y.-J., Hebert, M.: Self-explanatory sparse representation for image classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part II. LNCS, vol. 8690, pp. 600–616. Springer, Heidelberg (2014)
Liu, W., Tao, D.: Multiview Hessian Regularization for Image Annotation. IEEE Trans. Image Processing 22(7), 2676–2687 (2013)
Liu, W., Li, Y., Lin, X., Tao, D., Wang, Y.: Hessian regularized co-training for social activity recognition. PLoS ONE 9(9), e108474, doi:10.1371/journal.pone.0108474
Doloho, D.L.: Compressed sensing. IEEE Trans. Information Theory 52(4), 1289–1306 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Sun, F., Xu, M., Jiang, X. (2015). Robust Multi-label Image Classification with Semi-Supervised Learning and Active Learning. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8936. Springer, Cham. https://doi.org/10.1007/978-3-319-14442-9_56
Download citation
DOI: https://doi.org/10.1007/978-3-319-14442-9_56
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14441-2
Online ISBN: 978-3-319-14442-9
eBook Packages: Computer ScienceComputer Science (R0)