Jing-Han Wu
ABSTRACT
In conventional multi-label learning framework, each example is assumed to be represented by a single feature vector and associated with multiple valid labels simultaneously. Nonetheless, real-world objects usually exhibit complicated properties which can have multi-view feature representation as well as false positive labeling. Accordingly, the problem of multi-view partial multi-label learning (MVPML) is studied in this paper, where each example is assumed to be presented by multiple feature vectors while associated with multiple candidate labels which are only partially valid. To learn from MVPML examples, a novel approach named FIMAN is proposed which makes use of multi-view feature representation to tackle the noisy labeling information. Firstly, an aggregate manifold structure over training examples is generated by adaptively fusing affinity information conveyed by feature vectors of different views. Then, candidate labels of each training example are disambiguated by preserving the feature-induced manifold structure in label space. Finally, the resulting predictive models are learned by fitting modeling outputs with the disambiguated labels. Extensive experiments on a number of real-world data sets show that FIMAN achieves highly competitive performance against state-of-the-art approaches in solving the MVPML problem.
Supplemental Material
- A. Blum and T. Mitchell. 1998. Combining labeled and unlabeled data with co-training. In Proceedings of the 11th Annual Conference on Computational Learning Theory. Madison, WI, 92--100.Google Scholar
- C.-H. Chen, V. M. Patel, and R. Chellappa. 2018. Learning from ambiguously labeled face images. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, 7 (2018), 1653--1667.Google ScholarCross Ref
- Z.-S. Chen, X. Wu, Q.-G. Chen, Y. Hu, and M.-L. Zhang. 2020. Multi-view partial multi-label learning with graph-based disambiguation. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. New York, NY.Google ScholarCross Ref
- T. Cour, B. Sapp, and B. Taskar. 2011. Learning from partial labels. Journal of Machine Learning Research, Vol. 12, May (2011), 1501--1536.Google ScholarDigital Library
- J. Demvs ar. 2006. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, Vol. 7, Jan (2006), 1--30.Google ScholarDigital Library
- A. Elisseeff and J. Weston. 2002. A kernel method for multi-labelled classification. In Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani (Eds.). MIT Press, Cambridge, MA, 681--687.Google Scholar
- M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. 2010. The Pascal visual object classes (VOC) challenge. International Journal of Computer Vision, Vol. 88, 2 (2010), 303--338.Google ScholarDigital Library
- J. F. Gemmeke, D. P. W. Ellis, D. Freedman, A. Jansen, W. Lawrence, R. C. Moore, M. Plakal, and M. Ritter. 2017. Audio set: An ontology and human-labeled dataset for audio events. In Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing. New Orleans, LA, 776--780.Google Scholar
- E. Gibaja and S. Ventura. 2015. A tutorial on multilabel learning. ACM Computing Surveys, Vol. 47, 3 (2015), Article 52.Google Scholar
- S. He, K. Deng, L. Li, S. Shu, and L. Liu. 2019. Discriminatively relabel for partial multi-label learning. In Proceedings of the 19th IEEE International Conference on Data Mining. Beijing, China, 280--288.Google Scholar
- S.-J. Huang, G.-X. Li, W.-Y. Huang, and S.-Y. Li. 2020. Incremental multi-label learning with active queries. Journal of Computer Science and Technology, Vol. 35, 2 (2020), 234--246.Google ScholarDigital Library
- M. J. Huiskes and M. S. Lew. 2008. The MIR Flickr retrieval evaluation. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval. Vancouver, Canada, 39--43.Google Scholar
- L. Liu and T. Dietterich. 2012. A conditional multinomial mixture model for superset label learning. In Advances in Neural Information Processing Systems 25, P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). MIT Press, Cambridge, MA, 557--565.Google Scholar
- M. Liu, Y. Luo, D. Tao, C. Xu, and Y. Wen. 2015. Low-rank multi-view learning in matrix completion for multi-label image classification. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. Austin, TX, 2778--2784.Google Scholar
- Y. Luo, D. Tao, C. Xu, C. Xu, H. Liu, and Y. Wen. 2013. Multiview vector-valued manifold regularization for multilabel image classification. IEEE Transactions on Neural Networks and Learning Systems, Vol. 24, 5 (2013), 709--722.Google ScholarCross Ref
- Y. Ma, C. Cui, X. Nie, G. Yang, K. Shaheed, and Y. Yin. 2019. Pre-course student performance prediction with multi-instance multi-label learning. Science China Information Sciences, Vol. 62, 2 (2019), Article 029101.Google Scholar
- L. Sun, S. Feng, T. Wang, C. Lang, and Y. Jin. 2019. Partial multi-label learning by low-rank and sparse decomposition. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence. Honolulu, HI, 5016--5023.Google Scholar
- C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, 2818--2826.Google Scholar
- Q. Tan, G. Yu, J. Wang, C. Domeniconi, and X. Zhang. in press. Individually- and commonality-based multiview multilabel learning. IEEE Transactions on Cybernetics (in press).Google Scholar
- K. Trohidis, G. Tsoumakas, G. Kalliris, and I. Vlahavas. 2008. Multilabel classification of music into emotions. In Proceedings of the 2008 International Conference on Music Information Retrieval. Philadelphia, PA, 325--330.Google Scholar
- L. von Ahn and L. Dabbish. 2004. Labeling images with a computer game. In Proceedings of ACM CHI 2004 Conference on Human Factors in Computing Systems. Vienna, Austria, 319--326.Google Scholar
- D.-B. Wang, L. Li, and M.-L. Zhang. 2019 a. Adaptive graph guided disambiguation for partial label learning. In Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Anchorage, AK, 83--91.Google ScholarDigital Library
- H. Wang, W. Liu, Y. Zhao, C. Zhang, T. Hu, and G. Chen. 2019 b. Discriminative and correlative partial multi-label learning. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. Macau, China, 3691--3697.Google Scholar
- X. Wu, Q.-G. Chen, Y. Hu, D. Wang, X. Chang, X. Wang, and M.-L. Zhang. 2019. Multi-view multi-label learning with view-specific information extraction. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. Macau, China, 3884--3890.Google ScholarCross Ref
- T. Xia, D. Tao, T. Mei, and Y. Zhang. 2010. Multiview spectral embedding. IEEE Transactions on System, Man, and Cybernetics - Part B: Cybernetics, Vol. 40, 6 (2010), 1438--1446.Google ScholarDigital Library
- M.-K. Xie and S.-J. Huang. 2018. Partial multi-label learning. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. New Orleans, LA, 4302--4309.Google ScholarCross Ref
- Y. Xing, G. Yu, C. Domeniconi, J. Wang, and Z. Zhang. 2018. Multi-label co-training. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. Stockholm, Sweden, 2882--2888.Google Scholar
- F. Yu and M.-L. Zhang. 2017. Maximum margin partial label learning. Machine Learning, Vol. 106, 4 (2017), 573--593.Google ScholarDigital Library
- G. Yu, X. Chen, C. Domeniconi, J. Wang, Z. Li, Z. Zhang, and X. Wu. 2018. Feature-induced partial multi-label learning. In Proceedings of the 18th IEEE International Conference on Data Mining. Singapore, 1398--1403.Google Scholar
- W. Zhan and M.-L. Zhang. 2017. Inductive semi-supervised multi-label learning with co-training. In Proceedings of the 23rd ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Halifax, Canada, 1305--1314.Google ScholarDigital Library
- C. Zhang, Z. Yu, Q. Hu, P. Zhu, X. Liu, and X. Wang. 2018b. Latent semantic aware multi-view multi-label classification. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. New Orleans, LA, 4414--4421.Google Scholar
- L. Zhang, Q. Zhang, L. Zhang, D. Tao, X. Huang, and B. Du. 2015. Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding. Pattern Recognition, Vol. 48, 10 (2015), 3102--3112.Google ScholarDigital Library
- M.-L. Zhang and J.-P. Fang. in press. Partial multi-label learning via credible label elicitation. IEEE Transactions on Pattern Analysis and Machine Intelligence (in press).Google Scholar
- M.-L. Zhang, Y.-K. Li, X.-Y. Liu, and X. Geng. 2018a. Binary relevance for multi-label learning: An overview. Frontiers of Computer Science, Vol. 12, 2 (2018), 191--202.Google ScholarDigital Library
- M.-L. Zhang and Z.-H. Zhou. 2014. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, Vol. 26, 8 (2014), 1819--1837.Google ScholarCross Ref
- T. Zhang, D. Tao, X. Li, and J. Yang. 2009. Patch alignment for dimensionality reduction. IEEE Transactions on Knowledge and Data Engineering, Vol. 21, 9 (2009), 1299--1313.Google ScholarDigital Library
- Z.-H. Zhou and M. Li. 2010. Semi-supervised learning by disagreement. Knowledge and Information Systems, Vol. 24, 3 (2010), 415--439.Google ScholarDigital Library
- Z.-H. Zhou and M.-L. Zhang. 2017. Multi-label learning. In Encyclopedia of Machine Learning and Data Mining, C. Sammut and G. I. Webb (Eds.). Springer, Berlin, 875--881.Google Scholar
- P. Zhu, Q. Hu, Q. Hu, C. Zhang, and Z. Feng. 2018. Multi-view label embedding. Pattern Recognition, Vol. 84 (2018), 126--135.Google ScholarDigital Library
- X. Zhu, X. Li, and S. Zhang. 2016. Block-row sparse multiview multilabel learning for image classification. IEEE Transactions on Cybernetics, Vol. 46, 2 (2016), 450--461.Google ScholarCross Ref
Index Terms
- Feature-Induced Manifold Disambiguation for Multi-View Partial Multi-label Learning
Recommendations
Partial Label Learning via Feature-Aware Disambiguation
KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningPartial label learning deals with the problem where each training example is represented by a feature vector while associated with a set of candidate labels, among which only one label is valid. To learn from such ambiguous labeling information, the key ...
Adaptive Graph Guided Disambiguation for Partial Label Learning
KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningPartial label learning aims to induce a multi-class classifier from training examples where each of them is associated with a set of candidate labels, among which only one is the ground-truth label. The common strategy to train predictive model is ...
Maximum margin partial label learning
Partial label learning aims to learn from training examples each associated with a set of candidate labels, among which only one label is valid for the training example. The basic strategy to learn from partial label examples is disambiguation, i.e. by ...
Comments