Abstract
Partial multi-label learning (PML) models the scenario where each training sample is annotated with a candidate label set, among which only a subset corresponds to the ground-truth labels. Existing PML approaches generally promise that there are sufficient partial multi-label samples for training the predictor. Nevertheless, when dealing with new tasks, it is more common that we only have a few PML samples associated with those tasks at hand. Furthermore, existing few-shot learning solutions typically assume the labels of support (training) samples are noise-free; as a result, noisy labels concealed within the candidate labels may seriously misinform the meta-learner and thus lead to a compromised performance. We formalize this problem as new learning paradigm called few-shot partial multi-label learning (FsPML), which aims to induce a noise-robust multi-label classifier with limited PML samples related to the target task. To address this problem, we propose a method named FsPML via prototype rectification (FsPML-PR). Specifically, FsPML-PR first conducts adaptive distance metric learning with an embedding network on the tasks previously encountered. Next, it performs positive/negative prototype rectification and disambiguating labels using samples features and label correlations in the embedding space. A new sample can then be classified based on its distances to the positive and to the negative prototypes. Extensive experimental studies on benchmark datasets certificate that our proposed FsPML achieves superior performance across various settings.






Similar content being viewed by others
References
Xie M-K, Huang S-J (2018) Partial multi-label learning. In: AAAI conference on artificial intelligence, pp 4302–4309
Yu G, Chen X, Domeniconi C, Wang J, Li Z, Zhang Z, Wu X (2018) Feature-induced partial multi-label learning. In: International conference on data mining, pp 1398–1403
Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lect Artif Intell Mach Learn 3(1):1–130
Zhou Z-H, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439
Sun Y-Y, Zhang Y, Zhou Z-H (2010) Multi-label learning with weak label. In: AAAI conference on artificial intelligence, pp 593–598
Tan Q, Yu G, Domeniconi C, Wang J, Zhang Z (2018) Incomplete multi-view weak-label learning. In: International joint conference on artificial intelligence, pp 2703–2709
Cour T, Sapp B, Taskar B (2011) Learning from partial labels. J Mach Learn Res 12:1501–1536
Wang D-B, Li L, Zhang M-L (2019) Adaptive graph guided disambiguation for partial label learning. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 83–91
Zheng Y, Li G, Li Y, Shan C, Cheng R (2017) Truth inference in crowdsourcing: Is the problem solved? Proc VLDB Endowm 10(5):541–552
Tu J, Yu G, Domeniconi C, Wang J, Xiao G, Guo M (2020) Multi-label crowd consensus via joint matrix factorization. Knowl Inf Syst 62(4):1341–1369
Yu G, Lu C, Wang J (2017) Nogoa: predicting noisy go annotations using evidences and sparse representation. BMC Bioinf 18(1):1–13
Lu C, Wang J, Zhang Z, Yang P, Yu G (2016) Noisygoa: noisy go annotations prediction using taxonomic and semantic similarity. Comput Biol Chem 65:203–211
Li Z, Lyu G, Feng S (2020) Partial multi-label learning via multi-subspace representation. In: International joint conference on artificial intelligence, pp 2612–2618
He S, Deng K, Li L, Shu S, Liu L (2019) Discriminatively relabel for partial multi-label learning. In: IEEE international conference on data mining, pp 280–288
Sun L, Feng S, Wang T, Lang C, Jin Y (2019) Partial multi-label learning by low-rank and sparse decomposition. In: AAAI conference on artificial intelligence, pp 5016–5023
Xie M-K, Huang S-J (2020) Partial multi-label learning with noisy label identification. In: AAAI conference on artificial intelligence, pp 6454–6461
Yu T, Yu G, Wang J, Domeniconi C, Zhang X (2020) Partial multi-label learning using label compression. In: International conference on data mining, pp 761–770
Lyu G, Feng S, Li Y (2020) Partial multi-label learning via probabilistic graph matching mechanism. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 105–113
Xie M-K, Huang S-J (2020) Semi-supervised partial multi-label learning. In: International conference on data mining, pp 691–700
Yu T, Yu G, Wang J, Guo M (2020) Partial multi-label learning with label and feature collaboration. In: International conference on database systems for advanced applications, pp 621–637
Sun L, Feng S, Lyu G, Zhang H, Dai G (2021) Partial multi-label learning with noisy side information. Knowl Inf Syst 63(2):541–564
Yan Y, Guo Y (2021) Adversarial partial multi-label learning with label disambiguation. In: AAAI conference on artificial intelligence, pp 10568–10576
Wu J-H, Wu X, Chen Q-G, Hu Y, Zhang M-L (2020) Feature-induced manifold disambiguation for multi-view partial multi-label learning. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 557–565
Sun L, Feng S, Liu J, Lyu G, Lang C (2021) Global-local label correlation for partial multi-label learning. IEEE Trans Multimedia 24:581–593
Yan Y, Li S, Feng L (2021) Partial multi-label learning with mutual teaching. Knowl-Based Syst 212:106624
Xie M-K, Sun F, Huang S-J (2021) Partial multi-label learning with meta disambiguation. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp 1904–1912
Gong X, Yuan D, Bao W (2021) Understanding partial multi-label learning via mutual information. Adv Neural Inf Process Syst 34:1–10
Wang H, Liu W, Zhao Y, Zhang C, Hu T, Chen G (2019) Discriminative and correlative partial multi-label learning. Int Jt Conf Artif Intell 14:3691–3697
Fang J-P, Zhang M-L (2019) Partial multi-label learning via credible label elicitation. In: AAAI conference on artificial intelligence, pp 3518–3525
Xu N, Liu Y-P, Geng X (2020) Partial multi-label learning with label distribution. In: AAAI conference on artificial intelligence, pp 6510–6517
Chen Z-S, Wu X, Chen Q-G, Hu Y, Zhang M-L (2020) Multi-view partial multi-label learning with graph-based disambiguation. In: AAAI conference on artificial intelligence, pp 3553–3560
Rios A, Kavuluru R (2018) Few-shot and zero-shot multi-label learning for structured label spaces. In: Conference on empirical methods in natural language processing, pp 3132–3142
Alfassy A, Karlinsky L, Aides A, Shtok J, Harary S, Feris R, Giryes R, Bronstein AM (2019) Laso: Label-set operations networks for multi-label few-shot learning. In: IEEE conference on computer vision and pattern recognition, pp 6548–6557
Chen T, Lin L, Hui X, Chen R, Wu H (2020) Knowledge-guided multi-label few-shot learning for general image recognition. IEEE Trans Pattern Anal Mach Intell 99(1):1–12
Hou Y, Lai Y, Wu Y, Che W, Liu T (2021) Few-shot learning for multi-label intent detection. In: AAAI conference on artificial intelligence, pp 13036–13044
Simon C, Koniusz P, Harandi M (2022) Meta-learning for multi-label few-shot classification. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 3951–3960
Zhao Y, Yu G, Liu L, Yan Z, Cui L, Domeniconi C (2021) Few-shot partial-label learning. In: International joint conference on artificial intelligence, pp 3448–3454
Zhao Y, Yu G, Liu L, Yan Z, Cui L, Domeniconi C (2021) Few-shot partial multi-label learning. In: International conference on data mining, pp 926–935
Lyu G, Feng S, Li Y (2021) Noisy label tolerance: a new perspective of partial multi-label learning. Inf Sci 543:454–466
Yang Z, Han Y, Yu G, Yang Q, Zhang X (2019) Prototypical networks for multi-label learning. arXiv preprint arXiv:1911.07203
Zhang M-L, Yu F, Tang C-Z (2017) Disambiguation-free partial label learning. IEEE Trans Knowl Data Eng 29(10):2155–2167
Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837
Wu Q, Ng MK, Ye Y (2013) Markov-miml: a Markov chain-based multi-instance multi-label learning algorithm. Knowl Inf Syst 37(1):83–104
Zha D, Li C (2019) Multi-label dataless text classification with topic modeling. Knowl Inf Syst 61(1):137–160
Zhao P, Zhao S, Zhao X, Liu H, Ji X (2022) Partial multi-label learning based on sparse asymmetric label correlations. Knowl-Based Syst 245:108601
Gong X, Yuan D, Bao W (2022) Partial multi-label learning via large margin nearest neighbour embeddings. In: AAAI conference on artificial intelligence, pp 6729–6736
Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748
Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: Advances in neural information processing systems, pp 4077–4087
Wang Y, Yao Q, Kwok JT, Ni LM (2020) Generalizing from a few examples: a survey on few-shot learning. ACM Comput Surv 53(3):1–34
Wang H, Zhao Z, Tang Y (2020) An effective few-shot learning approach via location-dependent partial differential equation. Knowl Inf Syst 62(5):1881–1901
Hariharan B, Girshick R (2017) Low-shot visual recognition by shrinking and hallucinating features. In: Proceedings of the IEEE international conference on computer vision, pp 3018–3027
Douze M, Szlam A, Hariharan B, Jégou H (2018) Low-shot learning with large-scale diffusion. In: IEEE conference on computer vision and pattern recognition, pp 3349–3358
Cai Q, Pan Y, Yao T, Yan C, Mei T (2018) Memory matching networks for one-shot image recognition. In: IEEE conference on computer vision and pattern recognition, pp 4080–4088
Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International conference on machine learning, pp 1126–1135
Azadi S, Fisher M, Kim VG, Wang Z, Shechtman E, Darrell T (2018) Multi-content gan for few-shot font style transfer. In: IEEE conference on computer vision and pattern recognition, pp 7564–7573
Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to compare: Relation network for few-shot learning. In: IEEE conference on computer vision and pattern recognition 1199–1208
Tu J, Yu G, Domeniconi C, Wang J, Xiao G, Guo M (2018) Multi-label answer aggregation based on joint matrix factorization. In: International conference on data mining, pp 517–526
Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft coco: Common objects in context. In: European conference on computer vision, pp 740–755
Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: a real-world web image database from national university of singapore. In: Proceedings of the ACM international conference on image and video retrieval, pp 1–9
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778
Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet A large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255
Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International conference on learning representations, pp 1–12
Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9(11):2579–2605
Acknowledgements
We thank the authors who kindly share their datasets or source codes with us for the experimental study. This work is supported by Innovation Method Fund of China (No. 2020IM020100), National Natural Science Foundation of China (No. 62031003, 61872300 and 91846205) and Shenzhen Polytechnic Youth Innovation Project (No. 6019310007K0).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhao, Y., Yu, G., Liu, L. et al. Few-shot partial multi-label learning via prototype rectification. Knowl Inf Syst 65, 1851–1880 (2023). https://doi.org/10.1007/s10115-022-01819-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-022-01819-w