Skip to main content
SpringerLink
Log in

Few-shot partial multi-label learning via prototype rectification

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Partial multi-label learning (PML) models the scenario where each training sample is annotated with a candidate label set, among which only a subset corresponds to the ground-truth labels. Existing PML approaches generally promise that there are sufficient partial multi-label samples for training the predictor. Nevertheless, when dealing with new tasks, it is more common that we only have a few PML samples associated with those tasks at hand. Furthermore, existing few-shot learning solutions typically assume the labels of support (training) samples are noise-free; as a result, noisy labels concealed within the candidate labels may seriously misinform the meta-learner and thus lead to a compromised performance. We formalize this problem as new learning paradigm called few-shot partial multi-label learning (FsPML), which aims to induce a noise-robust multi-label classifier with limited PML samples related to the target task. To address this problem, we propose a method named FsPML via prototype rectification (FsPML-PR). Specifically, FsPML-PR first conducts adaptive distance metric learning with an embedding network on the tasks previously encountered. Next, it performs positive/negative prototype rectification and disambiguating labels using samples features and label correlations in the embedding space. A new sample can then be classified based on its distances to the positive and to the negative prototypes. Extensive experimental studies on benchmark datasets certificate that our proposed FsPML achieves superior performance across various settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Xie M-K, Huang S-J (2018) Partial multi-label learning. In: AAAI conference on artificial intelligence, pp 4302–4309

  2. Yu G, Chen X, Domeniconi C, Wang J, Li Z, Zhang Z, Wu X (2018) Feature-induced partial multi-label learning. In: International conference on data mining, pp 1398–1403

  3. Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lect Artif Intell Mach Learn 3(1):1–130

    MATH  Google Scholar 

  4. Zhou Z-H, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439

    Article  Google Scholar 

  5. Sun Y-Y, Zhang Y, Zhou Z-H (2010) Multi-label learning with weak label. In: AAAI conference on artificial intelligence, pp 593–598

  6. Tan Q, Yu G, Domeniconi C, Wang J, Zhang Z (2018) Incomplete multi-view weak-label learning. In: International joint conference on artificial intelligence, pp 2703–2709

  7. Cour T, Sapp B, Taskar B (2011) Learning from partial labels. J Mach Learn Res 12:1501–1536

    MathSciNet  MATH  Google Scholar 

  8. Wang D-B, Li L, Zhang M-L (2019) Adaptive graph guided disambiguation for partial label learning. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 83–91

  9. Zheng Y, Li G, Li Y, Shan C, Cheng R (2017) Truth inference in crowdsourcing: Is the problem solved? Proc VLDB Endowm 10(5):541–552

    Article  Google Scholar 

  10. Tu J, Yu G, Domeniconi C, Wang J, Xiao G, Guo M (2020) Multi-label crowd consensus via joint matrix factorization. Knowl Inf Syst 62(4):1341–1369

    Article  Google Scholar 

  11. Yu G, Lu C, Wang J (2017) Nogoa: predicting noisy go annotations using evidences and sparse representation. BMC Bioinf 18(1):1–13

    Article  Google Scholar 

  12. Lu C, Wang J, Zhang Z, Yang P, Yu G (2016) Noisygoa: noisy go annotations prediction using taxonomic and semantic similarity. Comput Biol Chem 65:203–211

    Article  Google Scholar 

  13. Li Z, Lyu G, Feng S (2020) Partial multi-label learning via multi-subspace representation. In: International joint conference on artificial intelligence, pp 2612–2618

  14. He S, Deng K, Li L, Shu S, Liu L (2019) Discriminatively relabel for partial multi-label learning. In: IEEE international conference on data mining, pp 280–288

  15. Sun L, Feng S, Wang T, Lang C, Jin Y (2019) Partial multi-label learning by low-rank and sparse decomposition. In: AAAI conference on artificial intelligence, pp 5016–5023

  16. Xie M-K, Huang S-J (2020) Partial multi-label learning with noisy label identification. In: AAAI conference on artificial intelligence, pp 6454–6461

  17. Yu T, Yu G, Wang J, Domeniconi C, Zhang X (2020) Partial multi-label learning using label compression. In: International conference on data mining, pp 761–770

  18. Lyu G, Feng S, Li Y (2020) Partial multi-label learning via probabilistic graph matching mechanism. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 105–113

  19. Xie M-K, Huang S-J (2020) Semi-supervised partial multi-label learning. In: International conference on data mining, pp 691–700

  20. Yu T, Yu G, Wang J, Guo M (2020) Partial multi-label learning with label and feature collaboration. In: International conference on database systems for advanced applications, pp 621–637

  21. Sun L, Feng S, Lyu G, Zhang H, Dai G (2021) Partial multi-label learning with noisy side information. Knowl Inf Syst 63(2):541–564

    Article  Google Scholar 

  22. Yan Y, Guo Y (2021) Adversarial partial multi-label learning with label disambiguation. In: AAAI conference on artificial intelligence, pp 10568–10576

  23. Wu J-H, Wu X, Chen Q-G, Hu Y, Zhang M-L (2020) Feature-induced manifold disambiguation for multi-view partial multi-label learning. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery & data mining, pp 557–565

  24. Sun L, Feng S, Liu J, Lyu G, Lang C (2021) Global-local label correlation for partial multi-label learning. IEEE Trans Multimedia 24:581–593

    Article  Google Scholar 

  25. Yan Y, Li S, Feng L (2021) Partial multi-label learning with mutual teaching. Knowl-Based Syst 212:106624

    Article  Google Scholar 

  26. Xie M-K, Sun F, Huang S-J (2021) Partial multi-label learning with meta disambiguation. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp 1904–1912

  27. Gong X, Yuan D, Bao W (2021) Understanding partial multi-label learning via mutual information. Adv Neural Inf Process Syst 34:1–10

    Google Scholar 

  28. Wang H, Liu W, Zhao Y, Zhang C, Hu T, Chen G (2019) Discriminative and correlative partial multi-label learning. Int Jt Conf Artif Intell 14:3691–3697

    Google Scholar 

  29. Fang J-P, Zhang M-L (2019) Partial multi-label learning via credible label elicitation. In: AAAI conference on artificial intelligence, pp 3518–3525

  30. Xu N, Liu Y-P, Geng X (2020) Partial multi-label learning with label distribution. In: AAAI conference on artificial intelligence, pp 6510–6517

  31. Chen Z-S, Wu X, Chen Q-G, Hu Y, Zhang M-L (2020) Multi-view partial multi-label learning with graph-based disambiguation. In: AAAI conference on artificial intelligence, pp 3553–3560

  32. Rios A, Kavuluru R (2018) Few-shot and zero-shot multi-label learning for structured label spaces. In: Conference on empirical methods in natural language processing, pp 3132–3142

  33. Alfassy A, Karlinsky L, Aides A, Shtok J, Harary S, Feris R, Giryes R, Bronstein AM (2019) Laso: Label-set operations networks for multi-label few-shot learning. In: IEEE conference on computer vision and pattern recognition, pp 6548–6557

  34. Chen T, Lin L, Hui X, Chen R, Wu H (2020) Knowledge-guided multi-label few-shot learning for general image recognition. IEEE Trans Pattern Anal Mach Intell 99(1):1–12

    Google Scholar 

  35. Hou Y, Lai Y, Wu Y, Che W, Liu T (2021) Few-shot learning for multi-label intent detection. In: AAAI conference on artificial intelligence, pp 13036–13044

  36. Simon C, Koniusz P, Harandi M (2022) Meta-learning for multi-label few-shot classification. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 3951–3960

  37. Zhao Y, Yu G, Liu L, Yan Z, Cui L, Domeniconi C (2021) Few-shot partial-label learning. In: International joint conference on artificial intelligence, pp 3448–3454

  38. Zhao Y, Yu G, Liu L, Yan Z, Cui L, Domeniconi C (2021) Few-shot partial multi-label learning. In: International conference on data mining, pp 926–935

  39. Lyu G, Feng S, Li Y (2021) Noisy label tolerance: a new perspective of partial multi-label learning. Inf Sci 543:454–466

    Article  MathSciNet  MATH  Google Scholar 

  40. Yang Z, Han Y, Yu G, Yang Q, Zhang X (2019) Prototypical networks for multi-label learning. arXiv preprint arXiv:1911.07203

  41. Zhang M-L, Yu F, Tang C-Z (2017) Disambiguation-free partial label learning. IEEE Trans Knowl Data Eng 29(10):2155–2167

    Article  Google Scholar 

  42. Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837

    Article  Google Scholar 

  43. Wu Q, Ng MK, Ye Y (2013) Markov-miml: a Markov chain-based multi-instance multi-label learning algorithm. Knowl Inf Syst 37(1):83–104

    Article  Google Scholar 

  44. Zha D, Li C (2019) Multi-label dataless text classification with topic modeling. Knowl Inf Syst 61(1):137–160

    Article  Google Scholar 

  45. Zhao P, Zhao S, Zhao X, Liu H, Ji X (2022) Partial multi-label learning based on sparse asymmetric label correlations. Knowl-Based Syst 245:108601

    Article  Google Scholar 

  46. Gong X, Yuan D, Bao W (2022) Partial multi-label learning via large margin nearest neighbour embeddings. In: AAAI conference on artificial intelligence, pp 6729–6736

  47. Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748

    Article  Google Scholar 

  48. Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: Advances in neural information processing systems, pp 4077–4087

  49. Wang Y, Yao Q, Kwok JT, Ni LM (2020) Generalizing from a few examples: a survey on few-shot learning. ACM Comput Surv 53(3):1–34

    Article  Google Scholar 

  50. Wang H, Zhao Z, Tang Y (2020) An effective few-shot learning approach via location-dependent partial differential equation. Knowl Inf Syst 62(5):1881–1901

    Article  Google Scholar 

  51. Hariharan B, Girshick R (2017) Low-shot visual recognition by shrinking and hallucinating features. In: Proceedings of the IEEE international conference on computer vision, pp 3018–3027

  52. Douze M, Szlam A, Hariharan B, Jégou H (2018) Low-shot learning with large-scale diffusion. In: IEEE conference on computer vision and pattern recognition, pp 3349–3358

  53. Cai Q, Pan Y, Yao T, Yan C, Mei T (2018) Memory matching networks for one-shot image recognition. In: IEEE conference on computer vision and pattern recognition, pp 4080–4088

  54. Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International conference on machine learning, pp 1126–1135

  55. Azadi S, Fisher M, Kim VG, Wang Z, Shechtman E, Darrell T (2018) Multi-content gan for few-shot font style transfer. In: IEEE conference on computer vision and pattern recognition, pp 7564–7573

  56. Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to compare: Relation network for few-shot learning. In: IEEE conference on computer vision and pattern recognition 1199–1208

  57. Tu J, Yu G, Domeniconi C, Wang J, Xiao G, Guo M (2018) Multi-label answer aggregation based on joint matrix factorization. In: International conference on data mining, pp 517–526

  58. Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft coco: Common objects in context. In: European conference on computer vision, pp 740–755

  59. Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: a real-world web image database from national university of singapore. In: Proceedings of the ACM international conference on image and video retrieval, pp 1–9

  60. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778

  61. Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet A large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255

  62. Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International conference on learning representations, pp 1–12

  63. Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9(11):2579–2605

    MATH  Google Scholar 

Download references

Acknowledgements

We thank the authors who kindly share their datasets or source codes with us for the experimental study. This work is supported by Innovation Method Fund of China (No. 2020IM020100), National Natural Science Foundation of China (No. 62031003, 61872300 and 91846205) and Shenzhen Polytechnic Youth Innovation Project (No. 6019310007K0).

Author information

Authors and Affiliations

  1. School of Software, Shandong University, Jinan, China

    Yunfeng Zhao, Guoxian Yu, Lei Liu, Zhongmin Yan & Lizhen Cui

  2. Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, China

    Yunfeng Zhao, Guoxian Yu, Lei Liu, Zhongmin Yan & Lizhen Cui

  3. Department of Computer Science, George Mason University, Fairfax, VA, USA

    Carlotta Domeniconi

  4. School of Artificial Intelligence, Shenzhen Polytechnic, Shenzhen, China

    Xiayan Zhang

Authors
  1. Yunfeng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guoxian Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongmin Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carlotta Domeniconi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiayan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Lizhen Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guoxian Yu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, Y., Yu, G., Liu, L. et al. Few-shot partial multi-label learning via prototype rectification. Knowl Inf Syst 65, 1851–1880 (2023). https://doi.org/10.1007/s10115-022-01819-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-022-01819-w

Keywords

Search

Navigation