Skip to main content
Log in

Label-dependent feature exploration for label distribution learning

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Label distribution learning (LDL) explicitly models label ambiguity by assigning a real-valued vector with label description degrees to each sample. Most LDL methods only build models on the same feature (sub)space shared by all labels. However, they ignore that each label has its own specific features, and there are some common features among labels. In this paper, we propose a novel LDL (LDL-LDF) algorithm that aims to exploit both label-dependent and common features. First, label-dependent feature reconstruction utilizes thresholding for relevant sample subset identification, density peaks clustering for representative sample selection, and Euclidean distance for feature value calculation. Second, common feature reconstruction follows a similar approach, however, on the whole dataset. Finally, the prediction neural network is composed of several components that serve each label with label-dependent features, one component that serves all labels with common features, and the fusion component. The effectiveness and competitiveness of our algorithm are verified through various experiments comparing seven algorithms on fourteen real-world datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837

    Article  Google Scholar 

  2. Gao B-B, Xing C, Xie C-W, Wu J-X, Geng X (2017) Deep label distribution learning with label ambiguity. IEEE Trans Imag Process 26(6):2825–2838

    Article  MathSciNet  MATH  Google Scholar 

  3. Geng X, Smith-Miles K, Zhou Z-H ( 2010) Facial age estimation by learning from label distributions. In: AAAI, pp. 451– 456

  4. Wen X, Li B, Guo H, Liu Z, Hu G, Tang M, Wang J ( 2020) Adaptive variance based label distribution learning for facial age estimation. In: ECCV, pp. 379– 395

  5. Zhou Y, Xue H, Geng X ( 2015) Emotion distribution recognition from facial expressions. In: ACM MM, pp. 1247– 1250

  6. Li S, Deng W (2019) Blended emotion in-the-wild: multi-label facial expression recognition using crowdsourced annotations and deep locality feature learning. Inter J Comput Vision 127(6):884–906

    Article  Google Scholar 

  7. Geng X, Xia Y ( 2014) Head pose estimation based on multivariate label distribution. In: CVPR, pp. 1837– 1842

  8. Zhang Z, Wang M, Geng X (2015) Crowd counting in public video surveillance by label distribution learning. Neurocomputing 166:151–163

    Article  Google Scholar 

  9. Liang L, Lin L, Jin L, Xie D, Li M (2018) Scut-fbp5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction. In: ICPR, pp. 1598– 1603

  10. Yang J, She D, Sun M ( 2017) Joint image emotion classification and distribution learning via deep nonvolutional neural network. In: IJCAI, pp. 3266– 3272

  11. Zhang M-L, Wu L (2014) Lift: Multi-label learning with label-specific features. IEEE Trans Pattern Anal Machine Intell 37(1):107–120

    Article  Google Scholar 

  12. Xu N, Liu Y-P, Geng X (2019) Label enhancement for label distribution learning. IEEE Trans Knowl Data Eng 33(4):1632–1643

    Article  Google Scholar 

  13. Xu N, Lv J, Geng X (2019) Partial label learning via label enhancement. AAAI 33:5557–5564

    Article  Google Scholar 

  14. Gao Y, Wang K, Geng X (2022) Sequential label enhancement. IEEE Transactions on Neural Networks and Learning Systems

  15. Du G, Zhang J, Jiang M, Long J, Lin Y, Li S, Tan KC (2021) Graph-based class-imbalance learning with label enhancement. IEEE Transactions on Neural Networks and Learning Systems

  16. Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748

    Article  Google Scholar 

  17. Xing C, Geng X, Xue H (2016) Logistic boosting regression for label distribution learning. In: CVPR, pp. 4489– 4497

  18. Shen W, Zhao K, Guo Y, Yuille AL (2017) Label distribution learning forests. Advances in Neural Information Processing Systems 30

  19. Jia X, Zheng X, Li W, Zhang C, Li Z (2019) Facial emotion distribution learning by exploiting low-rank label correlations locally. In: CVPR, pp. 9841– 9850

  20. Xu S, Shang L, Shen F (2019) Latent semantics encoding for label distribution learning. In: IJCAI, pp. 3982– 3988

  21. Zheng X, Jia X, Li W (2018) Label distribution learning by exploiting sample correlations locally. In: AAAI, pp. 4556– 4563

  22. Jia X, Li W, Liu J-Y, Zhang Y (2018) Label distribution learning by exploiting label correlations. In: AAAI, pp. 3310– 3317

  23. Ren T, Jia X, Li W, Chen L, Li Z (2019) Label distribution learning with label-specific features. In: IJCAI, pp. 3318– 3324

  24. Huang J, Li G, Huang Q, Wu X (2015) Learning label specific features for multi-label classification. In: ICDM, pp. 181– 190

  25. Zhang J, Li C, Cao D, Lin Y, Su S, Dai L, Li S (2018) Multi-label learning with label-specific features by resolving label correlations. Knowl-Based Syst 159:148–157

    Article  Google Scholar 

  26. Lin Y, Liu H, Zhao H, Hu Q, Zhu X, Wu X (2022) Hierarchical feature selection based on label distribution learning. IEEE Transactions on Knowledge and Data Engineering

  27. Rodriguez A, Laio A (2014) Clustering by fast search and find of density peaks. Science 344(6191):1492–1496

    Article  Google Scholar 

  28. Eisen MB, Spellman PT, Brown PO, Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. Proceed Nat Acad Sci 95(25):14863–14868

    Article  Google Scholar 

  29. Peng K-C, Chen T, Sadovnik A, Gallagher AC ( 2015) A mixed bag of emotions: model, predict, and transfer emotion distributions. In: CVPR, pp. 860– 868

  30. Yu J-F, Jiang D-K, Xiao K, Jin Y, Wang J-H, Sun X (2012) Discriminate the falsely predicted protein-coding genes in aeropyrum pernix k1 genome based on graphical representation. Match-Commun Mathe Comput Chem 67(3):845–866

    MathSciNet  Google Scholar 

  31. Zhang H-R, Huang Y-T, Xu Y-Y, Min F (2020) COS-LDL: Label distribution learning by cosine-based distance-mapping correlation. IEEE Access 8:63961–63970

    Article  Google Scholar 

  32. Jia X, Ren T, Chen L, Wang J, Zhu J, Long X (2019) Weakly supervised label distribution learning based on transductive matrix completion with sample correlations. Pattern Recognit Lett 125:453–462

    Article  Google Scholar 

  33. Jia X, Li Z, Zheng X, Li W, Huang S-J (2021) Label distribution learning with label correlations on local samples. IEEE Trans Knowl Data Eng 33(04):1619–1631

    Article  Google Scholar 

  34. Wang J, Geng X (2021) Label distribution learning by exploiting label distribution manifold. IEEE Trans Neural Netw Learn Syst 01:1–14

    Google Scholar 

  35. Wang J , Geng X ( 2021) Learn the highest label and rest label description degrees. In: IJCAI, pp. 3097– 3103

  36. Friedman M (1940) A comparison of alternative tests of significance for the problem of m rankings. Annals Math Stat 11(1):86–92

    Article  MathSciNet  MATH  Google Scholar 

  37. Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Machine Learn Res 7:1–30

    MathSciNet  MATH  Google Scholar 

  38. Li J, Huang C, Qi J, Qian Y, Liu W (2017) Three-way cognitive concept learning via multi-granularity. Inform Sci 378:244–263

    Article  MATH  Google Scholar 

  39. Qian Y, Liang J, Wu W-Z, Dang C (2010) Information granularity in fuzzy binary grc model. IEEE Trans Fuzzy Syst 19(2):253–264

    Article  Google Scholar 

  40. Jia X, Lu Y, Zhang F (2021) Label enhancement by maintaining positive and negative label relation. IEEE Trans Knowledge Data Eng 1(1):1–1

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China (61902328), the Applied Basic Research Project of Science and Technology Bureau of Nanchong City (SXHZ040), and Central Government Funds of Guiding Local Scientific and Technological Development (2021ZYD0003).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Heng-Ru Zhang.

Ethics declarations

Conflict of Interest

We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work. There is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bai, RT., Zhang, HR. & Min, F. Label-dependent feature exploration for label distribution learning. Int. J. Mach. Learn. & Cyber. 14, 3685–3704 (2023). https://doi.org/10.1007/s13042-023-01858-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01858-x

Keywords

Navigation