Abstract
Label distribution learning (LDL) explicitly models label ambiguity by assigning a real-valued vector with label description degrees to each sample. Most LDL methods only build models on the same feature (sub)space shared by all labels. However, they ignore that each label has its own specific features, and there are some common features among labels. In this paper, we propose a novel LDL (LDL-LDF) algorithm that aims to exploit both label-dependent and common features. First, label-dependent feature reconstruction utilizes thresholding for relevant sample subset identification, density peaks clustering for representative sample selection, and Euclidean distance for feature value calculation. Second, common feature reconstruction follows a similar approach, however, on the whole dataset. Finally, the prediction neural network is composed of several components that serve each label with label-dependent features, one component that serves all labels with common features, and the fusion component. The effectiveness and competitiveness of our algorithm are verified through various experiments comparing seven algorithms on fourteen real-world datasets.
Similar content being viewed by others
References
Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837
Gao B-B, Xing C, Xie C-W, Wu J-X, Geng X (2017) Deep label distribution learning with label ambiguity. IEEE Trans Imag Process 26(6):2825–2838
Geng X, Smith-Miles K, Zhou Z-H ( 2010) Facial age estimation by learning from label distributions. In: AAAI, pp. 451– 456
Wen X, Li B, Guo H, Liu Z, Hu G, Tang M, Wang J ( 2020) Adaptive variance based label distribution learning for facial age estimation. In: ECCV, pp. 379– 395
Zhou Y, Xue H, Geng X ( 2015) Emotion distribution recognition from facial expressions. In: ACM MM, pp. 1247– 1250
Li S, Deng W (2019) Blended emotion in-the-wild: multi-label facial expression recognition using crowdsourced annotations and deep locality feature learning. Inter J Comput Vision 127(6):884–906
Geng X, Xia Y ( 2014) Head pose estimation based on multivariate label distribution. In: CVPR, pp. 1837– 1842
Zhang Z, Wang M, Geng X (2015) Crowd counting in public video surveillance by label distribution learning. Neurocomputing 166:151–163
Liang L, Lin L, Jin L, Xie D, Li M (2018) Scut-fbp5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction. In: ICPR, pp. 1598– 1603
Yang J, She D, Sun M ( 2017) Joint image emotion classification and distribution learning via deep nonvolutional neural network. In: IJCAI, pp. 3266– 3272
Zhang M-L, Wu L (2014) Lift: Multi-label learning with label-specific features. IEEE Trans Pattern Anal Machine Intell 37(1):107–120
Xu N, Liu Y-P, Geng X (2019) Label enhancement for label distribution learning. IEEE Trans Knowl Data Eng 33(4):1632–1643
Xu N, Lv J, Geng X (2019) Partial label learning via label enhancement. AAAI 33:5557–5564
Gao Y, Wang K, Geng X (2022) Sequential label enhancement. IEEE Transactions on Neural Networks and Learning Systems
Du G, Zhang J, Jiang M, Long J, Lin Y, Li S, Tan KC (2021) Graph-based class-imbalance learning with label enhancement. IEEE Transactions on Neural Networks and Learning Systems
Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748
Xing C, Geng X, Xue H (2016) Logistic boosting regression for label distribution learning. In: CVPR, pp. 4489– 4497
Shen W, Zhao K, Guo Y, Yuille AL (2017) Label distribution learning forests. Advances in Neural Information Processing Systems 30
Jia X, Zheng X, Li W, Zhang C, Li Z (2019) Facial emotion distribution learning by exploiting low-rank label correlations locally. In: CVPR, pp. 9841– 9850
Xu S, Shang L, Shen F (2019) Latent semantics encoding for label distribution learning. In: IJCAI, pp. 3982– 3988
Zheng X, Jia X, Li W (2018) Label distribution learning by exploiting sample correlations locally. In: AAAI, pp. 4556– 4563
Jia X, Li W, Liu J-Y, Zhang Y (2018) Label distribution learning by exploiting label correlations. In: AAAI, pp. 3310– 3317
Ren T, Jia X, Li W, Chen L, Li Z (2019) Label distribution learning with label-specific features. In: IJCAI, pp. 3318– 3324
Huang J, Li G, Huang Q, Wu X (2015) Learning label specific features for multi-label classification. In: ICDM, pp. 181– 190
Zhang J, Li C, Cao D, Lin Y, Su S, Dai L, Li S (2018) Multi-label learning with label-specific features by resolving label correlations. Knowl-Based Syst 159:148–157
Lin Y, Liu H, Zhao H, Hu Q, Zhu X, Wu X (2022) Hierarchical feature selection based on label distribution learning. IEEE Transactions on Knowledge and Data Engineering
Rodriguez A, Laio A (2014) Clustering by fast search and find of density peaks. Science 344(6191):1492–1496
Eisen MB, Spellman PT, Brown PO, Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. Proceed Nat Acad Sci 95(25):14863–14868
Peng K-C, Chen T, Sadovnik A, Gallagher AC ( 2015) A mixed bag of emotions: model, predict, and transfer emotion distributions. In: CVPR, pp. 860– 868
Yu J-F, Jiang D-K, Xiao K, Jin Y, Wang J-H, Sun X (2012) Discriminate the falsely predicted protein-coding genes in aeropyrum pernix k1 genome based on graphical representation. Match-Commun Mathe Comput Chem 67(3):845–866
Zhang H-R, Huang Y-T, Xu Y-Y, Min F (2020) COS-LDL: Label distribution learning by cosine-based distance-mapping correlation. IEEE Access 8:63961–63970
Jia X, Ren T, Chen L, Wang J, Zhu J, Long X (2019) Weakly supervised label distribution learning based on transductive matrix completion with sample correlations. Pattern Recognit Lett 125:453–462
Jia X, Li Z, Zheng X, Li W, Huang S-J (2021) Label distribution learning with label correlations on local samples. IEEE Trans Knowl Data Eng 33(04):1619–1631
Wang J, Geng X (2021) Label distribution learning by exploiting label distribution manifold. IEEE Trans Neural Netw Learn Syst 01:1–14
Wang J , Geng X ( 2021) Learn the highest label and rest label description degrees. In: IJCAI, pp. 3097– 3103
Friedman M (1940) A comparison of alternative tests of significance for the problem of m rankings. Annals Math Stat 11(1):86–92
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Machine Learn Res 7:1–30
Li J, Huang C, Qi J, Qian Y, Liu W (2017) Three-way cognitive concept learning via multi-granularity. Inform Sci 378:244–263
Qian Y, Liang J, Wu W-Z, Dang C (2010) Information granularity in fuzzy binary grc model. IEEE Trans Fuzzy Syst 19(2):253–264
Jia X, Lu Y, Zhang F (2021) Label enhancement by maintaining positive and negative label relation. IEEE Trans Knowledge Data Eng 1(1):1–1
Acknowledgements
This work is supported by the National Natural Science Foundation of China (61902328), the Applied Basic Research Project of Science and Technology Bureau of Nanchong City (SXHZ040), and Central Government Funds of Guiding Local Scientific and Technological Development (2021ZYD0003).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work. There is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bai, RT., Zhang, HR. & Min, F. Label-dependent feature exploration for label distribution learning. Int. J. Mach. Learn. & Cyber. 14, 3685–3704 (2023). https://doi.org/10.1007/s13042-023-01858-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-023-01858-x