Abstract
Few-shot learning poses a great challenge for obtaining a classifier that recognizes new classes from a few labeled examples. Existing solutions perform well by leveraging meta-learning models driven by data information. However, these models only utilize the flat data information and ignore the existing hierarchical knowledge structure among classes. In this paper, we propose a knowledge transfer based hierarchical few-shot learning model, which takes advantage of a tree-structured knowledge graph to facilitate the classification results. First, we consider a tree-structured class hierarchy according to the semantic information among classes as a knowledge graph to alleviate the low-data problem. Second, we divide the tree structure into class structure and data, and build a multi-layer classifier to obtain classification results in the two parts. Finally, we consider the tradeoff between structure loss and data loss for hierarchical few-shot learning, which takes class structure information to assist learning. Experimental results on benchmark datasets show that our model outperforms several state-of-the-art models.







Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
AbuSalih B, AlTawil M, Aljarah I, Faris H, Wongthongtham P, Chan KY, Beheshti A (2021) Relational learning analysis of social politics using knowledge graph embedding. Data Min Knowl Disc 1–40
Andrychowicz M, Denil M, Gomez S, Hoffman MW, Pfau D, Schaul T, De Freitas N (2016) Learning to learn by gradient descent by gradient descent. In: International conference on neural information processing systems
Ayoub A, Jia Z, Szepesvari C, Wang M, Yang L (2020) Model-based reinforcement learning with value-targeted regression. In: International conference on machine learning
Bellet A, Habrard A, Sebban M (2015) Metric learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 9(1):1–151
Chen Y, Liu Z, Xu H, Darrell T, Wang X (2021) Meta-baseline: exploring simple meta-learning for few-shot learning. In: IEEE/CVF International Conference on Computer Vision
Dekel O, Keshet J, Singer Y (2004) Large margin hierarchical classification. In: International Conference on Machine Learning
Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence
Dhillon GS, Chaudhari P, Ravichandran A, Soatto S (2020) A baseline for few-shot image classification. In: International Conference on Learning Representations
Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A (2010) The pascal visual object classes (VOC) challenge. Int J Comput Vision 88(2):303–338
Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International Conference on Machine Learning
Ge Y, Li S, Li X, Fan F, Xie W, You J, Liu X (2021) Embedding semantic hierarchy in discrete optimal transport for risk minimization. In: IEEE international conference on acoustics, speech and signal processing
Guo S, Zhao H, Yang W (2021) Hierarchical feature selection with multi-granularity clustering structure. Inf Sci 568:448–462
He J, Hong R, Liu X, Xu M, Zha Z, Wang M (2020) Memory-augmented relation network for few-shot learning. In: International Conference on Multimedia
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Hu Z, Li Z, Wang X, Zheng S (2022) Unsupervised descriptor selection based meta-learning networks for few-shot classification. Pattern Recogn 122:108304
Hui B, Zhu P, Hu Q, Wang Q (2019) Self-attention relation network for few-shot learning. In: IEEE International Conference on Multimedia and Expo Workshops
Jamal MA, Qi G (2019) Task agnostic meta-learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Jiang R, Zhang J, Yan R, Tang H (2021) Few-shot learning in spiking neural networks by multi-timescale optimization. Neural Comput 33(9):2439–2472
Kang D, Kwon H, Min J, Cho M (2021) Relational embedding for few-shot classification. In: IEEE/CVF International Conference on Computer Vision
Kosmopoulos A, Partalas I, Gaussier E, Paliouras G, Androutsopoulos I (2015) Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Min Knowl Disc 29(3):820–865
Kulis B et al (2012) Metric learning: a survey. Foundations and Trends in Machine. Learning 5(4):287–364
Laenen S, Bertinetto L (2021) On episodes, prototypical networks, and few-shot learning. Adv Neural Inf Process Syst 34:24581–24592
Lee K, Maji S, Ravichandran A, Soatto S (2019) Meta-learning with differentiable convex optimization. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Li A, Luo T, Lu Z, Xiang T, Wang L (2019) Large-scale few-shot learning: knowledge transfer with class hierarchy. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Li D, Ju Y, Zou Q (2016) Protein folds prediction with hierarchical structured svm. Curr Proteomics 13(2):79–85
Li J, Li Y, Mi Y, Wu W (2020) Meso-granularity labeled method for multi-granularity formal concept analysis. Journal of Computer Research and Development 57(2):447–458
Li X, Sun Z, Xue JH, Ma Z (2021) A concise review of recent few-shot meta-learning methods. Neurocomputing 456:463–468
Lim JY, Lim KM, Ooi SY, Lee CP (2021) Efficient-prototypicalnet with self knowledge distillation for few-shot learning. Neurocomputing 459:327–337
Liu Y, Lee J, Park M, Kim S, Yang E, Hwang S, Yang Y (2019) Learning to propagate labels: transductive propagation network for few-shot learning. In: International Conference on Learning Representations
Liu Z, Winata GI, Xu P, Fung P (2020) Coach: a coarse-to-fine approach for cross-domain slot filling. In: Annual Meeting of the Association for Computational Linguistics
Löffler C, Reeb L, Dzibela D, Marzilger R, Witt N, Eskofier BM, Mutschler C (2021) Deep siamese metric learning: a highly scalable approach to searching unordered sets of trajectories. ACM Trans Intell Syst Technol 13(1):1–23
Miller GA (1995) WordNet: a lexical database for english. Commun ACM 38(11):39–41
Oreshkin B, Rodriguez P, Lacoste A (2020) TADAM: task dependent adaptive metric for improved few-shot learning. In: International Conference on Neural Information Processing Systems
Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: International Conference on Learning Representations
Ravichandran A, Bhotika R, Soatto S (2019) Few-shot learning with embedded class models and shot-free meta training. In: IEEE/CVF International Conference on Computer Vision
Ren M, Triantafillou E, Ravi S, Snell J, Swersky K, Tenenbaum JB, Larochelle H, Zemel RS (2018) Meta-learning for semi-supervised few-shot classification. In: International Conference on Learning Representations
Rossi A, Barbosa D, Firmani D, Matinata A, Merialdo P (2021) Knowledge graph embedding for link prediction: a comparative analysis. ACM Trans Knowl Discov Data 15(2):1–49
Simon C, Koniusz P, Nock R, Harandi M (2020) Adaptive subspaces for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: International Conference on Neural Information Processing Systems
Sun Q, Liu Y, Chua TS, Schiele B (2019) Meta-transfer learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to compare: relation network for few-shot learning. In: IEEE Conference on Computer Vision and Pattern Recognition
Tian Y, Wang Y, Krishnan D, Tenenbaum JB, Isola P (2020) Rethinking few-shot image classification: a good embedding is all you need? In: European Conference on Computer Vision
Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: International Conference on Neural Information Processing Systems
Wang G (2017) DGCC: data-driven granular cognitive computing. Granular Computing 2(4):343–355
Wang S, Zhu W (2018) Sparse graph embedding unsupervised feature selection. IEEE Transactions on Systems Man and Cybernetics Systems 48(3):329–341
Wang X, Li J (2020) New advances in three-way decision, granular computing and concept lattice. Int J Mach Learn Cybern 11(5):945–946
Wang X, Wang P, Yang X, Yao Y (2021) Attribution reduction based on sequential three-way search of granularity. International Journal of Machine Learning and Cybernetics 12(5):1439–1458
Wang Y, Wang Z, Hu Q, Zhou Y, Su H (2021) Hierarchical semantic risk minimization for large-scale classification, IEEE Transactions on Cybernetics, 1–13
Yang F, Wang R, Chen X (2022) SEGA: semantic guided attention on visual prototype for few-shot learning. In: IEEE/CVF Winter Conference on Applications of Computer Vision
Yang J, Wang G, Zhang Q (2018) Knowledge distance measure in multigranulation spaces of fuzzy equivalence relations. Inf Sci 448:18–35
Ye H, Hu H, Zhan D, Sha F (2020) Few-shot learning via embedding adaptation with set-to-set functions. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Zhang C, Cai Y, Lin G, Shen C (2020) DeepEMD: few-shot image classification with differentiable earth mover’s distance and structured classifiers. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Zhang Z, Lan C, Zeng W, Chen Z, Chang SF Uncertainty-aware few-shot image classification, arXiv preprint arXiv:2010.04525
Zhao H, Hu Q, Zhu P, Wang Y, Wang P (2021) A recursive regularization based feature selection framework for hierarchical classification. IEEE Trans Knowl Data Eng 33(7):2833–2846
Zhu Q, Mao Q, Jia H, Noi OEN, Tu J (2022) Convolutional relation network for facial expression recognition in the wild with few-shot learning. Expert Syst Appl 189:116046
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant No. 62141602 and the Natural Science Foundation of Fujian Province under Grant Nos. 2021J011003 and 2021J011006.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, Z., Wu, Z., Zhao, H. et al. Knowledge transfer based hierarchical few-shot learning via tree-structured knowledge graph. Int. J. Mach. Learn. & Cyber. 14, 281–294 (2023). https://doi.org/10.1007/s13042-022-01640-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-022-01640-5