Abstract
Knowledge Graphs can not contain all the knowledge during the construction process, so needs to be completed to enhance its integrity. In real knowledge graphs, different relationships often show apparent long-tail distributions, i.e., many relationships have only a small number of entity pairs. Therefore, it is an urgent need to study few-shot knowledge graph completion. Existing methods generally complete the knowledge graph by learning representations of entities and relationships, but ignore the impact of the similarity of neighbor relations between triple entity pairs on completion. In this paper, we propose an implicit relational attention network to address this limitation. First, we propose a heterogeneous entity and relational encoder to mine one-hop neighbor information and enhance entity and relational representations through attention mechanism and convolution. Next, we propose an implicit relationship aware encoder to mine the neighbor relationship similarity information of triple entity pairs and obtain the triple dynamic relationship representation. Then we propose an adaptive relationship fusion network, which fuses the triple dynamic relationship representation and the original information of the neighbor relationship similarity of entity pairs, enhances the relationship representation of the query set to the reference set, so as to improve the accuracy of the few-shot knowledge graph completion. On two benchmark datasets, by comparing with well-known completion methods, the experimental results show that the proposed method achieves very competitive performance.




Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability and access
Data will be made available on reasonable request.
References
Bassani E (2023) ranxhub: An online repository for information retrieval runs. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 3210–3214
Carlson A, Betteridge J, Kisiel B, Settles B, Hruschka E, Mitchell T (2010) Toward an architecture for never-ending language learning. Proceedings of the AAAI conference on artificial intelligence. 24:1306–1313
Chen M, Zhang W, Zhang W, Chen Q, Chen H (2019) Meta relational learning for few-shot link prediction in knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). pp. 4217–4226
Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International conference on machine learning. pp. 1126–1135
Geng Y, Chen J, Pan JZ, Chen M, Jiang S, Zhang W, Chen H (2023) Relational message passing for fully inductive knowledge graph completion. In: 2023 IEEE 39th International Conference on Data Engineering (ICDE). pp. 1221–1233
Jamal MA, Qi GJ (2019) Task agnostic meta-learning for few-shot learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11719–11727
Jiang Z, Gao J, Lv X (2021) Metap: Meta pattern learning for one-shot knowledge graph completion. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 2232–2236
Kazemi SM, Poole D (2018) Simple embedding for link prediction in knowledge graphs. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. pp. 4289–4300
Kumar J, Gupta A, Lu Z, Stefan A, King TH (2023) Multi-lingual semantic search for domain-specific applications: Adobe photoshop and illustrator help search. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 3225–3229
Schlichtkrull M, Kipf TN, Bloem P, van den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: 15th International Conference on Extended Semantic Web Conference, ESWC 2018. pp. 593–607
Shang B, Zhao Y, Wang D, Liu J (2023) Relation-aware multi-positive contrastive knowledge graph completion with embedding dimension scaling. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 878–888
Sheng J, Guo S, Chen Z, Yue J, Wang L, Liu T, Xu H (2020) Adaptive attentional network for few-shot knowledge graph completion. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). pp. 1681–1691
Sun Z, Deng ZH, Nie JY, Tang J (2018) Rotate: Knowledge graph embedding by relational rotation in complex space. In: International Conference on Learning Representations
Bordes A, Usunier N, Garcia-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems-Volume 2. pp. 2787–2795
Fang H, Wang Y, Tian Z, Ye Y (2023) Learning knowledge graph embedding with a dual-attention embedding network. Expert Systems with Applications 212:118806
Xu H, Bao J, Liu W (2023) Double-Branch Multi-Attention based Graph Neural Network for Knowledge Graph Completion. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 15257–15271
Yin H, Zhong J, Wang C, Li R, Li X (2023) GS-InGAT: An interaction graph attention network with global semantic for knowledge graph completion. Expert Systems with Applications 228:120380
Zhang X, Zhang C, Guo J, Peng C, Niu Z, Wu X (2023) Graph attention network with dynamic representation of relations for knowledge graph completion. Expert Systems with Applications 219:119616
Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International conference on machine learning. pp. 2071–2080
Vrandečić D, Krötzsch M (2014) Wikidata: a free collaborative knowledgebase. Commun ACM 57(10):78–85
Wu Y, Xie R, Zhu Y, Ao X, Chen X, Zhang X, Zhuang F, Lin L, He Q (2022) Multi-view multi-behavior contrastive learning in recommendation. In: International Conference on Database Systems for Advanced Applications. pp. 166–182
Xie M, Hao C, Zhang P (2022) A sequential flow control framework for multi-hop knowledge base question answering. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. pp. 8450–8460
Xiong W, Yu M, Chang S, Guo X, Wang WY (2018) One-shot relational learning for knowledge graphs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. pp. 1980–1990
Xu J, Zhang J, Ke X, Dong Y, Chen H, Li C, Liu Y (2021) P-int: A path-based interaction model for few-shot knowledge graph completion. Findings of the Association for Computational Linguistics: EMNLP 2021:385–394
Yang B, Yih SWt, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the International Conference on Learning Representations (ICLR) 2015
Yao Y, Zhang Z, Xu Y, Li C (2022) Data augmentation for few-shot knowledge graph completion from hierarchical perspective. In: Proceedings of the 29th International Conference on Computational Linguistics. pp. 2494–2503
Zhang C, Yao H, Huang C, Jiang M, Li Z, Chawla NV (2020) Few-shot knowledge graph completion. Proceedings of the AAAI conference on artificial intelligence. 34:3041–3048
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant 62176236 and 62106225, Natural Science Foundation of Zhejiang Province under Grant LZ24F030011 and LY23F030008.
Author information
Authors and Affiliations
Contributions
Xu-Hua Yang: Funding acquisition, Resources, Conceptualization, Methodology; Qi-Yao Li: Writing - original draft, Data curation, Software, Investigation; Dong Wei: Visualization, Validation; Hai-Xia Long: Funding acquisition, Supervision.
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that have no conflict of interest.
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethical and informed consent for data used
We would like to clarify that the data used in our paper does not involve any ethical concerns and is derived from publicly available datasets.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yang, XH., Li, QY., Wei, D. et al. Implicit relational attention network for few-shot knowledge graph completion. Appl Intell 54, 6433–6443 (2024). https://doi.org/10.1007/s10489-024-05511-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-024-05511-0