Skip to main content
Log in

Implicit relational attention network for few-shot knowledge graph completion

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Knowledge Graphs can not contain all the knowledge during the construction process, so needs to be completed to enhance its integrity. In real knowledge graphs, different relationships often show apparent long-tail distributions, i.e., many relationships have only a small number of entity pairs. Therefore, it is an urgent need to study few-shot knowledge graph completion. Existing methods generally complete the knowledge graph by learning representations of entities and relationships, but ignore the impact of the similarity of neighbor relations between triple entity pairs on completion. In this paper, we propose an implicit relational attention network to address this limitation. First, we propose a heterogeneous entity and relational encoder to mine one-hop neighbor information and enhance entity and relational representations through attention mechanism and convolution. Next, we propose an implicit relationship aware encoder to mine the neighbor relationship similarity information of triple entity pairs and obtain the triple dynamic relationship representation. Then we propose an adaptive relationship fusion network, which fuses the triple dynamic relationship representation and the original information of the neighbor relationship similarity of entity pairs, enhances the relationship representation of the query set to the reference set, so as to improve the accuracy of the few-shot knowledge graph completion. On two benchmark datasets, by comparing with well-known completion methods, the experimental results show that the proposed method achieves very competitive performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Algorithm 1
Fig. 3

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability and access

Data will be made available on reasonable request.

References

  1. Bassani E (2023) ranxhub: An online repository for information retrieval runs. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 3210–3214

  2. Carlson A, Betteridge J, Kisiel B, Settles B, Hruschka E, Mitchell T (2010) Toward an architecture for never-ending language learning. Proceedings of the AAAI conference on artificial intelligence. 24:1306–1313

    Article  Google Scholar 

  3. Chen M, Zhang W, Zhang W, Chen Q, Chen H (2019) Meta relational learning for few-shot link prediction in knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). pp. 4217–4226

  4. Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International conference on machine learning. pp. 1126–1135

  5. Geng Y, Chen J, Pan JZ, Chen M, Jiang S, Zhang W, Chen H (2023) Relational message passing for fully inductive knowledge graph completion. In: 2023 IEEE 39th International Conference on Data Engineering (ICDE). pp. 1221–1233

  6. Jamal MA, Qi GJ (2019) Task agnostic meta-learning for few-shot learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11719–11727

  7. Jiang Z, Gao J, Lv X (2021) Metap: Meta pattern learning for one-shot knowledge graph completion. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 2232–2236

  8. Kazemi SM, Poole D (2018) Simple embedding for link prediction in knowledge graphs. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. pp. 4289–4300

  9. Kumar J, Gupta A, Lu Z, Stefan A, King TH (2023) Multi-lingual semantic search for domain-specific applications: Adobe photoshop and illustrator help search. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 3225–3229

  10. Schlichtkrull M, Kipf TN, Bloem P, van den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: 15th International Conference on Extended Semantic Web Conference, ESWC 2018. pp. 593–607

  11. Shang B, Zhao Y, Wang D, Liu J (2023) Relation-aware multi-positive contrastive knowledge graph completion with embedding dimension scaling. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 878–888

  12. Sheng J, Guo S, Chen Z, Yue J, Wang L, Liu T, Xu H (2020) Adaptive attentional network for few-shot knowledge graph completion. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). pp. 1681–1691

  13. Sun Z, Deng ZH, Nie JY, Tang J (2018) Rotate: Knowledge graph embedding by relational rotation in complex space. In: International Conference on Learning Representations

  14. Bordes A, Usunier N, Garcia-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems-Volume 2. pp. 2787–2795

  15. Fang H, Wang Y, Tian Z, Ye Y (2023) Learning knowledge graph embedding with a dual-attention embedding network. Expert Systems with Applications 212:118806

    Article  Google Scholar 

  16. Xu H, Bao J, Liu W (2023) Double-Branch Multi-Attention based Graph Neural Network for Knowledge Graph Completion. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 15257–15271

  17. Yin H, Zhong J, Wang C, Li R, Li X (2023) GS-InGAT: An interaction graph attention network with global semantic for knowledge graph completion. Expert Systems with Applications 228:120380

    Article  Google Scholar 

  18. Zhang X, Zhang C, Guo J, Peng C, Niu Z, Wu X (2023) Graph attention network with dynamic representation of relations for knowledge graph completion. Expert Systems with Applications 219:119616

    Article  Google Scholar 

  19. Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International conference on machine learning. pp. 2071–2080

  20. Vrandečić D, Krötzsch M (2014) Wikidata: a free collaborative knowledgebase. Commun ACM 57(10):78–85

    Article  Google Scholar 

  21. Wu Y, Xie R, Zhu Y, Ao X, Chen X, Zhang X, Zhuang F, Lin L, He Q (2022) Multi-view multi-behavior contrastive learning in recommendation. In: International Conference on Database Systems for Advanced Applications. pp. 166–182

  22. Xie M, Hao C, Zhang P (2022) A sequential flow control framework for multi-hop knowledge base question answering. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. pp. 8450–8460

  23. Xiong W, Yu M, Chang S, Guo X, Wang WY (2018) One-shot relational learning for knowledge graphs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. pp. 1980–1990

  24. Xu J, Zhang J, Ke X, Dong Y, Chen H, Li C, Liu Y (2021) P-int: A path-based interaction model for few-shot knowledge graph completion. Findings of the Association for Computational Linguistics: EMNLP 2021:385–394

    Google Scholar 

  25. Yang B, Yih SWt, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the International Conference on Learning Representations (ICLR) 2015

  26. Yao Y, Zhang Z, Xu Y, Li C (2022) Data augmentation for few-shot knowledge graph completion from hierarchical perspective. In: Proceedings of the 29th International Conference on Computational Linguistics. pp. 2494–2503

  27. Zhang C, Yao H, Huang C, Jiang M, Li Z, Chawla NV (2020) Few-shot knowledge graph completion. Proceedings of the AAAI conference on artificial intelligence. 34:3041–3048

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant 62176236 and 62106225, Natural Science Foundation of Zhejiang Province under Grant LZ24F030011 and LY23F030008.

Author information

Authors and Affiliations

Authors

Contributions

Xu-Hua Yang: Funding acquisition, Resources, Conceptualization, Methodology; Qi-Yao Li: Writing - original draft, Data curation, Software, Investigation; Dong Wei: Visualization, Validation; Hai-Xia Long: Funding acquisition, Supervision.

Corresponding author

Correspondence to Xu-Hua Yang.

Ethics declarations

Conflict of interest

All authors declare that have no conflict of interest.

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical and informed consent for data used

We would like to clarify that the data used in our paper does not involve any ethical concerns and is derived from publicly available datasets.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, XH., Li, QY., Wei, D. et al. Implicit relational attention network for few-shot knowledge graph completion. Appl Intell 54, 6433–6443 (2024). https://doi.org/10.1007/s10489-024-05511-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05511-0

Keywords