Skip to main content
SpringerLink
Log in

Multi-relational knowledge graph completion method with local information fusion

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Knowledge graph completion(KGC) has attracted increasing attention in recent years, aiming at complementing missing relationships between entities in a Knowledge Graph(KG). While the existing KGC approaches utilizing the knowledge within KG could only complement a very limited number of missing relations, more and more approaches tend to study the completion of the multi-relationship knowledge graph. However, the existing completion methods of multi-relation knowledge graph regard knowledge graph as an undirected graph, which ignores the directionality of knowledge graph, so that the potential characteristics of multi-relation cannot be learned. Besides, most algorithms fail to explore the local information of knowledge because they ignore the different importance of entity adjacencies. In this paper, we propose to use local information fusion to join the entity and its adjacency relation, to acquiring the multi-relation representation. In addition, we try to specify distinct weights to model the direction of the relationship and apply the attention mechanism between entity nodes to obtain local information between entity nodes. Experiments conducted on three benchmark datasets and a medical domain knowledge graph dataset that we collect demonstrate the effectiveness of the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. https://github.com/ClaireZTH/JGANdata

References

  1. Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International conference on management of data, SIGMOD ’08. https://doi.org/10.1145/1376616.1376746. ACM, New York, pp 1247–1250

  2. Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Neural Information Processing Systems (NIPS), pp 2787–2795. https://hal.archives-ouvertes.fr/hal-00920777

  3. Bordes A, Weston J, Usunier N (2014) Open question answering with weakly supervised embedding models. In: Joint european conference on machine learning and knowledge discovery in databases. Springer, Berlin, pp 165–180

  4. Bruna J, Zaremba W, Szlam A, LeCun Y (2014) Spectral networks and locally connected networks on graphs. In: Bengio Y, LeCun Y (eds) 2nd International conference on learning representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, conference track proceedings. arXiv:1312.6203

  5. Catherine R, Cohen W (2016) Personalized Recommendations Using Knowledge Graphs: a probabilistic logic programming approach. Recsys ’16. Association for Computing Machinery, New York, pp pp 325–332. https://doi.org/10.1145/2959100.2959131

    Google Scholar 

  6. Clark P, Thompson JA, Holmback H, Duncan L (2000) Exploiting a thesaurus-based semantic net for knowledge-based search. In: Seventeenth national conference on artificial intelligence & twelfth conference on innovative applications of artificial intelligence

  7. Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2d knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 32. https://ojs.aaai.org/index.php/AAAI/article/view/11573

  8. Dong X, Gabrilovich E, Heitz G, Horn W, Lao N, Murphy K, Strohmann T, Sun S, Zhang W (2014) Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’14. Association for Computing Machinery, New York, pp 601–610, DOI https://doi.org/10.1145/2623330.2623623, (to appear in print)

  9. Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. CoRR arXiv:abs/1706.02216, pp 1024–1034. 1706.02216

  10. Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 1: long papers). https://doi.org/10.3115/v1/P15-1067. Association for Computational Linguistics, Beijing, pp 687–696

  11. Ji G, Liu K, He S, Zhao J (2016) Knowledge graph completion with adaptive sparse transfer matrix. In: Proceedings of the AAAI Conference on Artificial Intelligence 30(1). https://ojs.aaai.org/index.php/AAAI/article/view/10089

  12. Kazemi SM, Poole D (2018) Simple embedding for link prediction in knowledge graphs. In: Bengio S, Wallach HM, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems 31: annual conference on neural information processing systems 2018, NeurIPS 2018, 3-8 December 2018, Montréal, Canada, pp 4289–4300. http://papers.nips.cc/paper/7682-simple-embedding-for-link-prediction-in-knowledge-graphshttp://papers.nips.cc/paper/7682-simple-embedding-for-link-prediction-in-knowledge-graphshttp://papers.nips.cc/paper/7682-simple-embedding-for-link-prediction-in-knowledge-graphs

  13. Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net. https://openreview.net/forum?id=SJU4ayYgl

  14. Lehmann J, Isele R, Jakob M, Jentzsch A, Kontokostas D, Mendes PN, Hellmann S, Morsey M, Van Kleef P, Auer S et al (2015) Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia. Semantic Web 6(2):167–195

    Article  Google Scholar 

  15. Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. https://ojs.aaai.org/index.php/AAAI/article/view/9491

  16. Liu H, Wu Y, Yang Y (2017) Analogical inference for multi-relational embeddings. In: Precup D, Teh YW (eds) Proceedings of the 34th international conference on machine learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, proceedings of machine learning research. http://proceedings.mlr.press/v70/liu17d.html, vol 70. PMLR, pp 2168–2178

  17. Marcheggiani D, Titov I (2017) Encoding sentences with graph convolutional networks for semantic role labeling. In: Proceedings of the 2017 conference on empirical methods in natural language processing. 1703.04826

  18. Nguyen DQ, Nguyen TD, Nguyen DQ, Phung DQ (2018) A novel embedding model for knowledge base completion based on convolutional neural network. In: Walker MA, Ji H, Stent A (eds) Proceedings of the 2018 conference of the north american chapter of the association for computational linguistics: Human Language Technologies, NAACL-HLT, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 2 (Short Papers), Association for Computational Linguistics, pp 327–333. https://doi.org/10.18653/v1/n18-2053

  19. Nickel M, Tresp V, Kriegel HP (2011) A three-way model for collective learning on multi-relational data. ICML 11:809–816. https://icml.cc/2011/papers/438_icmlpaper.pdf

    Google Scholar 

  20. Schlichtkrull M, Kipf TN, Bloem P, Van Den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: European semantic web conference, Springer, pp 593–607

  21. Shang C, Tang Y, Huang J, Bi J, He X, Zhou B (2019) End-to-end structure-aware convolutional networks for knowledge base completion. Proc AAAI Conf Art Intell 33(01):3060–3067. https://doi.org/10.1609/aaai.v33i01.33013060. https://ojs.aaai.org/index.php/AAAI/article/view/4164

    Google Scholar 

  22. Suchanek FM, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th international conference on world wide web, WWW ’07. https://doi.org/10.1145/1242572.1242667. Association for Computing Machinery, New York, pp 697–706

  23. Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. https://openreview.net/forum?id=HkgEQnRqYQ

  24. Sun Z, Vashishth S, Sanyal S, Talukdar PP, Yang Y (2020) A re-evaluation of knowledge graph completion methods. In: Jurafsky D, Chai J, Schluter N, Tetreault JR (eds) Proceedings of the 58th annual meeting of the association for computational linguistics, ACL 2020, Online, July 5-10, 2020, pp. 5516–5522. association for computational linguistics. https://www.aclweb.org/anthology/2020.acl-main.489/

  25. Toutanova K, Chen D (2015) Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 57–66. Association for Computational Linguistics, Beijing, China. https://doi.org/10.18653/v1/W15-4007. https://www.aclweb.org/anthology/W15-4007

  26. Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp 2071–2080. 1606.06357

  27. Vashishth S, Sanyal S, Nitin V, Talukdar PP (2020) Composition-based multi-relational graph convolutional networks. In: 8th international conference on learning representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. https://openreview.net/forum?id=BylA_C4tPr

  28. Vashishth S, Yadav P, Bhandari M, Talukdar PP (2019) Confidence-based graph convolutional networks for semi-supervised learning. In: Chaudhuri K, Sugiyama M (eds) The 22nd International Conference on Artificial intelligence and statistics, AISTATS 2019, 16-18 April 2019, Naha, Okinawa, Japan, Proceedings of machine learning research, vol 89, PMLR, pp 1792–1801. http://proceedings.mlr.press/v89/vashishth19a.html

  29. Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. In: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net. https://openreview.net/forum?id=rJXMpikCZ

  30. Wang Q, Huang L, Jiang Z, Knight K, Ji H, Bansal M, Luan Y (2019) Paperrobot: Incremental draft generation of scientific ideas. In: Korhonen A, Traum DR, Márquez L (eds) Proceedings of the 57th conference of the association for computational linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: long papers, association for computational linguistics, pp 1980–1991. https://doi.org/10.18653/v1/p19-1191

  31. Wang Z, Li J (2016) Text-enhanced representation learning for knowledge graph. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI’16, AAAI Press, pp 1293–1299

  32. Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Twenty-Eighth AAAI conference on artificial intelligence. https://ojs.aaai.org/index.php/AAAI/article/view/8870

  33. Xie R, Liu Z, Jia J, Luan H, Sun M (2016) Representation learning of knowledge graphs with entity descriptions. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 30. https://ojs.aaai.org/index.php/AAAI/article/view/10329

  34. Yadav P, Nimishakavi M, Yadati N, Vashishth S, Rajkumar A, Talukdar PP (2019) Lovasz convolutional networks. In: Chaudhuri K, Sugiyama M (eds) The 22nd international conference on artificial intelligence and statistics, AISTATS 2019, 16-18 April 2019, Naha, Okinawa, Japan, Proceedings of Machine Learning Research, vol 89, pp 1978–1987. PMLR. http://proceedings.mlr.press/v89/yadav19a.html

  35. Yang B, Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Bengio Y, LeCun Y (eds) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings. 1412.6575

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant 62077015, No. 62177015, and the Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, Zhejiang, China.

Author information

Authors and Affiliations

  1. School of Computer Science, South China Normal University, Guangzhou, China

    Jin Huang, Tian Lu & Tinghua Zhang

  2. College of Teacher Education, Zhejiang Normal University, Zhejiang, China

    Jia Zhu

  3. Research Institute of China Telecom Corporate Ltd., Guangzhou, China

    Weihao Yu

Authors
  1. Jin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tian Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jia Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weihao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tinghua Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jia Zhu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, J., Lu, T., Zhu, J. et al. Multi-relational knowledge graph completion method with local information fusion. Appl Intell 52, 7985–7994 (2022). https://doi.org/10.1007/s10489-021-02876-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02876-4

Keywords

Search

Navigation