Skip to main content
SpringerLink
Log in

Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Knowledge graphs (KGs) play a vital role in natural language processing (NLP), which can serve several downstream tasks. Because different views of KGs are usually constructed independently, the multi-view knowledge graph fusion (MVKGF) becomes a hotspot. Although multi-view learning studied very well in past decades, MVKGF is still not well tackled because of the heterogeneous relations and the multi-view KGs. To overcome MVKGF, entity alignment is the most studied. Existing entity alignment methods are dominated by embedding based methods, such as TransE and Graph Neural Networks (GNNs), where the alignment is achieved by measuring the similarities between entity embeddings. However, most previous approaches suffer from the issues of the diverse knowledge facts and the complex neighboring structures. In this paper, we propose a novel K nowledge-aware A ttentional G raph N eural N etwork (KAGNN) model to carefully incorporate both knowledge facts and neighboring structures. In particular, a knowledge-aware attention mechanism is designed to preserve the original semantics and determine the importance of each knowledge fact. Furthermore, a three-layered GCN with highway gates is adopted to learn better entity representations from the neighboring structure information. Thus, our model can be regarded as a multi-view extension of GNN. We validate our model on three cross-lingual datasets and the results show our model beats the state-of-the-art baselines by a large margin.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://nlp.stanford.edu/projects/glove/

References

  1. Li C, Wang Y, Li D, Chu D, Ma M (2021) An effective method of evaluating pension service quality using multi-dimension attention convolutional neural networks. Int J Softw Eng Knowl Eng 31 (4):533–543

    Article  Google Scholar 

  2. Li C, Zhang H, Chu D, Xu X (2020) SRTM: a supervised relation topic model for multi-classification on large-scale document network. Neural Comput & Applic 32(10):6383–6392

    Article  Google Scholar 

  3. Belhadi H, Akli-Astouati K, Djenouri Y, Lin J C-W (2020) Data mining-based approach for ontology matching problem. Appl. Intell. 50(4):1204–1221

    Article  Google Scholar 

  4. Lehmann J, Isele R, Jakob M, Jentzsch A, Kontokostas D, Mendes P N, Hellmann S, Morsey M, Van Kleef P, Auer S, et al. (2015) Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia. Semantic Web 6(2):167–195

    Article  Google Scholar 

  5. Rebele T, Suchanek F, Hoffart J, Biega J, Kuzey E, Weikum G (2016) Yago: A multilingual knowledge base from wikipedia, wordnet, and geonames. In: International Semantic Web Conference, Springer, pp 177–185

  6. Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, pp 2787–2795

  7. Cui W, Xiao Y, Wang H, Song Y, Hwang S-, Wang W (2017) Kbqa: learning question answering over qa corpora and knowledge bases. Proceedings of the VLDB Endowment 10(5):565–576

    Article  Google Scholar 

  8. Chao G, Sun J, Lu J, Wang A-L, Langleben D D, Li C- R, Bi J (2019) Multi-view cluster analysis with incomplete data to understand treatment effects. Information Science 494:278–293

    Article  MATH  Google Scholar 

  9. Chao G, Sun S (2016) Alternative multiview maximum entropy discrimination. IEEE Transactions on Neural Networks and Learning Systems 27(7):1445–1456

    Article  Google Scholar 

  10. Chao G, Sun S (2019) Semi-supervised multi-view maximum entropy discrimination with expectation laplacian regularization. Information Fusion 45:296–306

    Article  Google Scholar 

  11. Hao Y, Zhang Y, He S, Liu K, Zhao J (2016) A joint embedding method for entity alignment of knowledge bases. In: China Conference on Knowledge Graph and Semantic Computing, Springer, pp 3–14

  12. Chen M, Tian Y, Yang M, Zaniolo C (2017) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp 1511–1517

  13. Sun Z, Hu W, Li C (2017) Cross-lingual entity alignment via joint attribute-preserving embedding. In: International Semantic Web Conference, Springer, pp 628–644

  14. Zhu H, Xie R, Liu Z, Sun M (2017) Iterative entity alignment via joint knowledge embeddings.. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp 4258–4264

  15. Sun Z, Hu W, Zhang Q, Qu Y (2018) Bootstrapping entity alignment with knowledge graph embedding.. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp 4396–4402

  16. Huang Z, Li X, Ye Y, Ng M K (2020) MR-GCN: multi-relational graph convolutional networks based on generalized tensor product. In: Bessiere C (ed) Proceedings of the 29th International Joint Conference on Artificial Intelligence, pp 1258–1264

  17. Wei Y, Wang X, Nie L, He X, Hong R, Chua T-S (2019) Mmgcn: Multi-modal graph convolution network for personalized recommendation of micro-video. In: Proceedings of the 27th ACM International Conference on Multimedia, pp 1437–1445

  18. Zhang Y, Dong X, Shang L, Zhang D, Wang D (2020) A multi-modal graph neural network approach to traffic risk forecasting in smart urban sensing. In: Proceedings of the 17th Annual IEEE International Conference on Sensing, Communication, and Networking, IEEE, pp 1–9

  19. Wang Z, Lv Q, Lan X, Zhang Y (2018) Cross-lingual knowledge graph alignment via graph convolutional networks. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 349–357

  20. Xu K, Wang L, Yu M, Feng Y, Song Y, Wang Z, Yu D (2019) Cross-lingual knowledge graph alignment via graph matching neural network. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 3156–3161

  21. Wu Y, Liu X, Feng Y, Wang Z, Yan R, Zhao D (2019) Relation-aware entity alignment for heterogeneous knowledge graphs. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp 5278–5284

  22. Kipf T N, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv:1609.02907

  23. Wu F, Souza A, Zhang T, Fifty C, Yu T, Weinberger K (2019) Simplifying graph convolutional networks. In: International conference on machine learning, PMLR, pp 6861–6871

  24. Bruna J, Zaremba W, Szlam A, LeCun Y (2014) Spectral networks and deep locally connected networks on graphs. In: Proceedings of International Conference on Learning Representations

  25. Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in Neural Information Processing Systems, pp 3844–3852

  26. Chen M, Tian Y, Chang K-W, Skiena S, Zaniolo C (2018) Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp 3998–4004

  27. Trisedya B D, Qi J, Zhang R (2019) Entity alignment between knowledge graphs using attribute embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 33, pp 297–304

  28. Pei S, Yu L, Hoehndorf R, Zhang X (2019) Semi-supervised entity alignment via knowledge graph embedding with awareness of degree difference. In: The World Wide Web Conference, ACM, pp 3130–3136

  29. Zhang Q, Sun Z, Hu W, Chen M, Guo L, Qu Y (2019) Multi-view knowledge graph embedding for entity alignment. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp 5429–5435

  30. Zhu Q, Zhou X, Wu J, Tan J, Guo L (2019) Neighborhood-aware attentional representation for multilingual knowledge graphs. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, AAAI Press, pp 1943–1949

  31. Cao Y, Liu Z, Li C, Li J, Chua T-S (2019) Multi-channel graph neural network for entity alignment. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 1452–1461

  32. Li C, Cao Y, Hou L, Shi J, Li J, Chua T-S (2019) Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 2723–2732

  33. Sun Z, Wang C, Hu W, Chen M, Dai J, Zhang W, Qu Y (2020) Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence, pp 222–229

  34. Wu Y, Liu X, Feng Y, Wang Z, Zhao D (2019) Jointly learning entity and relation representations for entity alignment. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 240–249

  35. Srivastava R K, Greff K, Schmidhuber J (2015) Highway networks. arXiv:1505.00387

  36. Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2017) Graph attention networks. arXiv:1710.10903

  37. Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701

    Article  MATH  Google Scholar 

  38. Nemenyi P (1963) Distribution-free multiple comparisons, Doctoral dissertation, Princeton University

Download references

Acknowledgements

This research was supported in part by the National Key R&D Program of China, 2018YFB2101100, 2018YFB2101101 and NSFC under Grant No. 61972111 and U1836107.

Author information

Authors and Affiliations

  1. Department of Computer Science, Harbin Institute of Technology, Shenzhen, Shenzhen, 518055, China

    Zhichao Huang, Xutao Li, Yunming Ye, Baoquan Zhang & Guangning Xu

  2. College of Cyber Security, Jinan University, Guangzhou, 510632, China

    Wensheng Gan

Authors
  1. Zhichao Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xutao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunming Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Baoquan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guangning Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wensheng Gan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Xutao Li or Yunming Ye.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, Z., Li, X., Ye, Y. et al. Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network. Appl Intell 53, 3652–3671 (2023). https://doi.org/10.1007/s10489-022-03667-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03667-1

Keywords

Search

Navigation