Skip to main content

Knowledge Graph Reasoning with Bidirectional Relation-Guided Graph Attention Network

  • Conference paper
  • First Online:
Data Science and Information Security (IAIC 2023)

Abstract

Graph convolutional neural networks (GCN) have demonstrated superior performance in graph data modeling and have been widely used in knowledge inference research in recent years. However, knowledge graph is a heterogeneous multi-relational connected graph with complex interactions between neighboring nodes, and most existing GCN-based methods aggregate neighborhood information with the same importance, which leads to the loss of important semantics in the context. In addition, most GAT-based methods consider the neighborhood as a whole and ignore the direction information of the relationship. To this end, we propose a bidirectional relation-guided graph attention network (BR-GAT), which utilizes a bidirectional self-attention mechanism to compute the importance of neighboring nodes, computes the importance of the neighborhood on the representation of relations through a relation-specific mechanism, and finally fuses the joint propagation of neighboring information to update the representations of entities and relations. We conduct link prediction experiments on three standard datasets, and the results demonstrate that BR-GAT outperforms several state-of-the-art models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sorokin, D., Gurevych, I.: Modeling semantics with gated graph neural networks for knowledge base question answering. In: Proceedings of the 27th International Conference on Computational Linguistics, COLING 2018, Santa Fe, New Mexico, USA, 20–26 August 2018, pp. 3306–3317. Association for Computational Linguistics (2018)

    Google Scholar 

  2. Huang, X., Zhang, J., Li, D., Li, P.: Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113 (2019)

    Google Scholar 

  3. Chen, L., Tu, D., Lv, M., Chen, G.: A knowledge-based semisupervised hierarchical online topic detection framework. IEEE Trans. Cybern. 49(9), 3307–3321 (2018)

    Article  Google Scholar 

  4. Li, F., Li, Y., Shang, C., Shen, Q.: Fuzzy knowledge-based prediction through weighted rule interpolation. IEEE Trans. Cybern. 50(10), 4508–4517 (2019)

    Article  Google Scholar 

  5. Rosa, R.L., Schwartz, G.M., Ruggiero, W.V., Rodríguez, D.Z.: A knowledge-based recommendation system that includes sentiment analysis and deep learning. IEEE Trans. Industr. Inf. 15(4), 2124–2135 (2018)

    Article  Google Scholar 

  6. Shao, B., Li, X., Bian, G.: A survey of research hotspots and frontier trends of recommendation systems from the perspective of knowledge graph. Exp. Syst. Appl. 165, 113764 (2021)

    Google Scholar 

  7. Wang, H., Zhang, F., Wang, J., Zhao, M., Li, W., Xie, X., et al.: Exploring high-order user preference on the knowledge graph for recommender systems. ACM Trans. Inf. Syst. (TOIS) 37(3), 1–26 (2019)

    Article  Google Scholar 

  8. Li, Z., Liu, H., Zhang, Z., Liu, T., Xiong, N.N.: Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Trans. Neural Netw. Learn. Syst. 33(8), 3961–3973 (2021)

    Google Scholar 

  9. Li, Q., Wang, D., Feng, S., Niu, C., Zhang, Y.: Global graph attention embedding network for relation prediction in knowledge graphs. IEEE Trans. Neural Netw. Learn. Syst. 33(11), 6712–6725 (2021)

    Google Scholar 

  10. Nathani, D., Chauhan, J., Sharma, C., Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp. 4710–4723 (2019)

    Google Scholar 

  11. Zhang, Z., Zhuang, F., Zhu, H., Shi, Z., Xiong, H., He, Q.: Relational graph neural network with hierarchical attention for knowledge graph completion. In: Proceedings of the AAAI conference on artificial intelligence, vol. 34, pp. 9612–9619 (2020)

    Google Scholar 

  12. Zhao, Y., Zhou, H., Xie, R., Zhuang, F., Li, Q., Liu, J.: Incorporating global information in local attention for knowledge representation learning. In Findings of the association for computational linguistics: ACL-IJCNLP 2021, pp. 1341–1351 (2021)

    Google Scholar 

  13. Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2d knowledge graph embeddings. In Thirty-Second AAAI Conference on Artificial Intelligence (2018)

    Google Scholar 

  14. Vashishth, S., Sanyal, S., Nitin, V., Agrawal, N., Talukdar, P.: Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3009–3016 (2020)

    Google Scholar 

  15. Jin, D., Huo, C., Liang, C., Yang, L.: Heterogeneous graph neural network via attribute completion. In: Proceedings of the Web Conference 2021, pp. 391–400 (2021)

    Google Scholar 

  16. Zhao, Y., Zhou, H., Zhang, A., Xie, R., Li, Q., Zhuang, F.: Connecting embeddings based on multiplex relational graph attention networks for knowledge graph entity typing. IEEE Trans. Knowl. Data Eng. 35(5), 4608–4620 (2022)

    Google Scholar 

  17. Zhuo, J., Zhu, Q., Yue, Y., Zhao, Y., Han, W.: A neighborhood-attention fine-grained entity typing for knowledge graph completion. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, pp. 1525–1533 (2022)

    Google Scholar 

  18. Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: Gangemi, A., et al. (ed.) The Semantic Web, ESWC 2018, LNCS, vol. 10843, pp. 593–607. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93417-4_38

  19. Vashishth, S., Sanyal, S., Nitin, V., Talukdar, P.: Composition-based multi-relational graph convolutional networks. In: International Conference on Learning Representations (2020)

    Google Scholar 

  20. Wu, J., Shi, W., Cao, X., Chen, J., Lei, W., Zhang, F., et al.: DisenKGAT: knowledge graph embedding with disentangled graph attention network. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 2140–2149 (2021)

    Google Scholar 

  21. Zhang, X, Zhang, C, Guo, J, Peng, C, Niu, Z, Wu, X , et al.: Graph attention network with dynamic representation of relations for knowledge graph completion. Expert Syst. Appl. 219, 119616 (2023)

    Google Scholar 

  22. Fang, H, Wang, Y, Tian, Z, Ye, Y.: Learning knowledge graph embedding with a dual-attention embedding network. Expert Syst. Appl. 212, 118806 (2023)

    Google Scholar 

  23. Li, Z, Zhao, Y, Zhang, Y, Zhang, Z.: Multi-relational graph attention networks for knowledge graph completion. Knowl.-Based Syst. 251, 109262 (2022)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rui Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, R., Wang, Y. (2024). Knowledge Graph Reasoning with Bidirectional Relation-Guided Graph Attention Network. In: Jin, H., Pan, Y., Lu, J. (eds) Data Science and Information Security. IAIC 2023. Communications in Computer and Information Science, vol 2059. Springer, Singapore. https://doi.org/10.1007/978-981-97-1280-9_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-1280-9_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-1279-3

  • Online ISBN: 978-981-97-1280-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics