Abstract
Graph convolutional neural networks (GCN) have demonstrated superior performance in graph data modeling and have been widely used in knowledge inference research in recent years. However, knowledge graph is a heterogeneous multi-relational connected graph with complex interactions between neighboring nodes, and most existing GCN-based methods aggregate neighborhood information with the same importance, which leads to the loss of important semantics in the context. In addition, most GAT-based methods consider the neighborhood as a whole and ignore the direction information of the relationship. To this end, we propose a bidirectional relation-guided graph attention network (BR-GAT), which utilizes a bidirectional self-attention mechanism to compute the importance of neighboring nodes, computes the importance of the neighborhood on the representation of relations through a relation-specific mechanism, and finally fuses the joint propagation of neighboring information to update the representations of entities and relations. We conduct link prediction experiments on three standard datasets, and the results demonstrate that BR-GAT outperforms several state-of-the-art models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sorokin, D., Gurevych, I.: Modeling semantics with gated graph neural networks for knowledge base question answering. In: Proceedings of the 27th International Conference on Computational Linguistics, COLING 2018, Santa Fe, New Mexico, USA, 20–26 August 2018, pp. 3306–3317. Association for Computational Linguistics (2018)
Huang, X., Zhang, J., Li, D., Li, P.: Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113 (2019)
Chen, L., Tu, D., Lv, M., Chen, G.: A knowledge-based semisupervised hierarchical online topic detection framework. IEEE Trans. Cybern. 49(9), 3307–3321 (2018)
Li, F., Li, Y., Shang, C., Shen, Q.: Fuzzy knowledge-based prediction through weighted rule interpolation. IEEE Trans. Cybern. 50(10), 4508–4517 (2019)
Rosa, R.L., Schwartz, G.M., Ruggiero, W.V., RodrÃguez, D.Z.: A knowledge-based recommendation system that includes sentiment analysis and deep learning. IEEE Trans. Industr. Inf. 15(4), 2124–2135 (2018)
Shao, B., Li, X., Bian, G.: A survey of research hotspots and frontier trends of recommendation systems from the perspective of knowledge graph. Exp. Syst. Appl. 165, 113764 (2021)
Wang, H., Zhang, F., Wang, J., Zhao, M., Li, W., Xie, X., et al.: Exploring high-order user preference on the knowledge graph for recommender systems. ACM Trans. Inf. Syst. (TOIS) 37(3), 1–26 (2019)
Li, Z., Liu, H., Zhang, Z., Liu, T., Xiong, N.N.: Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Trans. Neural Netw. Learn. Syst. 33(8), 3961–3973 (2021)
Li, Q., Wang, D., Feng, S., Niu, C., Zhang, Y.: Global graph attention embedding network for relation prediction in knowledge graphs. IEEE Trans. Neural Netw. Learn. Syst. 33(11), 6712–6725 (2021)
Nathani, D., Chauhan, J., Sharma, C., Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp. 4710–4723 (2019)
Zhang, Z., Zhuang, F., Zhu, H., Shi, Z., Xiong, H., He, Q.: Relational graph neural network with hierarchical attention for knowledge graph completion. In: Proceedings of the AAAI conference on artificial intelligence, vol. 34, pp. 9612–9619 (2020)
Zhao, Y., Zhou, H., Xie, R., Zhuang, F., Li, Q., Liu, J.: Incorporating global information in local attention for knowledge representation learning. In Findings of the association for computational linguistics: ACL-IJCNLP 2021, pp. 1341–1351 (2021)
Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2d knowledge graph embeddings. In Thirty-Second AAAI Conference on Artificial Intelligence (2018)
Vashishth, S., Sanyal, S., Nitin, V., Agrawal, N., Talukdar, P.: Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3009–3016 (2020)
Jin, D., Huo, C., Liang, C., Yang, L.: Heterogeneous graph neural network via attribute completion. In: Proceedings of the Web Conference 2021, pp. 391–400 (2021)
Zhao, Y., Zhou, H., Zhang, A., Xie, R., Li, Q., Zhuang, F.: Connecting embeddings based on multiplex relational graph attention networks for knowledge graph entity typing. IEEE Trans. Knowl. Data Eng. 35(5), 4608–4620 (2022)
Zhuo, J., Zhu, Q., Yue, Y., Zhao, Y., Han, W.: A neighborhood-attention fine-grained entity typing for knowledge graph completion. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, pp. 1525–1533 (2022)
Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: Gangemi, A., et al. (ed.) The Semantic Web, ESWC 2018, LNCS, vol. 10843, pp. 593–607. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93417-4_38
Vashishth, S., Sanyal, S., Nitin, V., Talukdar, P.: Composition-based multi-relational graph convolutional networks. In: International Conference on Learning Representations (2020)
Wu, J., Shi, W., Cao, X., Chen, J., Lei, W., Zhang, F., et al.: DisenKGAT: knowledge graph embedding with disentangled graph attention network. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 2140–2149 (2021)
Zhang, X, Zhang, C, Guo, J, Peng, C, Niu, Z, Wu, X , et al.: Graph attention network with dynamic representation of relations for knowledge graph completion. Expert Syst. Appl. 219, 119616 (2023)
Fang, H, Wang, Y, Tian, Z, Ye, Y.: Learning knowledge graph embedding with a dual-attention embedding network. Expert Syst. Appl. 212, 118806 (2023)
Li, Z, Zhao, Y, Zhang, Y, Zhang, Z.: Multi-relational graph attention networks for knowledge graph completion. Knowl.-Based Syst. 251, 109262 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, R., Wang, Y. (2024). Knowledge Graph Reasoning with Bidirectional Relation-Guided Graph Attention Network. In: Jin, H., Pan, Y., Lu, J. (eds) Data Science and Information Security. IAIC 2023. Communications in Computer and Information Science, vol 2059. Springer, Singapore. https://doi.org/10.1007/978-981-97-1280-9_1
Download citation
DOI: https://doi.org/10.1007/978-981-97-1280-9_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-1279-3
Online ISBN: 978-981-97-1280-9
eBook Packages: Computer ScienceComputer Science (R0)