Abstract
Knowledge graphs (KGs) play a pivotal role in various real-world applications, but they are frequently plagued by incomplete information, which manifests in the form of missing entities. Link prediction, which aims to infer missing entities given existing facts, has been mostly addressed by maximizing the likelihood of observed triplets at the instance level. However, they ignore the semantic information most KGs contain and the prior knowledge implied by the semantic information. To address this limitation, we propose a Type-Augmented Link Prediction (TALP) approach, which builds a hierarchical feature model, computes type feature weights, trains them to be specific to different relations, encodes weights into prior probabilities and convolutional encodes instance-level information into likelihood probabilities; finally, combining them via Bayes rule to compute the posterior probabilities of entity prediction. Our proposed TALP approach achieves significantly better performance than existing methods on link prediction benchmark datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Huang, X., Zhang, J., Li, D., Li, P.: Knowledge graph embedding based question answering. In: Culpepper, J.S., Moffat, A., Bennett, P.N., Lerman, K. (eds.) Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC, Australia, February 11–15, 2019, pp. 105– 113. ACM (2019)
Wang, X., He, X., Cao, Y., Liu, M., Chua, T.: KGAT: knowledge graph attention network for recommendation. In: Teredesai, A., Kumar, V., Li, Y., Rosales, R., Terzi, E., Karypis, G. (eds.) Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4–8, 2019, pp. 950–958. ACM (2019)
Xu, H., Bao, J., Zhang, G.: Dynamic knowledge graph-based dialogue generation with improved adversarial meta-learning. CoRR abs/2004.08833 (2020)
Kapanipathi, P., et al.: Infusing knowledge into the textual entailment task using graph convolutional networks. In: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7–12, 2020, pp. 8074–8081. AAAI Press (2020)
Tang Z, Du L. A Knowledge Graph Embedding Model Based on Node-Relation Fusion Perception. In: 2020 The 9th International Conference on Networks, Communication and Computing, pp. 65–70 (2020)
Hao, J., Chen, M., Yu, W., Sun, Y., Wang, W.: Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In: Teredesai, A., Kumar, V., Li, Y., Rosales, R., Terzi, E., Karypis, G. (eds.) Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4–8, 2019, pp. 1709–1719. ACM (2019)
LeCun, Y., Bottou, L., Bengio, Y., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
West, R., Gabrilovich, E., Murphy, K., Sun, S., Gupta, R., Lin, D.: Knowledgebase completion via search-based question answering. In: Chung, C., Broder, A.Z.,Shim, K., Suel, T. (eds.) 23rd International Worldwide Web Conference, WWW’14, Seoul, Republic of Korea, April 7–11, 2014, pp. 515–526. ACM (2014)
Bordes, A., Usunier, N., GarcÃa-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modelling multirelational data. In: NIPS (2013)
Zong, C., Strube, M.: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 2: Short papers). In: International Joint Conference on Natural Language Processing (2015)
Ma, S., Ding, J., Jia, W., Wang, K., Guo, M.: Transt: Type-based multiple embedding representations for knowledge graph completion. In: ECML/PKDD (2017)
Zhao, L., Akoglu, L.: Pairnorm: Tackling oversmoothing in gnns. vol. abs/1909.12223 (2019)
Balazevic, I., Allen, C., Hospedales, T.M.: Hypernetwork knowledge graph embeddings. In: ICANN (2021)
Leis, V., Kemper, A., Neumann, T.: The adaptive radix tree: Artful indexing for main-memory databases, pp. 38–49 (2013)
Cui Z, Kapanipathi P, Talamadupula K, et al.: Type-augmented relation prediction in knowledge graphs. In: Proceedings of the AAAI Conference on Artificial Intelligence vol. 35(8), pp. 7151–7159 (2021)
Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2d knowledge graph embeddings. In: McIlraith, S.A., Weinberger, K.Q. (eds.) Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2–7, 2018, pp. 1811–1818. AAAI Press (2018)
Vashishth, S., Sanyal, S., Nitin, V., Agrawal, N., Talukdar, P.P. : Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. In: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7–12, 2020, pp. 3009–3016. AAAI Press (2020)
Bordes, A., Usunier, N., GarcÃa-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modelling multirelational data. In: Burges, C.J.C., Bottou, L., Ghahramani, Z., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5–8, 2013, Lake Tahoe,Nevada, United States, pp. 2787–2795 (2013)
Hao, J., Chen, M., Yu, W., et al.: Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1709–1719 (2019)
Suchanek F M, Kasneci G, Weikum G. Yago: a core of semantic knowledge. In: Proceedings of the 16th international conference on Worldwide Web, pp. 697–706 (2007)
Acknowledgement
This work was supported by the National Key R&D Program of China under Grant No. 2020YFB1710200.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Luo, E., Li, L., Tao, W. (2023). Type-Augmented Link Prediction Based on Bayesian Formula. In: Yu, Z., et al. Data Science. ICPCSEE 2023. Communications in Computer and Information Science, vol 1880. Springer, Singapore. https://doi.org/10.1007/978-981-99-5971-6_22
Download citation
DOI: https://doi.org/10.1007/978-981-99-5971-6_22
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-5970-9
Online ISBN: 978-981-99-5971-6
eBook Packages: Computer ScienceComputer Science (R0)