Abstract
Relation prediction is one of the important tasks of knowledge graph completion, which aims to predict the missing links between entities. Although many different methods have been proposed, most of them usually follow the closed-world assumption. Specifically, these methods simply treat the unknown triples as errors, which will result in the loss of valuable information contained in the knowledge graphs (KGs). In addition, KGs exist large amounts of long-tail relations, which lack sufficient triples for training, and these relations will seriously affect inference performance. In order to address above-mentioned problems, we propose a novel relation prediction method based on three-way decisions, namely RP-TWD. In this paper, RP-TWD model first obtains the similarity between relations by K-Nearest Neighbors (KNN) to model the semantic associations between them. The semantic association between relations can be considered as supplementary information of long-tail relations, and constrain the learning of KG embeddings. Then, based on the idea of three-way decisions (TWD), the triples of specific relation are further divided into three disjoint regions, namely positive region (POS), boundary region (BND), and negative region (NEG). The introduction of BND intends to represent the uncertainty information contained in unknown triples. The experimental results show that our model has significant advantages in the task of relation prediction compared with baselines.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aranda-Corral, G.A., Borrego-DÃaz, J., Galán Páez, J.: A model of three-way decisions for knowledge harnessing. Int. J. Approx. Reason. 120, 184–202 (2020). https://doi.org/10.1016/j.ijar.2020.02.010
Bollacker, K.D., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Sigmod Conference (2008)
Bordes, A., Glorot, X., Weston, J., Bengio, Y.: A semantic matching energy function for learning with multi-relational data. Mach. Learn. 94(2), 233–259 (2014)
Bordes, A., Usunier, N., Garcia-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS 2013, vol. 2, p. 2787–2795. Curran Associates Inc., Red Hook (2013)
Ebisu, T., Ichise, R.: Toruse: Knowledge graph embedding on a lie group. arXiv preprint arXiv:1711.05435 (2017)
Gaeta, A., Loia, V., Orciuoli, F.: A method based on graph theory and three way decisions to evaluate critical regions in epidemic diffusion. Appl. Intell. 51(5), 2939–2955 (2021). https://doi.org/10.1007/s10489-020-02173-6
Huang, X., Zhang, J., Li, D., Li, P.: Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113 (2019)
Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 687–696 (2015)
Kaminski, M., Grau, B.C., Kostylev, E.V., Motik, B., Horrocks, I.: Foundations of declarative data analysis using limit datalog programs. CoRR abs/1705.06927 (2017). http://arxiv.org/abs/1705.06927
Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Advances in Neural Information Processing Systems, pp. 4284–4295 (2018)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI 2015, pp. 2181–2187. AAAI Press (2015)
Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)
Shadbolt, N., Hall, W., Berners-Lee, T.: The semantic web revisited. IEEE Intell. Syst. 21(3), 96–101 (2006)
Sun, Z., Deng, Z., Nie, J., Tang, J.: Rotate: knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197 (2019)
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., Bouchard, G.: Complex embeddings for simple link prediction. In: International Conference on Machine Learning (ICML) (2016)
Wang, H., Ren, H., Leskovec, J.: Entity context and relational paths for knowledge graph completion. arXiv preprint arXiv:2002.06757 (2020)
Wang, H., Zhao, M., Xie, X., Li, W., Guo, M.: Knowledge graph convolutional networks for recommender systems. In: The World Wide Web Conference, WWW 2019, pp. 3307–3313. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3308558.3313417
Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI, vol. 14, pp. 1112–1119. Citeseer (2014)
Xiong, C., Power, R., Callan, J.: Explicit semantic ranking for academic search via knowledge graph embedding. In: Proceedings of the 26th International Conference on World Wide Web, WWW 2017, pp. 1271–1279. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE (2017). https://doi.org/10.1145/3038912.3052558
Yang, B., Mitchell, T.: Leveraging knowledge bases in LSTMs for improving machine reading. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (2017)
Yao, Y.: Three-way decisions with probabilistic rough sets. Inf. Sci. 180(3), 341–353 (2010)
Yu, H., Liu, Z., Wang, G.: An automatic method to determine the number of clusters using decision-theoretic rough set. Int. J. Approx. Reason. 55(1), 101–115 (2014)
Zhang, S., Tay, Y., Yao, L., Liu, Q.: Quaternion knowledge graph embeddings. In: Advances in Neural Information Processing Systems, pp. 2735–2745 (2019)
Zhang, Z., Zhuang, F., Qu, M., Lin, F., He, Q.: Knowledge graph embedding with hierarchical relation structure. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 3198–3207 (2018)
Zhou, B., Yao, Y., Luo, J.: Cost-sensitive three-way email spam filtering. J. Intell. Inform. Syst. 42(1), 19–45 (2014)
Acknowledgements
This work was jointly supported by the National Natural Science Foundation of China (61876027, 61751312, 61533020), and the Natural Science Foundation of Chongqing (cstc2019jcyj-cxttX0002).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Peng, Z., Yu, H. (2021). Knowledge Graph Representation Learning for Link Prediction with Three-Way Decisions. In: Ramanna, S., Cornelis, C., Ciucci, D. (eds) Rough Sets. IJCRS 2021. Lecture Notes in Computer Science(), vol 12872. Springer, Cham. https://doi.org/10.1007/978-3-030-87334-9_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-87334-9_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87333-2
Online ISBN: 978-3-030-87334-9
eBook Packages: Computer ScienceComputer Science (R0)