Abstract
Link prediction in knowledge hypergraphs has been widely recognized as crucial for various downstream tasks of knowledge-enabled applications, from question answering to recommender systems. However, most current approaches are directly extended from binary relation of the knowledge graph to n-ary relation, thus cannot capture entities’ role and positional information in each n-ary tuple. To accommodate the transformation of relations from binary to n-ary in the knowledge hypergraph, in this work, we propose POSE, which exploits the semantic properties of tuples at both role and position levels. POSE explores an embedding space with basis vectors and represents the role and positional information of entities through a linear combination, which promotes similar representations for entities with related roles and the same positions. Then, a relation matrix is further employed to capture the compatibility of both information with all associated entities, and a scoring function is used to measure the plausibility of tuples composed of entities with specific roles and positions. Meanwhile, POSE achieves full theoretical expressiveness and predictive efficiency. Experimental results show that POSE achieves an average improvement of 4.1% on MRR compared to state-of-the-art knowledge hypergraph embedding methods. Our code is available at https://github.com/zirui-chen/POSE.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nickel, M., Tresp, V., Kriegel, H.-P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th International Conference on Machine Learning, pp. 809–816 (2011)
Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 2071–2080 (2016)
Ding, B., Wang, Q., Wang, B., Guo, L.: Improving knowledge graph embedding using simple constraints. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 110–121 (2018)
Bordes, A., Usunier, N., GarciaDuran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multirelational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, pp. 2787–2795 (2013)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2181–2187 (2015b)
Xiao, H., Huang, M., Zhu, X.: TransG: A generative model for knowledge graph embedding. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 2316–2325 (2016)
Ebisu, T., Ichise, R.: TorusE: Knowledge graph embedding on a Lie group. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 1819–1826 (2018)
Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 1112–1119 (2014)
Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., Phung, D.: A novel embedding model for knowledge base completion based on convolutional neural network. In: Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 327–333 (2018)
Nathani, D., Chauhan, J., Sharma, C., Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4710–4723, Florence, Italy (2019)
Wen, J., Li, J., Mao, Y., Chen, S., Zhang, R.: On the representation and embedding of knowledge bases beyond binary relations. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 1300–1307 (2016)
Zhang, R., Li, J., Mei, J., Mao, Y.: Scalable instance reconstruction in knowledge bases via relatedness affiliated embedding. In: Proceedings of the 2018 World Wide Web Conference, pp. 1185–1194 (2018)
Liu, Y., Yao, Q., Li, Y.: Generalizing tensor decomposition for n-ary relational knowledge bases. In: Proceedings of The Web Conference. pp. 1104–1114 (2020)
Guan, S., Jin, X., Wang, Y., Cheng, X.: Link prediction on n-ary relational data. In: Proceedings of the 2019 World Wide Web Conference, pp. 583–593 (2019)
Liu, Y., Yao, Q., Li, Y.: Roleaware modeling for n-ary relational knowledge bases. arXiv preprint arXiv:2104.09780 (2021)
Rosso, P., Yang, D., Cudr’eMauroux, P.: Beyond triplets: Hyper-relational knowledge graph embedding for link prediction. In: Proceedings of The Web Conference, pp. 1885–1896 (2020)
Guan, S., Jin, X., Guo, J., Wang, Y., Cheng, X.: NeuInfer: Knowledge inference on n-ary facts. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6141–6151 (2020)
Fatemi, B., Taslakian, P., Vazquez, D., Poole., D.: Knowledge Hypergraphs, Prediction Beyond Binary Relations. In: IJCAI (2020)
Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: NeurIPS (2018)
Balazevic, I., Allen, C., Hospedales, T: TuckER: Tensor Factorization for Knowledge Graph Completion. In: EMNLP, pp. 5188–5197 (2019)
Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating Embeddings for Modeling Multi-relational Data. In: NeurIPS (2013)
Lacroix, T., Usunier, N., Obozinski, G.: Canonical Tensor Decomposition for Knowledge Base Completion. In: ICML (2018)
Tran, H.N., Takasu, A.: Analyzing Knowledge Graph Embedding Methods from a Multi-embedding Interaction Perspective. arXiv preprint arXiv:1903.11406 (2019)
Wang, Q., Mao, Z., Wang, B., Guo, L.: Knowledge graph embedding: a survey of approaches and applications. TKDE 2912, 2724–2743 (2017)
Sun, Z., Deng, Z.-H., Nie, J.-Y., Tang, J.: RotatE: Knowledge Graph Embedding By Relational Rotation in Complex Space. In: ICLR (2019)
Rossi, A., Barbosa, D., Firmani, D., Matinata, A., Merialdo, P.: Knowledge graph embedding for link prediction: a comparative analysis. ACM Trans. Knowl. Discov. Data 15(2), 1–49 (2021). https://doi.org/10.1145/3424672
Zhang, Z., Cai, J., Zhang, Y., Wang, J.: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, No. 03, pp. 3065–3072 (2020)
Cao, Z., Xu, Q., Yang, Z., Cao, X., Huang, Q.: Dual quaternion knowledge graph embeddings. Proc. AAAI Conf. Artif. Intell. 35(8), 6894–6902 (2021)
Peng, Y., Choi, B., Xu, J.: Graph learning for combinatorial optimization: a survey of state-of-the-art. Data Sci. Eng. 6(2), 119–141 (2021). https://doi.org/10.1007/s41019-021-00155-3
Wawrzinek, J., Pinto, J.M.G., Wiehr, O., Balke, W.-T.: Exploiting latent semantic subspaces to derive associations for specific pharmaceutical semantics. Data Sci. Eng. 5(4), 333–345 (2020). https://doi.org/10.1007/s41019-020-00140-2
Zhang. F., Wang, X., Li, Z., Li, J.: Transrhs: A representation learning method for knowledge graphs with relation hierarchical structure. In: Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pp. 2987–2993 (2021)
Zhu, M., Shen, D., Xu, L., Wang, X.: Scalable multi-grained cross-modal similarity query with interpretability. Data Sci. Eng. 6(3), 280–293 (2021). https://doi.org/10.1007/s41019-021-00162-4
Wu, S., Zhang, Y., Gao, C., Bian, K., Cui, B.: GARG: anonymous recommendation of point-of-interest in mobile networks by graph convolution network. Data Sci. Eng. 5(4), 433–447 (2020). https://doi.org/10.1007/s41019-020-00135-z
Acknowledgements
This work is supported by the National Key R &D Program of China (2020AAA0108504) and National Natural Science Foundation of China (61972275).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, Z., Wang, X., Wang, C., Li, Z. (2023). POSE: A Positional Embedding Model for Knowledge Hypergraph Link Prediction. In: Li, B., Yue, L., Tao, C., Han, X., Calvanese, D., Amagasa, T. (eds) Web and Big Data. APWeb-WAIM 2022. Lecture Notes in Computer Science, vol 13422. Springer, Cham. https://doi.org/10.1007/978-3-031-25198-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-25198-6_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25197-9
Online ISBN: 978-3-031-25198-6
eBook Packages: Computer ScienceComputer Science (R0)