Abstract
The goal of knowledge graph embedding is to represent both entities and relationships as low-dimensional, dense vectors that can be used to empower other machine learning models. While most approaches concentrate on modeling the structural information of the graph, part of the work also focuses on fusing entity descriptions, allowing entities to be fused with richer semantics. However, the complex entity text descriptions contain a lot of noise, which reduces the semantic purity. Therefore, in this paper, we propose a novel sememes-based framework for knowledge graph to streamline the semantic space of entities. More specifically, We replace entity descriptions with a finite set of semantics and encode the sememe labels of entities using a pre-trained Bert model, and finally jointly learning the symbolic triples and sememe labels. The experimental results show that our method outperforms other baselines on the task of link prediction and entity classification.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bloomfield, L.: A set of postulates for the science of language. Language 2(3), 153–164 (1926)
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250 (2008)
Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, pp. 2787–2795 (2013)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Dong, Z., Dong, Q.: HowNet-a hybrid language and knowledge resource. In: International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003, pp. 820–824. IEEE (2003)
Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 249–256 (2010)
Han, X., et al.: Openke: an open toolkit for knowledge embedding. In: Proceedings of EMNLP (2018)
Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (volume 1: Long papers), pp. 687–696 (2015)
Jin, H., et al.: Incorporating Chinese characters of words for lexical sememe prediction. arXiv preprint arXiv:1806.06349 (2018)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of AAAI, pp. 2181–2187 (2015)
Miller, G.A.: Wordnet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)
Qin, Y., et al.: Improving sequence modeling ability of recurrent neural networks via sememes. IEEE/ACM Trans. Audio Speech Lang. Process. 28, 2364–2373 (2020)
Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI, vol. 14, pp. 1112–1119. Citeseer (2014)
Xiao, H.: Bert-as-service. https://github.com/hanxiao/bert-as-service (2018)
Xiao, H., Huang, M., Meng, L., Zhu, X.: SSP: semantic space projection for knowledge graph embedding with text descriptions. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
Xie, R., Liu, Z., Jia, J., Luan, H., Sun, M.: Representation learning of knowledge graphs with entity descriptions. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)
Yi-Xin, Z.: A study on information-knowledge-intelligence transformation. Acta Electronica Sinica 32(4), 16 (2004)
Zhong, Y.: Mechanism-based artificial intelligence theory: a universal theory of artificial intelligence. CAAI Trans. Intell. Syst. 13(1), 2–18 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Cui, Q., Zhou, Y., Zheng, M. (2021). Sememes-Based Framework for Knowledge Graph Embedding with Comprehensive-Information. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management . KSEM 2021. Lecture Notes in Computer Science(), vol 12816. Springer, Cham. https://doi.org/10.1007/978-3-030-82147-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-82147-0_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82146-3
Online ISBN: 978-3-030-82147-0
eBook Packages: Computer ScienceComputer Science (R0)