Abstract
Knowledge Graph Completion (KGC) aims to fill the missing facts in Knowledge Graphs (KGs). Due to the most real-world KGs evolve quickly with new entities and relations being added by the minute, the dynamic KGC task is more practical than static KGC task because it can be easily to scale up the KGs by add new entities and relations. Most existing dynamic KGC models are ignore the dependency between multi-source information and topology-structure so that they lose very much semantic information in KGs. In this paper, we proposed a novel dynamic KGC model with jointly structural and textual dependency based on deep recurrent neural network (DKGC-JSTD). This model learns embedding of entity’s name and parts of its text-description to connect unseen entities to KGs. In order to establish the relevance between text description information and topology information, DKGC-JSTD uses deep memory network and association matching mechanism to extract relevant semantic feature information between entity and relations from entity text-description. And then using deep recurrent neural network to model the dependency between topology-structure and text-description. Experiments on large data sets, both old and new, show that DKGC-JSTD performs well in the dynamic KGC task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bollacker, K., et al.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD, International Conference on Management of Data, pp. 1247–1250 (2008). ACM
Auer, S., et al.: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) The Semantic Web. Lecture Notes in Computer Science, vol. 4825, pp. 722–735. Springer, Berlin, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76298-0_52
Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. 45(11), 2673–2681 (1997)
Bordes, A., et al.: Translating embeddings for modeling multi-relational data. In: Burges, C.J.C., et al.: Advances in Neural Information Processing Systems, pp. 2787–2795. Curran Associates, Inc. (2013)
Wang, Z., et al.: Knowledge graph embedding by translating on hyperplanes. In: Twenty-Eighth AAAI Conference on Artificial Intelligence. AAAI Press (2014)
Lin, Y., et al.: Learning entity and relation embeddings for knowledge graph completion. In: Twenty-Ninth AAAI Conference on Artificial Intelligence. AAAI Press (2015)
Ji, G., et al.: Knowledge graph embedding via dynamic mapping matrix. In: Meeting of the Association for Computational Linguistics & International Joint Conference on Natural Language Processing. AAAI Press (2015)
Ebisu, T., Ichise, R.: Toruse: knowledge graph embedding on a lie group. In: Thirty-Second AAAI Conference on Artificial Intelligence. AAAI Press (2018)
Dettmers, T., et al.: Convolutional 2D knowledge graph embeddings. In: Thirty-Second AAAI Conference on Artificial Intelligence. AAAI Press (2018)
Nguyen, D.Q., et al.: A capsule network-based embedding model for knowledge graph completion and search personalization. arXiv preprint arXiv:1808.04122 (2018)
Guo, L., Sun, Z., Hu, W.: Learning to exploit long-term relational dependencies in knowledge graphs. arXiv preprint arXiv:1905.04914 (2019)
Jiang, T., et al.: Towards time-aware knowledge graph completion. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 1715–1724 (2016)
Wang, Z., Li, J.Z.: Text-enhanced representation learning for knowledge graph. In: IJCAI, pp. 1293–1299 (2016)
Xie, R., et al.: Representation learning of knowledge graphs with entity descriptions. In: Thirtieth AAAI Conference on Artificial Intelligence, pp. 2659–2665 (2016)
Xiao, H., et al.: SSP: semantic space projection for knowledge graph embedding with text descriptions. In: Thirty-First AAAI Conference on Artificial Intelligence. AAAI Press (2017)
Dai, S., et al.: Learning entity and relation embeddings with entity description for knowledge graph completion. In: 2018 2nd International Conference on Artificial Intelligence: Technologies and Applications (ICAITA 2018). Atlantis Press (2018)
Chen, M., et al.: Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment (2018)
An, B., et al.: Accurate text-enhanced knowledge graph representation learning. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational (2018)
Xu, J., et al. Knowledge graph representation with jointly structural and textual encoding, 1318–1324. arXiv preprint arXiv:1611.08661 (2017)
Shi, B., Weninger, T.: Open-world knowledge graph completion. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)
Zhou, B., et al.: Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921–2929 (2016)
Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Acknowledgements
This research is supported by the Scientific Research Platforms and Projects in Universities in Guangdong Province under Grants 2019KTSCX204.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xie, W., Wang, S., Wei, Y., Zhao, Y., Fu, X. (2020). Dynamic Knowledge Graph Completion with Jointly Structural and Textual Dependency. In: Qiu, M. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2020. Lecture Notes in Computer Science(), vol 12453. Springer, Cham. https://doi.org/10.1007/978-3-030-60239-0_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-60239-0_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60238-3
Online ISBN: 978-3-030-60239-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)