ABSTRACT
Question answering over knowledge graph is an important area of research within question answering. Existing methods mainly focus on the utilization of information in knowledge graphs and ignore the abundant external information of entities. However, knowledge graphs are usually incomplete and entities in knowledge graphs are not completely described. In this paper, we propose a novel text-enhanced question answering model over knowledge graph by taking advantage of the rich context information in a text corpus. We believe the rich textual context information can effectively alleviate the information loss in knowledge graphs and enhance the knowledge representation capability in the answer end. To this end, we apply an attention model to realize dynamic fusion of internal and external information. Besides, Transformer Encoder network is used to obtain the representation of input question and descriptive text. The experiments on the WebQuestions dataset prove that compared with other state-of-the-art QA methods, our method can effectively improve the accuracy.
- Abdalghani Abujabal, Mohamed Yahya, Mirek Riedewald, and Gerhard Weikum. 2017. Automated Template Generation for Question Answering over Knowledge Graphs. In the 26th International Conference.Google ScholarDigital Library
- Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on freebase from question-answer pairs. In Proceedings of the 2013 conference on empirical methods in natural language processing. 1533–1544.Google Scholar
- K. Bollacker. 2008. Freebase : A collaboratively created graph database for structuring human knowledge. Proc. SIGMOD’ 08 (2008).Google ScholarDigital Library
- Antoine Bordes, Sumit Chopra, and Jason Weston. 2014. Question answering with subgraph embeddings. arXiv preprint arXiv:1406.3676(2014).Google Scholar
- Antoine Bordes, Nicolas Usunier, Sumit Chopra, and Jason Weston. 2015. Large-scale simple question answering with memory networks. arXiv preprint arXiv:1506.02075(2015).Google Scholar
- Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Neural Information Processing Systems (NIPS). 1–9.Google Scholar
- J. Devlin, M. W. Chang, K. Lee, and K. Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. (2018).Google Scholar
- Li Dong, Furu Wei, Ming Zhou, and Ke Xu. 2015. Question Answering over Freebase with Multi-Column Convolutional Neural Networks. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers).Google ScholarCross Ref
- Yanchao Hao, Yuanzhe Zhang, Kang Liu, Shizhu He, and Jun Zhao. 2017. An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).Google ScholarCross Ref
- Sen Hu, Lei Zou, Jeffrey Xu Yu, Haixun Wang, and Dongyan Zhao. 2017. Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs. IEEE Transactions on Knowledge and Data Engineering (2017).Google Scholar
- Jayant Krishnamurthy and Tom M. Mitchell. 2012. Weakly Supervised Training of Semantic Parsers. In Joint Conference on Empirical Methods in Natural Language Processing & Computational Natural Language Learning.Google Scholar
- Percy Liang, Michael I. Jordan, and Dan Klein. 2013. Learning dependency-based compositional semantics. Computational Linguistics 39, 2 (2013), 389–446.Google ScholarDigital Library
- Md Mostafizur Rahman and Atsuhiro Takasu. 2020. Leveraging Entity-Type Properties in the Relational Context for Knowledge Graph Embedding. IEICE Transactions on Information and Systems E103.D, 5(2020), 958–968.Google Scholar
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. arXiv (2017).Google Scholar
- Zhigang Wang, Juanzi Li, Zhiyuan Liu, and Jie Tang. 2016. Text-enhanced representation learning for knowledge graph. In Proceedings of International Joint Conference on Artificial Intelligent (IJCAI). 4–17.Google Scholar
- Yuk Wah Wong and Raymond J. Mooney. 2007. Learning Synchronous Grammars for Semantic Parsing with Lambda Calculus. In Acl, Meeting of the Association for Computational Linguistics, June, Prague, Czech Republic.Google Scholar
- Ruobing Xie, Zhiyuan Liu, Maosong Sun, 2016. Representation Learning of Knowledge Graphs with Hierarchical Types.. In IJCAI. 2965–2971.Google Scholar
- Kun Xu, Yansong Feng, Songfang Huang, and Dongyan Zhao. 2016. Hybrid question answering over knowledge base and free text. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 2397–2407.Google Scholar
- Kun Xu, Siva Reddy, Yansong Feng, Songfang Huang, and Dongyan Zhao. 2016. Question answering on freebase via relation extraction and textual evidence. arXiv preprint arXiv:1603.00957(2016).Google Scholar
Index Terms
- Text-Enhanced Question Answering over Knowledge Graph
Recommendations
Knowledge Base Question Answering System Based on Knowledge Graph Representation Learning
ICIAI '20: Proceedings of the 2020 the 4th International Conference on Innovation in Artificial IntelligenceKnowledge Base Question Answering (KBQA) refers that questions are answered by acquiring the relationship or entity from knowledge graph. The knowledge base is being high frequent used in modern question answering systems, which can find the exact ...
Knowledge Graph Embedding Based Question Answering
WSDM '19: Proceedings of the Twelfth ACM International Conference on Web Search and Data MiningQuestion answering over knowledge graph (QA-KG) aims to use facts in the knowledge graph (KG) to answer natural language questions. It helps end users more efficiently and more easily access the substantial and valuable knowledge in the KG, without ...
Multi-space Knowledge Enhanced Question Answering over Knowledge Graph
Web and Big DataAbstractKnowledge graph question answering (KG-QA) accesses the substantial knowledge to return a comprehensive answer in a more user-friendly solution. Recently, the embedding-based methods to KG-QA have always been hot issues. Traditional embedding-...
Comments