Abstract
Distantly supervised relation extraction (RE) has been an effective way to find novel relational facts from text without a large amount of well-labeled training data. However, distant supervision always suffers from wrong labelling problem. Many neural approaches have been proposed to alleviate this problem recently, but none of them can make use of the rich semantic knowledge in the knowledge bases (KBs). In this paper, we propose a knowledge-aware attention model, which can leverage the semantic knowledge in the KB to select the valid sentences. Furthermore, based on knowledge representation learning (KRL), we formalize distantly supervised RE as relation retrieval instead of relation classification to leverage the semantic knowledge further. Experimental results on widely used datasets show that our approaches significantly outperform the popular benchmark methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) ASWC/ISWC -2007. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76298-0_52
Bollacker, E.K., Paritosh, C., Sturge, P., Taylor, T.: Freebase: a collaboratively created graph database for structuring human knowledge. In: SIGMOD Conference, pp. 1247–1250 (2008)
Bordes, A., Usunier, N., Weston, J.: Translating embeddings for modeling multi-relational. In: International Conference on Neural Information Processing Systems, pp. 2787–2795 (2013)
Bunescu, R., Mooney, R.: Learning to extract relations from the web using minimal supervision. In: ACL, pp. 576–583 (2007)
Thomas, G., Richard, H.: Solving the multiple instance problem with axis-parallel rectangles. J. Artif. Intell. 89(12), 31–71 (1997)
Geoffrey, E., Srivastava, N., Krizhevsky, A., Sutskever, I., Ruslan, R.: Improving neural networks by preventing co-adaptation of feature detectors. J. Comput. Sci. 3(4), 212–223 (2012)
Hoffmann, H., Zhang, C., Ling, X., Zettlemoyer, L., Daniel, W.: Knowledge-based weak supervision for information extraction of overlapping relations. In: Meeting of the Association for Computational Linguistics (ACL), pp. 541–550 (2011)
Ji, G., Liu, K., He, S., Zhao, J.: Distant supervision for relation extraction with sentence-level attention and entity descriptions. In: AAAI, pp. 3060–3066 (2017)
Lin, Y., Liu, Z., Sun, M.: Knowledge representation learning with entities, attributes and relations. J. Ethnicity 1, 41–52 (2016a)
Lin, Y., Liu, Z., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp. 2181–2187 (2015)
Lin, Y., Shen, S., Liu, Z., Luan, H., Sun, M.: Neural relation extraction with selective attention over instances. In: ACL, pp. 2124–2133 (2016)
Lukovnikov, D., Fischer, A., Lehmann, J., Auer, S.: Neural network-based question answering over knowledge graphs on word and character level. In: Proceedings of International Conference on World Wide Web (WWW), pp. 1211–1220 (2017)
Luong, M., Pham, H., Manning, C.: Effective approaches to attention based neural machine translation. J. Comput. Sci. (2015)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS, pp. 3111–3119 (2013)
Mintz, M., Bills, S., Jurafsky, D.: Distant supervision for relation extraction without labeled data. In: Joint Conference of the Meeting of the ACL and the International Joint Conference on Natural Language Processing of the AFNLP, pp. 1003–1011 (2009)
Mitra, B., Craswell, N.: Neural models for information retrieval. CoRR, abs/1705.01509 (2017)
Riedel, S., Yao, L., Mccallum, A.: Modeling relations and their mentions without labeled text. In: European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 148–163 (2010)
See, A., Liu, P., Manning, C.: Get to the point: summarization with pointer generator networks. In: ACL, pp. 1073–1083 (2017)
Shen, Y., He, X., Gao, J., Deng, L., Mesnil, G.: A latent semantic model with convolutional-pooling structure for information retrieval. In: Proceedings of ACM International Conference on Conference on Information and Knowledge Management, (CIKM), pp. 101–110 (2014)
Baoxu, S.B., Weninger, T.: Open-world knowledge graph completion. In: AAAI (2018)
Surdeanu, M., Tibshirani, J., Nallapati, R., Manning, C.: Multi-instance multi-label learning for relation extraction. In: Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 455–465 (2012)
Tan, M., Santos, C., Xiang, B., Zhou, B.: Improved representation learning for question answer matching. In: ACL, pp. 464–473 (2016)
Yang, B., Mitchell, T.: Leveraging knowledge bases in LSTMs for improving machine reading. In: ACL, pp. 1436–1446 (2017)
Yao, X., Durme, B.: Information extraction over structured data: question answering with freebase. In: ACL, pp. 956–966 (2014)
Zeng, D., Liu, K., Chen, Y., Zhao, J.: Distant supervision for relation extraction via piecewise convolutional neural networks. In: EMNLP, pp. 1753–1762 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, X., Deng, K., Zhang, L., Tan, Z., Liu, J. (2019). Knowledge-Aware and Retrieval-Based Models for Distantly Supervised Relation Extraction. In: Nayak, A., Sharma, A. (eds) PRICAI 2019: Trends in Artificial Intelligence. PRICAI 2019. Lecture Notes in Computer Science(), vol 11670. Springer, Cham. https://doi.org/10.1007/978-3-030-29908-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-29908-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29907-1
Online ISBN: 978-3-030-29908-8
eBook Packages: Computer ScienceComputer Science (R0)