Hailin Wang
ABSTRACT
Knowledge, data, algorithms and computing power are the foundations of artificial intelligence (AI), for which knowledge is the most powerful support. An effective way to acquire knowledge, called Relation Extraction (RE), is beneficial to knowledge graph completion, path inference, logical rule reasoning, and many other AI tasks. In this survey, we provide a comprehensive review on deep neural networks (DNNs) based RE covering some main research topics about: 1) general framework, 2) supervised and distant supervised RE, 3) future research directions. General framework provides a full-view summarization on traditional methods, main component and basic conceptions of DNN-based RE. For supervised and distant supervised RE, this part summarizes DNN-based RE methods into a new taxonomies on these topics. In the end, to facilitate future research on RE, we also discuss some obstacles.
- Eugene Agichtein and Luis Gravano. 2000. Snowball: Extracting Relations from Large Plain-Text Collections. Digital Libraries I, (2000), 85–94. DOI:https://doi.org/10.1145/336597.336644Google Scholar
Digital Library
- Siddhartha Banerjee and Kostas Tsioutsiouliklis. 2018. Relation Extraction using Multi-Encoder LSTM Network on a Distant Supervised Dataset. 2018 IEEE 12th International Conference on Semantic Computing (ICSC) (2018), 235–238. DOI:https://doi.org/10.1109/ICSC.2018.00040Google ScholarCross Ref
- Sergey Brin. 2006. Extracting Patterns and Relations from the World Wide Web. (2006), 172–183. DOI:https://doi.org/10.1007/10704656_11Google Scholar
- Rui Cai, Xiaodong Zhang, and Houfeng Wang. 2016. Bidirectional recurrent convolutional neural network for relation classification. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 756–765.Google ScholarCross Ref
- Shimin Di, Yanyan Shen, and Lei Chen. 2019. Relation extraction via domain-aware transfer learning. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2019), 1348–1357. DOI:https://doi.org/10.1145/3292500.3330890Google ScholarDigital Library
- Jinhua Du, Jingguang Han, Andy Way, and Dadong Wan. 2018. Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction. arXiv preprint arXiv:1809.00699 (2018).Google Scholar
- Tsu-Jui Fu, Peng-Hsuan Li, and Wei-Yun Ma. 2019. GraphRel: Modeling text as relational graphs for joint entity and relation extraction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 1409–1418.Google ScholarCross Ref
- Xiaoyu Guo, H U I Zhang, Haijun Yang, Lianyuan Xu, and Zhiwen Ye. 2019. A Single Attention-Based Combination of CNN and RNN for Relation Classification. IEEE Access 7, (2019), 12467–12475. DOI:https://doi.org/10.1109/ACCESS.2019.2891770Google Scholar
- Xu Han, Hao Zhu, Pengfei Yu, Ziyun Wang, Yuan Yao, Zhiyuan Liu, and Maosong Sun. 2018. Fewrel: A large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. arXiv preprint arXiv:1810.10147 (2018).Google Scholar
- Takaaki Hasegawa, Satoshi Sekine, and Ralph Grishman. 2004. Discovering relations among named entities from large corpora. In Proceedings of the 42nd annual meeting on association for computational linguistics, 415.Google ScholarDigital Library
- Marti A Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In Proceedings of the 14th conference on Computational linguistics-Volume 2, 539–545.Google ScholarDigital Library
- Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. 2009. Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. In Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions, 94–99.Google ScholarCross Ref
- Guoliang Ji, Kang Liu, Shizhu He, and Jun Zhao. 2017. Distant supervision for relation extraction with sentence-level attention and entity descriptions. In Thirty-First AAAI Conference on Artificial Intelligence.Google ScholarDigital Library
- Xiaotian Jiang, Quan Wang, Peng Li, and Bin Wang. 2016. Relation extraction with multi-instance multi-label convolutional neural networks. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 1471–1480.Google Scholar
- Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. (2014). Retrieved from http://arxiv.org/abs/1408.5882Google Scholar
- Shantanu Kumar. 2017. A survey of deep learning methods for relation extraction. arXiv preprint arXiv:1705.03645 (2017).Google Scholar
- Joohong Lee, Sangwoo Seo, and Yong Suk Choi. 2019. Semantic Relation Classification via Bidirectional LSTM Networks with Entity-aware Attention using Latent Entity Typing. arXiv preprint arXiv:1901.08163 (2019).Google Scholar
- Yankai Lin, Zhiyuan Liu, and Maosong Sun. 2017. Neural relation extraction with multi-lingual attention. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 34–43.Google ScholarCross Ref
- Yankai Lin, Shiqi Shen, Zhiyuan Liu, Huanbo Luan, and Maosong Sun. 2016. Neural relation extraction with selective attention over instances. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2124–2133.Google ScholarCross Ref
- ChunYang Liu, WenBo Sun, WenHan Chao, and Wanxiang Che. 2013. Convolution neural network for relation extraction. In International Conference on Advanced Data Mining and Applications, 231–242.Google ScholarDigital Library
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).Google Scholar
- Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2, 1003–1011.Google ScholarDigital Library
- Raymond J Mooney and Razvan C Bunescu. 2006. Subsequence kernels for relation extraction. In Advances in neural information processing systems, 171–178.Google Scholar
- Guoshun Nan, Zhijiang Guo, Ivan Sekulic, and Wei Lu. 2020. Reasoning with Latent Structure Refinement for Document-Level Relation Extraction. 2018 (2020), 1546–1557. DOI:https://doi.org/10.18653/v1/2020.acl-main.141Google Scholar
- Thien Huu Nguyen and Ralph Grishman. 2015. Relation extraction: Perspective from convolutional neural networks. In Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, 39–48.Google ScholarCross Ref
- Sachin Pawar, Girish K. Palshikar, and Pushpak Bhattacharyya. 2017. Relation Extraction: A Survey. (2017), 1–51. Retrieved from http://arxiv.org/abs/1712.05191Google Scholar
- Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 1532–1543.Google ScholarCross Ref
- Pengda Qin, Weiran Xu, and William Yang Wang. 2018. Robust distant supervision relation extraction via deep reinforcement learning. arXiv preprint arXiv:1805.09927 (2018).Google Scholar
- Pengda Qin, Weiran Xu, and William Yang Wang. 2018. Dsgan: Generative adversarial training for distant supervision relation extraction. arXiv preprint arXiv:1805.09929 (2018).Google Scholar
- Feiliang Ren, Di Zhou, Zhihui Liu, Yongcheng Li, Rongsheng Zhao, Yongkang Liu, and Xiaobo Liang. 2018. Neural relation classification with text descriptions. In Proceedings of the 27th International Conference on Computational Linguistics, 1167–1177.Google Scholar
- Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling relations and their mentions without labeled text. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 148–163.Google ScholarDigital Library
- Bryan Rink and Sanda Harabagiu. 2010. Utd: Classifying semantic relations by combining lexical and semantic resources. In Proceedings of the 5th International Workshop on Semantic Evaluation, 256–259.Google ScholarDigital Library
- Sunil Kumar Sahu, Fenia Christopoulou, Makoto Miwa, and Sophia Ananiadou. 2019. Inter-sentence relation extraction with document-level graph convolutional neural network. arXiv preprint arXiv:1906.04684 (2019).Google Scholar
- Cicero Nogueira dos Santos, Bing Xiang, and Bowen Zhou. 2015. Classifying relations by ranking with convolutional neural networks. arXiv preprint arXiv:1504.06580 (2015).Google Scholar
- Changzhi Sun and Yuanbin Wu. 2019. Distantly supervised entity relation extraction with adapted manual annotations. 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019 (2019), 7039–7046. DOI:https://doi.org/10.1609/aaai.v33i01.33017039Google ScholarDigital Library
- Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th annual meeting of the association for computational linguistics, 384–394.Google Scholar
- Shikhar Vashishth, Rishabh Joshi, Sai Suman Prayaga, Chiranjib Bhattacharyya, and Partha Talukdar. 2018. RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 1257–1266.Google ScholarCross Ref
- Guanying Wang, Wen Zhang, Ruoxu Wang, Yalin Zhou, Xi Chen, Wei Zhang, Hai Zhu, and Huajun Chen. 2018. Label-free distant supervision for relation extraction via knowledge graph embedding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2246–2255.Google ScholarCross Ref
- Hailin Wang, Ke Qin, Guoming Lu, Guangchun Luo, and Guisong Liu. 2020. Knowledge-Based Systems Direction-sensitive relation extraction using Bi-SDP attention model. Knowledge-Based Systems 198, (2020), 105928. DOI:https://doi.org/10.1016/j.knosys.2020.105928Google Scholar
- Linlin Wang, Zhu Cao, Gerard de Melo, and Zhiyuan Liu. 2016. Relation Classification via Multi-Level Attention CNNs. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (2016), 1298–1307. DOI:https://doi.org/10.18653/v1/P16-1123Google ScholarCross Ref
- Minguang Xiao and Cong Liu. 2016. Semantic relation classification via hierarchical recurrent neural network with attention. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 1254–1263.Google Scholar
- Kun Xu, Yansong Feng, Songfang Huang, and Dongyan Zhao. 2015. Semantic relation classification via convolutional neural networks with simple negative sampling. arXiv preprint arXiv:1506.07650 (2015).Google Scholar
- Yan Xu, Ran Jia, Lili Mou, Ge Li, Yunchuan Chen, Yangyang Lu, and Zhi Jin. 2016. Improved relation classification by deep recurrent neural networks with data augmentation. arXiv preprint arXiv:1601.03651 (2016).Google Scholar
- Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, and Zhi Jin. 2015. Classifying relations via long short term memory networks along shortest dependency paths. In proceedings of the 2015 conference on empirical methods in natural language processing, 1785–1794.Google ScholarCross Ref
- Linyi Yang, Tin Lok, James Ng, Catherine Mooney, and Ruihai Dong. Multi-level Attention-Based Neural Networks for Distant Supervised Relation Extraction.Google Scholar
- Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, and Maosong Sun. 2020. Docred: A large-scale document-level relation extraction dataset. ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (2020), 764–777.Google Scholar
- Daojian Zeng, Kang Liu, Yubo Chen, and Jun Zhao. 2015. Distant supervision for relation extraction via piecewise convolutional neural networks. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 1753–1762.Google ScholarCross Ref
- Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation Classification via Convolutional Deep Neural Network. Proceedings of the 25th International Conference on Computational Linguistics (COLING’14) 2011 (2014), 2335–2344. DOI:https://doi.org/http://aclweb.org/anthology/C/C14/C14-1220.pdfGoogle Scholar
- Chunyun Zhang, Chaoran Cui, Sheng Gao, L U Yang, Xiaoming Xi, and Yilong Yin. 2019. Multi-Gram CNN-Based Self-Attention Model for Relation Classification. IEEE Access 7, (2019), 5343–5357. DOI:https://doi.org/10.1109/ACCESS.2018.2888508Google ScholarCross Ref
- Dongxu Zhang and Dong Wang. 2015. Relation Classification via Recurrent Neural Network. August (2015). DOI:https://doi.org/http://aclweb.org/anthology/C/C14/C14-1220.pdfGoogle Scholar
- Lei Zhang and Fusheng Xiang. 2018. Relation classification via BiLSTM-CNN. In International Conference on Data Mining and Big Data, 373–382.Google ScholarDigital Library
- Ningyu Zhang, Shumin Deng, Zhanlin Sun, Jiaoyan Chen, Wei Zhang, and Huajun Chen. 2019. Transfer Learning for Relation Extraction via Relation-Gated Adversarial Learning. (2019). Retrieved from http://arxiv.org/abs/1908.08507Google Scholar
- Shu Zhang, Dequan Zheng, Xinchen Hu, and Ming Yang. 2015. Bidirectional long short-term memory networks for relation classification. In Proceedings of the 29th Pacific Asia conference on language, information and computation, 73–78.Google Scholar
- Suncong Zheng, Jiaming Xu, Peng Zhou, Hongyun Bao, Zhenyu Qi, and Bo Xu. 2016. A neural network framework for relation extraction: Learning entity semantic and relation pattern. Knowledge-Based Systems 114, (2016), 12–23. DOI:https://doi.org/10.1016/j.knosys.2016.09.019Google ScholarDigital Library
- Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, and Bo Xu. 2016. Attention-based bidirectional long short-term memory networks for relatiGoogle Scholar
Index Terms
- Relation Extraction: A Brief Survey on Deep Neural Network Based Methods
Index terms have been assigned to the content through auto-classification.
Recommendations
Deep neural network-based relation extraction: an overview
AbstractKnowledge is a formal way of understanding the world, providing human-level cognition and intelligence for the next-generation artificial intelligence (AI). An effective way to automatically acquire this important knowledge, called Relation ...
Distant Supervised Relation Extraction Based On Recurrent Convolutional Piecewise Neural Network
SSPS '19: Proceedings of the 2019 International Symposium on Signal Processing SystemsDistant supervised relation extraction (RE) is currently an effective way to solve the problem of extracting relation from large amounts of unlabeled data.The purpose of distant supervised relation extraction is to identify the relation between the two ...
Revisiting multiple instance neural networks
We revisit the problem of solving MIL using neural networks (MINNs), which are ignored in current MIL research community. Our experiments show that MINNs are very effective and efficient.We proposed a novel MI-Net which is centered on learning bag ...
Comments