skip to main content
10.1145/3451471.3451506acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicsimConference Proceedingsconference-collections
research-article

Relation Extraction: A Brief Survey on Deep Neural Network Based Methods

Published: 13 July 2021 Publication History

Abstract

Knowledge, data, algorithms and computing power are the foundations of artificial intelligence (AI), for which knowledge is the most powerful support. An effective way to acquire knowledge, called Relation Extraction (RE), is beneficial to knowledge graph completion, path inference, logical rule reasoning, and many other AI tasks. In this survey, we provide a comprehensive review on deep neural networks (DNNs) based RE covering some main research topics about: 1) general framework, 2) supervised and distant supervised RE, 3) future research directions. General framework provides a full-view summarization on traditional methods, main component and basic conceptions of DNN-based RE. For supervised and distant supervised RE, this part summarizes DNN-based RE methods into a new taxonomies on these topics. In the end, to facilitate future research on RE, we also discuss some obstacles.

References

[1]
Eugene Agichtein and Luis Gravano. 2000. Snowball: Extracting Relations from Large Plain-Text Collections. Digital Libraries I, (2000), 85–94.
[2]
Siddhartha Banerjee and Kostas Tsioutsiouliklis. 2018. Relation Extraction using Multi-Encoder LSTM Network on a Distant Supervised Dataset. 2018 IEEE 12th International Conference on Semantic Computing (ICSC) (2018), 235–238.
[3]
Sergey Brin. 2006. Extracting Patterns and Relations from the World Wide Web. (2006), 172–183.
[4]
Rui Cai, Xiaodong Zhang, and Houfeng Wang. 2016. Bidirectional recurrent convolutional neural network for relation classification. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 756–765.
[5]
Shimin Di, Yanyan Shen, and Lei Chen. 2019. Relation extraction via domain-aware transfer learning. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2019), 1348–1357.
[6]
Jinhua Du, Jingguang Han, Andy Way, and Dadong Wan. 2018. Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction. arXiv preprint arXiv:1809.00699 (2018).
[7]
Tsu-Jui Fu, Peng-Hsuan Li, and Wei-Yun Ma. 2019. GraphRel: Modeling text as relational graphs for joint entity and relation extraction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 1409–1418.
[8]
Xiaoyu Guo, H U I Zhang, Haijun Yang, Lianyuan Xu, and Zhiwen Ye. 2019. A Single Attention-Based Combination of CNN and RNN for Relation Classification. IEEE Access 7, (2019), 12467–12475.
[9]
Xu Han, Hao Zhu, Pengfei Yu, Ziyun Wang, Yuan Yao, Zhiyuan Liu, and Maosong Sun. 2018. Fewrel: A large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. arXiv preprint arXiv:1810.10147 (2018).
[10]
Takaaki Hasegawa, Satoshi Sekine, and Ralph Grishman. 2004. Discovering relations among named entities from large corpora. In Proceedings of the 42nd annual meeting on association for computational linguistics, 415.
[11]
Marti A Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In Proceedings of the 14th conference on Computational linguistics-Volume 2, 539–545.
[12]
Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. 2009. Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. In Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions, 94–99.
[13]
Guoliang Ji, Kang Liu, Shizhu He, and Jun Zhao. 2017. Distant supervision for relation extraction with sentence-level attention and entity descriptions. In Thirty-First AAAI Conference on Artificial Intelligence.
[14]
Xiaotian Jiang, Quan Wang, Peng Li, and Bin Wang. 2016. Relation extraction with multi-instance multi-label convolutional neural networks. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 1471–1480.
[15]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. (2014). Retrieved from http://arxiv.org/abs/1408.5882
[16]
Shantanu Kumar. 2017. A survey of deep learning methods for relation extraction. arXiv preprint arXiv:1705.03645 (2017).
[17]
Joohong Lee, Sangwoo Seo, and Yong Suk Choi. 2019. Semantic Relation Classification via Bidirectional LSTM Networks with Entity-aware Attention using Latent Entity Typing. arXiv preprint arXiv:1901.08163 (2019).
[18]
Yankai Lin, Zhiyuan Liu, and Maosong Sun. 2017. Neural relation extraction with multi-lingual attention. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 34–43.
[19]
Yankai Lin, Shiqi Shen, Zhiyuan Liu, Huanbo Luan, and Maosong Sun. 2016. Neural relation extraction with selective attention over instances. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2124–2133.
[20]
ChunYang Liu, WenBo Sun, WenHan Chao, and Wanxiang Che. 2013. Convolution neural network for relation extraction. In International Conference on Advanced Data Mining and Applications, 231–242.
[21]
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).
[22]
Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2, 1003–1011.
[23]
Raymond J Mooney and Razvan C Bunescu. 2006. Subsequence kernels for relation extraction. In Advances in neural information processing systems, 171–178.
[24]
Guoshun Nan, Zhijiang Guo, Ivan Sekulic, and Wei Lu. 2020. Reasoning with Latent Structure Refinement for Document-Level Relation Extraction. 2018 (2020), 1546–1557.
[25]
Thien Huu Nguyen and Ralph Grishman. 2015. Relation extraction: Perspective from convolutional neural networks. In Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, 39–48.
[26]
Sachin Pawar, Girish K. Palshikar, and Pushpak Bhattacharyya. 2017. Relation Extraction: A Survey. (2017), 1–51. Retrieved from http://arxiv.org/abs/1712.05191
[27]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 1532–1543.
[28]
Pengda Qin, Weiran Xu, and William Yang Wang. 2018. Robust distant supervision relation extraction via deep reinforcement learning. arXiv preprint arXiv:1805.09927 (2018).
[29]
Pengda Qin, Weiran Xu, and William Yang Wang. 2018. Dsgan: Generative adversarial training for distant supervision relation extraction. arXiv preprint arXiv:1805.09929 (2018).
[30]
Feiliang Ren, Di Zhou, Zhihui Liu, Yongcheng Li, Rongsheng Zhao, Yongkang Liu, and Xiaobo Liang. 2018. Neural relation classification with text descriptions. In Proceedings of the 27th International Conference on Computational Linguistics, 1167–1177.
[31]
Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling relations and their mentions without labeled text. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 148–163.
[32]
Bryan Rink and Sanda Harabagiu. 2010. Utd: Classifying semantic relations by combining lexical and semantic resources. In Proceedings of the 5th International Workshop on Semantic Evaluation, 256–259.
[33]
Sunil Kumar Sahu, Fenia Christopoulou, Makoto Miwa, and Sophia Ananiadou. 2019. Inter-sentence relation extraction with document-level graph convolutional neural network. arXiv preprint arXiv:1906.04684 (2019).
[34]
Cicero Nogueira dos Santos, Bing Xiang, and Bowen Zhou. 2015. Classifying relations by ranking with convolutional neural networks. arXiv preprint arXiv:1504.06580 (2015).
[35]
Changzhi Sun and Yuanbin Wu. 2019. Distantly supervised entity relation extraction with adapted manual annotations. 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019 (2019), 7039–7046.
[36]
Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th annual meeting of the association for computational linguistics, 384–394.
[37]
Shikhar Vashishth, Rishabh Joshi, Sai Suman Prayaga, Chiranjib Bhattacharyya, and Partha Talukdar. 2018. RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 1257–1266.
[38]
Guanying Wang, Wen Zhang, Ruoxu Wang, Yalin Zhou, Xi Chen, Wei Zhang, Hai Zhu, and Huajun Chen. 2018. Label-free distant supervision for relation extraction via knowledge graph embedding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2246–2255.
[39]
Hailin Wang, Ke Qin, Guoming Lu, Guangchun Luo, and Guisong Liu. 2020. Knowledge-Based Systems Direction-sensitive relation extraction using Bi-SDP attention model. Knowledge-Based Systems 198, (2020), 105928.
[40]
Linlin Wang, Zhu Cao, Gerard de Melo, and Zhiyuan Liu. 2016. Relation Classification via Multi-Level Attention CNNs. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (2016), 1298–1307.
[41]
Minguang Xiao and Cong Liu. 2016. Semantic relation classification via hierarchical recurrent neural network with attention. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 1254–1263.
[42]
Kun Xu, Yansong Feng, Songfang Huang, and Dongyan Zhao. 2015. Semantic relation classification via convolutional neural networks with simple negative sampling. arXiv preprint arXiv:1506.07650 (2015).
[43]
Yan Xu, Ran Jia, Lili Mou, Ge Li, Yunchuan Chen, Yangyang Lu, and Zhi Jin. 2016. Improved relation classification by deep recurrent neural networks with data augmentation. arXiv preprint arXiv:1601.03651 (2016).
[44]
Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, and Zhi Jin. 2015. Classifying relations via long short term memory networks along shortest dependency paths. In proceedings of the 2015 conference on empirical methods in natural language processing, 1785–1794.
[45]
Linyi Yang, Tin Lok, James Ng, Catherine Mooney, and Ruihai Dong. Multi-level Attention-Based Neural Networks for Distant Supervised Relation Extraction.
[46]
Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, and Maosong Sun. 2020. Docred: A large-scale document-level relation extraction dataset. ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (2020), 764–777.
[47]
Daojian Zeng, Kang Liu, Yubo Chen, and Jun Zhao. 2015. Distant supervision for relation extraction via piecewise convolutional neural networks. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 1753–1762.
[48]
Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation Classification via Convolutional Deep Neural Network. Proceedings of the 25th International Conference on Computational Linguistics (COLING’14) 2011 (2014), 2335–2344.
[49]
Chunyun Zhang, Chaoran Cui, Sheng Gao, L U Yang, Xiaoming Xi, and Yilong Yin. 2019. Multi-Gram CNN-Based Self-Attention Model for Relation Classification. IEEE Access 7, (2019), 5343–5357.
[50]
Dongxu Zhang and Dong Wang. 2015. Relation Classification via Recurrent Neural Network. August (2015).
[51]
Lei Zhang and Fusheng Xiang. 2018. Relation classification via BiLSTM-CNN. In International Conference on Data Mining and Big Data, 373–382.
[52]
Ningyu Zhang, Shumin Deng, Zhanlin Sun, Jiaoyan Chen, Wei Zhang, and Huajun Chen. 2019. Transfer Learning for Relation Extraction via Relation-Gated Adversarial Learning. (2019). Retrieved from http://arxiv.org/abs/1908.08507
[53]
Shu Zhang, Dequan Zheng, Xinchen Hu, and Ming Yang. 2015. Bidirectional long short-term memory networks for relation classification. In Proceedings of the 29th Pacific Asia conference on language, information and computation, 73–78.
[54]
Suncong Zheng, Jiaming Xu, Peng Zhou, Hongyun Bao, Zhenyu Qi, and Bo Xu. 2016. A neural network framework for relation extraction: Learning entity semantic and relation pattern. Knowledge-Based Systems 114, (2016), 12–23.
[55]
Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, and Bo Xu. 2016. Attention-based bidirectional long short-term memory networks for relati

Cited By

View all
  • (2024)A Survey on Challenges and Advances in Natural Language Processing with a Focus on Legal Informatics and Low-Resource LanguagesElectronics10.3390/electronics1303064813:3(648)Online publication date: 4-Feb-2024
  • (2024)From data to insights: the application and challenges of knowledge graphs in intelligent auditJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00674-013:1Online publication date: 29-May-2024
  • (2024)Incorporating Feature Interaction into Relation Contrastive Learning for Zero-shot Relation Extraction2024 International Conference on Computational Linguistics and Natural Language Processing (CLNLP)10.1109/CLNLP64123.2024.00012(17-21)Online publication date: 19-Jul-2024
  • Show More Cited By

Index Terms

  1. Relation Extraction: A Brief Survey on Deep Neural Network Based Methods
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ICSIM '21: Proceedings of the 2021 4th International Conference on Software Engineering and Information Management
      January 2021
      251 pages
      ISBN:9781450388955
      DOI:10.1145/3451471
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 July 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Distant Supervised Relation Extraction
      2. Information Extraction
      3. Neural Networks
      4. Supervised Relation Extraction

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • National Natural Science Foundation of China
      • National Key R&D Program of China
      • Ministry of Science and Technology of Sichuan Province Program

      Conference

      ICSIM 2021

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)58
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 16 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A Survey on Challenges and Advances in Natural Language Processing with a Focus on Legal Informatics and Low-Resource LanguagesElectronics10.3390/electronics1303064813:3(648)Online publication date: 4-Feb-2024
      • (2024)From data to insights: the application and challenges of knowledge graphs in intelligent auditJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00674-013:1Online publication date: 29-May-2024
      • (2024)Incorporating Feature Interaction into Relation Contrastive Learning for Zero-shot Relation Extraction2024 International Conference on Computational Linguistics and Natural Language Processing (CLNLP)10.1109/CLNLP64123.2024.00012(17-21)Online publication date: 19-Jul-2024
      • (2024)Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and OpportunitiesIEEE Access10.1109/ACCESS.2024.349473712(167655-167682)Online publication date: 2024
      • (2023)TSVFNInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10326460:3Online publication date: 1-May-2023
      • (2022)Construction of Social Community Knowledge Graph from Wikipedia2022 IEEE 24th Int Conf on High Performance Computing & Communications; 8th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys)10.1109/HPCC-DSS-SmartCity-DependSys57074.2022.00341(2308-2315)Online publication date: Dec-2022
      • (2022)A Survey on Deep Learning Techniques for Joint Named Entities and Relation Extraction2022 IEEE World AI IoT Congress (AIIoT)10.1109/AIIoT54504.2022.9817231(218-224)Online publication date: 6-Jun-2022
      • (2022)Augmenting Context Representation with Triggers Knowledge for Relation ExtractionIntelligent Information Processing XI10.1007/978-3-031-03948-5_11(124-135)Online publication date: 25-Apr-2022

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media