Abstract
Extracting entities and relationships between entities from news text information is the core task of building news knowledge graphs. In recent years, with the rise of knowledge graphs, the joint extraction of entity relationships has become a research hotspot in the field of natural language processing. Aiming at the problem that there are many entities in news text data and overlapping relationships between entities are common, this paper first proposes a labeling strategy around the central entity, which transforms the extraction of entities and relationships into sequence labeling problems. After that, this paper also proposes a joint extraction model, which is based on pre-trained language and combined with the improved Bi-directional Long Short-Term Memory (BiLSTM) and Conditional Random Field (CRF) model to achieve entity and relationship extraction. The experimental results on two public news datasets show that our proposed joint extraction model has different degrees of improvement in accuracy and recall compared with other popular joint extraction models. The F1 value on NYT and DuIE both achieved the highest values, reaching 71.6% and 81.4%, which proves that the method proposed in this paper is effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Pujara, J., Miao, H., Getoor, L., Cohen, W.: Knowledge graph identification. In: Alani, H., et al. (eds.) ISWC 2013. LNCS, vol. 8218, pp. 542–557. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41335-3_34
Li, D., Zhang, Y., Li, D., et al.: Review of entity relation extraction methods. J. Computer Res. Dev. 57(7), 1424–1448 (2020)
Miwa, M., Bansal, M.: End-to-end relation extraction using LSTMs on sequences and tree structures. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 1105–1116. Association for Computational Linguistics, Strasbourg (2016)
Bekoulis, G., Deleu, J., Demeester, T., et al.: Joint entity recognition and relation extraction as a multi-head selection problem. Expert Syst. Appl. 114, 34–45 (2018)
Zhao, T., Yan, Z., Cao, Y., Li, Z.: Entity relative position representation based multi-head selection for joint entity and relation extraction. In: Sun, M., Li, S., Zhang, Y., Liu, Y., He, S., Rao, G. (eds.) CCL 2020. LNCS (LNAI), vol. 12522, pp. 184–198. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63031-7_14
Hu, Y., Yan, H., Chen, C.: Joint entity and relation extraction for constructing financial knowledge graph. J. Chongqing University Technol. (Natural Science) 34(5), 139–149 (2020)
Liu, Y., Ott, M., Goyal, N., et al.: Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)
Kambhatla, N.: Combining lexical, syntactic, and semantic features with maximum entropy models for information extraction. In: Proceedings of the ACL Interactive Poster and Demonstration Sessions, pp. 178–181. Association for Computational Linguistics, Strasbourg (2004)
Nayak, T., Ng, H.T.: Effective attention modeling for neural relation extraction. In: Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pp. 603–612. Association for Computational Linguistics, Strasbourg (2019)
Zhang, D., Peng, D.: ENT-BERT: entity relation classification model combining bert and entity information. J. Chinese Computer Syst. 41(12), 2557–2562 (2020)
Zheng, S., Wang, F., Bao, H., et al.: Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp. 1227–1236. Association for Computational Linguistics, Strasbourg (2017)
Wang, S., Yue, Z., Che, W., et al.: Joint extraction of entities and relations based on a novel graph scheme. In: Twenty-Seventh International Joint Conference on Artificial Intelligence, pp. 4461–4467. AAAI Press, Menlo Park (2018)
Liu, J., Chen, S., Wang, B., et al.: Attention as relation: learning supervised multi-head self-attention for relation extraction. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, pp. 3787–3793. Springer (2021). https://doi.org/10.24963/ijcai.2020/524
Lai, T., Cheng, L., Wang, D., et al.: RMAN: Relational multi-head attention neural network for joint extraction of entities and relations. Applied Intelligence 52(3), 3132–3142 (2021)
Qiao, B., Zou, Z., Huang, Y., et al.: A joint model for entity and relation extraction based on BERT. Neural Computing Appl. 34(5), 3471–3481 (2022)
Wei, Z., Su, J., Wang, Y., et al.: A novel cascade binary tagging framework for relational triple extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1476–1488. Association for Computational Linguistics, Strasbourg (2020)
Devlin, J., Chang, M. W., Lee, K., et al.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Li, Z., Yu, T., Shen, H.: Research on Opinion Targets Extraction of Travel Reviews Based on RoBERTa Em-bedded BILSTM-CRF Model. In: 2021 International Conference on Culture-oriented Science & Technology (ICCST), pp. 114–118. IEEE, Piscataway (2021)
Fu, R., Li, J., Wang, J., et al.: Joint extraction of entities and relations for domain knowledge graph. J. East China Norm. Univ. Nat. Sci. 2021(5), 24–36 (2021)
Riedel, S., Yao, L., McCallum, A.: Modeling relations and their mentions without labeled text. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds.) ECML PKDD 2010, LNCS, vol. 6323, pp. 148–163. Springer, Heidelberg (2010)
Li, S., et al.: DuIE: a large-scale chinese dataset for information extraction. In: Tang, J., Kan, M.-Y., Zhao, D., Li, S., Zan, H. (eds.) NLPCC 2019. LNCS (LNAI), vol. 11839, pp. 791–800. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32236-6_72
Kingma, D., Ba, J.: Adam: A Method for Stochastic Optimization. Computer Science (2014)
Fu, T., Li, P., Ma, W.: Graphrel: Modeling text as relational graphs for joint entity and relation extraction. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 1409–1418. Association for Computational Linguistics, Strasbourg (2019)
Chen, R., Zheng, X., Zhu, Y.: Joint entity and relation extraction via fusing entity type information. Comput. Eng. 48(3), 46–53 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Z., Ma, H., Lv, Y., Shen, H. (2022). Joint Extraction of Entities and Relations in the News Domain. In: Chen, W., Yao, L., Cai, T., Pan, S., Shen, T., Li, X. (eds) Advanced Data Mining and Applications. ADMA 2022. Lecture Notes in Computer Science(), vol 13725. Springer, Cham. https://doi.org/10.1007/978-3-031-22064-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-22064-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22063-0
Online ISBN: 978-3-031-22064-7
eBook Packages: Computer ScienceComputer Science (R0)