Abstract
Extracting relation triplets from unstructured text has been well studied in recent years. However, previous works focus on solving the relation overlapping problem, and few of them deal with the long text relation extraction. In this work, we introduce a novel end-to-end joint entity and relation extraction model, namely, LTRel, which is capable of extracting relation triplets from long text based on a cross-sentence relation classification algorithm. On the other hand, due to the importance of entity recognition to the entire end-to-end model, we refine the entity tagging scheme and the feature representation of TPLinker, which save the memory space and computation, and also improve the accuracy. We evaluate our model on two public datasets: the English dataset NYT and the Chinese dataset DuIE2.0 proposed by Baidu, both of which are better than state-of-the-art on F1 score, especially significant on the Chinese dataset with a higher proportion of long text samples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zelenko, D., Aone, C., Richardella, A.: Kernel methods for relation extraction. J. Mach. Learn. Res. 3(3), 1083–1106 (2003)
Zhou, G., Su, J., Zhang, J., Zhang, M.: Exploring various knowledge in relation extraction. In Proceedings of ACL. In: Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics, ACL 2005, pp. 427–434. Association for Computational Linguistics, Michigan (2005)
Mintz, M., Bills, S., Snow, R., Jurafsky, D.: Distant supervision for relation extraction without labeled data. In: Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics, ACL 2009, pp. 1003–1011. Association for Computational Linguistics, Singapore (2009)
Chan, Y., Roth, D.: Exploiting syntactico-semantic structures for relation extraction. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, ACL 2011, pp. 551–560. Association for Computational Linguistics, Portland (2011)
Gormley, M.R., Yu, M., Dredze, M.: Improved relation extraction with feature-rich compositional embedding models. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, pp. 1774–1784. Association for Computational Linguistics, Portugal (2015)
Li, Q., Ji, H.: Incremental joint extraction of entity mentions and relations. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, pp. 402–412. Association for Computational Linguistics, Baltimore (2014)
Gupta, P., Schtze, H., Andrassy, B.: Table filling multi-task recurrent neural network for joint entity and relation extraction. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, pp. 2537–2547. The COLING 2016 Organizing Committee, Japan (2016)
Zheng, S., Wang, F., Bao, H., Hao, Y., Zhou, P., Xu, B.: Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, pp. 1227–1236. Association for Computational Linguistics, Vancouver (2017)
Tan, Z., Zhao, X., Wang, W., Xiao, W.: Jointly extracting multiple triplets with multilayer translation constraints. In: Proceedings of the AAAI Conference on Artificial Intelligence, AAAI 2019, pp. 7080–7087. Natural Language Processing, Atlanta (2019)
Takanobu, R., Zhang, T., Liu, J., Huang, M.: A hierarchical framework for relation extraction with reinforcement learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 7072–7079. Natural Language Processing, Atlanta (2019)
Li, X., et al.: Entity relation extraction as multi-turn question answering. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019, pp.1340–1350. Association for Computational Linguistics, Italy (2019)
Sun, C.: Joint type inference on entities and relations via graph convolutional networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019, pp.1361–1370. Association for Computational Linguistics, Italy (2019)
Yu, B., et al.: Joint extraction of entities and relations based on a novel decomposition strategy. arXiv:1909.04273 (2020)
Wei, Z., Su, J., Wang, Y., Tian, Y., Chang, Y.: A novel cascade binary tagging framework for relational triple extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, pp. 1476–1488. Association for Computational Linguistics, Spain (2020)
Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., Sun, L.: TPLinker: single-stage joint extraction of entities and relations through token pair linking. In: Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, pp. 1572–1582. International Committee on Computational Linguistics, Spain (2020)
Fu, T., Li, P., Ma, W.: Graphrel: modeling text as relational graphs for joint entity and relation extraction. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019, pp. 1409–1418. Association for Computational Linguistics, Italy (2019)
Sui, D., Chen, Y., Liu, K., Zhao, J., Zeng, X., Liu, S.: Joint entity and relation extraction with set prediction networks. arXiv:2011.01675 (2020)
Riedel, S., Yao, L., McCallum, A.: Modeling relations and their mentions without labeled text. In: Machine Learning and Knowledge Discovery in Databases, European Conference, ECML-PKDD 2010. Springer-Verlag, Spain (2010)
Devlin, J., Chang, M., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, NAACL 2019, pp. 4171–4186. Association for Computational Linguistics, Minnesota (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Cheng, D., Song, H., He, X., Xu, B. (2021). Joint Entity and Relation Extraction for Long Text. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management . KSEM 2021. Lecture Notes in Computer Science(), vol 12816. Springer, Cham. https://doi.org/10.1007/978-3-030-82147-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-82147-0_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82146-3
Online ISBN: 978-3-030-82147-0
eBook Packages: Computer ScienceComputer Science (R0)