Abstract
Entity relation extraction targets the extraction of structured triples from unstructured text, and is the start of the entire knowledge graph lifecycle. In recent advances, Machine Reading Comprehension (MRC) based approaches provide new paradigms for entity relationship extraction and achieve the state-of-the-art performance. Aiming at the features of nested entities, overlapping relationships and distant entities in recipe texts, this study proposes a relation-oriented approach for complex entity relation extraction. This approach addresses the entity redundancy problem caused by the traditional pipeline models which are entity-first methods. By predicting the starting and ending of entities, it solves the problem of nested entities that cannot be identified by traditional sequence labeling methods. Finally, the error propagation issue is mitigated by the triple determination module. We conduct extensive experiments on multi-datasets in both English and Chinese, and the experimental results show that our method significantly outperforms the baseline model in terms of both precision, recall and micro-F1 score.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhao, X., Wu, W., Tao, C., et al.: Low-resource knowledge-grounded dialogue generation. In: International Conference on Learning Representations (2022)
Wang, P., Jiang, H., Xu, J., et al.: Knowledge graph construction and applications for web search and beyond. Data Intell. 1(4), 333–349 (2019)
Deng, S., Zhang, N., Zhang, W., et al.: Knowledge-driven stock trend prediction and explanation via temporal convolutional network. In: Companion Proceedings of The 2019 World Wide Web Conference, pp. 678–685. ACM, San Francisco (2019)
Nadeau, D., Sekine, S.: A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1), 3–26 (2007)
Bach, N., Badaskar, S.: A review of relation extraction (2007)
Lin, Y., Shen, S., Liu, Z., et al.: Neural relation extraction with selective attention over instances. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 2121–2133. Association for Computational Linguistics, Berlin (2016)
Nickel, M., Murphy, K., Tresp, V., et al.: A review of relational machine learning for knowledge graphs. Proc. IEEE 104(1), 11–33 (2016)
Mikheev, A., Moens, M., Grover, C.: Named entity recognition without gazetteers. In: Ninth Conference of the European Chapter of the Association for Computational Linguistics, pp. 1–8. Association for Computational Linguistics, Bergen (1999)
Sekine, S., Nobata, C.: Definition, dictionaries and tagger for extended named entity hierarchy. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004). European Language Resources Association (ELRA), Lisbon (2004)
McNamee, P., Mayfield, J.: Entity extraction without language-specific resources. In: Proceedings of the 6th Conference on Natural Language Learning, vol. 20, pp. 1–4. Association for Computational Linguistics (2002)
Collins, M., Singer, Y.: Unsupervised models for named entity classification. In: 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (1999)
dos Santos, C., Guimarães, V.: Boosting named entity recognition with neural character embeddings. In: Proceedings of the Fifth Named Entity Workshop, pp. 25–33. Association for Computational Linguistics, Beijing (2015)
Collobert, R., Weston, J., Bottou, L., et al.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)
Ma, X., Hovy, E.: End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1064–1074. Association for Computational Linguistics, Berlin (2016)
Zheng, S., Wang, F., Bao, H., et al.: Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1227–1236. Association for Computational Linguistics, Vancouver (2017)
Yang, Z.H., Cao, M., Luo, L.: Joint drug entity and relations extraction based on neural network. J. Comput. Res. Dev. 56, 1432–1440 (2019)
Wei, Z., Su, J., Wang, Y., et al.: A novel cascade binary tagging framework for relational triple extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1476–1488. Association for Computational Linguistics (2020)
Sui, D., Zeng, X., Chen, Y., et al.: Joint entity and relation extraction with set prediction networks. IEEE Trans. Neural Netw. Learn. Syst. 1–12 (2023)
Lee, K., He, L., Lewis, M., et al.: End-to-end neural coreference resolution. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 188–197. Association for Computational Linguistics, Copenhagen (2017)
Dixit, K., Al-Onaizan, Y.: Span-level model for relation extraction. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5308–5314. Association for Computational Linguistics, Florence (2019)
Luan, Y., Wadden, D., He, L., et al.: A general framework for information extraction using dynamic span graphs. In: Proceedings of the 2019 Conference of the North, pp. 3036–3046. Association for Computational Linguistics, Minneapolis (2019)
Wadden, D., Wennberg, U., Luan, Y., et al.: Entity, relation, and event extraction with contextualized span representations. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5783–5788. Association for Computational Linguistics, Hong Kong (2019)
Eberts, M., Ulges, A.: Span-based joint entity and relation extraction with transformer pre-training. In: 24th European Conference on Artificial Intelligence - ECAI 2020, Santiago de Compostela, Spain, pp. 2006–2013 (2020)
Zhang, M., Ma, L., Ren, Y., et al.: Span-based model for overlapping entity recognition and multi-relations classification in the food domain. Math. Biosci. Eng. 19(5), 5134–5152 (2022)
Levy, O., Seo, M., Choi, E., et al.: Zero-shot relation extraction via reading comprehension. In: Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pp. 333–342. Association for Computational Linguistics, Vancouver (2017)
Li, X., Yin, F., Sun, Z., et al.: Entity-relation extraction as multi-turn question answering. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 1340–1350. Association for Computational Linguistics, Florence (2019)
Li, X., Feng, J., Meng, Y., et al.: A unified MRC framework for named entity recognition. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5849–5859. Association for Computational Linguistics (2020)
Doddington, G., Mitchell, A., Przybocki, M., et al.: The automatic content extraction (ACE) program – tasks, data, and evaluation. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004). European Language Resources Association (ELRA), Lisbon (2004)
Tjong, K., Sang, E.F., De Meulder, F.: Introduction to the CoNLL-2003 shared task: language-independent named entity recognition. In: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, pp. 142–147 (2003)
Che, W., Wang, M., Manning, C.D., et al.: Named entity recognition with bilingual constraints. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 52–62. Association for Computational Linguistics, Atlanta (2013)
Lin, H., Lu, Y., Han, X., et al.: Sequence-to-nuggets: nested entity mention detection via anchor-region networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5182–5192. Association for Computational Linguistics, Florence (2019)
Miwa, M., Sasaki, Y.: Modeling joint entity and relation extraction with table representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1858–1869. Association for Computational Linguistics, Doha (2014)
Chen, Z., Guo, C.: A pattern-first pipeline approach for entity and relation extraction. Neurocomputing 494, 182–191 (2022)
Miwa, M., Bansal, M.: End-to-end relation extraction using LSTMs on sequences and tree structures. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1105–1116. Association for Computational Linguistics, Berlin (2016)
Peters, M.E., Neumann, M., Iyyer, M., et al.: Deep contextualized word representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long Papers), pp. 2227–2237. Association for Computational Linguistics, New Orleans (2018)
Zhong, Z., Chen, D.: A frustratingly easy approach for entity and relation extraction. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 50–61. Association for Computational Linguistics (2021)
Zhang, Y., Yang, J.: Chinese NER using lattice LSTM. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1554–1564. Association for Computational Linguistics, Melbourne (2018)
Devlin, J., Chang, M.W., Lee, K., et al.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Minneapolis (2019)
Meng, Y., Wu, W., Wang, F., et al.: Glyce: glyph-vectors for Chinese character representations. arXiv (2020). https://arxiv.org/abs/1901.10125. 22 Mar 2023
Cui, Y., Che, W., Liu, T., et al.: Pre-training with whole word masking for Chinese BERT. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 3504–3514 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, X., Zhang, M. (2024). A Relation-Oriented Approach for Complex Entity Relation Extraction. In: Luo, B., Cheng, L., Wu, ZG., Li, H., Li, C. (eds) Neural Information Processing. ICONIP 2023. Communications in Computer and Information Science, vol 1966. Springer, Singapore. https://doi.org/10.1007/978-981-99-8148-9_38
Download citation
DOI: https://doi.org/10.1007/978-981-99-8148-9_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8147-2
Online ISBN: 978-981-99-8148-9
eBook Packages: Computer ScienceComputer Science (R0)