Skip to main content

A Relation-Oriented Approach for Complex Entity Relation Extraction

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2023)

Abstract

Entity relation extraction targets the extraction of structured triples from unstructured text, and is the start of the entire knowledge graph lifecycle. In recent advances, Machine Reading Comprehension (MRC) based approaches provide new paradigms for entity relationship extraction and achieve the state-of-the-art performance. Aiming at the features of nested entities, overlapping relationships and distant entities in recipe texts, this study proposes a relation-oriented approach for complex entity relation extraction. This approach addresses the entity redundancy problem caused by the traditional pipeline models which are entity-first methods. By predicting the starting and ending of entities, it solves the problem of nested entities that cannot be identified by traditional sequence labeling methods. Finally, the error propagation issue is mitigated by the triple determination module. We conduct extensive experiments on multi-datasets in both English and Chinese, and the experimental results show that our method significantly outperforms the baseline model in terms of both precision, recall and micro-F1 score.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhao, X., Wu, W., Tao, C., et al.: Low-resource knowledge-grounded dialogue generation. In: International Conference on Learning Representations (2022)

    Google Scholar 

  2. Wang, P., Jiang, H., Xu, J., et al.: Knowledge graph construction and applications for web search and beyond. Data Intell. 1(4), 333–349 (2019)

    Article  Google Scholar 

  3. Deng, S., Zhang, N., Zhang, W., et al.: Knowledge-driven stock trend prediction and explanation via temporal convolutional network. In: Companion Proceedings of The 2019 World Wide Web Conference, pp. 678–685. ACM, San Francisco (2019)

    Google Scholar 

  4. Nadeau, D., Sekine, S.: A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1), 3–26 (2007)

    Article  Google Scholar 

  5. Bach, N., Badaskar, S.: A review of relation extraction (2007)

    Google Scholar 

  6. Lin, Y., Shen, S., Liu, Z., et al.: Neural relation extraction with selective attention over instances. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 2121–2133. Association for Computational Linguistics, Berlin (2016)

    Google Scholar 

  7. Nickel, M., Murphy, K., Tresp, V., et al.: A review of relational machine learning for knowledge graphs. Proc. IEEE 104(1), 11–33 (2016)

    Article  Google Scholar 

  8. Mikheev, A., Moens, M., Grover, C.: Named entity recognition without gazetteers. In: Ninth Conference of the European Chapter of the Association for Computational Linguistics, pp. 1–8. Association for Computational Linguistics, Bergen (1999)

    Google Scholar 

  9. Sekine, S., Nobata, C.: Definition, dictionaries and tagger for extended named entity hierarchy. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004). European Language Resources Association (ELRA), Lisbon (2004)

    Google Scholar 

  10. McNamee, P., Mayfield, J.: Entity extraction without language-specific resources. In: Proceedings of the 6th Conference on Natural Language Learning, vol. 20, pp. 1–4. Association for Computational Linguistics (2002)

    Google Scholar 

  11. Collins, M., Singer, Y.: Unsupervised models for named entity classification. In: 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (1999)

    Google Scholar 

  12. dos Santos, C., Guimarães, V.: Boosting named entity recognition with neural character embeddings. In: Proceedings of the Fifth Named Entity Workshop, pp. 25–33. Association for Computational Linguistics, Beijing (2015)

    Google Scholar 

  13. Collobert, R., Weston, J., Bottou, L., et al.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)

    MATH  Google Scholar 

  14. Ma, X., Hovy, E.: End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1064–1074. Association for Computational Linguistics, Berlin (2016)

    Google Scholar 

  15. Zheng, S., Wang, F., Bao, H., et al.: Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1227–1236. Association for Computational Linguistics, Vancouver (2017)

    Google Scholar 

  16. Yang, Z.H., Cao, M., Luo, L.: Joint drug entity and relations extraction based on neural network. J. Comput. Res. Dev. 56, 1432–1440 (2019)

    Google Scholar 

  17. Wei, Z., Su, J., Wang, Y., et al.: A novel cascade binary tagging framework for relational triple extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1476–1488. Association for Computational Linguistics (2020)

    Google Scholar 

  18. Sui, D., Zeng, X., Chen, Y., et al.: Joint entity and relation extraction with set prediction networks. IEEE Trans. Neural Netw. Learn. Syst. 1–12 (2023)

    Google Scholar 

  19. Lee, K., He, L., Lewis, M., et al.: End-to-end neural coreference resolution. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 188–197. Association for Computational Linguistics, Copenhagen (2017)

    Google Scholar 

  20. Dixit, K., Al-Onaizan, Y.: Span-level model for relation extraction. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5308–5314. Association for Computational Linguistics, Florence (2019)

    Google Scholar 

  21. Luan, Y., Wadden, D., He, L., et al.: A general framework for information extraction using dynamic span graphs. In: Proceedings of the 2019 Conference of the North, pp. 3036–3046. Association for Computational Linguistics, Minneapolis (2019)

    Google Scholar 

  22. Wadden, D., Wennberg, U., Luan, Y., et al.: Entity, relation, and event extraction with contextualized span representations. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5783–5788. Association for Computational Linguistics, Hong Kong (2019)

    Google Scholar 

  23. Eberts, M., Ulges, A.: Span-based joint entity and relation extraction with transformer pre-training. In: 24th European Conference on Artificial Intelligence - ECAI 2020, Santiago de Compostela, Spain, pp. 2006–2013 (2020)

    Google Scholar 

  24. Zhang, M., Ma, L., Ren, Y., et al.: Span-based model for overlapping entity recognition and multi-relations classification in the food domain. Math. Biosci. Eng. 19(5), 5134–5152 (2022)

    Article  MATH  Google Scholar 

  25. Levy, O., Seo, M., Choi, E., et al.: Zero-shot relation extraction via reading comprehension. In: Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pp. 333–342. Association for Computational Linguistics, Vancouver (2017)

    Google Scholar 

  26. Li, X., Yin, F., Sun, Z., et al.: Entity-relation extraction as multi-turn question answering. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 1340–1350. Association for Computational Linguistics, Florence (2019)

    Google Scholar 

  27. Li, X., Feng, J., Meng, Y., et al.: A unified MRC framework for named entity recognition. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5849–5859. Association for Computational Linguistics (2020)

    Google Scholar 

  28. Doddington, G., Mitchell, A., Przybocki, M., et al.: The automatic content extraction (ACE) program – tasks, data, and evaluation. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004). European Language Resources Association (ELRA), Lisbon (2004)

    Google Scholar 

  29. Tjong, K., Sang, E.F., De Meulder, F.: Introduction to the CoNLL-2003 shared task: language-independent named entity recognition. In: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, pp. 142–147 (2003)

    Google Scholar 

  30. Che, W., Wang, M., Manning, C.D., et al.: Named entity recognition with bilingual constraints. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 52–62. Association for Computational Linguistics, Atlanta (2013)

    Google Scholar 

  31. Lin, H., Lu, Y., Han, X., et al.: Sequence-to-nuggets: nested entity mention detection via anchor-region networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5182–5192. Association for Computational Linguistics, Florence (2019)

    Google Scholar 

  32. Miwa, M., Sasaki, Y.: Modeling joint entity and relation extraction with table representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1858–1869. Association for Computational Linguistics, Doha (2014)

    Google Scholar 

  33. Chen, Z., Guo, C.: A pattern-first pipeline approach for entity and relation extraction. Neurocomputing 494, 182–191 (2022)

    Article  Google Scholar 

  34. Miwa, M., Bansal, M.: End-to-end relation extraction using LSTMs on sequences and tree structures. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1105–1116. Association for Computational Linguistics, Berlin (2016)

    Google Scholar 

  35. Peters, M.E., Neumann, M., Iyyer, M., et al.: Deep contextualized word representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long Papers), pp. 2227–2237. Association for Computational Linguistics, New Orleans (2018)

    Google Scholar 

  36. Zhong, Z., Chen, D.: A frustratingly easy approach for entity and relation extraction. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 50–61. Association for Computational Linguistics (2021)

    Google Scholar 

  37. Zhang, Y., Yang, J.: Chinese NER using lattice LSTM. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1554–1564. Association for Computational Linguistics, Melbourne (2018)

    Google Scholar 

  38. Devlin, J., Chang, M.W., Lee, K., et al.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Minneapolis (2019)

    Google Scholar 

  39. Meng, Y., Wu, W., Wang, F., et al.: Glyce: glyph-vectors for Chinese character representations. arXiv (2020). https://arxiv.org/abs/1901.10125. 22 Mar 2023

  40. Cui, Y., Che, W., Liu, T., et al.: Pre-training with whole word masking for Chinese BERT. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 3504–3514 (2021)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mengqi Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, X., Zhang, M. (2024). A Relation-Oriented Approach for Complex Entity Relation Extraction. In: Luo, B., Cheng, L., Wu, ZG., Li, H., Li, C. (eds) Neural Information Processing. ICONIP 2023. Communications in Computer and Information Science, vol 1966. Springer, Singapore. https://doi.org/10.1007/978-981-99-8148-9_38

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8148-9_38

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8147-2

  • Online ISBN: 978-981-99-8148-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics