Abstract
Information systems that have to deal with natural language text are often equipped with application-specific techniques for solving various Natural Language Processing (NLP) tasks. One of those tasks, extracting entities and their relations from human-readable text, is relevant for downstream tasks like automated model extraction (e.g. UML diagrams, business process models) and question answering (e.g. in chatbots). In NLP the rapidly evolving research field of Relation Extraction denotes a family of techniques for solving this task application-independently. Thus, the question arises why scientific publications about information systems often neglect those existing solutions. One supposed reason is that for reliably selecting an appropriate technique, a comprehensive study of the available alternatives is required. However, existing studies (i) cannot be considered complete due to irreproducible literature search methods and (ii) lack validity, since they compare relevant approaches based on different datasets and different experimental setups. This paper presents an empirical comparative study on domain-independent, open-source deep learning techniques for extracting entities and their relations jointly from texts. Limitations of former studies are overcome (i) by a rigorous and well-documented literature search and (ii) by evaluating relevant techniques on equal datasets in a unified experimental setup. The results\(^{1}\) show that a group of approaches form a reliable baseline for developing new techniques or for utilizing them directly in the above mentioned application scenarios(\(^{1}\)Our code and data: https://github.com/JulianNeuberger/re-study-caise.).
Our work is supported by the Bavarian Research Foundation (grant no. AZ-1390-19).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
A definition for this term is given in Sect. 3.1.
- 2.
- 3.
- 4.
- 5.
Criteria list: https://github.com/JulianNeuberger/re-study-caise#filtering.
- 6.
the modified implementations can be found at https://github.com/JulianNeuberger/re-study-caise/#considered-approaches.
References
van der Aa, H., Carmona, J., Leopold, H., Mendling, J., Padró, L.: Challenges and opportunities of applying natural language processing in business process management. In: Proceedings of COLING. ACL (2018)
Ackermann, L., Neuberger, J., Jablonski, S.: Data-driven annotation of textual process descriptions based on formal meaning representations. In: CAiSE. Springer International Publishing (2021)
Alshuwaier, F., Areshey, A., Poon, J.: A comparative study of the current technologies and approaches of relation extraction in biomedical literature using text mining. In: ICETAS (2017)
Btoush, E.S., Hammad, M.M.: Generating er diagrams from requirement specifications based on natural language processing. In: IJDTA (2015)
Dawood, O.S., et al.: From requirements engineering to uml using natural language processing-survey study. In: EJERS (2017)
Eberts, M., Ulges, A.: An end-to-end model for entity-level relation extraction using multi-instance learning. In: EACL ACL (2021)
Elallaoui, M., Nafil, K., Touahni, R.: Automatic transformation of user stories into uml use case diagrams using nlp techniques. Procedia Computer Science (2018)
Friedrich, F., Mendling, J., Puhlmann, F.: Process model generation from natural language text. In: CAiSE. Springer, Berlin Heidelberg (2011)
Han, X., Yu, P., Liu, Z., Sun, M., Li, P.: Hierarchical relation extraction with coarse-to-fine grained attention. In: EMNLP. ACL (2018)
Han, X., et al.: FewRel: A large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. In: EMNLP. ACL (2018)
Hendrickx, I., et al.: SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. In: SemEval. ACL (2010)
Klöser, L., Kohl, P., Kraft, B., Zündorf, A.: Multi-attribute relation extraction (MARE): simplifying the application of relation extraction. In: DeLTA. SCITEPRESS (2021)
Kumar, S.: A survey of deep learning methods for relation extraction. CoRR (2017)
Liu, K.: A survey on neural relation extraction. Sci. China Technol, Sciences (2020)
López, H.A., Debois, S., Hildebrandt, T.T., Marquard, M.: The process highlighter: From texts to declarative processes and back. In: CEUR Workshop Proc. (2018)
Nasar, Z., Jaffry, S.W., Malik, M.K.: Named entity recognition and relation extraction: State-of-the-art. ACM Comput, Surv (2021)
Nayak, T., Majumder, N., Goyal, P., Poria, S.: Deep neural approaches to relation triplets extraction: a comprehensive survey. Cogn, Comput (2021)
Page, M.J., et al.: The prisma 2020 statement: an updated guideline for reporting systematic reviews. In: Systematic reviews (2021)
Peng, H., et al.: Learning from Context or Names? An Empirical Study on Neural Relation Extraction. In: EMNLP. ACL (2020)
Qian, K., et al.: Annotation inconsistency and entity bias in MultiWOZ. In: Proceedings of SIGdial. ACL (2021)
Quishpi, L., Carmona, J., Padró, L.: Extracting annotations from textual descriptions of processes. In: Fahland, D., Ghidini, C., Becker, J., Dumas, M. (eds.) BPM 2020. LNCS, vol. 12168, pp. 184–201. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58666-9_11
Ren, F., et al.: A novel global feature-oriented relational triple extraction model based on table filling. In: EMNLP. ACL (2021)
Riedel, S., Yao, L., McCallum, A.: Modeling relations and their mentions without labeled text. In: Proceedings of ECML PKDD. Springer, Berlin Heidelberg (2010)
Roth, D., Yih, W.t.: A linear programming formulation for global inference in natural language tasks. In: CoNLL. ACL (2004)
Salih Dawood, O., Sahraoui, A.E.K.: From requirements engineering to uml using natural language processing - survey study. EJIE (2017)
Saranya, M., Geetha, T.V., Annie, R.A.X.: Comparative analysis of different deep learning techniques for relation extraction from biomedıcal literature. In: Proceedings of ICSADL. Springer Singapore (2022)
Taillé, B., Guigue, V., Scoutheeten, G., Gallinari, P.: Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! In: EMNLP. ACL (2020)
Vashishth, S., Joshi, R., Prayaga, S.S., Bhattacharyya, C., Talukdar, P.: RESIDE: Improving distantly-supervised neural relation extraction using side information. In: EMNLP. ACL (2018)
Wang, H., Qin, K., Zakari, R.Y., Lu, G., Yin, J.: Deep neural network-based relation extraction: an overview. Neural Comput, Appl (2022)
Wang, J., Lu, W.: Two are better than one: Joint entity and relation extraction with table-sequence encoders. In: EMNLP. ACL (2020)
Wei, Z., Su, J., Wang, Y., Tian, Y., Chang, Y.: A novel cascade binary tagging framework for relational triple extraction. In: ACL (2020)
Yan, Z., Zhang, C., Fu, J., Zhang, Q., Wei, Z.: A partition filter network for joint entity and relation extraction. In: EMNLP. ACL (2021)
Yu, B., et al.: Joint extraction of entities and relations based on a novel decomposition strategy. In: Proceedings of ECAI (2020)
Yuan, Y., Zhou, X., Pan, S., Zhu, Q., Song, Z., Guo, L.: A relation-specific attention network for joint entity and relation extraction. In: IJCAI (2020)
Zeng, D., Zhang, H., Liu, Q.: Copymtl: Copy mechanism for joint extraction of entities and relations with multi-task learning. ArXiv (2020)
Zhang, X., Dai, Y., Jiang, T.: A survey deep learning based relation extraction. J. Phys.: Conf. Series 1601, 032029 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ackermann, L., Neuberger, J., Käppel, M., Jablonski, S. (2023). Bridging Research Fields: An Empirical Study on Joint, Neural Relation Extraction Techniques. In: Indulska, M., Reinhartz-Berger, I., Cetina, C., Pastor, O. (eds) Advanced Information Systems Engineering. CAiSE 2023. Lecture Notes in Computer Science, vol 13901. Springer, Cham. https://doi.org/10.1007/978-3-031-34560-9_28
Download citation
DOI: https://doi.org/10.1007/978-3-031-34560-9_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34559-3
Online ISBN: 978-3-031-34560-9
eBook Packages: Computer ScienceComputer Science (R0)