Abstract
Entity relation extraction aims to identify entities and their semantic relationships from unstructured text. To address issues like cascading errors and redundant information found in current joint extraction methods, a One-Module One-Step model is adopted. Additionally, in overcoming challenges related to limited annotated data and the tendency of neural networks to overfit, this paper introduces a method leveraging data augmentation based on a large language model. The approach utilizes five data augmentation strategies to improve the accuracy of triple extraction. Conducting experiments on the augmented dataset reveals significant enhancements in evaluation metrics compared to unaugmented data. In entity relation extraction tasks, the proposed method demonstrates a notable boost, increasing accuracy and F1 scores by 7.3 and 8.5 percentage points, respectively. Moreover, it shows a positive impact on the non-prompting strategy, elevating accuracy and F1 scores by 9.4 and 9.1 percentage points, respectively. These experiments affirm the effectiveness of data augmentation based on a large language model in improving entity relation extraction tasks.
This is a preview of subscription content, log in via an institution to check access.
References
Yang, S.Z., Liu, Y.X., Zhang, K.W., Hong, Y., Huang, H.: Survey on distantly-supervised relation extraction. Chin. J. Comput. 44(8), 1636–1660 (2021)
Mintz, M., Bills, S., Snow, R., Jurafsky, D.: Distant supervision for relation extraction without labeled data. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pp. 1003–1011 (2009)
Zhao, Y.M., Pan, P., Mao, J.: Recognizing intensity of medical query intentions based on task knowledge fusion and text data enhancement. Data Anal. Knowl. Disc. 7(2), 38–47 (2023)
Zhang, H.P., Li, L.H., Li, C.J.: ChatGPT performance evaluation on Chinese language and risk measures. Data Anal. Knowl. Disc. 7(3), 16–25 (2023)
Ma, Y., Cao, Y., Hong, Y.C., Sun, A.: Large language model is not a good few-shot information extractor, but a good reranker for hard samples!. arXiv preprint arXiv:2303.08559 (2023)
Shang, Y.M., Huang, H., Mao, X.: Onerel: joint entity and relation extraction with one module in one step. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp. 11285–11293 (2022)
Ding, B., Qin, C., Liu, L., Bing, L., Joty, S., Li, B.: Is gpt-3 a good data annotator? arXiv preprint arXiv:2212.10450 (2022)
Zhou, P., et al.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 2, pp. 207–212 (2016)
Wei, Z., Su, J., Wang, Y., Tian, Y., Chang, Y.: A novel cascade binary tagging framework for relational triple extraction. arXiv preprint arXiv:1909.03227(2019)
Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., Sun, L.: TPLinker: single-stage joint extraction of entities and relations through token pair linking. arXiv preprint arXiv:2010.13415 (2020)
Acknowledgements
This work was supported by the National Key Research and Development Program of China (2022YFC3302300), Advanced Research Project (7090201050307), National 242 Information Security Program (2023A105).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 IFIP International Federation for Information Processing
About this paper
Cite this paper
Zhang, M., Zhu, S., Zhang, J., Han, Y., Zhu, X., Zhang, L. (2024). Entity Relation Joint Extraction with Data Augmentation Based on Large Language Model. In: Shi, Z., Torresen, J., Yang, S. (eds) Intelligent Information Processing XII. IIP 2024. IFIP Advances in Information and Communication Technology, vol 703. Springer, Cham. https://doi.org/10.1007/978-3-031-57808-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-57808-3_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-57807-6
Online ISBN: 978-3-031-57808-3
eBook Packages: Computer ScienceComputer Science (R0)
