Abstract
Extracting triples of subjects, objects, and predicates from text to populate knowledge bases traditionally involves several intermediate steps such as co-reference resolution, named entity recognition, and relationship extraction. Treating triple extraction as translation task from source sentences to sets of triples, we present an end-to-end solution for information extraction that uses task prefixes to prompts a fine-tuned large language model to extract triples from text. Thus, the need for data labeling and training multiple models is reduced.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adnan, K., Akbar, R.: Limitations of information extraction methods and techniques for heterogeneous unstructured big data. Int. J. Eng. Bus. Manag. 11, 1847979019890771 (2019)
De Cao, N., Izacard, G., Riedel, S., Petroni, F.: Autoregressive entity retrieval. arXiv preprint arXiv:2010.00904 (2020)
DeepL: DeepL translate - the most accurate translator in the world. https://www.DeepL.com/translator
Del Corro, L., Gemulla, R.: ClausIE: clause-based open information extraction. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 355–366 (2013)
Ellis, J., Getman, J., Graff, D., Strassel, S.: TAC KBP comprehensive English source corpora 2009–2014. https://doi.org/10.35111/3RXW-5114. https://catalog.ldc.upenn.edu/LDC2018T03
Etzioni, O., Banko, M., Soderland, S., Weld, D.S.: Open information extraction from the web. Commun. ACM 51(12), 68–74 (2008)
Fader, A., Soderland, S., Etzioni, O.: Identifying relations for open information extraction. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 1535–1545. Association for Computational Linguistics (2011). https://aclanthology.org/D11-1142
Kotnis, B., et al.: milIE: modular & iterative multilingual open information extraction. http://arxiv.org/abs/2110.08144
Liu, P., Gao, W., Dong, W., Huang, S., Zhang, Y.: Open information extraction from 2007 to 2022 - a survey. http://arxiv.org/abs/2208.08690
Mausam, M.: Open information extraction systems and downstream applications. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 4074–4077 (2016)
Niklaus, C., Cetto, M., Freitas, A., Handschuh, S.: A survey on open information extraction. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 3866–3878. Association for Computational Linguistics (2018). https://aclanthology.org/C18-1326
NIST: text analysis conference (TAC) KBP 2017 tracks. https://tac.nist.gov/2017/KBP/index.html
Nogueira, R., Yang, W., Lin, J., Cho, K.: Document expansion by query prediction. http://arxiv.org/abs/1904.08375
Ouyang, L., et al.: Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155 (2022)
Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2002)
Ro, Y., Lee, Y., Kang, P.: Multi\(^{2}\)OIE: multilingual open information extraction based on multi-head attention with BERT. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 1107–1117 (2020). http://arxiv.org/abs/2009.08128
Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 885–895. Association for Computational Linguistics (2018). http://aclweb.org/anthology/N18-1081
Stoica, G., Platanios, E.A., Póczos, B.: Re-TACRED: addressing shortcomings of the TACRED dataset. http://arxiv.org/abs/2104.08398
Wang, C., Liu, X., Chen, Z., Hong, H., Tang, J., Song, D.: Zero-shot information extraction as a unified text-to-triple translation. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 1225–1238. Association for Computational Linguistics (2021). https://aclanthology.org/2021.emnlp-main.94
Xue, L., et al.: mT5: a massively multilingual pre-trained text-to-text transformer. arXiv preprint arXiv:2010.11934 (2020)
Zhang, Y.: Stanford TACRED homepage. https://nlp.stanford.edu/projects/tacred/
Zhang, Y., Zhong, V., Chen, D., Angeli, G., Manning, C.D.: Position-aware attention and supervised data improve slot filling. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 35–45. Association for Computational Linguistics (2017). http://aclweb.org/anthology/D17-1004
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Schacht, S., Kamath Barkur, S., Lanquillon, C. (2023). PromptIE - Information Extraction with Prompt-Engineering and Large Language Models. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2023 Posters. HCII 2023. Communications in Computer and Information Science, vol 1836. Springer, Cham. https://doi.org/10.1007/978-3-031-36004-6_69
Download citation
DOI: https://doi.org/10.1007/978-3-031-36004-6_69
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36003-9
Online ISBN: 978-3-031-36004-6
eBook Packages: Computer ScienceComputer Science (R0)