Abstract
In the face of the increasing prevalence of GPT in translation, a significant research gap exists in examining the interplay between GPT and translation. This article aims to fill this gap by offering a systematic review of the literature, discerning the overarching trends and the primary focuses of pertinent papers, and encapsulating the key advantages and drawbacks of employing GPT for translation. This systematic review examines 26 papers related to GPT and translation published in five major databases. The findings reveal a substantial growth in the volume of related publications, especially in the realm of translation accuracy and quality for high-resource and European languages. Most of these studies utilized quantitative methods, with the results consistently indicating that translations produced by GPT are equivalent to those translated by humans and surpass the quality of neural machine translation outputs. GPT has demonstrated its proficiency in accurately translating cultural texts, complex structures, and sophisticated linguistic elements, such as poetry, humor, and puns. Moreover, the findings also suggest that GPT can be effectively leveraged not only for translation but also for post-editing and translation evaluation, thereby creating new possibilities. It is also found that the quality of GPT-generated translations largely depends on the design of prompts, in which adding specific details, such as purpose, target audience, task information, pre-edit scheme, and examples, would enhance the translation accuracy. This study underscores the evolving roles of the main stakeholders and concludes by suggesting potential areas for future research. It also discusses the potential impact on the translation education, illuminating how teaching and learning processes in the field of translation could be influenced by the application of GPT.






Similar content being viewed by others
Data Availability
The authors confirm that all data generated or analysed during this study are included in this published article.
References
Hendy A, Abdelrehim M, Sharaf A, Raunak V, Gabr M, Matsushita H, Kim YJ, Mohamed A, Awadalla HH. How good are GPT models at machine translation? A comprehensive evaluation. 2023. arXiv:2302.09210. https://doi.org/10.48550/arXiv.2302.09210. Accessed 17 Apr 2024.
Karaban V, Karaban A. AI-translated poetry: Ivan Franko’s poems in GPT-3.5-driven machine and human-produced translations. Forum Linguist Stud. 2024;6(1):1994.
Raunak V, Sharaf A, Wang Y, Awadallah HH, Menezes A. Leveraging GPT-4 for automatic translation post-editing. 2023. arXiv:2305.14878. https://doi.org/10.48550/arXiv.2305.14878. Accessed 8 May 2024.
Chan V, Tang, KWW. GPT and translation: a systematic review. In: Proceeding of international symposium on educational technology, Macao, 2024. pp. 60–64.
Castilho S, Mallon CQ, Meister R, Yue S. Do online machine translation systems care for context? What about a GPT model? In: Proceedings of the 24th annual conference of the European Association for Machine Translation. Tampere: European Association for Machine Translation; 2023. pp. 393–417. https://aclanthology.org/2023.eamt-1.39/. Accessed 17 Apr 2024.
Wu Y, Hu G. Exploring prompt engineering with GPT language models for document-level machine translation: insights and findings. In: Proceedings of the eighth conference on machine translation. Singapore: Association for Computational Linguistics; 2023. pp. 166–169. https://doi.org/10.18653/v1/2023.wmt-1.15. Accessed 17 Apr 2024.
Chan V. Using a virtual reality mobile application for interpreting learning: listening to the student’s voice. Interact Learn Environ. 2022. https://doi.org/10.1080/10494820.2022.2147958.
Chan V. VIP: Investigating the impact of a virtual reality mobile application on learners’ interpreting competence. J Comput Assist Learn. 2023;39(4):1242–58. https://doi.org/10.1111/jcal.12796.
Chan V. Investigating students’ perceptions of the use of a multifunctional mobile-based virtual reality application for English/Chinese interpreting learning. Int J Mob Learn Org. 2024. https://doi.org/10.1504/IJMLO.2024.10056650.
Chan V. Investigating the effects of extended reality (XR) on interpreter competencies: an experimental study of a pioneering XR mobile-assisted language learning application for interpreting training. Unpublished.
Chan V. Impact of an extended reality-powered mobile application: an experimental study in interpreting classes. Unpublished.
Chan V, Shuttleworth M. Teaching translation technology. In: Chan SW, editor. Routledge encyclopedia of translation technology. 2nd ed. Oxon: Routledge; 2023. p. 259–79. https://doi.org/10.4324/9781003168348-15/.
Liang JC, Hwang GJ, Chen MRA, Darmawansah D. Roles and research foci of artificial intelligence in language education: an integrated bibliographic analysis and systematic review approach. Interact Learn Environ. 2023;31(7):4270–96. https://doi.org/10.1080/10494820.2021.1958348.
Huang X, Zou D, Cheng G, Chen X, Xie H. Trends, research issues and applications of artificial intelligence in language education. Educ Technol Soc. 2023;26(1):112–31.
Ji H, Han I, Ko Y. A systematic review of conversational AI in language education: focusing on the collaboration with human teachers. J Res Technol Educ. 2023;55(1):48–63. https://doi.org/10.1080/15391523.2022.2142873.
Pradana M, Elisa HP, Syarifuddin S. Discussing ChatGPT in education: a literature review and bibliometric analysis. Cogent Educ. 2023;10(2):2243134. https://doi.org/10.1080/2331186X.2023.2243134.
Imran M, Almusharraf N. Analyzing the role of ChatGPT as a writing assistant at higher education level: a systematic review of the literature. Contemp Educ Technol. 2023;15(4):ep464. https://doi.org/10.30935/cedtech/13605.
Lo CK. What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci. 2023;13(4):410. https://doi.org/10.3390/educsci13040410.
Stahlberg F. Neural machine translation: a review and survey. J Artif Intell Res. 2020;69:343–4187.
Deng X, Yu Z. A systematic review of machine-translation-assisted language learning for sustainable education. Sustainability. 2022;14(13):7598. https://doi.org/10.3390/su14137598.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRIMSA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34. https://doi.org/10.1136/bmj.b2700.
Chan V. Research on computer-assisted interpreter training: a review of studies from 2013 to 2023. SN Comput Sci. 2023;4:648. https://doi.org/10.1007/s42979-023-02072-w.
Chan V. Impact of technology on interpreting practice: a review of studies on technology and interpreting practice from 2013 to 2024. Interact Technol Smart Educ. 2024. https://doi.org/10.1108/ITSE-02-2024-004.
Yamada M. Optimizing machine translation through prompt engineering: an investigation into ChatGPT’s customizability. 2023. arXiv:2308.01391. https://doi.org/10.48550/arXiv.2308.01391. Accessed 8 May 2024.
Gu W. Linguistically informed ChatGPT prompts to enhance Japanese-Chinese machine translation: a case study on attributive clauses. 2023. arXiv:2303.15587. https://doi.org/10.48550/arXiv.2303.15587. Accessed 8 May 2024.
Sahari Y, Al-Kadi ATM, Ali JKM. A cross sectional study of ChatGPT in translation: magnitude of use, attitudes, and uncertainties. J Psycholinguist Res. 2023;52(6):2937–54. https://doi.org/10.1007/s10936-023-10031-y.
Kocmi T, Federmann C. GEMBA-MQM: detecting translation quality error spans with GPT-4. 2023. arXiv:2310.13988. https://doi.org/10.48550/arXiv.2310.13988. Accessed 8 May 2024.
Gao Y, Wang R, Hou F. How to design translation prompts for ChatGPT: an empirical study. 2023. arXiv:2304.02182. https://doi.org/10.48550/arXiv.2304.02182. Accessed 8 May 2024.
Popova O, Dadić P. Does AI have a sense of humor? CLEF 2023 JOKER tasks 1, 2 and 3: using BLOOM, GPT, SimpleT5, and more for pun detection, location, interpretation and translation. In: Proceedings of the working notes of CLEF 2023; 2023. pp. 1888–1908. https://ceur-ws.org/Vol-3497/paper-160.pdf. Accessed 17 Apr 2024.
Abu-Rayyash H. AI meets comedy: viewers’ reactions to GPT-4 generated humor translation. Ampersand. 2024;12:100162. https://doi.org/10.1016/j.amper.2023.100162.
Si S, Zhou S, Tang L, Cheng X, Zhang Y. Exploring the capabilities of ChatGPT in ancient Chinese translation and person name recognition. 2024. arXiv:2312.15304v2. https://doi.org/10.48550/arXiv.2312.15304. Accessed 8 May 2024.
Deilen S, Garrido SH, Lapshinova-Koltunski E, Maaß C. Using ChatGPT as a CAT tool in Easy Language translation. 2023. arXiv:2308.11563. https://doi.org/10.48550/arXiv.2308.11563. Accessed 8 May 2024.
Sawai R, Paik I, Kuwana A. Sentence augmentation for language translation using GPT-2. Electronics. 2021;10(24):3082. https://doi.org/10.3390/electronics10243082.
Jiang Z, Zhang Z. Can ChatGPT rival neural machine translation? A comparative study. 2024. arXiv:2401.05176. https://arxiv.org/pdf/2401.05176v1. Accessed 8 May 2024.
Chen Y. Enhancing machine translation through advanced in-context learning: a methodological strategy for GPT-4 improvement. 2023. arXiv:2311.10765. https://arxiv.org/abs/2311.10765v1. Accessed 17 Apr 2024.
Peng K, Ding L, Zhong Q, Shen L, Liu X, Zhang M, Ouyang Y, Tao D. Towards making the most of ChatGPT for machine translation. 2023. arXiv:2303.13780. https://doi.org/10.48550/arXiv.2303.13780. Accessed 17 Apr 2024.
Tang WKW. One plus one is greater than two: faculty-librarian collaboration for developing information literacy in higher education. IAFOR J Lit Librariansh. 2020;9(2):82–6. https://doi.org/10.22492/ijl.9.2.05.
Tang WKW. Assessing information literacy skills of undergraduate freshmen: a case study from Hong Kong. Int J Media Inf Lit. 2018;3(1):11–7. https://doi.org/10.13187/ijmil.2018.1.11.
Tang WKW, Chan V. Agile-blended learning approach for Metropolitan learners in higher education: a systematic literature review. In: Proceeding of international symposium on educational technology, Macao, 2024. pp. 299–303.
Chan V. Unveiling the strengths and weaknesses of technology in interpreter training: a literature survey. Forum Int J Interpret Transla. 2024.
Funding
This work described in this paper was fully supported by Hong Kong Metropolitan University Research Grant. (PFDS/2023/04).
Author information
Authors and Affiliations
Contributions
Venus Chan: designed the study; conducted analysis; drafted the work; revised it critically. William Tang: reviewed the content and provided feedback.
Corresponding author
Ethics declarations
Conflict of interest
The author declares that he/she has no conflict of interest.
Research involving human and/or animals
Not applicable.
Informed consent
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chan, V., Tang, W.KW. GPT for Translation: A Systematic Literature Review. SN COMPUT. SCI. 5, 986 (2024). https://doi.org/10.1007/s42979-024-03340-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-024-03340-z