ABSTRACT
In the field of natural language processing, evaluating translation quality has been a long-standing challenge. Traditionally, the assessment of translation quality has relied heavily on manual assessment, which can be time-consuming, subjective and resource-intensive. These limitations spur the need for automated methods to streamline processes and increase objectivity and efficiency. To solve this problem, this paper introduces an automatic scoring system based on the Transformer model for evaluating the quality of translation tasks. The Transformer is a powerful sequence-to-sequence model that has achieved significant success in the field of natural language processing. By using the Transformer model, we can transform the translation task into a machine learning problem and automatically analyze the differences between the target language and the reference language. The training process of this automatic scoring system involves using a large amount of parallel corpora for data training, enabling the model to learn effective translation rules and semantic representations. In the testing phase, the system can accept the translation text to be evaluated and assign it an automatic score, representing the quality of its translation. This automatic scoring system can improve the efficiency and accuracy of translation tasks while reducing reliance on manual evaluation.
- Stahlberg F. 2020. Neural machine translation: A review. Journal of Artificial Intelligence Research, Vol. 69: 343-418.Google ScholarCross Ref
- Ranathunga S, Lee E S A, Prifti Skenduli M, 2023. Neural machine translation for low-resource languages: A survey. ACM Computing Surveys, Vol. 55(11): 1-37.Google ScholarDigital Library
- Lopez A. 2008. Statistical machine translation. ACM Computing Surveys (CSUR), 40(3): 1-49.Google ScholarDigital Library
- Maruf S, Saleh F, Haffari G. 2021. A survey on document-level neural machine translation: Methods and evaluation. ACM Computing Surveys (CSUR), Vol. 54(2): 1-36.Google ScholarDigital Library
- Saunders D. 2022. Domain adaptation and multi-domain adaptation for neural machine translation: A survey. Journal of Artificial Intelligence Research, Vol. 75: 351-424.Google ScholarDigital Library
- Xiao Y, Wu L, Guo J, 2023. A survey on non-autoregressive generation for neural machine translation and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence.Google ScholarDigital Library
- Li L, Tayir T, Han Y, 2023. Multimodality information fusion for automated machine translation. Information Fusion, Vol.91: 352-363.Google ScholarDigital Library
- Lyu X, Li J, Zhang M, 2022. Refining History for Future-Aware Neural Machine Translation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 31: 500-512.Google ScholarDigital Library
- Almusharraf, A., & Bailey, D. 2023. Machine translation in language acquisition: A study on EFL students' perceptions and practices in Saudi Arabia and South Korea. Journal of Computer Assisted Learning. https://onlinelibrary.wiley.com/doi/10.1111/jcal.12857.Google ScholarCross Ref
- Lee, S.-M. 2018. The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning, 33(3). https://www.tandfonline.com/doi/abs/10.1080/09588221.2018.1553186.Google Scholar
- Lee, M. 2019. The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning, 33(2), 1-19. DOI:10.1080/09588221.2018.1553186.Google ScholarCross Ref
- Klimova, B., Pikhart, M., Benites, A.D., 2023. Neural machine translation in foreign language teaching and learning: a systematic review. Educ Inf Technol, 28(1), 663–682. https://doi.org/10.1007/s10639-022-11194-2.Google ScholarDigital Library
Index Terms
- Transformer-based a Automatic Scoring Model for Translation Jobs
Recommendations
Dependency-based automatic evaluation for machine translation
SSST '07: Proceedings of the NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical TranslationWe present a novel method for evaluating the output of Machine Translation (MT), based on comparing the dependency structures of the translation and reference rather than their surface string forms. Our method uses a treebank-based, widecoverage, ...
Design and Testing of Automatic Machine Translation System Based on Chinese-English Phrase Translation
With the development of linguistics and the improvement of computer performance, the effect of machine translation is getting better and better, and it is widely used. The automatic expression translation method based on the Chinese-English machine takes ...
Automatic interpretation system integrating free-style sentence translation and parallel text based translation
S2S '02: Proceedings of the ACL-02 workshop on Speech-to-speech translation: algorithms and systems - Volume 7This paper proposes an automatic interpretation system that integrates freestyle sentence translation and parallel text based translation. Free-style sentence translation accepts natural language sentences and translates them by machine translation. ...
Comments