Abstract
The primary aim of this contribution is to provide an editorial introduction to this Special Issue ofMachine Translation dedicated to Evaluation. The intention is to describe the rationale for the Issue, outline the various contributions of the papers in this issue, and try to situate them in a wider context. As part of providing this wider context, we give an overview and assessment of the main current approaches to Evaluation of Natural Language Processing, and especially Machine Translation systems.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
L. Balkan, M. Jaäschke, L. Humphreys, S. Meijer and A. Way (1991) Declarative Evaluation of an MT System: Practical Experiences,Applied Computer Translation, 1(3), 49–59
M. King and K. Falkedal (1990) Using Test Suites in Evaluation of Machine Translation Systems,13th International Conference on Computational Linguistics, Helsinki, 211–216
Dan Flickinger, John Nerbonne, Ivan Sag and Tom Wasow (1987) Toward Evaluation of NLP Systems,Ms delivered at Session of 25th Annual Meeting of the Association for Computational Linguistics
Giovanni Guida and Giancarlo Mauri (1986) Evaluation of Natural Language Processing Systems: Issues and Approaches,Proceedings of the IEEE, 74 (7), 1026–1035.
John A. Hawkins (1985)A Comparative Typology of English and German: Unifying the Contrasts, Croom Helm, London
L. Humphreys, M. Jaäschke, A. Way, L. Balkan, and S. Meijer (1991) Operational Evaluation of MT,Working Papers in Language Processing 22, Dept. of Language and Linguistics, University of Essex, Colchester, UK.
Margaret King (1989)A Practical Guide to the Evaluation of Machine Translation Systems, ms. ISSCO, Geneva
John Lehrberger and Laurent Bourbeau (1987)Machine Translation: Linguistic Characteristics of MT Systems and General Methodology of Evaluation, Amsterdam, John Benjamin
M. Nagao, J. Tsujii, and J. Nakamura (1988). The Japanese Government Project for Machine Translation. In: J. Slocum (ed.).Machine Translation Systems, Cambridge: University Press Cambridge 141–186
Martha Palmer and Tim Finin (1990) Workshop on the Evaluation of Natural Language Processing Systems,Computational Linguistics, 16 (3), 175–181.
John R. Pierce and John B. Carroll (1966)Language and Machines - Computers in Translation and Linguistics (ALPAC Report), Washington D.C.
G. van Slype (1982) Conception d'une méthodologie générale d' évaluation de la traduction automatique,Multilingua, 1(4), 221–237
Muriel Vasconcellos (1989), Long-term Data for an MT Policy,Literary and Linguistic Computing, 4(3), 203–213
Bernard Vauquois and Christian Boitet (1988) Automated Translation at Grenoble University. In: J. Slocum (ed.)Machine Translation Systems, Cambridge, Cambridge University Press, 85–110
A. Way (1991), A Practical Developer-Oriented Evaluation of Two MT Systems. Working Papers in Language Processing, 26, Department of Language and Linguistics, University of Essex, Colchester, UK
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Arnold, D., Sadler, L. & Humprheys, R.L. Evaluation: An assessment. Mach Translat 8, 1–24 (1993). https://doi.org/10.1007/BF00981238
Issue Date:
DOI: https://doi.org/10.1007/BF00981238