Abstract
The role of language resources and language technology evaluation is now recognized as being crucial for the development of written and spoken language processing systems. Given the increasing challenge of multilingualism in Europe, the development of language technologies requires a more internationally distributed effort. This paper first describes several recent and on-going activities in France aimed at the development of language resources and evaluation. We then outline a new project intended to enhance collaboration, cooperation, and resource sharing among the international language processing research community.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adda G., Mariani J., Lecomte J., Paroubek P., Rajman M. (1998) The GRACE French Part-Of-Speech Tagging Evaluation Task. 1st International Conference on Language Resources and Evaluation. Granada.
Antoine J.Y., Zeiliger J., Caelen J. (1998) DQR Test Suites for a Qualitative Evaluation of Spoken Dialogue Systems: from Speech Understanding to Dialogue Strategy. 1st International Conference on Language Resources and Evaluation. Granada.
Bonhomme P., Bruneseaux F., Pierrel J.M., Romary L. (1997) Vers une normalisation des ressources linguistiques: le serveur SILFIDE. JST Francil 1997 Proceedings. Aupelf-Uref, University of Avignon (F).
Boula de Mareuil P., Yvon F., d’Alessandro C., Auberge V., Bagein M., Bailly G., Bechet F., Foukia S., Goldman J.P., Keller E., O’Shaughnessy D., Pagel V., Sannier F., Véronis J., Zellner B. (1998) Evaluation of Grapheme-to-Phoneme Conversion for Text-to-Speech Synthesis in French. 1st International Conference on Language Resources and Evaluation. Granada.
Cole R., Mariani J., Uszkoreit H., Varile G.B., Zaenen A., Zampolli A., Zue V. (eds.) (1997), Survey of the State-of-the-Art in Human Language Technology. Giardini Editori.
Devillers L., Maynard H., Rosset S., Paroubek P., Mc Tait K., Mostefa D., Choukri K., Charnay L., Bousquet C., Vigouroux N., Béchet F., Romary L., Antoine J.Y., Villaneau J., Vergnes M., Goulian J. (2004) The French Media/Evalda project: the evaluation of the understanding capability of Spoken Language Dialogue Systems. Proceeding of the 4th International Conference on Language Resources and Evaluation. Lisbon.
Dolmazon J.M., Bimbot F., Adda G., El Beze M., Caerou J.C., Zeiliger J., Adda-Decker M. (1997) Organisation de la première campagne AUPELF pour l’évaluation des systèmes de dictée vocale. JST Francil 1997 Proceedings. Aupelf-Uref, University of Avignon (F).
Gravier G., Bonastre J.F., Galliano S., Geoffrois E., Mc Tait K., Choukri K. (2004) The ESTER Evaluation Campaign of Rich Transcription of French Broadcast News. Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon.
Hovy E., Ide N., Frederking R., Mariani J., Zampolli A. (eds) (1999) Multilingual Information Management: Current Levels and Future Abilities, NSF-EC-Darpa report.
Jardino M., Bimbot F., Igounet S., Smaili K., Zitouni I., El-Beze M. (1998) A First Evaluation Campaign for Language Models. 1st International Conference on Language Resources and Evaluation. Granada.
Landi B., Kremer P., Schibler D., Schmitt L. (1998) AMARYLLIS: an Evaluation Experiment on Search Engines in a French-Speaking Context. 1st International Conference on Language Resources and Evaluation. Granada.
Langlais P., Simard M., Véronis J., Amstrong S., Bonhomme P., Debili F., Isabelle P., Souissi E., Théron P. (1998) ARCADE: a Cooperative Research Project on Parallel Text Alignment Evaluation. 1st International Conference on Language Resources and Evaluation. Granada.
Mapelli V., Nava M., Surcin S., Mostefa D., Choukri K. (2004) Technolangue: a Permanent Evaluation & Information Infrastructure. Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon.
J. Mariani F. Néel (1995) Aupelf-Uref actions towards language resources and evaluation Cocosda workshop Madrid, Spain
McTait K., Nava M., Choukri K. (2004) EVALDA: constitution d’une infrastructure d’évaluation pérenne. TALN-JEP-RECITAL Conference 2004. Fès.
Mustafa W., Jouis C. (1998) Terminology Extraction and Acquisition from Textual Data: Criteria for Evaluating Tools and Methods. 1st International Conference on Language Resources and Evaluation. Granada.
Mustafa el Hadi W., Timimi I., Dabbadie M. (2004a) Evalda-Cesart Project: Terminological Resources Acquisition Tools Evaluation Campaign. Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon.
Mustafa el Hadi W., Dabbadie B., Timimi I., Rajman, Langlais P., Hatley A., Popescu Belis B. (2004b) Work – in-progress project report: CESTA – Machine Translation Evaluation Campaign. COLING 2004, Geneva.
Nava M. (2004) Présentation de EqueR, la campagne d’évaluation des systèmes de question-réponse sur le Français. TALN-JEP-RECITAL 2004 Conference. Fès.
Paroubek P. (2000) Language Resources as by-Product of Evaluation: The MULTITAG Example. Second International Conference on Language Resources and Evaluation. Athens.
Rosset S., Bennacef S., Gauvain J.L., Devillers L., Lamel L. (1997) Corpus oral de renseignements touristiques. JST Francil 1997 Proceedings. Aupelf-Uref, University of Avignon (F).
Sabatier P., Blache P., Guizol J.J., Levy F., Nazarenko A., N’Guema S., Pasero R., Rolbert M. (1997) Evaluer des Systèmes de Compréhension de Textes. JST Francil 1997 Proceedings. Aupelf-Uref, University of Avignon (F).
Vilnat A., Paroubek P., Monceaux L., Robba I., Gendner V., Illouz G., Jardino M. (2004) The Ongoing Evaluation Campaign of Syntactic Parsing of French: EASY. Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mariani, J. Developing Language Technologies with the Support of Language Resources and Evaluation Programs. Language Res Eval 39, 35–44 (2005). https://doi.org/10.1007/s10579-005-2694-3
Issue Date:
DOI: https://doi.org/10.1007/s10579-005-2694-3