Abstract
A usability study of Clarity, a cross language information retrieval system for rare languages, is presented. Clarity aims at investigating CLIR for so-called low-density languages, those with few translation resources. The usability study explored two different levels of feedback and control over the query translation mechanism. Techniques like word-by-word translation of title and keywords were also tested. Although it would appear that a greater control over query translation enables users to retrieve more relevant documents a great difference among participants, topics, and tasks was discovered. Indeed the user engagement with the searching task is extremely subjective and variable, thus affecting the homogeneity of the results and preventing any statistical validity. A revision of the current evaluation schema is important to get a better understanding of user-CLIR interaction and some issues on different ways of measuring user’s performance are outlined in this perspective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Airio, E, Keskustalo, H., Hedlund, T., Pirkola, A.: UTACLIR @ CLEF 2002: Towards a unified translation process model. Working notes CLEF2002, (2002), 51-58.
Beaulieu, M., Jones, S.: Interactive searching and interface issues in the Okapi best match probabilistic retrieval system. Interacting with computers, 10(3), (1998) 237–248.
Borlund, P., and Ingwersen, P. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation, (53)3, (2000) 225–250.
Capstick, J., Diagne, A. K. Erbach, G., Uszkoreit, H., Laisenberg, A., Leisenberg, M.A.: A system for supporting cross-lingual information retrieval. Information Processing and Management, 36(2), (2000) 275–289.
He, D., Wang, J., Oard, D., and Nossal, M.: Comparing User-assisted and Automatic Query Translation. Working notes CLEF 2002, (2002) 267-278.
Koenemann, J., and Belkin, N.J.: A case for interaction: A study of interactive information retrieval behaviour and effectiveness. Proceedings of CHI96, (1996) 205-212
Oard, D.: Serving users in many languages cross-language information retrieval for digital libraries, D-Lib Magazine, December 1997.
Ogden, W. C., and Davis, M.W.: Improving cross-language text retrieval with human interactions. Proceedings of the Hawaii International Conference on System Science — HICSS-33, 2000.
Petrelli, D., Hansen, P., Beaulieu, M. Sanderson M.: User Requirement Elicitation for Cross-Language Information Retrieval. Proceedings of International Conference on Information Seeking and Retrieval in Context — ISIC 2002, Lisbon, September 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Petrelli, D., Demetriou, G., Herring, P., Beaulieu, M., Sanderson, M. (2003). Exploring the Effect of Query Translation when Searching Cross-Language. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds) Advances in Cross-Language Information Retrieval. CLEF 2002. Lecture Notes in Computer Science, vol 2785. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45237-9_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-45237-9_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40830-7
Online ISBN: 978-3-540-45237-9
eBook Packages: Springer Book Archive