Abstract
iCLEF 2004 is the first comparative evaluation of interactive Cross-Language Question Answering systems. The UNED group has participated in this task comparing two strategies to help users in the answer finding task: the baseline system is just a standard document retrieval engine searching machine-translated versions of the documents; the contrastive system is identical, but searches passages which contain expressions of the appropriate answer type. Although the users prefer the passage system because searching is faster and simpler, it leads to slightly worse results, because the document context (which is not available in the passage retrieval system) turns out to be useful to verify the correctness of candidate answers; this makes an interesting difference with automatic Q&A systems. In addition, our experiment sets a strong baseline of 69% strict accuracy, showing that Cross-Language Question Answering can be efficiently accomplished by users without using dedicated Q&A technology.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Gonzalo, J., Oard, D.: iCLEF 2004 Track Overview: Pilot Experiments in Interactive Cross-Language Question Answering. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 310–322. Springer, Heidelberg (2005)
Callan, J., Croft, B., Harding, S.: The INQUERY retrieval system. In: Proceedings of the 3rd Int. Conference on Database and Expert Systems applications (1992)
Magnini, B., Vallin, A., Ayache, C., Rijke, M., Erbach, G., Peñas, A., Santos, D., Simov, K., Sutcliffe, R.: Overview of the CLEF 2004 Multilingual Question Answering Track. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 371–391. Springer, Heidelberg (2005)
iCLEF website, http://nlp.uned.es/iCLEF
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
López-Ostenero, F., Gonzalo, J., Peinado, V., Verdejo, F. (2005). Interactive Cross-Language Question Answering: Searching Passages Versus Searching Documents. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds) Multilingual Information Access for Text, Speech and Images. CLEF 2004. Lecture Notes in Computer Science, vol 3491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11519645_33
Download citation
DOI: https://doi.org/10.1007/11519645_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27420-9
Online ISBN: 978-3-540-32051-7
eBook Packages: Computer ScienceComputer Science (R0)