Abstract
In this paper, we present two different question-answering systems on speech transcripts which participated to the QAst 2007 evaluation. These two systems are based on a complete and multi-level analysis of both queries and documents. The first system uses handcrafted rules for small text fragments (snippet) selection and answer extraction. The second one replaces the handcrafting with an automatically generated research descriptor. A score based on those descriptors is used to select documents and snippets. The extraction and scoring of candidate answers is based on proximity measurements within the research descriptor elements and a number of secondary factors. The evaluation results are ranged from 17% to 39% as accuracy depending on the tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Voorhees, E.M., Buckland, L.P.: In: Voorhees, Buckland (eds.) The Fifteenth Text REtrieval Conference Proceedings (TREC 2006) (2006)
Giampiccolo, D., Forner, P., Peñas, A., Ayache, C., Cristea, D., Jijkoun, V., Osenova, P., Rocha, P., Sacaleanu, B., Sutcliffe, R.: Overview of the CLEF 2007 Multilingual Question Answering Track. In: Working Notes for the CLEF 2007 Workshop, Budapest, Hungary (September 2007)
Ayache, C., Grau, B., Vilnat, A.: Evaluation of question-answering systems: The French EQueR-EVALDA Evaluation Campaign. In: Proceedings of LREC 2006, Genoa, Italy (2006)
Turmo, J., Comas, P., Ayache, C., Mostefa, D., Rosset, S., Lamel, L.: Overview of QAST 2007. In: Working Notes of CLEF 2007 Workshop, Budapest, Hungary (September 2007)
Harabagiu, S., Moldovan, D.: Question-Answering. In: Mitkov, R. (ed.) The Oxford Handbook of Computational Linguistics. Oxford University Press, Oxford (2003)
Harabagiu, S., Hickl, A.: Methods for using textual entailment in Open-Domain question-answering. In: Proceedings of COLING 2006, Sydney, Australia (July 2006)
van Schooten, B., Rosset, S., Galibert, O., Max, A., op den Akker, R., Illouz, G.: Handling speech input in the Ritel QA dialogue system. In: Proceedings of Interspeech 2007, Antwerp. Belgium (August 2007)
Déchelotte, D., Schwenk, H., Adda, G., Gauvain, J.-L.: Improved Machine Translation of Speech-to-Text outputs. In: Proceedings of Interspeech 2007, Antwerp. Belgium (August 2007)
Bikel, D.M., Miller, S., Schwartz, R., Weischedel, R.: Nymble: a high-performance learning name-finder. In: Proceedings of ANLP 1997, Washington, USA (1997)
Isozaki, H., Kazawa, H.: Efficient Support Vector Classifiers for Named Entity Recognition. In: Proceedings of COLING, Taipei (2002)
Surdeanu, M., Turmo, J., Comelles, E.: Named Entity Recognition from spontaneous Open-Domain Speech. In: Proceedings of InterSpeech 2005, Lisbon, Portugal (2005)
Wolinski, F., Vichot, F., Dillet, B.: Automatic Processing of Proper Names in Texts. In: Proceedings of EACL 1995, Dublin, Ireland (1995)
Sekine, S.: Definition, dictionaries and tagger of Extended Named Entity hierarchy. In: Proceedings of LREC 2004, Lisbon, Portugal (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rosset, S., Galibert, O., Adda, G., Bilinski, E. (2008). The LIMSI Participation in the QAst Track. In: Peters, C., et al. Advances in Multilingual and Multimodal Information Retrieval. CLEF 2007. Lecture Notes in Computer Science, vol 5152. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85760-0_55
Download citation
DOI: https://doi.org/10.1007/978-3-540-85760-0_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85759-4
Online ISBN: 978-3-540-85760-0
eBook Packages: Computer ScienceComputer Science (R0)