Abstract
The paper describes the University of Amsterdam’s participation in the Question Answering track at CLEF 2003, our system and the results produced by it. A thorough analysis of the wrong answers given by our system is provided, including a discussion of each type of error and possible strategies for handling them. We outline our current efforts for improvement of the system, and propose additional research directions and procedures to reduce errors of the presented types.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Monz, C., de Rijke, M.: Tequesta: The University of Amsterdam’s textual question answering system. In: Voorhees, E., Harman, D. (eds.) The Tenth Text REtrieval Conference (TREC 2001), National Institute for Standards and Technology, pp. 519–528. NIST Special Publication 500-250 (2002)
Moldovan, D., Harabagiu, S., Girju, R., Morarescu, P., Lacatusu, F., Novischi, A., Badulescu, A., Bolohan, O.: LCC Tools for Question Answering. In: [19]
Banko, M., et al.: AskMSR: Question answering using the Worldwide Web. In: Proc. EMNLP 2002 (2002)
Jijkoun, V., Mishne, G., de Rijke, M.: Preprocessing Documents to Answer Dutch Questions. In: Proc. 15th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2003) (2003)
Brants, T.: TnT – a statistical part-of-speech tagger. In: Proc. 6th Applied NLP Conference, ANLP 2000 (2000)
Oostdijk, N.: The Spoken Dutch Corpus: Overview and first evaluation. In: Proc. LREC 2000, pp. 887–894 (2000)
Magnini, B., Negri, M., Prevete, R., Tanev, H.: Is it the right answer? exploiting web redundancy for answer validation. In: Proc. 40th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 425–432 (2002)
Jijkoun, V., Mishne, G., de Rijke, M.: The University of Amsterdam at QA@CLEF 2003. In: Working Notes for the CLEF 2003 Workshop (2003)
Xu, J., Licuanan, A., May, J., Miller, S., Weischedel, R.: TREC 2002 QA at BBN: Answer selection and confidence estimation. In: [19]
Ittycheriah, A., Roukos, S.: IBM’s Statistical Question Answering System – TREC-11. In: Proc. 11th Text REtrieval Conference (2002)
Duclaye, F., Yvon, F., Collin, O.: Learning paraphrases to improve a question-answering system. In: Proc. EACL 2003 Workshop on NLP for QA (2003)
Echihabi, A., Marcu, D.: A Noisy-Channel Approach to Question Answering. In: Hinrichs, E., Roth, D. (eds.) Proc. 41st Annual Meeting of the Association for Computational Linguistics, pp. 16–23 (2003)
Ravichandran, D., Hovy, E.: Learning Surface Text Patterns for a Question Answering System. In: Proc. 40th ACL conference (2002)
Zhang, D., Lee, W.: Question Classification using Support Vector Machines. In: Proc. 26th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 26–32. ACM Press, New York (2003)
Brill, E., Lin, J., Banko, M., Dumais, S., Ng, A.: Data-Intensive Question Answering. In: Text REtrieval Conference (2001)
Lin, J., Fernandes, A., Katz, B., Marton, G., Tellex, S.: Extracting Answers from the Web Using Knowledge Annotation and Knowledge Mining Techniques (2002)
Sang, E.T.K., Meulder, F.D.: Introduction to the CoNLL 2003 Shared Task: Language-Independent Named Entity Recognition. In: Daelemans, W., Osborne, M. (eds.) Proc. of CoNLL 2003, Edmonton, Canada, pp. 142–147 (2003)
Chu-Carroll, J., Prager, J., Welty, C., Czuba, K., Ferrucci, D.: A multi-strategy and multi-source approach to question answering. In: Proc. Eleventh Text REtrieval Conference (TREC 2002) (2002)
Voorhees, E., Harman, D. (eds.): The Tenth Text REtrieval Conference (TREC 2002). In: Voorhees, E., Harman, D. (eds.): The Tenth Text REtrieval Conference (TREC 2002), National Institute for Standards and Technology. NIST Special Publication 500-251 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jijkoun, V., Mishne, G., de Rijke, M. (2004). How Frogs Built the Berlin Wall. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds) Comparative Evaluation of Multilingual Information Access Systems. CLEF 2003. Lecture Notes in Computer Science, vol 3237. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30222-3_50
Download citation
DOI: https://doi.org/10.1007/978-3-540-30222-3_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24017-4
Online ISBN: 978-3-540-30222-3
eBook Packages: Springer Book Archive