Skip to main content

Making Stone Soup: Evaluating a Recall-Oriented Multi-stream Question Answering System for Dutch

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3491))

Abstract

We describe the participation of the University of Amsterdam in the Question Answering track at CLEF 2004. We took part in the monolingual Dutch task and, for the first time, also in the bilingual English to Dutch task. This year’s system is a further elaboration and refinement of the multi-stream architecture we introduced last year, extended with improved candidate answer re-ranking and filtering, and with additional answer finding strategies. We report the evaluation results for the whole system and its various components. The results indicate the recall-oriented approach to QA is an effective one.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ahn, D., Jijkoun, V., Kamps, J., Mishne, G., Müller, K., de Rijke, M., Schlobach, S.: The University of Amsterdam at TREC 2004. In: TREC 2004 Conference Notebook, Gaithersburg, Maryland USA (2004)

    Google Scholar 

  2. Bouma, G., Van Noord, G., Malouf, R.: Alpino: Wide-coverage computational analysis of Dutch. In: Computational Linguistics in The Netherlands 2000 (2001)

    Google Scholar 

  3. Brants, T.: TnT – a statistical part-of-speech tagger. In: Proceedings of the 6th Applied NLP Conference, ANLP 2000 (2000)

    Google Scholar 

  4. Dumais, S., Banko, M., Brill, E., Lin, J., Ng, A.: Web question answering: Is more always better? In: Bennett, P., Dumais, S., Horvitz, E. (eds.) Proceedings of SIGIR 2002, pp. 291–298 (2002)

    Google Scholar 

  5. Banko, M., et al.: AskMSR: Question answering using the Worldwide Web. In: Proceedings EMNLP 2002 (2002)

    Google Scholar 

  6. Foeldesi, C., Müller, K., de Rijke, M.: Using the Corpus Gesproken Nederlands to Build a Named Entity Recognizer. In: 14th Meeting of Computational Linguistics in the Netherlands, CLIN 2003 (2003)

    Google Scholar 

  7. Jijkoun, V., de Rijke, M.: Answer selection in a multi-stream open domain question answering system. In: McDonald, S., Tait, J.I. (eds.) ECIR 2004. LNCS, vol. 2997, pp. 99–111. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  8. Jijkoun, V., de Rijke, M., Mur, J.: Information extraction for question answering: Improving recall through syntactic patterns. In: Proceedings of the 20th International Conference on Computational Linguistics, COLING 2004 (2004)

    Google Scholar 

  9. Jijkoun, V., Mishne, G., de Rijke, M.: Preprocessing Documents to Answer Dutch Questions. In: Proceedings of the 15th Belgian-Dutch Conference on Artificial Intelligence, BNAIC 2003 (2003)

    Google Scholar 

  10. Jijkoun, V., Mishne, G., de Rijke, M.: How frogs built the Berlin Wall. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 523–534. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  11. Jijkoun, V., Mishne, G., Monz, C., de Rijke, M., Schlobach, S., Tsur, O.: The University of Amsterdam at the TREC 2003 Question Answering Track. In: Proceedings TREC 2003, pp. 586–593 (2004)

    Google Scholar 

  12. Moldovan, D., Harabagiu, S., Girju, R., Morarescu, P., Lacatusu, F., Novischi, A., Badulescu, A., Bolohan, O.: LCC Tools for Question Answering. In: Voorhees, E.M., Harman, D.K. (eds.) The Tenth Text REtrieval Conference (TREC 2002). National Institute for Standards and Technology, NIST Special Publication 500-251 (2003)

    Google Scholar 

  13. Monz, C., de Rijke, M.: The University of Amsterdam’s textual question answering system. In: Voorhees, E.M., Harman, D.K. (eds.) The Tenth Text REtrieval Conference (TREC 2001). National Institute for Standards and Technology, pp. 519–528. NIST Special Publication 500-250 (2002)

    Google Scholar 

  14. Monz, C., de Rijke, M.: Shallow morphological analysis in monolingual information retrieval for Dutch, German and Italian. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, p. 262. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  15. Oostdijk, N.: The Spoken Dutch Corpus: Overview and first evaluation. In: Proceedings LREC 2000, pp. 887–894 (2000)

    Google Scholar 

  16. Schlobach, S., Olsthoorn, M., de Rijke, M.: Type checking in open-domain question answering. In: Proceedings of the 16th European Conference on Artificial Intelligence, ECAI 2004 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ahn, D., Jijkoun, V., Müller, K., de Rijke, M., Schlobach, S., Mishne, G. (2005). Making Stone Soup: Evaluating a Recall-Oriented Multi-stream Question Answering System for Dutch. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds) Multilingual Information Access for Text, Speech and Images. CLEF 2004. Lecture Notes in Computer Science, vol 3491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11519645_42

Download citation

  • DOI: https://doi.org/10.1007/11519645_42

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-27420-9

  • Online ISBN: 978-3-540-32051-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics