Skip to main content

Evaluation of Complex Temporal Questions in CLEF-QA

  • Conference paper
Multilingual Information Access for Text, Speech and Images (CLEF 2004)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3491))

Included in the following conference series:

  • 626 Accesses

Abstract

This paper presents the evaluation of a QA system for the treatment of complex temporal questions. The system was implemented in a multilayered architecture where complex temporal questions are first decomposed into simple questions, according to the temporal relations expressed in the original question. These simple questions are then processed independently by our standard Question Answering engine and their respective answers are filtered to satisfy the temporal restrictions of each simple question. The answers to the simple decomposed questions are then combined, according to the temporal relations extracted from the original complex question, to give the final answer. This evaluation was performed as a pilot task in the Spanish QA Track of the Cross Language Evaluation Forum 2004.

This paper has been supported by the Spanish government, project TIC-2003-07158-C04-01.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Breck, E., Burger, J., Ferro, L., Greiff, W., Light, M., Mani, I., Rennie, J.: Another sys called quanda. In: Ninth Text REtrieval Conference, Gaithersburg, USA, November 2000. NIST Special Publication, vol. 500-249, pp. 369–378. National Institute of Standards and Technology (2000)

    Google Scholar 

  2. Mani, I., Wilson, G.: Robust temporal processing of news. In: ACL (ed.) Proceedings of the 38th Meeting of the Association of Computational Linguistics (ACL 2000), Hong Kong (October 2000)

    Google Scholar 

  3. Radev, D., Sundheim, B.: Using timeml in question answering (2002), http://www.cs.brandeis.edu/~jamesp/arda/time/documentation/TimeML-use-in-qa-v1.0.pdf

  4. Saquete, E., Martínez-Barco, P., Muñoz, R., Vicedo, J.L.: Splitting complex temporal questions for question answering systems. In: ACL (ed.) Proceedings of the 42nd Meeting of the Association of Computational Linguistics (ACL 2004), Barcelona, July 2004, pp. 567–574 (2004)

    Google Scholar 

  5. Saquete, E., Martínez-Barco, P., Muñoz, R., Vicedo, J.L.: Multilayered question answering system applied to temporality evaluation. Procesamiento del Lenguaje Natural 33, 25–34 (2004)

    Google Scholar 

  6. Saquete, E., Mun̄oz, R., Martínez-Barco, P.: Terseo: Temporal expression resolution system applied to event ordering. In: Matoušek, V., Mautner, P. (eds.) TSD 2003. LNCS (LNAI), vol. 2807, pp. 220–228. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  7. Eighth Text REtrieval Conference, Gaithersburg, USA, November 1999. NIST Special Publication, vol. 500-246. National Institute of Standards and Technology (1999)

    Google Scholar 

  8. Vicedo, J.L., Izquierdo, R., Llopis, F., Muñoz, R.: Question answering in Spanish. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 541–548. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Saquete, E., Vicedo, J.L., Martínez-Barco, P., Muñoz, R., Llopis, F. (2005). Evaluation of Complex Temporal Questions in CLEF-QA. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds) Multilingual Information Access for Text, Speech and Images. CLEF 2004. Lecture Notes in Computer Science, vol 3491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11519645_58

Download citation

  • DOI: https://doi.org/10.1007/11519645_58

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-27420-9

  • Online ISBN: 978-3-540-32051-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics