Abstract
We briefly survey the current state of art in the field of Question Answering and present the YodaQA system, an open source framework for this task and a baseline pipeline with reasonable performance. We take a holistic approach, reviewing and aiming to integrate many different question answering task definitions and approaches concerning classes of knowledge bases, question representation and answer generation. To ease performance comparisons of general-purpose QA systems, we also propose an effort in building a new reference QA testing corpus which is a curated and extended version of the TREC corpus.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baudiš, P.: YodaQA: a modular question answering system pipeline. In: POSTER 2015–19th International Student Conference on Electrical Engineering (2015)
Berant, J., Chou, A., Frostig, R., Liang, P.: Semantic parsing on freebase from question-answer pairs. In: EMNLP, pp. 1533–1544 (2013)
Bordes, A., Chopra, S., Weston, J.: Question answering with subgraph embeddings (2014). arXiv preprint arXiv:1406.3676
Brill, E., Dumais, S., Banko, M.: An analysis of the AskMSR question-answering system. In: Proceedings of the ACL 2002 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 257–264. Association for Computational Linguistics (2002)
Chu-Carroll, J., Fan, J., Boguraev, B., Carmel, D., Sheinwald, D., Welty, C.: Finding needles in the haystack: Search and candidate generation. IBM Journal of Research and Development 56(3.4), 6:1–6:12 (2012)
Epstein, E.A., Schor, M.I., Iyer, B., Lally, A., et al.: Making watson fast. IBM Journal of Research and Development 56(3.4), 15:1–15:12 (2012)
Fader, A., Zettlemoyer, L., Etzioni, O.: Open question answering over curated and extracted knowledge bases. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1156–1165. ACM (2014)
Fader, A., Zettlemoyer, L.S., Etzioni, O.: Paraphrase-driven learning for open question answering. In: ACL (1), pp. 1608–1618 (2013)
Gondek, D., Lally, A., Kalyanpur, A., Murdock, J.W., Duboué, P.A., Zhang, L., et al.: A framework for merging and ranking of answers in DeepQA. IBM Journal of Research and Development 56(3.4), 14:1–14:12 (2012)
Harabagiu, S.M., Moldovan, D.I., Clark, C., Bowden, M., Williams, J., Bensley, J.: Answer mining by combining extraction techniques with abductive reasoning. In: TREC, pp. 375–382 (2003)
Heilman, M., Smith, N.A.: Tree edit models for recognizing textual entailments, paraphrases, and answers to questions. In: Human Language Technologies: The Annual Conference of the North American Chapter of the ACL (2010), pp. 1011–1019. Association for Computational Linguistics (2010)
Iyyer, M., Boyd-Graber, J., Claudino, L., Socher, R., Daumé III, H.: A neural network for factoid question answering over paragraphs. In: Empirical Methods in Natural Language Processing (2014)
Lally, A., Prager, J.M., McCord, M.C., Boguraev, B., Patwardhan, S., Fan, J., Fodor, P., Chu-Carroll, J.: Question analysis: how watson reads a clue. IBM Journal of Research and Development 56(3.4), 2:1–2:14 (2012)
Schlaefer, N., Gieselmann, P., Schaaf, T., Waibel, A.: A pattern learning approach to question answering within the ephyra framework. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2006. LNCS (LNAI), vol. 4188, pp. 687–694. Springer, Heidelberg (2006)
Unger, C.: Multilingual question answering over linked data: Qald-4 dataset (2014)
Yao, X., Van Durme, B., Clark, P.: Automatic coupling of answer extraction and information retrieval. In: ACL (2), pp. 159–165. Citeseer (2013)
Yao, X., Van Durme, B., et al.: Answer extraction as sequence tagging with tree edit distance. In: HLT-NAACL, pp. 858–867 (2013)
Yu, L., Hermann, K.M., Blunsom, P., Pulman, S.: Deep learning for answer sentence selection. In: NIPS Deep Learning Workshop, December 2014
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Baudiš, P., Šedivý, J. (2015). Modeling of the Question Answering Task in the YodaQA System. In: Mothe, J., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2015. Lecture Notes in Computer Science(), vol 9283. Springer, Cham. https://doi.org/10.1007/978-3-319-24027-5_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-24027-5_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24026-8
Online ISBN: 978-3-319-24027-5
eBook Packages: Computer ScienceComputer Science (R0)