Skip to main content

Open-Domain Non-factoid Question Answering

  • Conference paper
  • First Online:
Text, Speech, and Dialogue (TSD 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10415))

Included in the following conference series:

Abstract

We present an end-to-end system for open-domain non-factoid question answering. We leverage the information on the ever-growing World Wide Web, and the capabilities of modern search engines to find the relevant information. Our QA system is composed of three components: (i) query formulation module (QFM) (ii) candidate answer generation module (CAGM) and (iii) answer selection module (ASM). A thorough empirical evaluation using two datasets demonstrates that the proposed approach is highly competitive.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://sites.google.com/site/trecliveqa2015/.

  2. 2.

    https://project-hobbit.eu/challenges/qald2017/.

  3. 3.

    https://pypi.python.org/pypi/html2text.

  4. 4.

    https://pypi.python.org/pypi/langdetect.

  5. 5.

    http://webscope.sandbox.yahoo.com.

  6. 6.

    The datasets will be shared after publication.

  7. 7.

    https://code.google.com/archive/p/word2vec/.

  8. 8.

    http://www.cs.cmu.edu/~alavie/METEOR/.

  9. 9.

    https://radimrehurek.com/gensim/models/doc2vec.html.

  10. 10.

    https://research.googleblog.com/2016/08/text-summarization-with-tensorflow.html.

References

  1. Agarwal A., et al.: Learning to rank for Robust question answering. In: Proceedings of CIKM (2012)

    Google Scholar 

  2. Agichtein E., et al.: Finding high-quality content in social media. In: Proceedings of WSDM (2008)

    Google Scholar 

  3. Agichtein E., et al.: Overview of the TREC 2015 LiveQA track. In: Proceedings of TREC (2015)

    Google Scholar 

  4. Bian J., et al.: Finding the right facts in the crowd: factoid question answering over social media. In: Proceedings of WWW (2008)

    Google Scholar 

  5. Bilotti M.W., et al.: Rank learning for factoid question answering with linguistic and semantic constraints. In: Proceedings of CIKM (2010)

    Google Scholar 

  6. Bobrow D.G.: A question-answering system for high school algebra word problems. In: Proceedings of FJCC (1964)

    Google Scholar 

  7. Burges C.: From ranknet to lambdarank to lambdamart: an overview. Learning 11, 81 (2010)

    Google Scholar 

  8. Chen D., Manning, C.: A fast and accurate dependency parser using neural networks. In: Proceedings of EMNLP (2014)

    Google Scholar 

  9. Chen, Q., Li, M., Zhou, M.: Improving query spelling correction using web search results. In: Proceedings of EMNLP-CoNLL (2007)

    Google Scholar 

  10. Cohen, D., Croft, B.: End to end long short term memory networks for non-factoid question answering. In: Proceedings of ICTIR (2016)

    Google Scholar 

  11. Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5), 602–610 (2005)

    Google Scholar 

  12. Green, C.: Theorem proving by resolution as a basis for question-answering systems. Mach. Intell. 4, 183–205 (1969)

    Google Scholar 

  13. Higashinaka, R., Isozaki, H.: Corpus-based question answering for why-questions. In: Proceedings of IJCNLP (2008)

    Google Scholar 

  14. Oh, J.H., et al.: Why question answering using sentiment analysis and word classes. In: Proceedings of EMNLP-CoNLL (2012)

    Google Scholar 

  15. Severyn A., Moschitti A.: Learning to rank short text pairs with convolutional deep neural networks. In: Proceedings of SIGIR (2015)

    Google Scholar 

  16. Soricut, R., Brill, E.: Automatic question answering using the web: beyond the factoid. Inf. Retrieval. 9, 191–206 (2006)

    Google Scholar 

  17. Surdeanu M., et al.: Learning to rank answers to non-factoid questions from web collections. Comput. Linguist. 37, 351–383 (2011)

    Google Scholar 

  18. Suryanto, M.A., et al.: Quality-aware collaborative question answering: methods and evaluation. In: Proceedings of WSDM (2009)

    Google Scholar 

  19. Varanasi, S., Neumann, G.: Question/answer matching for Yahoo! Answers using a corpus-based extracted ngram-based mapping. In: Proceedings of TREC (2015)

    Google Scholar 

  20. Waltz, D.L.: An English language question answering system for a large relational database. Commun. ACM. 21, 526–539 (1978)

    Google Scholar 

  21. Wang, D., Nyberg, E.: CMU OAQA at TREC 2015 LiveQA: discovering the right answer with clues. In: Proceedings of TREC (2015)

    Google Scholar 

  22. Wang, D., Nyberg, E.: CMU OAQA at TREC 2016 LiveQA: an attentional neural encoder-decoder approach for answer ranking. In: Proceedings of TREC (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria Khvalchik .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Khvalchik, M., Kulkarni, A. (2017). Open-Domain Non-factoid Question Answering. In: Ekštein, K., Matoušek, V. (eds) Text, Speech, and Dialogue. TSD 2017. Lecture Notes in Computer Science(), vol 10415. Springer, Cham. https://doi.org/10.1007/978-3-319-64206-2_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64206-2_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64205-5

  • Online ISBN: 978-3-319-64206-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics