Skip to main content
SpringerLink
Log in

Overview of the NLPCC 2015 Shared Task: Open Domain QA

  • Conference paper
  • First Online:
Natural Language Processing and Chinese Computing (NLPCC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9362))

  • 2320 Accesses

Abstract

In this paper, we give the overview of the open domain Question Answering (or open domain QA) shared task in NLPCC 2015. We first review the background of QA, and then describe open domain QA shared task in this year’s NLPCC, including the construction of the benchmark datasets, the auxiliary dataset, and the evaluation metrics. The evaluation results of submissions from participating teams are presented in the experimental part, together with a brief introduction to the techniques used in each participating team’s QA system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wang, Y., Berant, J., Liang, P.: Building a semantic parser overnight. In: ACL (2015)

    Google Scholar 

  2. Pasupat, P., Liang, P.: Compositional semantic parsing on semi-structured tables. In: ACL (2015)

    Google Scholar 

  3. Pasupat, P., Liang, P.: Zero-shot entity extraction from web pages. In: ACL (2014)

    Google Scholar 

  4. Bao, J., Duan, N., Zhou, M., Zhao, T.: Knowledge-based question answering as machine translation. In: ACL (2014)

    Google Scholar 

  5. Yang, M.-C., Duan, N., Zhou, M., Rim, H.-C.: Joint relational embeddings for knowledge-based question answering. In: EMNLP (2014)

    Google Scholar 

  6. Berant, J., Chou, A., Frostig, R., Liang, P.: Semantic parsing on freebase from question-answer pairs. In: EMNLP (2013)

    Google Scholar 

  7. Kwiatkowski, T., Choi, E., Artzi, Y., Zettlemoyer, L.: Scaling semantic parsers with on-the-fly ontology matching. In: EMNLP (2013)

    Google Scholar 

  8. Bordes, A., Usunier, N., Chopra, S., Weston, J.: Large-scale simple question answering with memory network. In: ICLR (2015)

    Google Scholar 

  9. Weston, J., Bordes, A., Chopra, S., Mikolov, T.: Towards AI-complete question answering: a set of prerequisite toy tasks (2015). arXiv

    Google Scholar 

  10. Dong, L., Wei, F., Zhou, M., Xu, K.: Question answering over freebase with multi-column convolutional neural networks. In: ACL (2015)

    Google Scholar 

  11. Yih, W., Chang, M.-W., He, X., Gao, J.: Semantic parsing via staged query graph generation: question answering with knowledge base. ACL (2015)

    Google Scholar 

  12. Yao, X.: Lean question answering over freebase from scratch. In: NAACL (2015)

    Google Scholar 

  13. Berant, J., Liang, P.: Semantic parsing via paraphrasing. In: ACL (2014)

    Google Scholar 

  14. Yao, X., Durme, V.: Information extraction over structured data: question answering with freebase. In: ACL (2014)

    Google Scholar 

  15. Bordes, A., Weston, J., Chopra, S.: Question answering with subgraph embeddings. In: EMNLP (2014)

    Google Scholar 

  16. Bordes, A., Weston, J., Usunier, N.: Open question answering with weakly supervised embedding models. In: Calders, T., Esposito, F., Hüllermeier, E., Meo, R. (eds.) ECML PKDD 2014, Part I. LNCS, vol. 8724, pp. 165–180. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  17. Yin, P., Duan, N., Kao, B., Bao, J., Zhou, M.: Answering questions with complex semantic constraints on open KBs. In: CIKM (2015)

    Google Scholar 

  18. Fader, A., Zettlemoyer, L., Etzioni, O.: Open question answering over curated and extracted knowledge bases. In: KDD (2014)

    Google Scholar 

  19. Fader, A., Zettlemoyer, L., Etzioni, O.: Paraphrase-driven learning for open question answering. In: ACL (2013)

    Google Scholar 

  20. Del Corro, L., Gemulla, R.: ClausIE: Clause-based open information extraction. In: WWW (2013)

    Google Scholar 

  21. Mausam, Schmitz, M., Bart, R., Soderland, S., Etzioni, O.: Open language learning for information extraction. In: EMNLP (2012)

    Google Scholar 

  22. Yahya, M., Berberich, K., Elbassuoni, S.: Natural language questions for the web of data. In: EMNLP-CoNLL (2012)

    Google Scholar 

  23. Fader, A., Soderland, S., Etzioni, O.: Identifying relations for open information extraction. In: EMNLP (2011)

    Google Scholar 

  24. Wu, F., Weld, D.S.: Open information extraction using wikipedia. In: ACL (2010)

    Google Scholar 

  25. Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web. In: IJCAI (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Microsoft Research, Beijing, China

    Nan Duan

Authors
  1. Nan Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nan Duan .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Juanzi Li

  2. Rensselaer Polytechnic Institute, Troy, NY, USA

    Heng Ji

  3. Peking University, Beijing, China

    Dongyan Zhao

  4. Peking University, Beijing, China

    Yansong Feng

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Duan, N. (2015). Overview of the NLPCC 2015 Shared Task: Open Domain QA. In: Li, J., Ji, H., Zhao, D., Feng, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2015. Lecture Notes in Computer Science(), vol 9362. Springer, Cham. https://doi.org/10.1007/978-3-319-25207-0_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25207-0_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25206-3

  • Online ISBN: 978-3-319-25207-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation