Skip to main content

Recommending Question-Answers for Enriching Textbooks

  • Conference paper
  • First Online:
Big Data Analytics (BDA 2020)

Abstract

The students often use the community question-answering (cQA) systems along with textbooks to gain more knowledge. The millions of question-answers (QA) already accessible in these cQA forums. The huge amount of QA makes it hard for the students to go through all possible QA for a better understanding of the concepts. To address this issue, this paper provides a technological solution “Topic-based text enrichment process” for a textbook with relevant QA pairs from cQA. We used techniques of natural language processing, topic modeling, and data mining to extract the most relevant QA sets and corresponding links of cQA to enrich the textbooks. This work provides all the relevant QAs for the important topics of the textbook to the students, therefore it helps them to learn the concept more quickly. Experiments were carried out on a variety of textbooks such as Pattern Recognition and Machine Learning by Christopher M Bishop, Data Mining Concepts & techniques by Jiawei Han, Information Theory, Inference, & Learning Algorithms by David J.C. MacKay, and National Council of Educational Research and Training (NCERT). The results prove that we are effective in learning enhancement by enhancing the textbooks on various subjects and across different grades with the relevant QA pairs using automated techniques. We also present the results of quiz sessions which were conducted to evaluate the effectiveness of the proposed model in establishing relevance to learning among students.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.quora.com/.

  2. 2.

    https://stackoverflow.com/.

  3. 3.

    https://www.reddit.com/.

References

  1. Agrawal, R., Gollapudi, S., Kenthapadi, K., Srivastava, N., Velu, R.: Enriching textbooks through data mining. In: Proceedings of the First ACM Symposium on Computing for Development, ACM DEV 2010. Association for Computing Machinery, New York (2010)

    Google Scholar 

  2. Bishop, C.M.: Pattern Recognition and Machine Learning. Information Science and Statistics. Springer, Heidelberg (2006)

    MATH  Google Scholar 

  3. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  4. Bonadiman, D., Uva, A., Moschitti, A.: Effective shared representations with multitask learning for community question answering. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (ACL): Volume 2, Short Papers, Vlencia, Spain, pp. 726–732, April 2017

    Google Scholar 

  5. Bonadiman, D., Uva, A., Moschitti, A.: Effective shared representations with multitask learning for community question answering. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (ACL): Volume 2, Short Papers, Valencia, Spain, pp. 726–732, April 2017

    Google Scholar 

  6. Chen, D., Fisch, A., Weston, J., Bordes, A.: Reading Wikipedia to answer open-domain questions. CoRR, abs/1704.00051 (2017)

    Google Scholar 

  7. Choi, E., Hewlett, D., Uszkoreit, J., Polosukhin, I., Lacoste, A., Berant, J.: Coarse-to-fine question answering for long documents. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, Canada, pp. 209–220, July 2017

    Google Scholar 

  8. Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.04805 (2018)

    Google Scholar 

  9. Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques, 3rd edn. Morgan Kaufmann Publishers Inc., San Francisco (2011)

    MATH  Google Scholar 

  10. Herrera, J., Poblete, B., Parra, D.: Learning to leverage microblog information for QA retrieval. In: Pasi, G., Piwowarski, B., Azzopardi, L., Hanbury, A. (eds.) ECIR 2018. LNCS, vol. 10772, pp. 507–520. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-76941-7_38

    Chapter  Google Scholar 

  11. Jatnika, D., Bijaksana, M.A., Suryani, A.A.: Word2Vec model analysis for semantic similarities in English words. Procedia Comput. Sci. 157, 160–167 (2019). The 4th International Conference on Computer Science and Computational Intelligence (ICCSCI 2019): Enabling Collaboration to Escalate Impact of Research Results for Society

    Article  Google Scholar 

  12. Joty, S., Màrquez, L., Nakov, P.: Joint multitask learning for community question answering using task-specific embeddings. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4196–4207. Association for Computational Linguistics, Brussels (2018). https://doi.org/10.18653/v1/D18-1452

  13. Karpukhin, V., et al.: Dense passage retrieval for open-domain question answering. arXiv preprint arXiv:2004.04906 [cs.CL] (2020)

  14. Kumar, S., Chauhan, A.: Enriching textbooks by question-answers using cQA. In: TENCON 2019 – 2019 IEEE Region 10 Conference (TENCON), pp. 707–714 (2019)

    Google Scholar 

  15. MacKay, D.J.C.: Information Theory, Inference and Learning Algorithms. Cambridge University Press, New York (2002)

    Google Scholar 

  16. Min, S., Zhong, V., Socher, R., Xiong, C.: Efficient and robust question answering from minimal context over documents. CoRR, abs/1805.08092 (2018)

    Google Scholar 

  17. Nakov, P., et al.: SemEval-2017 task 3: community question answering. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pp. 27–48. Association for Computational Linguistics, Vancouver (2017). https://doi.org/10.18653/v1/S17-2003

  18. Nasehi, S.M., Sillito, J., Maurer, F., Burns, C.: What makes a good code example?: A study of programming Q&A in StackOverflow. In: 2012 28th IEEE International Conference on Software Maintenance (ICSM), pp. 25–34 (2012)

    Google Scholar 

  19. Patro, B.N., Kurmi, V.K., Kumar, S., Namboodiri, V.P.: Learning semantic sentence embeddings using sequential pair-wise discriminator. arXiv preprint arXiv:1806.00807 [cs.CL] (2019)

  20. Rücklé, A., Moosavi, N., Gurevych, I.: COALA: a neural coverage-based approach for long answer selection with small data, vol. 33, July 2019

    Google Scholar 

  21. Rücklé, A., Moosavi, N.S., Gurevych, I.: Neural duplicate question detection without labeled training data. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 1607–1617. Association for Computational Linguistics, Hong Kong (2019). https://doi.org/10.18653/v1/D19-1171

  22. Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, WSDM 2015, New York, NY, USA, pp. 399–408 (2015)

    Google Scholar 

  23. Sakata, W., Shibata, T., Tanaka, R., Kurohashi, S.: FAQ retrieval using query-question similarity and BERT-based query-answer relevance. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, pp. 1113–1116. Association for Computing Machinery, New York (2019)

    Google Scholar 

  24. Shen, Y., et al.: Knowledge-aware attentive neural network for ranking question answer pairs. In: The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, pp. 901–904. Association for Computing Machinery, New York (2018)

    Google Scholar 

  25. Srba, I., Savic, M., Bielikova, M., Ivanovic, M., Pautasso, C.: Employing community question answering for online discussions in university courses: students’ perspective. Comput. Educ. 135, 75–90 (2019)

    Article  Google Scholar 

  26. Tan, M., dos Santos, C., Xiang, B., Zhou, B.: Improved representation learning for question answer matching. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany, pp. 464–473, August 2016

    Google Scholar 

  27. Wang, S., et al.: R3: reinforced ranker-reader for open-domain question answering. In: AAAI (2018)

    Google Scholar 

  28. Weissenborn, D., Wiese, G., Seiffe, L.: FastQA: a simple and efficient neural architecture for question answering. arXiv, abs/1703.04816 (2017)

    Google Scholar 

  29. Wen, J., Ma, J., Feng, Y., Zhong, M.: Hybrid attentive answer selection in CQA with deep users modelling. In: AAAI (2018)

    Google Scholar 

  30. Wu, W., Sun, X., Wang, H.: Question condensing networks for answer selection in community question answering. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia, pp. 1746–1755, July 2018

    Google Scholar 

  31. Xu, J., et al.: Short text clustering via convolutional neural networks. In: Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, Association for Computational Linguistics, Denver, Colorado, pp. 62–69, June 2015

    Google Scholar 

  32. Yang, M., Tu, W., Qu, Q., Zhou, W., Liu, Q., Zhu, J.: Advanced community question answering by leveraging external knowledge and multi-task learning. Knowl.-Based Syst. 171, 106–119 (2019)

    Google Scholar 

  33. Yoon, S., Shin, J., Jung, K.: Learning to rank question-answer pairs using hierarchical recurrent encoder with latent topic clustering. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, Louisiana, pp. 1575–1584, June 2018

    Google Scholar 

  34. Zheng, C., Zhai, S., Zhang, Z.: A deep learning approach for expert identification in question answering communities. CoRR, abs/1711.05350 (2017)

    Google Scholar 

  35. Zheng, C.T., Liu, C., San Wong, H.: Corpus-based topic diffusion for short text clustering. Neurocomputing 275, 2444–2458 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shobhan Kumar .

Editor information

Editors and Affiliations

Appendix: Questionnaire for Quiz

Appendix: Questionnaire for Quiz

See Fig. 6.

Fig. 6.
figure 6

(a) Questionnaire for Quiz 1 (Group 1). (b) Questionnaire for Quiz 2 (Group 1). (c) Questionnaire for Quiz 1 (Group 2). (d) Questionnaire for Quiz 2 (Group 2).

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kumar, S., Chauhan, A. (2020). Recommending Question-Answers for Enriching Textbooks. In: Bellatreche, L., Goyal, V., Fujita, H., Mondal, A., Reddy, P.K. (eds) Big Data Analytics. BDA 2020. Lecture Notes in Computer Science(), vol 12581. Springer, Cham. https://doi.org/10.1007/978-3-030-66665-1_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-66665-1_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-66664-4

  • Online ISBN: 978-3-030-66665-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics