Skip to main content
SpringerLink
Log in

A comprehensive review on MCQ generation from text

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

While to save time, effort, and money by making and generating standard multiple choice questions and generation through text is important and it is the current necessity for all educational institutes like universities, colleges, schools, coaching centers, etc., through online as well as offline. The automatic multiple choice questions generation tools are also useful for all basic and expert users in their subject knowledge field. This paper’s aim is to understand the various approaches involved in question generation, key selection, and distractor selection based on current trends, needs. In this paper, the precised methods for MCQs generation in different stages has mentioned, and also the areas for improvement in the quality of generating the automatic multiple choice questions based on the text were also suggested. The learner’s or stakeholders understood easily based on the understanding of the techniques of the stages for generation of automatic MCQs selection and generations in various domain applications of an unstructured text.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Data Availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study

References

  1. Afzal N, Mitkov R (2014) Automatic generation of multiple choice questions using dependency-based semantic relations. Soft Comput 18(7):12–1281

    Article  Google Scholar 

  2. Agarwal M (2012) Cloze and open cloze question generation systems and their evaluation guidelines. International Institute of Information Technology, Hyderabad

    Google Scholar 

  3. Agarwal M, Mannem P (2011) Automatic gap-fill question generation from text books. In: Proceedings of the Sixth Workshop on Innovative Use of NLP for Building Educational Applications, pp 56–64, Portland, Oregon, 24 June 2011. 2011 Association for Computational Linguistics

  4. Agarwal R, Negi V, Kalra A, Mittal A (2022) Deep learning and linguistic feature based automatic multiple choice question generation from text. In: International conference on distributed computing and internet technology, Springer, pp 260–264

  5. Aldabe I, Lacalle MLd, Maritxalar M, Martinez E, Uria L (2006) Arikiturri: an automatic question generator based on corpora and nlp techniques. In: International conference on intelligent tutoring systems, Springer, pp 584–594

  6. Aldabe I, Maritxalar M (2010) Automatic distractor generation for domain specific texts. In: International conference on natural language processing, Springer, pp 27–38

  7. Aldabe I, Maritxalar M (2014) Semantic similarity measures for the generation of science tests in basque. IEEE Trans Learn Technol 7(4):375–387

    Article  Google Scholar 

  8. Aldabe I, Maritxalar M, Martinez E (2007) Evaluating and improving the distractor-generating heuristics. In: Workshop Natural Language Processing for Educational Resources’2007 - Borovets, Bulgaria

  9. Aldabe I, Maritxalar M, Mitkov R (2009) A study on the automatic selection of candidate sentences distractors. In: Artificial intelligence in education, IOS Press, pp 656–658

  10. Araki J, Rajagopal D, Sankaranarayanan S, Holm S, Yamakawa Y, Mitamura T (2016) Generating questions and multiple-choice answers using semantic analysis of texts. In: The COLING 2016 Organizing Committee, Osaka, Japan

  11. Azad HK, Deepak A (2019) Query expansion techniques for information retrieval: a survey. Inf Process Manag 56(5):1698–1735

    Article  Google Scholar 

  12. Azad HK, Deepak A, Chakraborty C, Abhishek K (2022) Improving query expansion using pseudo-relevant web knowledge for information retrieval. Pattern Recogn Lett 158:148–156

    Article  Google Scholar 

  13. Bednarik L, Kovacs L (2012) Implementation and assessment of the automatic question generation module. In: 2012 IEEE 3rd international conference on cognitive infocommunications (CogInfoCom), IEEE, pp 687–0

  14. Belkin NJ, Croft WB (1992) Information filtering and information retrieval: two sides of the same coin? Commun ACM 35(12):29–38

    Article  Google Scholar 

  15. Brown J, Frishkoff G, Eskenazi M (2005) Automatic question generation for vocabulary assessment. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP), pp 819–826, Vancouver, October 2005. 2005 Association for Computational Linguistics

  16. Ch DR, Saha SK (2018) Automatic multiple choice question generation from text: a survey. IEEE Trans Learn Technol 13(1):14–25

    Article  Google Scholar 

  17. Chen C-Y, Liou H-C, Chang JS (2006) Fast–an automatic generation system for grammar tests. In: Proceedings of the COLING/ACL 2006 Interactive Presentation Sessions, pages 1–4, Sydney, July 2006. 2006 Association for Computational Linguistics

  18. Chu M-H, Chen W-Y, Lin S-D (2012) A learning-based framework to utilize e-hownet ontology and wikipedia sources to generate multiple-choice factual questions. In: 2012 conference on technologies and applications of artificial intelligence, IEEE, pp 125–130

  19. Coniam D (1997) A preliminary inquiry into using corpus word frequency data in the automatic generation of english language cloze tests. Calico J 14 (2/4):15–33. (19 pages)

    Google Scholar 

  20. Correia R, Baptista J, Eskenazi M, Mamede N (2012) Automatic generation of cloze question stems. In: International conference on computational processing of the portuguese language, Springer, pp 168–178

  21. Correia RPdS, Baptista J, Mamede N, Trancoso I, Eskenazi M (2010) Automatic generation of cloze question distractors. In: Second Language Studies: Acquisition, Learning, Education and Technology, Tokyo, Japan September 22–24, 2010, http://www.isca-speech.org/archive

  22. Curto SdSL (2010) Automatic generation of multiple-choice tests. Unpublished master’s thesis). Universida de Técnica de Lisboa, Portugal

    Google Scholar 

  23. Das B, Majumder M (2017) Factual open cloze question generation for assessment of learner’s knowledge. Int J Educ Technol High Educ 14(1):1–12

    Article  Google Scholar 

  24. Das B, Majumder M, Phadikar S (2018) A novel system for generating simple sentences from complex and compound sentences. Int J Mod Educ Comput Sci 10(1):57

    Article  Google Scholar 

  25. Das B, Majumder M, Sekh AA, Phadikar S (2022) Automatic question generation and answer assessment for subjective examination. Cogn Syst Res 72:14–22

    Article  Google Scholar 

  26. Feeney CM, Heilman M (2008) Automatically generating and validating reading-check questions. In: International conference on intelligent tutoring systems, Springer, pp 659–661

  27. Gildea D, Jurafsky D (2002) Automatic labeling of semantic roles. Comput Linguist 28(3):245–288

    Article  Google Scholar 

  28. Goto T, Kojiri T, Watanabe T, Iwata T, Yamada T (2009) An automatic generation of multiple-choice cloze questions based on statistical learning. In: Proceedings of the 17th international conference on computers in education, asia-pacific society for computers in education Hong Kong, pp 415–422

  29. Goto T, Kojiri T, Watanabe T, Iwata T, Yamada T (2010) Automatic generation system of multiple-choice cloze questions and its evaluation. Knowl Manag E-Learn Int J 2(3):210–224

    Google Scholar 

  30. Heilman M, Eskenazi M (2007) Application of automatic thesaurus extraction for computer generation of vocabulary questions. In: Workshop on speech and language technology in education, Citeseer

  31. Heilman M, Smith NA (2010) Good question! statistical ranking for question generation. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the ACL, pp 609–617, Los Angeles, California, June 2010. 2010 Association for Computational Linguistics

  32. Hoshino A, Nakagawa H (2005) A real-time multiple-choice question generation for language testing: a preliminary study. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, pages 17–20, Ann Arbor, June 2005. Association for Computational Linguistics, 2005

  33. Hoshino A, Nakagawa H (2007) Assisting cloze test making with a web application. In: Society for information technology & teacher education international conference, Association for the Advancement of Computing in Education (AACE), pp 2807–2814

  34. Karamanis N, Mitkov R, et al. (2006) Generating multiple-choice test items from medical text: a pilot study. In: Proceedings of the Fourth International Natural Language Generation Conference, pp 111–113, Sydney, July 2006. 2006 Association for Computational Linguistics

  35. Kim Y, Lee H, Shin J, Jung K (2019) Improving neural question generation using answer separation. In: Copyright 2019, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved

  36. Kumar G, Banchs RE, D’Haro LF (2015) Automatic fill-the-blank question generator for student self-assessment. In: 2015 IEEE frontiers in education conference (FIE), IEEE, pp 1–3

  37. Kurtasov A (2013) A system for generating cloze test items from russian-language text. In: Proceedings of the Student Research Workshop associated with RANLP 2013, pp 107–112, Hissar, Bulgaria, 9–11 September 2013

  38. Lee H, Peirsman Y, Chang A, Chambers N, Surdeanu M, Jurafsky D (2011) Stanford’s multi-pass sieve coreference resolution system at the conll-2011 shared task. In: Proceedings of the 15th Conference on Computational Natural Language Learning: Shared Task, pp 28–34, Portland, Oregon, 23–24 June 2011. 2011 Association for Computational Linguistics

  39. Li J, Huang G, Fan C, Sun Z, Zhu H (2019) Key word extraction for short text via word2vec, doc2vec, and textrank. Turk J Electr Eng Comput Sci 27(3):1794–1805

    Article  Google Scholar 

  40. Lindberg D, Popowich F, Nesbit J, Winne P (2013) Generating natural language questions to support learning on-line. In: Proceedings of the 14th European Workshop on Natural Language Generation, pp 105–114, Sofia, Bulgaria, August 8–9 2013. 2013 Association for Computational Linguistics

  41. Liu M, Rus V, Liu L (2016) Automatic chinese factual question generation. IEEE Trans Learn Technol 10(2):194–204

    Article  Google Scholar 

  42. Liu M, Rus V, Liu L (2017) Automatic chinese multiple choice question generation using mixed similarity strategy. IEEE Trans Learn Technol 11 (2):193–202

    Article  Google Scholar 

  43. Liu C-L, Wang C-H, Gao ZM, Huang S-M (2005) Applications of lexical information for algorithmically composing multiple-choice cloze items. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, pp 1–8, Ann Arbor, June 2005. Association for Computational Linguistics, 2005

  44. Majumder M, Saha SK (2015) A system for generating multiple choice questions: With a novel approach for sentence selection. In: Proceedings of The 2nd Workshop on Natural Language Processing Techniques for Educational Applications, pp 64–72, Beijing, China, July 31, 2015. 2015 Association for Computational Linguistics and Asian Federation of Natural Language Processing

  45. Malinova A, Rahneva O (2016) Automatic generation of english language test questions using mathematica. In: CBU international conference on innovations in science and education, March 23–25, 2016, Prague, Czech Republic, www.cbuni.cz, www.journals.cz

  46. Mannem P, Prasad R, Joshi A (2010) Question generation from paragraphs at upenn: Qgstec system description. In: The Open University’s repository of research publications and other research outputs, 2010 The ContributorsVersion: Version of RecordLink(s) to article on publisher’s website: http://questiongeneration.org/QG2010

  47. Maurya KK, Desarkar MS (2020) Learning to distract: a hierarchical multi-decoder network for automated generation of long distractors for multiple-choice questions for reading comprehension. In: CIKM’20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management October 2020 pp 1115–1124 https://doi.org/10.1145/3340531.3411997

  48. Mazidi K, Nielsen R (2014) Linguistic considerations in automatic question generation. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Short Papers), pp 321–326, Baltimore, Maryland, USA, June 23–25 2014. 2014 Association for Computational Linguistics

  49. Metzler D, Croft WB (2005) Analysis of statistical question classification for fact-based questions. Inf Retr 8(3):481–504

    Article  Google Scholar 

  50. Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv:1301.3781

  51. Miller GA, Beckwith R, Fellbaum C, Gross D, Miller KJ (1990) Introduction to wordnet: an on-line lexical database. Int J Lexicogr 3 (4):235–244

    Article  Google Scholar 

  52. Mitkov R, Le An H, Karamanis N (2006) A computer-aided environment for generating multiple-choice test items. Nat Lang Eng 12(2):177–194

    Article  Google Scholar 

  53. Mitkov R, Varga A, Rello L, et al. (2009) Semantic similarity of distractors in multiple-choice tests: extrinsic evaluation. In: Proceedings of the EACL 2009 Workshop on GEMS: GEometical Models of Natural Language Semantics, pp 49–56, Athens, Greece, 31 March 2009. 2009 Association for Computational Linguistics

  54. Mitkov R, et al. (2003) Computer-aided generation of multiple-choice tests. In: The HLT-NAACL 03 workshop on building educational applications using natural language processing, pp 17–22, https://www.aclanthology.org

  55. Mokhtar M, Doma S, Abdel-Galil H (2021) Automatic question generation model based on deep learning approach. Int J Intell Comput Inf Sci 21 (2):110–123

    Google Scholar 

  56. Mostow J, Chen W (2009) Generating instruction automatically for the reading strategy of self-questioning. In: AIED, 2009 - books.google.com

  57. Narendra A, Agarwal M, Shah R (2013) Automatic cloze-questions generation. In: Proceedings of Recent Advances in Natural Language Processing, pp 511–515, Hissar, Bulgaria, 7–13 September 2013

  58. Nielsen RD, Buckingham J, Knoll G, Marsh B, Palen L (2008) A taxonomy of questions for question generation. In: Proceedings of the workshop on the question generation shared task and evaluation challenge 2008 – cs.ecu.edu

  59. Pabitha P, Mohana M, Suganthi S, Sivanandhini B (2014) Automatic question generation system. In: 2014 international conference on recent trends in information technology, IEEE, pp 1–5

  60. Papasalouros A, Kanaris K, Kotis K (2008) Automatic generation of multiple choice questions from domain ontologies. e-Learning 1:427–434

    Google Scholar 

  61. Perez-Beltrachini L, Gardent C, Kruszewski G (2012) Generating grammar exercises. In: The 7th Workshop on the Innovative Use of NLP for Building Educational Applications, pp 147–156, Montreal, Canada, June 3–8, 2012. 2012 Association for Computational Linguistics

  62. Pino J, Heilman M, Eskenazi M (2008) A selection strategy to improve cloze question quality Proceedings of the Workshop on Intelligent Tutoring Systems for Ill-Defined Domains. 9th International Conference on Intelligent Tutoring Systems. Citeseer, Montreal, pp 22–32

  63. Qiu X, Xue H, Liang L, Xie Z, Liao S, Shi G (2021) Automatic generation of multiple-choice cloze-test questions for lao language learning. In: 2021 international conference on asian language processing (IALP), IEEE, pp 125–130

  64. Satria AY, Tokunaga T (2017) Evaluation of automatically generated pronoun reference questions. In: Association for Computational Linguistics, Copenhagen, Denmark

  65. Satria AY, Tokunaga T (2017) Automatic generation of english reference question by utilising nonrestrictive relative clause. In: Proceedings of the 9th International Conference on Computer Supported Education (CSEDU 2017) - Volume 1, pages 379-386 ISBN: 978-989-758-239-4 CopyrightⒸ 2017 by SCITEPRESS - Science and Technology Publications, Lda. All rights reserved, CSEDU 2017 - 9th International Conference on Computer Supported Education

  66. Seyler D, Yahya M, Berberich K (2017) Knowledge questions from knowledge graphs. In: Association for Computing Machinery, New York, NY, United States

  67. Shah R (2012) Automatic question generation using discourse cues and distractor selection for cloze questions. Language Technology and Research Center (LTRC), International Institute of Information Technology, Hyderabad. Jul:31–44

  68. Shah R, Shah D, Kurup L (2017) Automatic question generation for intelligent tutoring systems. In: 2017 2nd international conference on communication systems, computing and it applications (CSCITA), IEEE, pp 127–132

  69. Smith S, Avinesh P, Kilgarriff A (2010) Gap-fill tests for language learners: Corpus-driven item generation. In: Proceedings of ICON-2010: 8th international conference on natural language processing, Macmillan Publishers India, pp 1–6

  70. Sproat R, Black AW, Chen S, Kumar S, Ostendorf M, Richards C (2001) Normalization of non-standard words. Comput Speech Lang 15 (3):287–333

    Article  Google Scholar 

  71. Srivastava S, Govilkar S (2017) A survey on paraphrase detection techniques for indian regional languages. Int J Comput Appl 163(9):0975–8887

    Google Scholar 

  72. Stancheva NS, Popchev I, Stoyanova-Doycheva A, Stoyanov S (2016) Automatic generation of test questions by software agents using ontologies. In: 2016 IEEE 8th international conference on intelligent systems (IS), IEEE, pp 741–746

  73. Subramanian S, Wang T, Yuan X, Zhang S, Bengio Y, Trischler A (2017) Neural models for key phrase detection and question generation. arXiv:1706.04560

  74. Sumita E, Sugaya F, Yamamoto S (2005) Measuring non-native speakers’ proficiency of english by using a test with automatically-generated fill-in-the-blank questions. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, pages 61–68, Ann Arbor, June 2005. Association for Computational Linguistics, 2005

  75. Sung L-C, Lin Y-C, Chen MC (2007) The design of automatic quiz generation for ubiquitous english e-learning system. In: Technology enhanced learning conference (TELearn 2007), Jhongli, pp 161–168, Niigata

  76. Sung L-C, Lin Y-C, Chen MC (2007) An automatic quiz generation system for english text. In: Seventh IEEE international conference on advanced learning technologies (Icalt 2007), IEEE, pp 196–197

  77. Susanti Y, Nishikawa H, Tokunaga T, Obari H, et al. (2016) Item difficulty analysis of english vocabulary questions. In: Proceedings of the 8th International Conference on Computer Supported Education (CSEDU 2016) - Volume 1, pp 267–274 ISBN: 978-989-758-179-3 Copyright 2016 by SCITEPRESS - Science and Technology Publications, Lda. All rights reserved

  78. Susanti Y, Tokunaga T, Nishikawa H, Obari H (2017) Evaluation of automatically generated english vocabulary questions. Res Pract Technol Enhanc Learn 12(1):1–21

    Article  Google Scholar 

  79. Venitha ME (2021) Automatic quiz generator using deep learning. International Journal of Advanced Engineering Science and Information Technology, 4(4)

  80. Vickrey D, Koller D (2008) Sentence simplification for semantic role labeling. In: Proceedings of ACL-08: HLT, pp 344–352, Columbus, Ohio, USA, June 2008. 2008 Association for Computational Linguistics

  81. Vinu EV, Alsubait T, Kumar PS (2016) Modeling of item-difficulty for ontology-based MCQS. arXiv:1607.008

  82. Wu HC, Luk RWP, Wong KF, Kwok KL (2008) Interpreting tf-idf term weights as making relevance decisions. ACM Trans Inf Syst 26(3):1–37

    Article  Google Scholar 

  83. Yao X, Zhang Y (2010) Question generation with minimal recursion semantics. In: Proceedings of QG2010: the third workshop on question generation, Citeseer, pp 68–75

Download references

Funding

This research did not receive any specific grant from funding agencies.

Author information

Authors and Affiliations

  1. Research Scholar, Jawaharlal Nehru Technological University, Anantapur, Ananthapuramu, K.S.R.M. College of Engineering, Kadapa, Affiliated to Jawaharlal Nehru Technological University, Anantapur, Ananthapuramu, Kadapa, India

    Vijaya Raju Madri

  2. Department of Computer Science and Engineering, K.S.R.M College of Engineering, Kadapa, Affiliated to Jawaharlal Nehru Technological University, Anantapur, Ananthapuramu, Kadapa, India

    Sreenivasulu Meruva

Authors
  1. Vijaya Raju Madri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sreenivasulu Meruva
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vijaya Raju Madri.

Ethics declarations

Conflict of Interests

The authors declare that they have no Conflict of Interest. The work described has not been published previously. It is not under consideration for publication elsewhere. Its publication is approved by all authors and tacitly or explicitly by the responsible authorities where the work was carried out, and If accepted, it will not be published elsewhere in the same form, in English or in any other language, including electronically without the written consent of the copyright-holder.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Madri, V.R., Meruva, S. A comprehensive review on MCQ generation from text. Multimed Tools Appl 82, 39415–39434 (2023). https://doi.org/10.1007/s11042-023-14768-5

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14768-5

Keywords

Search

Navigation