Skip to main content

Domain-Specific Automatic Item Generation for Higher Competence Levels: A Comparative Study on Three Cases

  • Conference paper
  • First Online:
Methodologies and Intelligent Systems for Technology Enhanced Learning, 13th International Conference (MIS4TEL 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 764))

  • 168 Accesses

Abstract

Automatic item generation can generate large amounts of assessment items from a single configuration. For items that ask students to demonstrate domain-specific competences in applying methods or analysing artifacts, the generation process also needs to reflect domain-specific properties. The paper presents an item template approach for automatic, domain-specific item generation. Three examples demonstrate how to respect domain-specific properties in the generation process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Irvine, S.H.: The foundations of item generation for mass testing. In: Item Generation for Test Development, pp. 3–34. Routledge, Milton Park (2002)

    Google Scholar 

  2. Kurdi, G., Leo, J., Parsia, B., Sattler, U., Al-Emari, S.: A systematic review of automatic question generation for educational purposes. Int. J. Artif. Intell. Educ. 30, 121–204 (2020)

    Article  Google Scholar 

  3. Anderson, L.W., Krathwohl, D.R., Airasian, P.W., Cruikshank, K.A., Mayer, R.E.: A Taxonomy for learning, teaching, and assessing. Pearson Education (US) (2000)

    Google Scholar 

  4. Pugh, D., De Champlain, A., Gierl, M., Lai, H., Touchie, C.: Can automated item generation be used to develop high quality MCQs that assess application of knowledge? Res. Pract. Technol. Enhanc. Learn. 15(1), 12 (2020)

    Article  Google Scholar 

  5. Gierl, M.J., Lai, H., Turner, S.R.: Using automatic item generation to create multiple-choice test items. Med. Educ. 46(8), 757–765 (2012)

    Article  Google Scholar 

  6. Embretson, S., Yang, X.: Automatic Item Generation and Cognitive Psychology. In: Psychometrics, pp. 747–768. Elsevier (2006)

    Google Scholar 

  7. Embretson, S.E., Kingston, N.M.: Automatic item generation: a more efficient process for developing mathematics achievement items? J. Educ. Meas. 55(1), 112–131 (2018)

    Article  Google Scholar 

  8. Gierl, M.J., Zhou, J., Alves, C.: Developing a taxonomy of item model types to promote assessment engineering. J. Technol. Learn. Assess. 7(2) (2008)

    Google Scholar 

  9. Striewe, M.: Dynamic generation of assessment items using Wikidata. In: Draaijer, S., Joosten-ten Brinke, D., Ras, E. (eds.) TEA 2018. CCIS, vol. 1014, pp. 1–15. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25264-9_1

    Chapter  Google Scholar 

  10. Striewe, M.: An architecture for modular grading and feedback generation for complex exercises. Sci. Comput. Program. 129, 35–47 (2016). http://www.sciencedirect.com/science/article/pii/S0167642316300260

  11. Striewe, M., Goedicke, M.: Automatische Generierung von Aufgaben zum Codeverständnis. In: DeLFI 2018 - Die 16. E-Learning Fachtagung Informatik der Gesellschaft für Informatik e. V., pp. 153–164 (2018)

    Google Scholar 

  12. Pérez-Solà, C., Herrera-Joancomartí, J., Rifà-Pous, H.: On improving automated self-assessment with moodle quizzes: experiences from a cryptography course. In: Technology Enhanced Assessment, pp. 176–189 (2018)

    Google Scholar 

  13. Pobel, S., Striewe, M.: Domain-specific extensions for an E-assessment system. Adv. Web-Based Learn. ICWL 2019, 327–331 (2019)

    Google Scholar 

  14. Timm, J., Otto, B., Schramm, T., Striewe, M., Schmiemann, P., Goedicke, M.: Technical aspects of automated item generation for blended learning environments in biology. i-com 1(19), 3–15 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Striewe .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Striewe, M. (2023). Domain-Specific Automatic Item Generation for Higher Competence Levels: A Comparative Study on Three Cases. In: Milrad, M., et al. Methodologies and Intelligent Systems for Technology Enhanced Learning, 13th International Conference. MIS4TEL 2023. Lecture Notes in Networks and Systems, vol 764. Springer, Cham. https://doi.org/10.1007/978-3-031-41226-4_16

Download citation

Publish with us

Policies and ethics