skip to main content
10.1145/3661904.3661921acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicettConference Proceedingsconference-collections
research-article

Development and Utilization of AI-Enabled Automatic Programming Problem Generator Using the CodeRunner Plugin of Moodle

Published: 26 August 2024 Publication History

Abstract

Programming instructors provide various kinds of problems that suit their current topics of programming. With the use of Learning Management Systems (LMS) such as Moodle, teachers can create and store their problems in problem banks using a question plugin CodeRunner. However creating and validating programming problems takes significant time and creative effort. With instructors dealing multiple programming languages, it would need mastery not only to solve the problem but also to use a specific language. This paper presents an automation of the programming problem generation using AI. This is effectively an improvement of the CodeRunner plugin of Moodle that allows programming instructors to generate problem descriptions, answers, and testcases of different programming topics in various programming languages with a few clicks. To address the issue of difficulty control, an additional feature is placed to generate an easier or harder problem than what is currently generated. The evaluation of the improved tool showed that the problems generated with AI are similar, correct, and practical that matches the human-generated problems.

References

[1]
S. Russell, “Automatically Generated and Graded Program Tracing Quizzes with Feedback,” in Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 2, in ITiCSE ’21. New York, NY, USA: Association for Computing Machinery, Jun. 2021, p. 652.
[2]
J. Bennedsen and M. E. Caspersen, “Failure rates in introductory programming: 12 years later,” ACM Inroads, vol. 10, no. 2, pp. 30–36, Apr. 2019.
[3]
G. Kurdi, J. Leo, B. Parsia, U. Sattler, and S. Al-Emari, “A Systematic Review of Automatic Question Generation for Educational Purposes,” Int. J. Artif. Intell. Educ., vol. 30, no. 1, pp. 121–204, Mar. 2020.
[4]
M. Rahmat, S. Shahrani, R. Latih, N. F. M. Yatim, N. F. A. Zainal, and R. A. Rahman, “Major Problems in Basic Programming that Influence Student Performance,” Procedia - Soc. Behav. Sci., vol. 59, pp. 287–296, Oct. 2012.
[5]
F. Constantinou, “How novel can examination questions really be? Exploring the boundaries of creativity in examination question writing,” Res. Pap. Educ., vol. 38, no. 2, pp. 208–226, Mar. 2023.
[6]
C. Troussas, A. Krouska, and C. Sgouropoulou, “A Novel Teaching Strategy Through Adaptive Learning Activities for Computer Programming,” IEEE Trans. Educ., vol. 64, no. 2, pp. 103–109, May 2021.
[7]
U. Lee, “Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education,” Educ. Inf. Technol., Oct. 2023.
[8]
A. Tran, K. Angelikas, E. Rama, C. Okechukwu, D. Smith, and S. Macneil, Generating Multiple Choice Questions for Computing Courses using Large Language Models. 2023.
[9]
C. Grévisse, “Comparative Quality Analysis of GPT-Based Multiple Choice Question Generation,” in Applied Informatics, H. Florez and M. Leon, Eds., in Communications in Computer and Information Science. Cham: Springer Nature Switzerland, 2024, pp. 435–447.
[10]
D. C. L. Tsai, W. J. W. Chang, and S. J. H. Yang, “Short Answer Questions Generation by Fine-Tuning BERT and GPT-2”.
[11]
A. Prokudin, O. Sychev, and M. Denisov, “Learning problem generator for introductory programming courses,” Softw. Impacts, vol. 17, p. 100519, Sep. 2023.
[12]
M. Liu, Y. Ren, L. M. Nyagoga, F. Stonier, Z. Wu, and L. Yu, “Future of education in the era of generative artificial intelligence: Consensus among Chinese scholars on applications of ChatGPT in schools,” Future Educ. Res., vol. 1, no. 1, pp. 72–101, 2023.
[13]
A. Ade-Ibijola, “Syntactic Generation of Practice Novice Programs in Python | SpringerLink,” presented at the Annual Conference of the Southern African Computer Lecturers’ Association, in Communications in Computer and Information Science, vol. 963. 2018, pp. 158–172.

Index Terms

  1. Development and Utilization of AI-Enabled Automatic Programming Problem Generator Using the CodeRunner Plugin of Moodle

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICETT '24: Proceedings of the 2024 10th International Conference on Education and Training Technologies
    April 2024
    190 pages
    ISBN:9798400717895
    DOI:10.1145/3661904
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 August 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Automatic question generation
    2. Generative AI
    3. Programming learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICETT 2024

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 33
      Total Downloads
    • Downloads (Last 12 months)33
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media