skip to main content
10.1145/3626252.3630791acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Clearn: A Cost-conscious Student-led Online Judge for a Large Programming Course

Published: 07 March 2024 Publication History

Abstract

Online judges in programming courses allow students to improve their coding abilities and instructors to analyze student work and detect challenging topics. Although several online judge platforms are available, most are limited in that they cannot support a large number of students simultaneously working on an assignment during a fixed time period, or can only do so at a significant cost, making the use of such systems in developing countries non-viable. This paper presents Clearn, a new platform that is (1) cost-conscious, as we have focused on lowering costs, (2) student-led, as we have empowered students and teaching assistants to lead its development and maintenance, and (3) highly simultaneous, as it allows over 1,000 students to work simultaneously on a timed assignment. This paper presents the platform, as well as the lessons learned during its development and deployment, and its reception by the students.

References

[1]
Stephen H. Edwards and Manuel A. Perez-Quinones. 2008. Web-CAT: Automatically Grading Programming Assignments. SIGCSE Bull., Vol. 40, 3 (jun 2008), 328. https://doi.org/10.1145/1597849.1384371
[2]
Barbara J. Ericson and Bradley N. Miller. 2020. Runestone: A Platform for Free, On-Line, and Interactive Ebooks. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (Portland, OR, USA) (SIGCSE '20). Association for Computing Machinery, New York, NY, USA, 1012--1018. https://doi.org/10.1145/3328778.3366950
[3]
Ginés Gárcia-Mateos and José Luis Fernández-Alemán. 2009. A Course on Algorithms and Data Structures Using On-Line Judging. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (Paris, France) (ITiCSE '09). Association for Computing Machinery, New York, NY, USA, 45--49. https://doi.org/10.1145/1562877.1562897
[4]
Petri Ihantola, Tuukka Ahoniemi, Ville Karavirta, and Otto Sepp"al"a. 2010. Review of Recent Systems for Automatic Assessment of Programming Assignments. In Proceedings of the 10th Koli Calling International Conference on Computing Education Research (Koli, Finland) (Koli Calling '10). Association for Computing Machinery, New York, NY, USA, 86--93. https://doi.org/10.1145/1930464.1930480
[5]
José Paulo Leal and Fernando Silva. 2003. Mooshak: A Web-based multi-site programming contest system. Software: Practice and Experience, Vol. 33, 6 (2003), 567--581.
[6]
Luciana Oliveira, Anabela Mesquita, Arminda Sequeira, and Adriana Oliveira. 2021. Emergency Remote Learning During COVID-19: Socio-educational Impacts on Portuguese Students. In Educating Engineers for Future Industrial Revolutions, Michael E. Auer and Tiia Rüütmann (Eds.). Springer International Publishing, Cham, 303--314.
[7]
José Carlos Paiva, José Paulo Leal, and Álvaro Figueira. 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Trans. Comput. Educ., Vol. 22, 3, Article 34 (jun 2022), bibinfonumpages40 pages. https://doi.org/10.1145/3513140
[8]
Jordi Petit, Omer Giménez, and Salvador Roura. 2012. Jutge. org: an educational programming judge. In Proceedings of the 43rd ACM technical symposium on Computer Science Education. 445--450.
[9]
Hui Sun, Bofang Li, and Min Jiao. 2014. YOJ: An online judge system designed for programming courses. In 2014 9th International Conference on Computer Science and Education. 812--816. https://doi.org/10.1109/ICCSE.2014.6926575
[10]
Szymon Wasik, Maciej Antczak, Jan Badura, Artur Laskowski, and Tomasz Sternal. 2018. A Survey on Online Judge Systems and Their Applications. ACM Comput. Surv., Vol. 51, 1, Article 3 (jan 2018), bibinfonumpages34 pages. https://doi.org/10.1145/3143560
[11]
World Health Organization. 2020. Listings of WHO's response to COVID-19. https://www.who.int/news/item/29-06--2020-covidtimeline
[12]
Wenju Zhou, Yigong Pan, Yinghua Zhou, and Guangzhong Sun. 2018. The Framework of a New Online Judge System for Programming Education. In Proceedings of ACM Turing Celebration Conference - China (Shanghai, China) (ACM TURC '18). Association for Computing Machinery, New York, NY, USA, 9--14. https://doi.org/10.1145/3210713.3210721 io

Index Terms

  1. Clearn: A Cost-conscious Student-led Online Judge for a Large Programming Course

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1
    March 2024
    1583 pages
    ISBN:9798400704239
    DOI:10.1145/3626252
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 March 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cs1
    2. online judge
    3. programming

    Qualifiers

    • Research-article

    Conference

    SIGCSE 2024
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

    Upcoming Conference

    SIGCSE TS 2025
    The 56th ACM Technical Symposium on Computer Science Education
    February 26 - March 1, 2025
    Pittsburgh , PA , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 94
      Total Downloads
    • Downloads (Last 12 months)94
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media