skip to main content
10.1145/3478431.3499285acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Labtool: A Command-Line Interface Lab Assistant and Assessment Tool

Published: 22 February 2022 Publication History

Abstract

Automated lab assistant and automated grading tools are commonly used to help manage student work in Computer Science lab sections. These tools can ease routine grading tasks and provide rapid and consistent feedback to inform student progress. However, we found their application lacking in our mid-level systems courses. To address this, we present a command-line interface (CLI) driven lab assistant and assessment tool designed specifically for this environment. We provide insights into our design choices and provide context and comparison of this system to other similar tools. Then we present results from using the tool since 2019. By easing routine tasks and common challenges, students and instructors both report uniformly positive reviews. At the same time, grading time is consistently lower than other similar courses while maintaining a humanized and personal student connection.

Supplementary Material

MP4 File (SIGCSETS2022-labtool-77-rev2.mp4)
Presentation Video for "Labtool: A Command-Line Interface Lab Assistant and Assessment Tool"

References

[1]
Elisa Baniassad, Lucas Zamprogno, Braxton Hall, and Reid Holmes. 2021. STOP THE (AUTOGRADER) INSANITY: Regression Penalties to Deter Autograder Overreliance. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (SIGCSE '21). Association for Computing Machinery, New York, NY, USA, 1062--1068. https://doi.org/10.1145/3408877.3432430
[2]
Stephen H. Edwards. 2021. Automated Feedback, the Next Generation: Designing Learning Experiences. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (SIGCSE '21). Association for Computing Machinery, New York, NY, USA, 610--611. https://doi.org/10.1145/3408877.3437225
[3]
Xiang Fu, Boris Peltsverger, Kai Qian, Lixin Tao, and Jigang Liu. 2008. APOGEE: automated project grading and instant feedback system for web based computing. In Proceedings of the 39th SIGCSE technical symposium on Computer science education (SIGCSE '08). Association for Computing Machinery, New York, NY, USA, 77--81. https://doi.org/10.1145/1352135.1352163
[4]
Michael J. Hull, Daniel Powell, and Ewan Klein. 2011. Infandango: automated grading for student programming. In Proceedings of the 16th annual joint conference on Innovation and technology in computer science education (ITiCSE '11). Association for Computing Machinery, New York, NY, USA, 330. https://doi.org/10.1145/1999747.1999841
[5]
David G. Kay, Terry Scott, Peter Isaacson, and Kenneth A. Reek. 1994. Automated grading assistance for student programs. ACM SIGCSE Bulletin, Vol. 26, 1 (March 1994), 381--382. https://doi.org/10.1145/191033.191184
[6]
Haden Hooyeon Lee. 2021. Effectiveness of Real-time Feedback and Instructive Hints in Graduate CS Courses via Automated Grading System . In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education. Association for Computing Machinery, New York, NY, USA, 101--107. https://doi.org/10.1145/3408877.3432463
[7]
David J. Malan. 2010. Moving CS50 into the cloud. Journal of Computing Sciences in Colleges, Vol. 25, 6 (June 2010), 111--120.
[8]
Chad Sharp, Jelle van Assema, Brian Yu, Kareem Zidane, and David J. Malan. 2020. An Open-Source, API-Based Framework for Assessing the Correctness of Code in CS50. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '20). Association for Computing Machinery, New York, NY, USA, 487--492. https://doi.org/10.1145/3341525.3387417
[9]
Jaime Spacco, David Hovemeyer, William Pugh, Fawzi Emad, Jeffrey K. Hollingsworth, and Nelson Padua-Perez. 2006. Experiences with marmoset: designing and using an advanced submission and testing system for programming courses. In Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education (ITICSE '06). Association for Computing Machinery, New York, NY, USA, 13--17. https://doi.org/10.1145/1140124.1140131
[10]
Chris Wilcox. 2015. The Role of Automation in Undergraduate Computer Science Education. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE '15). Association for Computing Machinery, New York, NY, USA, 90--95. https://doi.org/10.1145/2676723.2677226
[11]
Chris Wilcox. 2016. Testing Strategies for the Automated Grading of Student Programs. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE '16). Association for Computing Machinery, New York, NY, USA, 437--442. https://doi.org/10.1145/2839509.2844616

Cited By

View all
  • (2024)Automated feedback for participants of hands-on cybersecurity trainingEducation and Information Technologies10.1007/s10639-023-12265-829:9(11555-11584)Online publication date: 1-Jun-2024

Index Terms

  1. Labtool: A Command-Line Interface Lab Assistant and Assessment Tool

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1
    February 2022
    1049 pages
    ISBN:9781450390705
    DOI:10.1145/3478431
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 February 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. automated assistant
    2. immediate feedback
    3. semi-automated grading

    Qualifiers

    • Research-article

    Conference

    SIGCSE 2022
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,787 of 5,146 submissions, 35%

    Upcoming Conference

    SIGCSE TS 2025
    The 56th ACM Technical Symposium on Computer Science Education
    February 26 - March 1, 2025
    Pittsburgh , PA , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)38
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Automated feedback for participants of hands-on cybersecurity trainingEducation and Information Technologies10.1007/s10639-023-12265-829:9(11555-11584)Online publication date: 1-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media