skip to main content
10.1145/2676723.2677217acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

WebWolf: Towards a Simple Framework for Automated Assessment of Webpage Assignments in an Introductory Web Programming Class

Published: 24 February 2015 Publication History

Abstract

Grading student submissions of webpage assignments is difficult and time-consuming because it involves reading and evaluating source code for compliance with assignment specifications. In addition, the pages must be examined in a browser to check for required functionality such as working links. As a result fewer assignments tend to be given, or instructors spend significant time grading at the expense of working with students or other necessary activities. There is thus a need for automated assessment of webpage assignments. This paper describes WebWolf, a simple framework for automated assessment of assignments in an introductory web programming class. A WebWolf program can load web pages, find and inspect elements, click links and make assertions about expected results. WebWolf was evaluated with assignments from three different classes and on a set of assignment submissions with injected errors. WebWolf correctly identified errors in the submissions. Manual grading of a four page assignment took an average of 17 minutes, while the WebWolf program took 35 seconds.

References

[1]
Beust, C. and Suleiman, H., 2008. Next Generation Java Testing: TestNG and Advanced Concepts. Pearson Education, Inc., Boston, MA.
[2]
Brandle, S., 2009. Automated grading of student programming assignments. J. Comput. Small Coll. 25, 1 (October 2009), 83--84.
[3]
Brusilovsky, P. and Sosnovsky, S., 2005. Individualized exercises for self-assessment of programming knowledge: An evaluation of QuizPACK. J. Educ. Resour. Comput. 5, 3, 6.
[4]
Burns, D., 2012. Selenium 2 Testing Tools Beginner's Guide. Packt Publishing, Birmingham, UK.
[5]
Carter, J., Ala-Mutka, K., Fuller, U., Dick, M., English, J., Fone, W., and Sheard, J., 2003. How shall we assess this? SIGCSE Bull. 35, 4, 107--123.
[6]
Coffman, J. and Weaver, A.C., 2010. Electronic commerce virtual laboratory. In Proceedings of the 41st ACM Technical Symposium on Computer Science Education (Milwaukee, Wisconsin, USA, 2010), ACM, 1734295, 92--96.
[7]
Douce, C., Livingstone, D., and Orwell, J., 2005. Automatic test-based assessment of programming: A review. J. Educ. Resour. Comput. 5, 3, 4.
[8]
Edwards, S.H. and Perez-Quiñones, M.A., 2008. Web-CAT: automatically grading programming assignments. In Proceedings of the 13th annual conference on Innovation and technology in computer science education (ITiCSE '08) ACM, New York, NY, USA, 328--328.
[9]
Filipin, Z., 2014. Web Application Testing in Ruby with Selenium and Friends, version 2014-03-08. Retrieved November 17, 2014 from http://leanpub.com/watirbook.
[10]
Fu, X., Peltsverger, B., Qian, K., Tao, L., and Liu, J., 2008. APOGEE: automated project grading and instant feedback system for web based computing. SIGCSE Bull. 40, 1, 77--81.
[11]
Guillemot, M. and König, D., 2006. Web testing made easy. In Proceedings of the Companion to the 21st ACM SIGPLAN Symposium on Object-Oriented Programming Systems, Languages, and Applications (Portland, Oregon, USA, 2006), ACM, 1176677, 692--693.
[12]
Lahtonen, T. and Isomöttönen, V., 2012. PARSI: a tool for automatic assessment of office documents and basic IT skills. In Proceedings of the 12th Koli Calling International Conference on Computing Education Research (Koli, Finland, 2012), ACM, 2401824, 174--180.
[13]
Morgan, J., 2013. Cucumber & Cheese: a Tester's Workshop, version 2013-07-09. Retrieved July 16, 2013 from http://leanpub.com/cucumber_and_cheese.
[14]
Sztipanovits, M., Qian, K., and Fu, X., 2008. The automated web application testing (AWAT) system. In Proceedings of the 46th Annual Southeast Regional Conference (Auburn, Alabama, 2008), ACM, 1593128, 88--93.
[15]
Tahchiev, P., Leme, F., Massol, V., and Gregory, G., 2011. JUnit in Action. Manning Publications Co., Stamford, CT.

Cited By

View all
  • (2024)ProgEdu4Web: An automated assessment tool for motivating the learning of web programming courseComputer Applications in Engineering Education10.1002/cae.2277032:5Online publication date: 28-May-2024
  • (2023)A Systematic Literature Review of Student Assessment Framework in Software Engineering CoursesJournal of Information Systems Engineering and Business Intelligence10.20473/jisebi.9.2.264-2759:2(264-275)Online publication date: 1-Nov-2023
  • (2022)Automated Assessment in Computer Science Education: A State-of-the-Art ReviewACM Transactions on Computing Education10.1145/3513140Online publication date: 24-Feb-2022
  • Show More Cited By

Index Terms

  1. WebWolf: Towards a Simple Framework for Automated Assessment of Webpage Assignments in an Introductory Web Programming Class

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGCSE '15: Proceedings of the 46th ACM Technical Symposium on Computer Science Education
      February 2015
      766 pages
      ISBN:9781450329668
      DOI:10.1145/2676723
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 24 February 2015

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. automated assessment
      2. computer science education
      3. web programming

      Qualifiers

      • Research-article

      Conference

      SIGCSE '15
      Sponsor:

      Acceptance Rates

      SIGCSE '15 Paper Acceptance Rate 105 of 289 submissions, 36%;
      Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

      Upcoming Conference

      SIGCSE TS 2025
      The 56th ACM Technical Symposium on Computer Science Education
      February 26 - March 1, 2025
      Pittsburgh , PA , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)18
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 11 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)ProgEdu4Web: An automated assessment tool for motivating the learning of web programming courseComputer Applications in Engineering Education10.1002/cae.2277032:5Online publication date: 28-May-2024
      • (2023)A Systematic Literature Review of Student Assessment Framework in Software Engineering CoursesJournal of Information Systems Engineering and Business Intelligence10.20473/jisebi.9.2.264-2759:2(264-275)Online publication date: 1-Nov-2023
      • (2022)Automated Assessment in Computer Science Education: A State-of-the-Art ReviewACM Transactions on Computing Education10.1145/3513140Online publication date: 24-Feb-2022
      • (2020)SIGITE and SIGCSE SymposiumsProceedings of the 21st Annual Conference on Information Technology Education10.1145/3368308.3415400(132-137)Online publication date: 7-Oct-2020
      • (2020)Automated and Manual Grading of Web-Based AssignmentsProceedings of the 51st ACM Technical Symposium on Computer Science Education10.1145/3328778.3372682(1373-1373)Online publication date: 26-Feb-2020

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media