Sebastian Pape
ABSTRACT
We report on an approach and associated tool-support for automatically evaluating and grading exercises in Software Engineering courses, by connecting various third-party tools to the online learning platform Moodle. In the case study presented here, the tool was used in several instances of a lecture course to automatically measure the test coverage criteria wrt. the test cases defined by the students for given Java code. We report on empirical evidence gathered using this case-study (involving more than 250 students), including the results of a survey conducted after the exercises (which yielded positive feedback from the students), as well as a performance evaluation of our tool implementation.
- A. P. F. F. Lopes, "Teaching with Moodle in higher education," tech. rep., Institute of Accounting and Administration (ISCAP), Polytechnic Institute of Oporto (IPP), 2011.Google Scholar
- A. Fox, "From MOOCs to SPOCs," Communications of the ACM, vol. 56, no. 12, pp. 38--40, 2013. Google ScholarDigital Library
- J. Burge, A. Fox, D. Grossman, G. Roth, and J. Warren, "SPOCs: what, why, and how," in 46th ACM Technical Symposium on Computer Science Education, SIGCSE '15, pp. 595--596, ACM, 2015. Google ScholarDigital Library
- J. Hollingsworth, "Automatic graders for programming classes," Commun. ACM, vol. 3, pp. 528--529, Oct. 1960. Google ScholarDigital Library
- G. E. Forsythe and N. Wirth, "Automatic grading programs," Commun. ACM, vol. 8, no. 5, pp. 275--278, 1965. Google ScholarDigital Library
- C. Douce, D. Livingstone, and J. Orwell, "Automatic test-based assessment of programming: A review," J. Educ. Resour. Comput., vol. 5, Sept. 2005. Google ScholarDigital Library
- P. Ihantola, T. Ahoniemi, V. Karavirta, and O. Seppälä, "Review of recent systems for automatic assessment of programming assignments," in Proceedings of the 10th Koli Calling International Conference on Computing Education Research, Koli Calling '10, (New York, NY, USA), pp. 86--93, ACM, 2010. Google ScholarDigital Library
- J. C. Caiza and J. M. D. Alamo, "Programming assignments automatic grading: Review of tools and implementations," in Proceedings of 7th International Technology, Education and Development Conference, (Valencia (Spain)), January 2013.Google Scholar
- S. H. Edwards and Z. Shams, "Comparing test quality measures for assessing student-written tests," in Companion Proceedings of the 36th International Conference on Software Engineering, pp. 354--363, ACM, 2014. Google ScholarDigital Library
- A. Barana, M. Marchisio, and S. Rabellino, "Automated assessment in mathematics," in Proceedings of COMPSAC, 2015. Google ScholarDigital Library
- S. Zhigang, S. Xiaohong, Z. Ning, and C. Yanyu, "Moodle plugins for highly efficient programmin courses," in Moodle Research Conference, vol. 1, pp. 157--163, 2012.Google Scholar
- C. Sanchez, O. Ramos, P. Márquez, E. Martí, J. Rocarias, and D. Gil, "Automatic evaluation of practices in Moodle for self learning in engineering," Journal of Technology and Science Education, vol. 5, no. 2, 2015.Google ScholarCross Ref
- S. T. Deane, Further development on the Moodle CodeHandIn Package. PhD thesis, Flinders University-Adelaide, Australia, 2014.Google Scholar
- R. Lobb, "Coderunner documentation (v2.4.2)." http://coderunner.org.nz/mod/book/tool/print/index.php?id=50, October 2015.Google Scholar
- R. Likert, "A technique for the measurement of attitudes.," Archives of psychology, 1932.Google Scholar
- M. B. Miles, A. M. Huberman, and J. Saldaña, Qualitative data analysis: A methods sourcebook. SAGE Publications, Incorporated, 2013.Google Scholar
- S. Robertson, "Moodle on the move." WebEx session, https://onlinevideo.napier.ac.uk/Play/5081, 2015.Google Scholar
Index Terms
- STAGE: a software tool for automatic grading of testing exercises: case study paper
Recommendations
A Comparative Study on Automated Software Test Oracle Methods
ICSEA '09: Proceedings of the 2009 Fourth International Conference on Software Engineering AdvancesSoftware testing has been used to find software faults in order to improve its quality. To verify the software behavior, testers require test oracle. Test oracle is a reliable source of expected software behavior that provides outputs for any input ...
Future of Mining Software Archives: A Roundtable
This article looks at what happens when you combine the four goal-driven approaches to testing classification (requirements-driven, structure-driven, statistics-driven, and risk-driven) with the three phase-driven approaches (unit testing, integration ...
Evaluating Automated Unit Testing in Sulu
ICST '08: Proceedings of the 2008 International Conference on Software Testing, Verification, and ValidationSulu is a programming language designed with automated unit testing specifically in mind. One aim of Sulu is to demonstrate how automated software testing can be more integrated into current software development processes. Sulu's runtime and tools ...
Comments