Tapio Auvinen
ABSTRACT
It is important that students receive sufficient feedback from exercises. However, writing feedback can be laborious on large courses. We present a rubric-based assessment tool called Rubyric that helps course staff to construct textual feedback effortlessly using grading rubrics. The tool allows teachers to create rubrics, or grading templates that specify the evaluation criteria and contain feedback phrases for typical mistakes. Because many students make similar mistakes, large portions of feedback can be constructed from pre-written blocks making it possible to give detailed feedback with little effort. The use of a rubric also helps to ensure consistency of grading between multiple graders because they are required to give grades based on a detailed list of criteria.
Rubyric has been used on multiple computer science courses at Aalto university since year 2008. User satisfaction of both students and teaching assistants have been measured with questionnaires. The results show that teaching assistants find the tool helpful and students have been satisfied with the amount and quality of feedback produced with the system.
- T. Ahoniemi and V. Karavirta. Analyzing the use of a rubric-based grading tool. In Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education, ITiCSE '09, pages 333--337, New York, NY, USA, 2009. ACM. Google Scholar
Digital Library
- T. Ahoniemi, E. Lahtinen, and T. Reinikainen. Improving pedagogical feedback and objective grading. In Proceedings of the 39th SIGCSE technical symposium on Computer science education, SIGCSE '08, pages 72--76, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- T. Ahoniemi and T. Reinikainen. Aloha - a grading tool for semi-automatic assessment of mass programming courses. In Proceedings of the 6th Baltic Sea conference on Computing education research: Koli Calling 2006, Baltic Sea '06, pages 139--140, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- H. Andrade. Using Rubrics to Promote Thinking and Learning. Educational Leadership, 57(5):13--19, 2000.Google Scholar
- L. Anglin, K. Anglin, P. Schumann, and J. Kaliski. Improving the Efficiency and Effectiveness of Grading Through the Use of Computer-Assisted Grading Rubrics. Decision Sciences Journal of Innovative Education, 6(1):51--73, 2008.Google ScholarCross Ref
- T. Auvinen. Rubyric - A rubrics-based online assessment tool for effortless authoring of personalized feedback. Master's thesis, Helsinki University of Technology, 2009.Google Scholar
- P. Black and D. Wiliam. Assessment and classroom learning. Assessment in education, 5(1):7--74, 1998.Google ScholarCross Ref
- B. Edmison, S. Edwards, and M. Pérez-Quiñones. Using a Rubric-based assessment system to improve feedback and student performance in course-management systems. In Proceedings of 2010 ASEE Southeast Section Conference, 2010.Google Scholar
- J. Hamer, C. Kell, and F. Spence. Peer assessment using aropä. In Proceedings of the ninth Australasian conference on Computing education - Volume 66, ACE '07, pages 43--54, Darlinghurst, Australia, Australia, 2007. Australian Computer Society, Inc. Google ScholarDigital Library
- W. Popham. What's wrong-and what's right-with rubrics. Educational Leadership, 55:72--75, 1997.Google Scholar
- A. Powell, S. Turner, M. Tungare, M. Pérez-Quiñones, and S. Edwards. An online teacher peer review system. In Proceedings of Society for Information Technology and Teacher Education International Conference, pages 126--133, 2006.Google Scholar
- M. Scriven. The Methodology of Evaluation (AERA Monograph Series on Curriculum Evaluation, No. 1), 1967.Google Scholar
- T. Winters and T. Payne. Computer Aided Grading with Agar. In FECS, pages 245--251, 2006.Google Scholar
- M. Yorke. Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education, 45(4):477--501, 2003.Google ScholarCross Ref
Index Terms
- Rubyric
Recommendations
Improving pedagogical feedback and objective grading
SIGCSE '08: Proceedings of the 39th SIGCSE technical symposium on Computer science educationIt is important for learning that students receive enough of educational feedback of their work. To get the students to be seriously disposed to the feedback it has to be personal, objective and consistent. In large classes ensuring such feedback can be ...
Rubyric: an online assessment tool for effortless authoring of personalized feedback
ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science educationWriting feedback can be very time-consuming on large Computer Science courses. Evolving from years of research on computer-assisted grading tools, we present the Rubyric assessment tool which allows graders to effortlessly construct feedback with ...
Rubyric: an online assessment tool for effortless authoring of personalized feedback
ITiCSE '09Writing feedback can be very time-consuming on large Computer Science courses. Evolving from years of research on computer-assisted grading tools, we present the Rubyric assessment tool which allows graders to effortlessly construct feedback with ...
Comments