Yue Zhao
Dan Davis
Christoph Lofi
ABSTRACT
Massive Open Online Courses (MOOCs) play an ever more central role in open education. However, in contrast to traditional classroom settings, many aspects of learners' behaviour in MOOCs are not well researched. In this work, we focus on modelling learner behaviour in the context of continuous assessments with completion certificates, the most common assessment setup in MOOCs today. Here, learners can obtain a completion certificate once they obtain a required minimal score (typically somewhere between 50-70%) in tests distributed throughout the duration of a MOOC. In this setting, the course material or tests provided after "passing" do not contribute to earning the certificate (which is ungraded), thus potentially affecting learners' behaviour. Therefore, we explore how ``passing'' impacts MOOC learners: do learners alter their behaviour after this point? And if so how? While in traditional classroom-based learning the role of assessment and its influence on learning behaviour has been well-established, we are among the first to provide answers to these questions in the context of MOOCs.
- Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec 2014. Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide web. ACM, 687--698. Google Scholar
Digital Library
- Pavlo D. Antonenko, Serkan Toy, and Dale S. Niederhauser. 2012. Using cluster analysis for data mining in educational technology research. Educational Technology Research and Development, Vol. 60, 3 (2012), 383--398.Google ScholarCross Ref
- Lori Breslow, David E. Pritchard, Jennifer DeBoer, Glenda S. Stump, Andrew D. Ho, and Daniel T. Seaton 2013. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment Vol. 8 (2013), 13--25.Google Scholar
- Averil Cook. 2001. Assessing the use of flexible assessment. Assessment & Evaluation in Higher Education, Vol. 26, 6 (2001), 539--549.Google ScholarCross Ref
- Dan Davis, Guanliang Chen, Claudia Hauff, and Geert-Jan Houben 2016. Gauging MOOC Learners' Adherence to the Designed Learning Path Proceedings of the 9th International Conference on Educational Data Mining. 54--61.Google Scholar
- D. Forbes and J. Spence. 1991. An experiment in assessment for a large class. Innovations in engineering education. London: Ellis Horwood (1991), 97--101.Google Scholar
- Graham Gibbs. 2006. How assessment frames student learning. Innovative assessment in higher education (2006), 23.Google Scholar
- Graham Gibbs and Claire Simpson 2004. Does your assessment support your students' learning. Journal of Teaching and Learning in Higher Education, Vol. 1, 1 (2004), 1--30.Google Scholar
- Graham Gibbs and Claire Simpson 2005. Conditions under which assessment supports students' learning. Learning and teaching in higher education 1 (2005), 3--31.Google Scholar
- Philip J. Guo and Katharina Reinecke 2014. Demographic differences in how students navigate through MOOCs Proceedings of the first ACM conference on Learning@ scale conference. ACM, 21--30. Google ScholarDigital Library
- Christian Gütl, Rocael Hernández Rizzardini, Vanessa Chang, and Miguel Morales. 2014. Attrition in MOOC: Lessons learned from drop-out students International Workshop on Learning Technology for Education in Cloud. Springer, 37--48.Google Scholar
- K. Innis 1996. Diary Survey: how undergraduate full-time students spend their time. Leeds Metropolitan Univ., Leeds, UK (1996).Google Scholar
- René F. Kizilcec, Chris Piech, and Emily Schneider. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses Proceedings of the third international conference on learning analytics and knowledge. ACM, 170--179. Google ScholarDigital Library
- Geza Kovacs. 2016. Effects of In-Video Quizzes on MOOC Lecture Viewing Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 31--40. Google ScholarDigital Library
- Ference Marton and R. Säaljö 1976. On qualitative differences in learning -- ii Outcome as a function of the learner's conception of the task. British journal of educational psychology Vol. 46, 2 (1976), 115--127.Google Scholar
- Carolyn M.L. Miller and Malcolm Parlett 1974. Up to the Mark: A Study of the Examination Game. (1974).Google Scholar
- Anka Mulder. 2016. MOOCs for Credit... Goes Live. (2016).Google Scholar
- Gary Natriello and Sanford M. Dornbusch 1984. Teacher evaluative standards and student effort. Longman Publishing Group.Google Scholar
- David I. Newble and Kerry Jaeger 1983. The effect of assessments and examinations on the learning of medical students. Medical education, Vol. 17, 3 (1983), 165--171.Google Scholar
- Osvaldo Rodriguez. 2013. The concept of openness behind c and x-MOOCs (Massive Open Online Courses). Open Praxis, Vol. 5, 1 (2013), 67--73.Google ScholarCross Ref
- Peter J. Rousseeuw. 1987. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Journal of computational and applied mathematics Vol. 20 (1987), 53--65. Google ScholarDigital Library
- Chris Rust. 2002. The impact of assessment on student learning how can the research literature practically help to inform the development of departmental assessment strategies and learner-centred assessment practices? Active learning in higher education Vol. 3, 2 (2002), 145--158.Google Scholar
- Kay Sambell and Liz McDowell 1998. The construction of the hidden curriculum: messages and meanings in the assessment of student learning. Assessment & Evaluation in Higher Education, Vol. 23, 4 (1998), 391--402.Google ScholarCross Ref
- Karen Scouller. 1998. The influence of assessment method on students' learning approaches: Multiple choice question examination versus assignment essay. Higher Education, Vol. 35, 4 (1998), 453--472.Google ScholarCross Ref
- Daniel T. Seaton, Yoav Bergner, Isaac Chuang, Piotr Mitros, and David E. Pritchard 2014. Who does what in a massive open online course? Commun. ACM Vol. 57, 4 (2014), 58--65. Google ScholarDigital Library
- Benson R. Snyder. 1970. The Hidden Curriculum. Cambridge, Mass.,MIT Press.Google Scholar
- Xiaoyue Wang, Abdullah Mueen, Hui Ding, Goce Trajcevski, Peter Scheuermann, and Eamonn Keogh. 2013. Experimental comparison of representation methods and distance measures for time series data. DataData Mining and Knowledge Discovery, Vol. 26, 2 (2013), 275--309. Google ScholarDigital Library
Index Terms
- Certificate Achievement Unlocked: How Does MOOC Learners' Behaviour Change?
Recommendations
Using learning analytics to explore help-seeking learner profiles in MOOCs
LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge ConferenceIn online learning environments, learners are often required to be more autonomous in their approach to learning. In scaled online learning environments, like Massive Open Online Courses (MOOCs), there are differences in the ability of learners to ...
Examining engagement: analysing learner subpopulations in massive open online courses (MOOCs)
LAK '15: Proceedings of the Fifth International Conference on Learning Analytics And KnowledgeMassive open online courses (MOOCs) are now being used across the world to provide millions of learners with access to education. Many learners complete these courses successfully, or to their own satisfaction, but the high numbers who do not finish ...
Moving Through MOOCS: Pedagogy, Learning Design and Patterns of Engagement
Design for Teaching and Learning in a Networked WorldAbstractMassive open online courses (MOOCs) are part of the lifelong learning experience of people worldwide. Many of these learners participate fully. However, the high levels of dropout on most of these courses are a cause for concern. Previous studies ...
Comments