Abstract
Student assessment is a challenging topic where methods are still being developed to embed active learning, deeper understanding, fairness and appropriateness to the learning process. As a candidate assessment factor, student engagement is a known contributor to student success, although the lack of student engagement and success, particularly in online environments are both challenging and ongoing issues. Student engagement is typically measured in retrospective data collection to understand how engagement has affected student learning. However in online learning environments we have access to data in a timely manner from resource access to assessment tasks, where they can be captured seamlessly and used in analytics to understand student behaviours and learning patterns. By combining a microlevel student engagement measurement we have implemented, with the goal of assessing engagement, we present initial results in this paper from a study we have carried out at Universitat Oberta de Catalunya in Spain, which shows promise in student engagement measurement as a form of continuous assessment. By measuring microlevel engagement, we have observed we can collect a variety of missing subjective dataset to complement the system-level data, and it can also be an opportunity for students to reflect on their own engagement as well as have a method to record their microlevel state. In several courses teachers rewarded points based on engagement, leading to continued engagement of students and a stream of actionable information to understand where students have challenges of engagement in their learning and revision of course content.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allen, I.E., Seaman, J.: Grade Level: Tracking Online Education in the United States. Babson Survey Research Group and Quahog Research Group, LLC. (2015). http://www.onlinelearningsurvey.com/reports/gradelevel.pdf
Appleton, J.J., Christenson, S.L., Kim, D., Reschly, A.L.: Measuring cognitive and psychological engagement: validation of the student engagement instrument. J. Sch. Psychol. 44(5), 427–445 (2006)
Ash, S.L., Clayton, P.H.: The articulated learning: an approach to guided reflection and assessment. Innov. High. Educ. 29(2), 137–154 (2004)
Balasooriya, I., Mor, E., Rodríguez, M.E.: Extending learning analytics with microlevel student engagement data. In: Proceedings of EduLearn 2017 (2017)
Bonk, C.J., Kim, K.J.: The future of online teaching and learning in higher education: the survey says. EDUCAUSE Q. Mag. 29(4), 22–30 (2006)
Braunsberger, K., McCuiston, V., Patterson, G., Watkins, A.: Perceived risks and psychological well-being in online education: implications for grade expectations and future enrollment. In: Groza, M., Ragland, C. (eds.) Marketing Challenges in a Turbulent Business Environment. Developments in Marketing Science: Proceedings of the Academy of Marketing Science, pp. 487–488. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-19428-8_123
Burkett, E.: Another Planet: A Year in the Life of a Suburban High School. Harper Collins, New York (2002)
Carini, R.M., Kuh, G.D., Klein, S.P.: Student engagement and student learning: testing the linkages. Res. High. Educ. 47(1), 1–32 (2006)
Carr, S.: As distance education comes of age, the challenge is keeping the students. In: Chronicle of Higher Education, Information Technology Section (2000). http://chronicle.com/free/v46/i23/23a00101.htm
Cavanaugh, J., Jacquemin, S.J.: A large sample comparison of grade based student learning outcomes in online vs. face-to-face courses. In: Online Learning, vol. 19, no. 2 (2015)
Coates, H.: The value of student engagement for higher education quality assurance. Qual. High. Educ. 11(1), 25–36 (2005)
Connell, J., Wellborn, J.G.: Competence, autonomy, and relatedness: a motivational analysis of self-system process. In: Gunnar, M.R., Sroufe, L.A. (eds.) Self Process in Development: Minnesota Symposium on Child Psychology, vol. 2, pp. 167–216. Lawrence Erlbaum, Hillsdale (1991)
Cowie, B., Bell, B.: A model of formative assessment in science education. Assess. Educ.: Principles Policy Pract. 6(1), 101–116 (1999)
Crisp, G.: Teacher’s Handbook on e-Assessment. Transforming Assessment-An ALTC Fellowship Activity, vol. 18 (2011)
Fairweather, J.: Linking evidence and promising practices in science, technology, engineering, and mathematics (STEM) undergraduate education. Board of Science Education, National Research Council, The National Academies, Washington, DC. (2008)
Fredricks, J.A., Blumenfeld, P.C., Paris, A.H.: School engagement: potential of the concept, state of the evidence. Rev. Educ. Res. 74(1), 59–109 (2004)
Freeman, S., Eddy, S.L., McDonough, M., Smith, M.K., Okoroafor, N., Jordt, H., Wenderoth, M.P.: Active learning increases student performance in science, engineering, and mathematics. Proc. Natl. Acad. Sci. 111(23), 8410–8415 (2014)
Fredricks, J.A., McColskey, W.: The measurement of student engagement: a comparative analysis of various methods and student self-report instruments. In: Christenson, S., Reschly, A., Wylie, C. (eds.) Handbook of Research on Student Engagement, pp. 763–782. Springer, Boston (2012). https://doi.org/10.1007/978-1-4614-2018-7_37
Gibbs, G., Simpson, C.: Conditions under which assessment supports students’ learning. Learn. Teach. High. Educ. 1(1), 3–31 (2004)
Goetz, T., Bieg, M., Lüdtke, O., Pekrun, R., Hall, N.C.: Do girls really experience more anxiety in mathematics? Psychol. Sci. 24(10), 2079–2087 (2013)
Gogol, K., et al.: “My questionnaire is too long!” the assessments of motivational-affective constructs with three-item and single-item measures. Contemp. Educ. Psychol. 39(3), 188–205 (2014)
Hettiarachchi, E., Balasooriya, I., Mor, E., Huertas, M.A.: E-assessment for skill acquisition in online engineering education: challenges and opportunities. In: Caballé, S., Clarisó, R. (eds.) Formative Assessment, Learning Data Analytics and Gamification in ICT Education, pp. 49–64 (2016)
Keeves, J.P.: Methods of assessment in schools. In: International Encyclopedia of Education, pp. 362–370 (1994)
Ladd, G.W., Dinella, L.M.: Continuity and change in early school engagement: predictive of children’s achievement trajectories from first to eighth grade? J. Educ. Psychol. 101(1), 190–206 (2009)
Ni, A.Y.: Comparing the effectiveness of classroom and online learning: teaching research methods. J. Public Affairs Educ. 19(2), 199–215 (2013)
Nicol, D.J., Macfarlane-Dick, D.: Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud. High. Educ. 31(2), 199–218 (2006)
Pope, D.: Doing school: how we are creating a generation of stressed-out, materialistic, and miseducated students. Yale University Press, New Haven (2002)
Rogers, R.: Reflection in higher education: a concept analysis. Innov. High. Educ. 26, 37–57 (2001)
Shernoff, D.J., Schmidt, J.A.: Further evidence of an engagement–achievement paradox among US high school students. J. Youth Adolesc. 37(5), 564–580 (2008)
Shum, S.B., Crick, R.D.: Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 92–101. ACM (2012)
Skinner, E.A., Kindermann, T.A., Connell, J.P., Wellborn, J.G.: Engagement and disaffection as organizational constructs in the dynamics of motivational development. In: Handbook of Motivation at School, pp. 223–245 (2009)
Smith, D., Hardaker, G.: e-Learning innovation through the implementation of an internet supported learning environment. Educ. Technol. Soc. 3, 1–16 (2000)
Susman, G.I., Evered, R.D.: An assessment of the scientific merits of action research. Adm. Sci. Q. 582–603 (1978)
Welch, M.: The ABCs of reflection: a template for students and instructors to implement written reflection in service-learning. NSEE Q. 25, 22–25 (1999)
Acknowledgments
This work has been funded by the project Open Data for All: an API-based infrastructure for exploiting online data sources given by the Spanish Ministerio de Economía, Industria y Competitividad (ref. TIN2016-75944-R) and a doctoral grant from the Universitat Oberta de Catalunya (UOC).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Balasooriya, I., Rodríguez, M.E., Mor, E. (2018). Assessment of Engagement: Using Microlevel Student Engagement as a Form of Continuous Assessment. In: Ras, E., Guerrero Roldán, A. (eds) Technology Enhanced Assessment. TEA 2017. Communications in Computer and Information Science, vol 829. Springer, Cham. https://doi.org/10.1007/978-3-319-97807-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-97807-9_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97806-2
Online ISBN: 978-3-319-97807-9
eBook Packages: Computer ScienceComputer Science (R0)