Abstract
Students’ effort is often considered to be a key element in the learning process. As such, it can be a relevant element to integrate in learning analytics tools, such as dashboards, intelligent tutoring systems, adaptive hypermedia systems, and recommendation systems. A prerequisite to do so is to measure and predict it from learning data, which poses some challenges. We propose to rely on the cognitive load theory to infer the students’ perceived effort using subjective, performance, behavioral and physiological data collected from 120 seventh grade students. We also estimate students’ effort in future tasks using the data from previous tasks. Our results show a high relevance of interaction data to measure students’ effort, especially when compared to physiological data. Moreover, we also found that using the data collected on previous tasks allows us to achieve slightly higher accuracy values than the data collected during the task execution. Finally, this approach also allowed us to predict students’ perceived effort in future tasks, which, to the best of our knowledge, is one of the first attempts towards this goal.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
A full list of the extracted effort and engagement features can be seen here: https://bit.ly/2UUYfuc.
- 2.
All the statistical tests mentioned in this paper were done with the unpaired Student’s T-test (for the parametric data) or the unpaired Mann-Whitney U test (for the non-parametric data) after checking for normality with the Shapiro-Wilk test. The null hypothesis was rejected when p-value < 0.05.
References
Borys, M., Plechawska-Wójcik, M., Wawrzyk, M., Wesołowska, K.: Classifying cognitive workload using eye activity and EEG features in arithmetic tasks. In: Damaševičius, R., Mikašytė, V. (eds.) ICIST 2017. CCIS, vol. 756, pp. 90–105. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67642-5_8
D’Mello, S., Dieterle, E., Duckworth, A.: Advanced, analytic, automated (AAA) measurement of engagement during learning. Educ. Psychol. 52, 104–123 (2017)
Henrie, C.R., Halverson, L.R., Graham, C.R.: Measuring student engagement in technology-mediated learning: a review. Comput. Educ. 90, 36–53 (2015)
Herbig, N., et al.: Investigating multi-modal measures for cognitive load detection in e-learning. In: Proceedings of UMAP. ACM (2020)
Kelleher, C., Hnin, W.: Predicting cognitive load in future code puzzles. In: Proceedings of CHI Conference on Human Factors in Computing Systems. ACM (2019)
Leppink, J.: Cognitive load theory: practical implications and an important challenge. J. Taibah Univ. Med. Sci. 12, 385–391 (2017)
Moissa, B., Bonnin, G., Boyer, A.: Towards the exploitation of multimodal data to measure students’ mental effort. In: Proceedings of ICALT. IEEE (2020)
Paas, F., Tuovinen, J.E., Tabbers, H., Van Gerven, P.W.M.: Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38, 36–71 (2003)
Rozo, R.C.: Suivi de l’engagement des apprenants lors de la construction de cartes mentales à partir de traces d’interaction. Ph.D. thesis, Université de Lyon (2019)
Scariot, A.P., Andrade, F.G., da Silva, J.M.C., Imran, H.: Students effort vs. outcome: analysis through Moodle logs. In: Proceedings of ICALT (2016)
Sharma, K., Papamitsiou, Z., Olsen, J.K., Giannakos, M.: Predicting learners’ effortful behaviour in adaptive assessment using multimodal data. In: Proceedings of the LAK. ACM (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Moissa, B., Bonnin, G., Boyer, A. (2021). Measuring and Predicting Students’ Effort: A Study on the Feasibility of Cognitive Load Measures to Real-Life Scenarios. In: De Laet, T., Klemke, R., Alario-Hoyos, C., Hilliger, I., Ortega-Arranz, A. (eds) Technology-Enhanced Learning for a Free, Safe, and Sustainable World. EC-TEL 2021. Lecture Notes in Computer Science(), vol 12884. Springer, Cham. https://doi.org/10.1007/978-3-030-86436-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-86436-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86435-4
Online ISBN: 978-3-030-86436-1
eBook Packages: Computer ScienceComputer Science (R0)