Skip to main content

Measuring and Predicting Students’ Effort: A Study on the Feasibility of Cognitive Load Measures to Real-Life Scenarios

  • Conference paper
  • First Online:
Technology-Enhanced Learning for a Free, Safe, and Sustainable World (EC-TEL 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12884))

Included in the following conference series:

Abstract

Students’ effort is often considered to be a key element in the learning process. As such, it can be a relevant element to integrate in learning analytics tools, such as dashboards, intelligent tutoring systems, adaptive hypermedia systems, and recommendation systems. A prerequisite to do so is to measure and predict it from learning data, which poses some challenges. We propose to rely on the cognitive load theory to infer the students’ perceived effort using subjective, performance, behavioral and physiological data collected from 120 seventh grade students. We also estimate students’ effort in future tasks using the data from previous tasks. Our results show a high relevance of interaction data to measure students’ effort, especially when compared to physiological data. Moreover, we also found that using the data collected on previous tasks allows us to achieve slightly higher accuracy values than the data collected during the task execution. Finally, this approach also allowed us to predict students’ perceived effort in future tasks, which, to the best of our knowledge, is one of the first attempts towards this goal.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A full list of the extracted effort and engagement features can be seen here: https://bit.ly/2UUYfuc.

  2. 2.

    All the statistical tests mentioned in this paper were done with the unpaired Student’s T-test (for the parametric data) or the unpaired Mann-Whitney U test (for the non-parametric data) after checking for normality with the Shapiro-Wilk test. The null hypothesis was rejected when p-value < 0.05.

References

  1. Borys, M., Plechawska-Wójcik, M., Wawrzyk, M., Wesołowska, K.: Classifying cognitive workload using eye activity and EEG features in arithmetic tasks. In: Damaševičius, R., Mikašytė, V. (eds.) ICIST 2017. CCIS, vol. 756, pp. 90–105. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67642-5_8

    Chapter  Google Scholar 

  2. D’Mello, S., Dieterle, E., Duckworth, A.: Advanced, analytic, automated (AAA) measurement of engagement during learning. Educ. Psychol. 52, 104–123 (2017)

    Article  Google Scholar 

  3. Henrie, C.R., Halverson, L.R., Graham, C.R.: Measuring student engagement in technology-mediated learning: a review. Comput. Educ. 90, 36–53 (2015)

    Article  Google Scholar 

  4. Herbig, N., et al.: Investigating multi-modal measures for cognitive load detection in e-learning. In: Proceedings of UMAP. ACM (2020)

    Google Scholar 

  5. Kelleher, C., Hnin, W.: Predicting cognitive load in future code puzzles. In: Proceedings of CHI Conference on Human Factors in Computing Systems. ACM (2019)

    Google Scholar 

  6. Leppink, J.: Cognitive load theory: practical implications and an important challenge. J. Taibah Univ. Med. Sci. 12, 385–391 (2017)

    Google Scholar 

  7. Moissa, B., Bonnin, G., Boyer, A.: Towards the exploitation of multimodal data to measure students’ mental effort. In: Proceedings of ICALT. IEEE (2020)

    Google Scholar 

  8. Paas, F., Tuovinen, J.E., Tabbers, H., Van Gerven, P.W.M.: Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38, 36–71 (2003)

    Google Scholar 

  9. Rozo, R.C.: Suivi de l’engagement des apprenants lors de la construction de cartes mentales à partir de traces d’interaction. Ph.D. thesis, Université de Lyon (2019)

    Google Scholar 

  10. Scariot, A.P., Andrade, F.G., da Silva, J.M.C., Imran, H.: Students effort vs. outcome: analysis through Moodle logs. In: Proceedings of ICALT (2016)

    Google Scholar 

  11. Sharma, K., Papamitsiou, Z., Olsen, J.K., Giannakos, M.: Predicting learners’ effortful behaviour in adaptive assessment using multimodal data. In: Proceedings of the LAK. ACM (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Barbara Moissa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moissa, B., Bonnin, G., Boyer, A. (2021). Measuring and Predicting Students’ Effort: A Study on the Feasibility of Cognitive Load Measures to Real-Life Scenarios. In: De Laet, T., Klemke, R., Alario-Hoyos, C., Hilliger, I., Ortega-Arranz, A. (eds) Technology-Enhanced Learning for a Free, Safe, and Sustainable World. EC-TEL 2021. Lecture Notes in Computer Science(), vol 12884. Springer, Cham. https://doi.org/10.1007/978-3-030-86436-1_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86436-1_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86435-4

  • Online ISBN: 978-3-030-86436-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics