Abstract
Learning engagement is an important factor in academic success and instructional quality. In authentic settings, analyzing learner engagement status can be challenging due to the complexity of its multidimensional construct. It requires constant monitoring of multimodal engagement indicators (cognitive-level indicators, e.g., effort, emotional-level indicators, e.g., positive/negative emotions) and individualized pacing of learners, identifying when and who needs assistance, as well as making pedagogical strategy that matches the needs of the learners (or group of learners). This study combines user requirements with computational techniques to construct a multimodal learning engagement analysis framework in the blended setting. In addition, a teacher-faced dashboard prototype is developed to statistically summarize and visualize multimodal indicators in a way that enables teachers to deploy personalized instruction schemes. The teachers’ perspectives discussed in this study portray the great potential of introducing Artificial Intelligent (AI)-augmented models and visual analytics techniques aimed at deploying personalized instructions in the blended learning environment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Carrillo, R., Renaud, C., Prié, Y., Lavoué, É.: Dashboard for monitoring student engagement in mind mapping activities. In: 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT), pp. 433–437 (2017). https://doi.org/10.1109/ICALT.2017.100
Dourado, R.A., Rodrigues, R.L., Ferreira, N., Mello, R. F., Gomes, A. S., Verbert, K.: A teacher-facing learning analytics dashboard for process-oriented feedback in online learning. In: LAK21: 11th International Learning Analytics and Knowledge Conference, pp. 482–489 (2021)
Ez-Zaouia, M.: Teacher-centered dashboards design process. In: 2nd International Workshop on EXplainable Learning Analytics, Companion Proceedings of the 10th International Conference on Learning Analytics & Knowledge LAK20 (2020, March)
Ez-zaouia, M., Lavoué, E.: EMODA: A tutor oriented multimodal and contextual emotional dashboard. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 429–438 (2017). https://doi.org/10.1145/3027385.3027434
Ez-zaouia, M., Tabard, A., Lavoué, E.: PROGDASH: lessons learned from a learning dashboard In-the-wild: In: Proceedings of the 12th International Conference on Computer Supported Education, pp. 105–117 (2020). https://doi.org/10.5220/0009424801050117
Fernandez Nieto, G.M., Kitto, K., Buckingham Shum, S., Martinez-Maldonado, R.: Beyond the learning analytics dashboard: alternative ways to communicate student data insights combining visualisation, narrative and storytelling. In: LAK22: 12th International Learning Analytics and Knowledge Conference, pp. 219–229 (2022). https://doi.org/10.1145/3506860.3506895
Goldberg, P., et al.: Attentive or Not? Toward a machine learning approach to assessing students’ visible engagement in classroom instruction. Educ. Psychol. Rev. 33(1), 27–49 (2019). https://doi.org/10.1007/s10648-019-09514-z
Halverson, L.R., Graham, C.R.: Learner engagement in blended learning environments: a conceptual framework. Online Learn. 23(2) (2019). https://doi.org/10.24059/olj.v23i2.148
Hillaire, G.E., Schlichtmann, G., Ducharme, K.: Prototyping visual learning analytics guided by an educational theory informed goal. J. Learn. Anal. 3(3), 115–142 (2016). https://doi.org/10.18608/jla.2016.33.7
Holstein, K., Hong, G., Tegene, M., McLaren, B. M., Aleven, V.: The classroom as a dashboard: Co-designing wearable cognitive augmentation for K-12 teachers. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 79–88 (2018). https://doi.org/10.1145/3170358.3170377
Johnson, J., Conderman, G., Van Laarhoven, T., Liberty, L.: Wearable technologies: a new way to address student anxiety. Kappa Delta Pi Record 58(3), 124–129 (2022). https://doi.org/10.1080/00228958.2022.2076531
Krithika, L.B., Priya, G.L.: Student emotion recognition system (SERS) for E-learning improvement based on learner concentration metric. Procedia Comput. Sci. 85, 767–776 (2016)
Lechuga, C.G., Doroudi, S.: Three algorithms for grouping students: a bridge between personalized tutoring system data and classroom pedagogy. Int. J. Artif. Intell. Educ (2022). https://doi.org/10.1007/s40593-022-00309-y
Li, H., Ding, W., Liu, Z.: Identifying At-Risk K-12 students in multimodal online environments: a machine learning approach (arXiv:2003.09670). arXiv. http://arxiv.org/abs/2003.09670 (2020)
Martinez-Maldonado, R., Pardo, A., Mirriahi, N., Yacef, K., Kay, J., Clayphan, A.: The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings. In: Proceedings of the Fifth International Conference on Learning Analytics and Knowledge, pp. 1–10. https://doi.org/10.1145/2723576.2723583
Nazaretsky, T., Hershkovitz, S., Alexandron, G. Kappa learning: a new item-similarity method for clustering educational items from response data, 10p (2019)
Pozdniakov, S., et al.: The question-driven dashboard: how can we design analytics interfaces aligned to teachers’ inquiry? In: LAK22: 12th International Learning Analytics and Knowledge Conference, pp. 175–185 (2022). https://doi.org/10.1145/3506860.3506885
Schwendimann, B.A., et al.: Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans. Learn. Technol. 10(1), 30–41 (2017). https://doi.org/10.1109/TLT.2016.2599522
Sellier, N., & An, P.: How peripheral interactive systems can support teachers with differentiated instruction: using fireflies as a probe. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, 1117–1129 (2020). https://doi.org/10.1145/3357236.3395497
Shankar, S.K., Prieto, L.P., RodrĂguez-Triana, M. J., Ruiz-Calleja, A.: A review of multimodal learning analytics architectures. In: 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), pp. 212–214 (2018). https://doi.org/10.1109/ICALT.2018.00057
Sharma, K., Giannakos, M.: Multimodal data capabilities for learning: what can multimodal data tell us about learning? Br. J. Edu. Technol. 51(5), 1450–1484 (2020). https://doi.org/10.1111/bjet.12993
Vieira, C., Parsons, P., Byrd, V.: Visual learning analytics of educational data: a systematic literature review and research agenda. Comput. Educ. 122, 119–135 (2018). https://doi.org/10.1016/j.compedu.2018.03.018
Zamecnik, A., et al.: Team interactions with learning analytics dashboards. Comput. Educ. 185, 104514 (2022). https://doi.org/10.1016/j.compedu.2022.104514
Zhao, L., et al.: Modelling co-located team communication from voice detection and positioning data in healthcare simulation. In: LAK22: 12th International Learning Analytics and Knowledge Conference, pp. 370–380 (2022). https://doi.org/10.1145/3506860.3506935
Acknowledgement
This work was supported by the first Batch of 2021 MOE of PRC Industry-University Collaborative Education Program (Program No. 202101042006, Kingfar-CES “Human Factors and Ergonomics” Program).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, H., Sun, X., Zhang, Y., Wang, Q., Yao, C. (2023). Towards Personalized Instruction: Co-designing a Teacher-Centered Dashboard for Learning Engagement Analysis in Blended Learning Environments. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies. HCII 2023. Lecture Notes in Computer Science, vol 14040. Springer, Cham. https://doi.org/10.1007/978-3-031-34411-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-34411-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34410-7
Online ISBN: 978-3-031-34411-4
eBook Packages: Computer ScienceComputer Science (R0)