Skip to main content

An Architectural System for Automatic Pedagogical Interventions in Massive Online Learning Environments

  • Conference paper
  • First Online:
Advanced Information Networking and Applications (AINA 2023)

Abstract

Massive Open Online Courses (MOOCs) are a teaching method that uses Virtual Learning Environments to reach a vast number of students, thus, facilitating access to education by making costs more appealing because of scale economics. Consequently, Tutors’ and teachers’ interaction is crucial for the successful development of a MOOC. However, due to the size and diversity of the student body in MOOCs, instructors and tutors need help to keep an eye on them carefully and intervene as needed. This work aims to set and validate an architecture for pedagogical interventions in online learning based on how a student feels, using the automatically detected subjective attributes obtained through interactions in the learning management systems. The architecture is based on three layers: (i) the Application layer for managing interaction with the Virtual Learning Environment; (ii) the Knowledge layer for the automatic textual classification, the attributes identification, knowledge representation through ontology and selection of pedagogical intervention actions; and (iii) the Intervention layer carries out pedagogical interventions through an autonomous conversational agent. The proposed architecture can identify the necessary pedagogical intervention, and the conversational agent can make decisions and adopt an approach more suited to the student’s needs. The proposed architecture was evaluated using the Stanford MOOC dataset, comprised of 11,042 participants who posted 29,604 messages from eleven courses. The preliminary evaluation results conclude that our approach is able to significantly support the tutor in MOOC environments as 65% of the student posts were automatically managed by the system while only the 35% left needed tutor attention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barbier, K., Struyf, E., Verschueren, K., Donche, V.: Fostering cognitive and affective-motivational learning outcomes for high-ability students in mixed-ability elementary classrooms: a systematic review. Eur. J. Psychol. Educ. 38, 83–107 (2022)

    Article  Google Scholar 

  2. Caballe, S.: A computer science methodology for online education research. Int. J. Eng. Educ. 35(2), 548–562 (2019)

    Google Scholar 

  3. Caballé, S., Conesa, J., Gañán, D.: Evaluation on using conversational pedagogical agents to support collaborative learning in MOOCs. In: Barolli, L., Takizawa, M., Yoshihisa, T., Amato, F., Ikeda, M. (eds.) 3PGCIC 2020. LNNS, vol. 158, pp. 199–210. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-61105-7_20

    Chapter  Google Scholar 

  4. Gurel, Z.C., Bekdemir, M.: The teacher and peer intervention for pre-service mathematics teachers on the validity of mathematical models. Pedagogical Res. 7(2), em0120 (2022)

    Google Scholar 

  5. Capuano, N., Caballé, S.: Towards adaptive peer assessment for MOOCs. In: 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), pp. 64–69. IEEE (2015)

    Google Scholar 

  6. Capuano, N., Caballé, S.: Multi-attribute categorization of MOOC forum posts and applications to conversational agents. In: Barolli, L., Hellinckx, P., Natwichai, J. (eds.) 3PGCIC 2019. LNNS, vol. 96, pp. 505–514. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-33509-0_47

    Chapter  Google Scholar 

  7. Chaturvedi, S., Goldwasser, D., Daumé III, H.: Predicting instructor’s intervention in mooc forums. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1501–1511 (2014)

    Google Scholar 

  8. Cuevas, R., Ntoumanis, N., Fernandez-Bustos, J.G., Bartholomew, K.: Does teacher evaluation based on student performance predict motivation, well-being, and ill-being? J. School Psychol. 68, 154–162 (2018)

    Google Scholar 

  9. Demetriadis, S., et al.: Conversational agents in MOOCs: reflections on first outcomes of the ColMOOC project. In: Intelligent Systems and Learning Data Analytics in Online Education, pp. xxxvii–lxxiv (2021)

    Google Scholar 

  10. Fandiño, F.G.E., Velandia, A.J.S.: How an online tutor motivates e-learning English. Heliyon 6(8), e04630 (2020)

    Article  Google Scholar 

  11. Hattie, J., Biggs, J., Purdie, N.: Effects of learning skills interventions on student learning: a meta-analysis. Rev. Educ. Res. 66(2), 99–136 (1996)

    Article  Google Scholar 

  12. Khanal, S.S., Prasad, P.W.C., Alsadoon, A., Maag, A.: A systematic review: machine learning based recommendation systems for e-learning. Educ. Inf. Technol. 25(4), 2635–2664 (2020)

    Article  Google Scholar 

  13. Leiss, D.: Adaptive lehrerinterventionen beim mathematischen modellieren-empirische befunde einer vergleichenden labor-und unterrichtsstudie. J. für Mathematik-Didaktik 31(2), 197–226 (2010)

    Article  Google Scholar 

  14. Marbouti, F., Diefes-Dux, H.A., Madhavan, K.: Models for early prediction of at-risk students in a course using standards-based grading. Comput. Educ. 103, 1–15 (2016)

    Article  Google Scholar 

  15. Máximo, V., Marinho, R.A.C.: Intervenção pedagógica no processo de ensino e aprendizagem. Braz. J. Dev. 7(1), 8208–8218 (2021)

    Article  Google Scholar 

  16. Moreno-Guerrero, A.-J., Aznar-Díaz, I., Cáceres-Reche, P., Alonso-García, S.: E-learning in the teaching of mathematics: an educational experience in adult high school. Mathematics 8(5), 840 (2020)

    Article  Google Scholar 

  17. Moreno-Marcos, P.M., Alario-Hoyos, C., Muñoz-Merino, P.J., Estévez-Ayres, I., Kloos, C.D.: Sentiment analysis in MOOCs: a case study. In: 2018 IEEE Global Engineering Education Conference (EDUCON), pp. 1489–1496. IEEE (2018)

    Google Scholar 

  18. Moreno-Marcos, P.M., Alario-Hoyos, C., Muñoz-Merino, P.J., Kloos, C.D.: Prediction in MOOCs: a review and future research directions. IEEE Trans. Learn. Technol. 12(3), 384–401 (2018)

    Article  Google Scholar 

  19. Palvia, S.: Online education: worldwide status, challenges, trends, and implications. J. Global Inf. Technol. Manage. 21(4), 233–241 (2018)

    Google Scholar 

  20. Panigrahi, R., Srivastava, P.R., Panigrahi, P.K.: Effectiveness of e-learning: the mediating role of student engagement on perceived learning effectiveness. Inf. Technol. People 34(7), 1840–1862 (2020)

    Google Scholar 

  21. Rossi, D., et al.: CAERS: a conversational agent for intervention in MOOCs’ learning processes. In: Guralnick, D., Auer, M.E., Poce, A. (eds.) TLIC 2021. LNNS, vol. 349, pp. 371–382. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-90677-1_36

    Chapter  Google Scholar 

  22. Toti, D., Capuano, N., Campos, F., Dantas, M., Neves, F., Caballé, S.: Detection of student engagement in e-learning systems based on semantic analysis and machine learning. In: Barolli, L., Takizawa, M., Yoshihisa, T., Amato, F., Ikeda, M. (eds.) 3PGCIC 2020. LNNS, vol. 158, pp. 211–223. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-61105-7_21

    Chapter  Google Scholar 

  23. Tropper, N., Leiss, D., Hänze, M.: Teachers’ temporary support and worked-out examples as elements of scaffolding in mathematical modeling. ZDM 47(7), 1225–1240 (2015)

    Article  Google Scholar 

  24. Yang, D., Wen, M., Howley, I., Kraut, R., Rose, C.: Exploring the effect of confusion in discussion forums of massive open online courses. In: Proceedings of the Second (2015) ACM Conference on Learning@ Scale, pp. 121–130 (2015)

    Google Scholar 

  25. Zhang, J.-H., Zou, L., Miao, J., Zhang, Y.-X., Hwang, G.-J., Zhu, Y.: An individualized intervention approach to improving university students’ learning performance and interactive behaviors in a blended learning environment. Interact. Learn. Environ. 28(2), 231–245 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Santi Caballé .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rossi, D. et al. (2023). An Architectural System for Automatic Pedagogical Interventions in Massive Online Learning Environments. In: Barolli, L. (eds) Advanced Information Networking and Applications. AINA 2023. Lecture Notes in Networks and Systems, vol 661. Springer, Cham. https://doi.org/10.1007/978-3-031-29056-5_20

Download citation

Publish with us

Policies and ethics