Skip to main content

Process and Self-regulation Explainable Feedback for Novice Programmers Appears Ineffectual

  • Conference paper
  • First Online:
Educating for a New Future: Making Sense of Technology-Enhanced Learning Adoption (EC-TEL 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13450))

Included in the following conference series:

Abstract

This paper investigates how to provide novice programmers with feedback about their learning process including hints and explanations to improve their learning. The aim is to improve the feedback effectiveness and perceived utility by making it more meaningful through the use of explanations. Our proposals were implemented in the context of computer science education and an experiment was conducted to evaluate the effect of explainable feedback on changes in learners’ strategies, performance and perceptions. The first results of this experiment show no significant effect of process and self-regulation feedback (explained or not) on students’ strategies or learning outcomes. Also, we conducted a qualitative analysis that allowed us to propose a series of recommendations for stakeholders exploring feedback explainability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Afzaal, M., et al.: Generation of automatic data-driven feedback to students using explainable machine learning. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) AIED 2021. LNCS (LNAI), vol. 12749, pp. 37–42. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78270-2_6

    Chapter  Google Scholar 

  2. Arguel, A., Lockyer, L., Kennedy, G., Lodge, J.M., Pachman, M.: Seeking optimal confusion: a review on epistemic emotion management in interactive digital learning environments. Interact. Learn. Environ. (2019)

    Google Scholar 

  3. Bey, A., Pérez-Sanagustín, M., Broisin, J.: Unsupervised automatic detection of learners’ programming behavior. In: Scheffel, M., Broisin, J., Pammer-Schindler, V., Ioannou, A., Schneider, J. (eds.) EC-TEL 2019. LNCS, vol. 11722, pp. 69–82. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29736-7_6

    Chapter  Google Scholar 

  4. Broisin, J., Venant, R., Vidal, P.: Lab4CE: a remote laboratory for computer education. Int. J. Artif. Intell. Educ. 27(1), 154–180 (2015). https://doi.org/10.1007/s40593-015-0079-3

    Article  Google Scholar 

  5. Conati, C., Barral, O., Putnam, V., Rieger, L.: Toward personalized XAI: a case study in intelligent tutoring systems. Artif. Intell. 298, 103503 (2021)

    Article  Google Scholar 

  6. Hattie, J., Timperley, H.: The power of feedback. Rev. Educ. Res. (2007)

    Google Scholar 

  7. Keuning, H., Jeuring, J., Heeren, B.: A systematic literature review of automated feedback generation for programming exercises. ACM Trans. Comput. Educ. 19, 1–43 (2018)

    Article  Google Scholar 

  8. Kleij, E., Veldkamp, T.: Effects of feedback in a computer-based assessment for learning - ScienceDirect. Comput. Educ. (2012)

    Google Scholar 

  9. Kraus, S., et al.: AI for explaining decisions in multi-agent environments. In: Proceedings of the AAAI Conference on Artificial Intelligence. Springer (2020)

    Google Scholar 

  10. Narciss, S., Huth, K., Narciss, D.: How to design informative tutoring feedback for multi-media learning. Inst. Des. Multimedia Learn. (2002)

    Google Scholar 

  11. Serral, E., De Weerdt, J., Sedrakyan, G., Snoeck, M.: Automating immediate and personalized feedback taking conceptual modelling education to a next level (2016)

    Google Scholar 

  12. Timmers, C., Veldkamp, B.: Attention paid to feedback provided by a computer-based assessment for learning on information literacy. Comput. Educ. (2011)

    Google Scholar 

  13. Wisniewski, B., Zierer, K., Hattie, J.: The power of feedback revisited: a meta-analysis of educational feedback research. Front. Psychol. (2020)

    Google Scholar 

  14. Yeo, G., Neal, A.: Subjective cognitive effort: a model of states, traits, and time. J. Appl. Psychol. 93, 617 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Esther Félix .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Félix, E., Amadieu, F., Venant, R., Broisin, J. (2022). Process and Self-regulation Explainable Feedback for Novice Programmers Appears Ineffectual. In: Hilliger, I., Muñoz-Merino, P.J., De Laet, T., Ortega-Arranz, A., Farrell, T. (eds) Educating for a New Future: Making Sense of Technology-Enhanced Learning Adoption. EC-TEL 2022. Lecture Notes in Computer Science, vol 13450. Springer, Cham. https://doi.org/10.1007/978-3-031-16290-9_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-16290-9_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-16289-3

  • Online ISBN: 978-3-031-16290-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics