Skip to main content
SpringerLink
Log in

Chatbot Feedback on Students’ Writing: Typology of Comments and Effectiveness

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2023 Workshops (ICCSA 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14112))

Included in the following conference series:

Abstract

Providing feedback is time-consuming. A chatbot has the potential to facilitate provision of detailed feedback saving instructors time and energy. However, the effectiveness of chatbot feedback has not been determined. In this study, chatbot end-comments on 28 students’ written papers were classified by topic and function. The comments were further evaluated for whether they reflected the five characteristics of effective feedback. Results demonstrated the ability of the chatbot to provide a variety of comments. The characteristics of these comments nevertheless, did not seem to reflect feedback best practices. The study provides recommendations for further chatbot feedback research, and in particular calls for more partnership between artificial intelligence developers and writing researchers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Graham, S., Harris, K.R., Santangelo, T.: based writing practices and the common core: meta-analysis and meta-synthesis. Elem. Sch. J. 115(4), 498–522 (2015)

    Article  Google Scholar 

  2. Black, P., Wiliam, D.: Assessment and classroom learning. Assess. Educ. Princ. Policy Pract. 5(1), 7–74 (1998)

    Google Scholar 

  3. Hyland, K., Hyland, F.: Feedback on second language students’ writing. Lang. Teach. 39(2), 83–101 (2006)

    Article  MathSciNet  Google Scholar 

  4. Guo, K., Wang, J., Chu, S.K.W.: Using chatbots to scaffold EFL students’ argumentative writing. Assess. Writ. 54, 100666 (2022)

    Article  Google Scholar 

  5. Lin, M.P.C., Chang, D.: Enhancing post-secondary writers’ writing skills with a chatbot. J. Educ. Technol. Soc. 23(1), 78–92 (2020)

    Google Scholar 

  6. Vázquez-Cano, E., Mengual-Andrés, S., López-Meneses, E.: Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. Int. J. Educ. Technol. High. Educ. 18(1), 1–20 (2021). https://doi.org/10.1186/s41239-021-00269-8

    Article  Google Scholar 

  7. Chou, C.-Y., Zou, N.-B.: An analysis of internal and external feedback in self-regulated learning activities mediated by self-regulated learning tools and open learner models. Int. J. Educ. Technol. High. Educ. 17(1), 1–27 (2020). https://doi.org/10.1186/s41239-020-00233-y

    Article  Google Scholar 

  8. Wen, Y.: Teacher written feedback on L2 student writings. J. Lang. Teach. Res. 4(2), 427 (2013)

    Google Scholar 

  9. Barkaoui, K.: Teaching writing to second language learners: insights from theory and research. TESL Report. 40, 14 (2007)

    Google Scholar 

  10. Junining, E.: A critique on giving feedback for English as a foreign language (EFL) students’ writing. Asian J. Educ. E-Learn. 2(1) (2014)

    Google Scholar 

  11. Zheng, Y., Yu, S.: Student engagement with teacher written corrective feedback in EFL writing: a case study of Chinese lower-proficiency students. Assess. Writ. 37, 13–24 (2018)

    Article  Google Scholar 

  12. Wulandari, Y.: Effective feedback to improve students’ writing skills. Educalitra Engl. Educ. Linguist. Lit. J. 1(1), 10–17 (2022)

    Google Scholar 

  13. Smith, S.: The genre of the end comment: conventions in teacher responses to student writing. Coll. Compos. Commun. 48(2), 249–268 (1997)

    Article  Google Scholar 

  14. Tack, A., Piech, C.: The AI teacher test: measuring the pedagogical ability of blender and GPT-3 in educational dialogues. arXiv preprint arXiv:2205.07540 (2022)

  15. Ndukwe, I.G., Daniel, B.K., Amadi, C.E.: A machine learning grading system using chatbots. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), Part II, vol. 11626, pp. 365–368. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23207-8_67

    Chapter  Google Scholar 

  16. Qu, W.: Research on the application of automatic scoring system in college English writing. In: 2016 International Conference on Economics, Social Science, Arts, Education and Management Engineering, pp. 694–698. Atlantis Press, August 2016

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. General Education Department, Rabdan Academy, Abu Dhabi, UAE

    Besma Allagui

Authors
  1. Besma Allagui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Besma Allagui .

Editor information

Editors and Affiliations

  1. University of Perugia, Perugia, Italy

    Osvaldo Gervasi

  2. University of Basilicata, Potenza, Italy

    Beniamino Murgante

  3. University of Minho, Braga, Portugal

    Ana Maria A. C. Rocha

  4. University of Cagliari, Cagliari, Italy

    Chiara Garau

  5. University of Basilicata, Potenza, Italy

    Francesco Scorza

  6. University of Massachusetts Medical School, Worcester, MA, USA

    Yeliz Karaca

  7. Polytechnic University of Bari, Bari, Italy

    Carmelo M. Torre

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Allagui, B. (2023). Chatbot Feedback on Students’ Writing: Typology of Comments and Effectiveness. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2023 Workshops. ICCSA 2023. Lecture Notes in Computer Science, vol 14112. Springer, Cham. https://doi.org/10.1007/978-3-031-37129-5_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-37129-5_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-37128-8

  • Online ISBN: 978-3-031-37129-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation