Skip to main content

Data Mining and Analysis of NLP Methods in Students Evaluation of Teaching

  • Conference paper
  • First Online:
Advances in Soft Computing (MICAI 2023)

Abstract

Student evaluations of teachings (SETs) are essential for determining the quality of the educational process. Natural Language Processing (NLP) techniques may produce informative insights into these surveys. This study aims to provide an overview of the various approaches used in NLP and sentiment analysis, focusing on identifying the top outcomes, models, and text representations used. Furthermore, we investigate NLP methods applied to a Spanish corpus of SETs, which is relatively uncommon, and discuss the application of less well-known tools in this scenario. In general, by showing the top models and text representations, especially in the case of a Spanish corpus, this study contributes to NLP and sentiment analysis. Additionally, it promotes research and interest in other languages that receive little attention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Data Availability Statement

The dataset used in this work may be available on request to the Institute for the Future of Education Data Hub.

References

  1. Bedggood, R.E., Donovan, J.D.: University performance evaluations: what are we really measuring? Stud. High. Educ. 37(7), 825–842 (2012)

    Article  Google Scholar 

  2. Cheng, M., Taylor, J., Williams, J., Tong, K.: Student satisfaction and perceptions of quality: testing the linkages for PhD students. High. Educ. Res. Dev. 35(6), 1153–1166 (2016)

    Article  Google Scholar 

  3. Clayson, D.E., Haley, D.A.: Are students telling us the truth? a critical look at the student evaluation of teaching. Mark. Educ. Rev. 21(2), 101–112 (2011)

    Google Scholar 

  4. Cook, J., Chen, C., Griffin, A.: Using text mining and data mining techniques for applied learning assessment. J. Effect. Teach. High. Educ. 2(1), 60–79 (2019)

    Google Scholar 

  5. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  6. Hoang, M., Bihorac, O.A., Rouces, J.: Aspect-based sentiment analysis using BERT. In: Proceedings of the 22nd nordic conference on computational linguistics, pp. 187–196 (2019)

    Google Scholar 

  7. Hoel, A., Dahl, T.I.: Why bother? student motivation to participate in student evaluations of teaching. Assess. Eval. High. Educ. 44(3), 361–378 (2019)

    Article  Google Scholar 

  8. Ikauniece, I.: Sentiment analysis of student evaluation of teaching (2018)

    Google Scholar 

  9. Jojoa, M., et al.: Analysis of the effects of lockdown on staff and students at universities in Spain and Colombia using natural language processing techniques. Int. J. Environ. Res. Public Health 19(9), 5705 (2022)

    Article  Google Scholar 

  10. Kandhro, I.A., Wasi, S., Kumar, K., Rind, M., Ameen, M.: Sentiment analysis of students’ comment using long-short term model. Indian J. Sci. Technol. 12(8), 1–16 (2019)

    Article  Google Scholar 

  11. Kite, M.E., Subedi, P.C., Bryant-Lees, K.B.: Students’ perceptions of the teaching evaluation process. Teach. Psychol. 42(4), 307–314 (2015)

    Article  Google Scholar 

  12. Kučak, D., Juričić, V., Đambić, G.: Machine learning in education-a survey of current research trends. Annals of DAAAM & Proceedings 29 (2018)

    Google Scholar 

  13. Leung, S.O.: A comparison of psychometric properties and normality in 4-, 5-, 6-, and 11-point likert scales. J. Soc. Serv. Res. 37(4), 412–421 (2011)

    Article  Google Scholar 

  14. Litman, D., Forbes-Riley, K.: Predicting student emotions in computer-human tutoring dialogues. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pp. 351–358 (2004)

    Google Scholar 

  15. Miranda, C.H., Buelvas, E.: AspectSA: unsupervised system for aspect based sentiment analysis in Spanish. Prospectiva 17(1), 87–95 (2019)

    Article  Google Scholar 

  16. Okoye, K., et al.: Impact of students evaluation of teaching: a text analysis of the teachers qualities by gender. Int. J. Educ. Technol. High. Educ. 17(1), 1–27 (2020)

    Article  Google Scholar 

  17. Pandey, S., Pandey, S.K.: Applying natural language processing capabilities in computerized textual analysis to measure organizational culture. Organ. Res. Methods 22(3), 765–797 (2019)

    Article  Google Scholar 

  18. Pedro, F., Subosa, M., Rivas, A., Valverde, P.: Artificial intelligence in education: challenges and opportunities for sustainable development (2019)

    Google Scholar 

  19. Rajput, Q., Haider, S., Ghani, S., et al.: Lexicon-based sentiment analysis of teachers’ evaluation. Appl. Comput. Intell. Soft Comput. 2016 (2016)

    Google Scholar 

  20. Ren, P., Yang, L., Luo, F.: Automatic scoring of student feedback for teaching evaluation based on aspect-level sentiment analysis. Educ. Inf. Technol. 28(1), 797–814 (2023)

    Article  Google Scholar 

  21. Rybinski, K.: Are rankings and accreditation related? examining the dynamics of higher education in Poland. Qual. Assur. Educ. 28(3), 193–204 (2020)

    Article  Google Scholar 

  22. Rybinski, K., Kopciuszewska, E.: Will artificial intelligence revolutionise the student evaluation of teaching? A big data study of 1.6 million student reviews. Assess. Eval. High. Educ. 46(7), 1127–1139 (2021)

    Google Scholar 

  23. Santhanam, E., Lynch, B., Jones, J.: Making sense of student feedback using text analysis-adapting and expanding a common lexicon. Qual. Assur. Educ. 26(1), 60–69 (2018)

    Article  Google Scholar 

  24. Santos, C.L., Rita, P., Guerreiro, J.: Improving international attractiveness of higher education institutions based on text mining and sentiment analysis. Int. J. Educ. Manag. 32(3), 431–447 (2018)

    Article  Google Scholar 

  25. Schuck, S., Gordon, S., Buchanan, J.: What are we missing here? problematising wisdoms on teaching quality and professionalism in higher education. Teach. High. Educ. 13(5), 537–547 (2008)

    Article  Google Scholar 

  26. Sindhu, I., Daudpota, S.M., Badar, K., Bakhtyar, M., Baber, J., Nurunnabi, M.: Aspect-based opinion mining on student’s feedback for faculty teaching performance evaluation. IEEE Access 7, 108729–108741 (2019)

    Article  Google Scholar 

  27. Stupans, I., McGuren, T., Babey, A.M.: Student evaluation of teaching: a study exploring student rating instrument free-form text comments. Innov. High. Educ. 41, 33–42 (2016)

    Article  Google Scholar 

  28. Wolf, T., et al.: Transformers: state-of-the-art natural language processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45 (2020)

    Google Scholar 

Download references

Acknowledgments

The authors would like to acknowledge the financial support and the supply of the data set to the iClassroom, a project of the Institute for the Future of Education of the Tecnologico de Monterrey.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Diego Acosta-Ugalde .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Acosta-Ugalde, D., Conant-Pablos, S.E., Camacho-Zuñiga, C., Gutiérrez-Rodríguez, A.E. (2024). Data Mining and Analysis of NLP Methods in Students Evaluation of Teaching. In: Calvo, H., Martínez-Villaseñor, L., Ponce, H. (eds) Advances in Soft Computing. MICAI 2023. Lecture Notes in Computer Science(), vol 14392. Springer, Cham. https://doi.org/10.1007/978-3-031-47640-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47640-2_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47639-6

  • Online ISBN: 978-3-031-47640-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics