Abstract
Student evaluations of teachings (SETs) are essential for determining the quality of the educational process. Natural Language Processing (NLP) techniques may produce informative insights into these surveys. This study aims to provide an overview of the various approaches used in NLP and sentiment analysis, focusing on identifying the top outcomes, models, and text representations used. Furthermore, we investigate NLP methods applied to a Spanish corpus of SETs, which is relatively uncommon, and discuss the application of less well-known tools in this scenario. In general, by showing the top models and text representations, especially in the case of a Spanish corpus, this study contributes to NLP and sentiment analysis. Additionally, it promotes research and interest in other languages that receive little attention.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Data Availability Statement
The dataset used in this work may be available on request to the Institute for the Future of Education Data Hub.
References
Bedggood, R.E., Donovan, J.D.: University performance evaluations: what are we really measuring? Stud. High. Educ. 37(7), 825–842 (2012)
Cheng, M., Taylor, J., Williams, J., Tong, K.: Student satisfaction and perceptions of quality: testing the linkages for PhD students. High. Educ. Res. Dev. 35(6), 1153–1166 (2016)
Clayson, D.E., Haley, D.A.: Are students telling us the truth? a critical look at the student evaluation of teaching. Mark. Educ. Rev. 21(2), 101–112 (2011)
Cook, J., Chen, C., Griffin, A.: Using text mining and data mining techniques for applied learning assessment. J. Effect. Teach. High. Educ. 2(1), 60–79 (2019)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Hoang, M., Bihorac, O.A., Rouces, J.: Aspect-based sentiment analysis using BERT. In: Proceedings of the 22nd nordic conference on computational linguistics, pp. 187–196 (2019)
Hoel, A., Dahl, T.I.: Why bother? student motivation to participate in student evaluations of teaching. Assess. Eval. High. Educ. 44(3), 361–378 (2019)
Ikauniece, I.: Sentiment analysis of student evaluation of teaching (2018)
Jojoa, M., et al.: Analysis of the effects of lockdown on staff and students at universities in Spain and Colombia using natural language processing techniques. Int. J. Environ. Res. Public Health 19(9), 5705 (2022)
Kandhro, I.A., Wasi, S., Kumar, K., Rind, M., Ameen, M.: Sentiment analysis of students’ comment using long-short term model. Indian J. Sci. Technol. 12(8), 1–16 (2019)
Kite, M.E., Subedi, P.C., Bryant-Lees, K.B.: Students’ perceptions of the teaching evaluation process. Teach. Psychol. 42(4), 307–314 (2015)
Kučak, D., Juričić, V., Đambić, G.: Machine learning in education-a survey of current research trends. Annals of DAAAM & Proceedings 29 (2018)
Leung, S.O.: A comparison of psychometric properties and normality in 4-, 5-, 6-, and 11-point likert scales. J. Soc. Serv. Res. 37(4), 412–421 (2011)
Litman, D., Forbes-Riley, K.: Predicting student emotions in computer-human tutoring dialogues. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pp. 351–358 (2004)
Miranda, C.H., Buelvas, E.: AspectSA: unsupervised system for aspect based sentiment analysis in Spanish. Prospectiva 17(1), 87–95 (2019)
Okoye, K., et al.: Impact of students evaluation of teaching: a text analysis of the teachers qualities by gender. Int. J. Educ. Technol. High. Educ. 17(1), 1–27 (2020)
Pandey, S., Pandey, S.K.: Applying natural language processing capabilities in computerized textual analysis to measure organizational culture. Organ. Res. Methods 22(3), 765–797 (2019)
Pedro, F., Subosa, M., Rivas, A., Valverde, P.: Artificial intelligence in education: challenges and opportunities for sustainable development (2019)
Rajput, Q., Haider, S., Ghani, S., et al.: Lexicon-based sentiment analysis of teachers’ evaluation. Appl. Comput. Intell. Soft Comput. 2016 (2016)
Ren, P., Yang, L., Luo, F.: Automatic scoring of student feedback for teaching evaluation based on aspect-level sentiment analysis. Educ. Inf. Technol. 28(1), 797–814 (2023)
Rybinski, K.: Are rankings and accreditation related? examining the dynamics of higher education in Poland. Qual. Assur. Educ. 28(3), 193–204 (2020)
Rybinski, K., Kopciuszewska, E.: Will artificial intelligence revolutionise the student evaluation of teaching? A big data study of 1.6 million student reviews. Assess. Eval. High. Educ. 46(7), 1127–1139 (2021)
Santhanam, E., Lynch, B., Jones, J.: Making sense of student feedback using text analysis-adapting and expanding a common lexicon. Qual. Assur. Educ. 26(1), 60–69 (2018)
Santos, C.L., Rita, P., Guerreiro, J.: Improving international attractiveness of higher education institutions based on text mining and sentiment analysis. Int. J. Educ. Manag. 32(3), 431–447 (2018)
Schuck, S., Gordon, S., Buchanan, J.: What are we missing here? problematising wisdoms on teaching quality and professionalism in higher education. Teach. High. Educ. 13(5), 537–547 (2008)
Sindhu, I., Daudpota, S.M., Badar, K., Bakhtyar, M., Baber, J., Nurunnabi, M.: Aspect-based opinion mining on student’s feedback for faculty teaching performance evaluation. IEEE Access 7, 108729–108741 (2019)
Stupans, I., McGuren, T., Babey, A.M.: Student evaluation of teaching: a study exploring student rating instrument free-form text comments. Innov. High. Educ. 41, 33–42 (2016)
Wolf, T., et al.: Transformers: state-of-the-art natural language processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45 (2020)
Acknowledgments
The authors would like to acknowledge the financial support and the supply of the data set to the iClassroom, a project of the Institute for the Future of Education of the Tecnologico de Monterrey.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Acosta-Ugalde, D., Conant-Pablos, S.E., Camacho-Zuñiga, C., Gutiérrez-Rodríguez, A.E. (2024). Data Mining and Analysis of NLP Methods in Students Evaluation of Teaching. In: Calvo, H., Martínez-Villaseñor, L., Ponce, H. (eds) Advances in Soft Computing. MICAI 2023. Lecture Notes in Computer Science(), vol 14392. Springer, Cham. https://doi.org/10.1007/978-3-031-47640-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-47640-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47639-6
Online ISBN: 978-3-031-47640-2
eBook Packages: Computer ScienceComputer Science (R0)