Abstract
Learners’ adaptation to academic trajectory is shaped by several influencing factors that ought to be considered while attempting to design an intervention towards improving academic performance. Emotion is one factor that influences students’ academic orientation and performance. Tracking emotions in text by psychologists have long been a subject of concern to researchers. This is due to the challenges associated with determining the level of accuracy and consistency of decisions made from analysing such text by psychologists. Lately, Artificial Intelligence has complemented human efforts in tracking emotions in text. This paper provides an overview of machine learning application for detecting emotions in text through a Support vector machine learning system. In addition, we compared the performance of the system’s classifier to WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. Real time data from using the system in counselling delivery and collected students’ life stories were used for evaluating the performance of the classifiers. The evaluation results show that the Support vector machine, implemented in our system, is superior over WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. Nevertheless, the various classifiers performed beyond the acceptable threshold. The implication for the findings goes to indicate that machine learning algorithms can be implemented to track emotions in text, especially from students generated content.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-Shihi, H., Sharma, S. K., & Sarrab, M. (2018). Neural network approach to predict mobile learning acceptance. Education and Information Technologies, 23(5), 1805–1824. https://doi.org/10.1007/s10639-018-9691-9.
Arthur L. S. (1988). "Some studies in machine learning using the game of checkers. I". Computer Games I. Springer, New York. pp. 335–365.
Artino, A. R., La Rochelle, J. S., & Durning, S. J. (2010). Second-year medical students’ motivational beliefs, emotions, and achievement. Medical Education, 44(12), 1203–1212.
Astleitner, H. (2000). Designing emotionally sound instruction: The FEASP-approach. Instructional Science, (3)28, 209-219.
Balabantaray, R. C., Mohammad, M., & Sharma, N. (2012). Multi-class twitter emotion classification: A new approach. International Journal of Applied Information Systems, 4(1), 48–53.
Balahur, A., Hermida, J. M., & Montoyo, A. (2012). Detecting implicit expressions of emotion in text: A comparative analysis. Decision Support Systems, 53(4), 742-753.
Barrett, L. F., & Russell, J. A. (1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74(4), https://doi.org/10.1037/0022-3514.74.4.967.
Boekaerts, M. (2017). Motivation to learn. Educational practices 10. Available at https://iaoed.org/downloads/prac10e.pdf. Access: June 1, 2019
Calefato, F., Lanubile, F., & Novielli, N. (2017, October). EmoTxt: a toolkit for emotion recognition from text. In 2017 seventh international conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 79-80). IEEE.
Eisenberg, N., Spinrad, T. L., & Eggum, N. D. (2010). Emotion-related self-regulation and its relation to children's maladjustment. Annual review of clinical psychology, 6, (pp. 495-525).
Ekman, P. (1992). Are There Basic Emotions? Psychological Review, 99(3), 550-553.
Frenzel, A. C., Pekrun, R., & Goetz, T. (2007). Perceived learning environment and students' emotional experiences: A multilevel analysis of mathematics classrooms. Learning and Instruction, 17(5), 478–493.
Goetz, T., Pekrun, R., Hall, N., & Haag, L. (2006). Academic emotions from a social-cognitive perspective: Antecedents and domain specificity of students' affect in the context of Latin instruction. British Journal of Educational Psychology, 76(2), 289–308.
Hadwin, A. F., Järvelä, S., & Miller, M. (2011). Self-regulated, co-regulated, and socially shared regulation of learning. Handbook of Self-regulation of Learning and Performance, 30, 65–84.
Hashem, E., & Mabrouk, M. (2014). A study of support vector machine algorithm for liver disease diagnosis. American Journal of Intelligent Systems, 4(1), 9–14.
Isen, A. M. (1999). Positive affect. Handbook of Cognition and Emotion, 20, 522–539.
James, L. (2012). Evaluation of an adaptive learning technology as a predictor of student performance in undergraduate biology. Appalachian State University, North Carolina.
Järvenoja, H., & Järvelä, S. (2009). Emotion control in collaborative learning situations: Do students regulate emotions evoked by social challenges. British Journal of Educational Psychology, 79(3), 463–481.
Kim, C., & Pekrun, R. (2014). Emotions and motivation in learning and performance. In Handbook of research on educational communications and technology (pp. 65–75). New York: Springer.
Kolog, E. A., & Suero Montero, C. (2018). Towards automated e-counselling system based on Counsellors' emotion perception. Education and Information Technologies, 23(2), 911-933..
Kolog, E. A., Sutinen, E., Vanhalakka-Ruoho, M., Sohunen, J., & Anohah, E. (2015). Using unified theory of acceptance and use of technology model to predict students’ behavioral intention to adopt and use E - counseling in Ghana. International Journal of Modern Education and Computer Science, 7(11), 1–11.
Kolog E.A., Montero C.S., & Toivonen T. (2018). Using machine learning for sentiment and social influence analysis in text. In: Rocha Á., Guarda T. (eds) Proceedings of the international conference on Information Technology & Systems (ICITS 2018). ICITS 2018. Advances in intelligent systems and computing, vol 721. Springer, Cham.
Landis, J., & Kouch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
Levine, L. J., & Pizarro, D. A. (2004). Emotion and memory research: A grumpy overview. Social Cognition, 22(5: Special issue), 530–554.
Li, S., Huang, L., Wang, R. and Zhou, G (2015). Sentence-level emotion classification with label and context dependence. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International.
Lugmayr, A., Sutinen, E., Suhonen, J., Sedano, C., Hlavacs, H., & Montero, C. (2016). Serious storytelling – A first definition and review. Multimedia Tools and Applications, 76(14), 15707-15733.
Ohle, A., & McElvany, N. (2015). Teachers’ diagnostic competences and their practical relevance. Special Issue Editorial, Journal for Educational Research Online, 7(2).
Ouano, J. A. (2011). Motivational antecedents of academic emotions in Filipino college students. Asia-Pacific Education Researcher, 20(1), 127–132.
Parrott, W. G., & Spackman, M. P. (2000). Emotion and memory. Handbook of Emotions, 2, 476–490.
Peffers, K., Tuunanen, T., Gengler, C. E., Rossi, M., Hui, W., Virtanen, V., & Bragge, J. (2006). The design science research process: A model for producing and presenting information systems research. In Proceedings of the first international conference on design science research in information systems and technology, (pp. 83–106).
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18, 315-341. https://doi.org/10.1007/s10648-006-9029-9.
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–105.
Pekrun, R., Elliot, A. J., & Maier, M. A. (2006). Achievement goals and discrete achievement emotions: A theoretical model and prospective test. Journal of Educational Psychology, 98(3), 583–597.
Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40.
Plutchik, R. (1980). Emotion: Theory, research, and experience: Theories of emotion (Vol. 1, p. 399). New York: Academic.
Purver, M., & Battersby, S. (2012). Experimenting with distant supervision for emotion classification. In Proceedings of the 13th Conference of the European chapter of the Association for Computational Linguistics (pp. 482–491). Association for Computational Linguistics.
Schwarz, N. (2000). Agenda 2000: Attitudes and social judgment—Warmer, more social, and less conscious. European Journal of Social Psychology, 30, 149–176
Shina, D., & Choib, M. (2014). Ecological views of big data: Perspective and issues. Telematics and informatics, (pp. 311-320).
Vibulphol, J. (2016). Students’ motivation and learning and teachers’ motivational strategies in english classrooms in Thailand. Canadian Center of Science and Education. Vol. 9, No. 4.
Villavicencio, F. T., & Bernardo, A. B. (2013). Positive academic emotions moderate the relationship between self-regulation and academic achievement. British Journal of Educational Psychology, 83(2), 329–340.
Wang, C., Chen, M. H., Schifano, E., Wu, J., & Yan, J. (2016). Statistical methods and computing for big data. Statistics and its interface, 9(4), 399.09-6 Published online 2017 Aug 9. https://doi.org/10.1002/cjs.11330.
You, J. W., & Kang, M. (2014). The role of academic emotions in the relationship between perceived academic control and self-regulated learning in online learning. Computers & Education, 77, 125–133.
Zhang, L., Jiang, M., Farid, D., & Hossain, M.A. (2013). Intelligent facial emotion recognition and semantic based topic detection for a humanoid robot. Expert Systems with Applications, 40 (13), 5160–5168.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kolog, E.A., Devine, S.N.O., Ansong-Gyimah, K. et al. Fine-grained affect detection in learners’ generated content using machine learning. Educ Inf Technol 24, 3767–3783 (2019). https://doi.org/10.1007/s10639-019-09948-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-019-09948-6