Abstract
Many works in the literature show that positive emotions improve learning. However, in the educational context, the affective dimension is often not adopted in the teaching-learning process. One of them is that there are many students for a teacher, making the practice of adapting the didactics and individualized feedbacks practically impossible. The low or sometimes no emotion analysis of those involved in learning also becomes a obstacle. One possibility to circumvent this problem is the use of Intelligent Tutoring Systems (ITS), to understand the student individually and adapt environments according to their use. It also adds the theories of emotions so that the ITS can understand the affective dimension of the student during activities. This paper aims to present a way to infer changes in a student’s affective states to improve feedbacks in ITS For this, facial expressions and brain waves (using a low-cost equipment called openBCI) were studied for acquisition and emotions. In the initial tests, the methodology has met what was expected, however, more studies with experiments must be carried out.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsChange history
03 June 2020
The original version of the chapter was inadvertently published without incorporating the author’s proof corrections. The chapter has now been corrected and approved by the author.
Notes
References
Ainley, M.: Connecting with learning: motivation, affect and cognition in interest processes. Educ. Psychol. Rev. 18(4), 391–405 (2006)
Aldridge, A., et al.: Accessible electroencephalograms (EEGs): a comparative review with openBCI’s ultracortex mark IV headset. In: 2019 29th International Conference Radioelektronika (RADIOELEKTRONIKA), pp. 1–6, April 2019. https://doi.org/10.1109/RADIOELEK.2019.8733482
Blaiech, H., Neji, M., Wali, A., Alimi, A.M.: Emotion recognition by analysis of EEG signals. In: 13th International Conference on Hybrid Intelligent Systems (HIS 2013), pp. 312–318, December 2013. https://doi.org/10.1109/HIS.2013.6920451
Brand, S., Reimer, T., Opwis, K.: How do we learn in a negative mood? Effects of a negative mood on transfer and learning. Learn. Instr. 17(1), 1–16 (2007). https://doi.org/10.1016/j.learninstruc.2006.11.002. http://www.sciencedirect.com/science/article/pii/S0959475206001150
Chang, W., Hsu, S., Chien, J.: FATAUVA-Net: an integrated deep learning framework for facial attribute recognition, action unit detection, and valence-arousal estimation. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1963–1971, July 2017. https://doi.org/10.1109/CVPRW.2017.246
Huang, Y., Yang, J., Liao, P., Pan, J.: Fusion of facial expressions and EEG for multimodal emotion recognition. Comput. Intell. Neurosci. 2017, 2107451 (2017). https://doi.org/10.1155/2017/2107451. http://europepmc.org/articles/PMC5625811
Huang, Y., Yang, J., Liu, S., Pan, J.: Combining facial expressions and electroencephalography to enhance emotion recognition. Future Internet 11(5), 105 (2019)
Hwang, S., Jebelli, H., Choi, B., Choi, M., Lee, S.: Measuring workers’ emotional state during construction tasks using wearable EEG. J. Constr. Eng. Manage. 144(7), 04018050 (2018). https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506
Koelstra, S., Patras, I.: Fusion of facial expressions and EEG for implicit affective tagging. Image Vis. Comput. 31(2), 164–174(2013). https://doi.org/10.1016/j.imavis.2012.10.002. http://www.sciencedirect.com/science/article/pii/S0262885612001825. Affect Analysis in Continuous Input
Kollias, D., et al.: Deep affect prediction in-the-wild: aff-wild database and challenge, deep architectures, and beyond. Int. J. Comput. Vis. 127(6–7), 907–929 (2019)
Lakhan, P., et al.: EDOSE: emotion datasets from open source EEG with a real-time bracelet sensor. arXiv abs/1810.04582 (2018)
Lewis, R.S., Weekes, N.Y., Wang, T.H.: The effect of a naturalistic stressor on frontal EEG asymmetry, stress, and health. Biol. Psychol. 75(3), 239–247 (2007). https://doi.org/10.1016/j.biopsycho.2007.03.004. http://www.sciencedirect.com/science/article/pii/S0301051107000506
Mohanan, R., Stringfellow, C., Gupta, D.: An emotionally intelligent tutoring system. In: 2017 Computing Conference, pp. 1099–1107, July 2017. https://doi.org/10.1109/SAI.2017.8252228
Mollahosseini, A., Hasani, B., Mahoor, M.H.: AffectNet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput. 10(1), 18–31 (2019). https://doi.org/10.1109/TAFFC.2017.2740923
Silva, P., Costa, E., de Araújo, J.R.: An adaptive approach to provide feedback for students in programming problem solving. In: Coy, A., Hayashi, Y., Chang, M. (eds.) ITS 2019. LNCS, vol. 11528, pp. 14–23. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22244-4_3
Tiam-Lee, T.J., Sumi, K.: Adaptive feedback based on student emotion in a system for programming practice. In: Nkambou, R., Azevedo, R., Vassileva, J. (eds.) ITS 2018. LNCS, vol. 10858, pp. 243–255. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91464-0_24
Turabzadeh, S., Meng, H., Swash, R.M., Pleva, M., Juhar, J.: Facial expression emotion detection for real-time embedded systems. Technologies 6(1) (2018). https://doi.org/10.3390/technologies6010017. https://www.mdpi.com/2227-7080/6/1/17
Yohanandan, S.A.C., Kiral-Kornek, I., Tang, J., Mshford, B.S., Asif, U., Harrer, S.: A robust low-cost EEG motor imagery-based brain-computer interface. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5089–5092, July 2018. https://doi.org/10.1109/EMBC.2018.8513429
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
de Oliveira, W.C., Gottardo, E., Pimentel, A.R. (2020). Changes of Affective States in Intelligent Tutoring System to Improve Feedbacks Through Low-Cost and Open Electroencephalogram and Facial Expression. In: Kumar, V., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2020. Lecture Notes in Computer Science(), vol 12149. Springer, Cham. https://doi.org/10.1007/978-3-030-49663-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-49663-0_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49662-3
Online ISBN: 978-3-030-49663-0
eBook Packages: Computer ScienceComputer Science (R0)