Abstract
In this paper we investigate the usefulness of eye tracking data for predicting emotions relevant to learning, specifically boredom and curiosity. The data was collected during a study with MetaTutor, an intelligent tutoring system (ITS) designed to promote the use of self-regulated learning strategies. We used a variety of machine learning and feature selection techniques to predict students’ self-reported emotions from gaze data features. We examined the optimal amount of interaction time needed to make predictions, as well as which features are most predictive of each emotion. The findings provide insight into how to detect when students disengage from MetaTutor.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
AlZoubi, O., D’Mello, S., Calvo, R.: Detecting naturalistic expressions of nonbasic affect using physiological signals (2012)
Anderson, J.R., Gluck, K.: What role do cognitive architectures play in intelligent tutoring systems. Cognition & Instruction, 227–262 (2001)
Arroyo, I., Cooper, D.G., Burleson, W., Woolf, B.P., Muldner, K., Christopherson, R.: Emotion sensors go to school. In: AIED, July 6-10, pp. 17–24. IOS Press, Brighton (2009)
Azevedo, R., Harley, J., Trevors, G., et al.: Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems. In: IHMLT, pp. 427–449. Springer (2013)
Azevedo, R., Johnson, A., Chauncey, A., Burkett, C.: Self-regulated learning with MetaTutor: Advancing the science of learning with MetaCognitive tools. In: New Science of Learning, pp. 225–247. Springer (2010)
Bondareva, D., Conati, C., Feyzi-Behnagh, R., Harley, J.M., Azevedo, R., Bouchet, F.: Inferring Learning from Gaze Data during Interaction with an Environment to Support Self-Regulated Learning. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS, vol. 7926, pp. 229–238. Springer, Heidelberg (2013)
Conati, C., Maclaren, H.: Empirically building and evaluating a probabilistic model of user affect. UMUAI 19(3), 267–303 (2009)
D’Mello, S., Graesser, A.: Mind and body: Dialogue and posture for affect detection in learning environments. FAIA 158, 161 (2007)
D’Mello, S., Graesser, A., Picard, R.W.: Toward an affect-sensitive AutoTutor. IEEE Intelligent Systems 22(4), 53–61 (2007)
D’Mello, S., Olney, A., Williams, C., Hays, P.: Gaze tutor: A gaze-reactive intelligent tutoring system. IJHCS 70(5), 377–398 (2012)
D’mello, S., Craig, S., Gholson, B., Franklin, S., Picard, R., Graesser, A.: Integrating affect sensors in an intelligent tutoring system. Affective Interactions, 7–13 (2005)
Field, A.: Discovering statistics using SPSS. Sage publications (2009)
Forbes-Riley, K., Litman, D., Friedberg, H., Drummond, J.: Intrinsic and extrinsic evaluation of an automatic user disengagement detector for an uncertainty-adaptive spoken dialogue system. In: NAACL: Human Language Technologies, pp. 91–102 (2012)
Gutica, Conati: Student Emotions with an Edu-Game: A Detailed Analysis (2013)
Harley, J.M., Bouchet, F., Azevedo, R.: Aligning and Comparing Data on Emotions Experienced during Learning with MetaTutor. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS, vol. 7926, pp. 61–70. Springer, Heidelberg (2013)
Hussain, M.S., Calvo, R.A.: Multimodal affect detection from physiological and facial features during ITS interaction. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS, vol. 6738, pp. 472–474. Springer, Heidelberg (2011)
Kardan, S., Conati, C.: Exploring gaze data for determining user learning with an interactive simulation. In: Masthoff, J., Mobasher, B., Desmarais, M.C., Nkambou, R. (eds.) UMAP 2012. LNCS, vol. 7379, pp. 126–138. Springer, Heidelberg (2012)
Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: Theory, design, and results. Interacting with Computers 14(2), 119–140 (2002)
Kort, B., Reilly, R., Mostow, J., Picard, R.: Experimentally augmenting an intelligent tutoring system with human-supplied capabilities: Adding human-provided emotional scaf-folding to an automated reading tutor that listens. In: ICMI, p. 483 (2002)
Muldner, K., Christopherson, R., Atkinson, R., Burleson, W.: Investigating the utility of eye-tracking information on affect and reasoning for user modeling. In: Houben, G.-J., McCalla, G., Pianesi, F., Zancanaro, M. (eds.) UMAP 2009. LNCS, vol. 5535, pp. 138–149. Springer, Heidelberg (2009)
Pekrun, R., Goetz, T., Titz, W., Perry, R.P.: Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist 37(2), 91–105 (2002)
Pekrun, R.: Emotions as drivers of learning and cognitive development. In: New Perspectives on Affect and Learning Technologies, pp. 23–39. Springer (2011)
Prendinger, H., Ishizuka, M.: The empathic companion: A character-based interface that addresses users’affective states. APAI 19(3-4), 267–285 (2005)
Sabourin, J., Mott, B., Lester, J.C.: Modeling learner affect with theoretically grounded dynamic bayesian networks. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011, Part I. LNCS, vol. 6974, pp. 286–295. Springer, Heidelberg (2011)
Sabourin, J., Shores, L., Mott, B., Lester, J.: Predicting student self-regulation strategies in game-based learning environments, 141–150 (2012)
Sibert, J.L., Gokturk, M., Lavine, R.A.: The reading assistant: Eye gaze triggered auditory prompting for reading remediation, pp. 101–107. ACM Press (2000)
Silvia, P.J.: Interest—The curious emotion. Current Directions in Psychological Science 17(1), 57–60 (2008)
Smilek, D., Carriere, J.S., Cheyne, J.A.: Out of Mind, Out of Sight Eye Blinking as Indicator and Embodiment of Mind Wandering. Psych. Sci. 21(6), 786–789 (2010)
Wang, H., Chignell, M., Ishizuka, M.: Empathic tutoring software agents using real-time eye tracking. ETRA, 73–78 (2006)
Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., Collins, H.: The politeness effect: Pedagogical agents and learning outcomes. IJHCS 66(2), 98–112 (2008)
Wang, W., Li, Z., Wang, Y., Chen, F.: Indexing cognitive workload based on pupillary response under luminance and emotional changes. IUI, 247–256 (2013)
Zimmerman, B.J.: Self-efficacy: An essential motive to learn. Contemporary Educational Psychology 25(1), 82–91 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Jaques, N., Conati, C., Harley, J.M., Azevedo, R. (2014). Predicting Affect from Gaze Data during Interaction with an Intelligent Tutoring System. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds) Intelligent Tutoring Systems. ITS 2014. Lecture Notes in Computer Science, vol 8474. Springer, Cham. https://doi.org/10.1007/978-3-319-07221-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-07221-0_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07220-3
Online ISBN: 978-3-319-07221-0
eBook Packages: Computer ScienceComputer Science (R0)