Sidney D'Mello
ABSTRACT
One of the primary goals of Affective Computing (AC) is to develop computer interfaces that automatically detect and respond to users' emotions. Despite significant progress, "basic emotions" (e.g., anger, disgust, sadness) have been emphasized in AC at the expense of other non-basic emotions. The present paper questions this emphasis by analyzing data from five studies that systematically tracked both basic and non-basic emotions. The results indicate that engagement, boredom, confusion, and frustration (all non-basic emotions) occurred at five times the rate of basic emotions after generalizing across tasks, interfaces, and methodologies. Implications of these findings for AC are discussed
- Jaimes, A. and Sebe, N. Multimodal human-computer interaction: A survey. Computer Vision and Image Understanding, 108, 1--2 (Oct-Nov 2007), 116--134. Google Scholar
Digital Library
- Picard, R. Affective Computing. MIT Press, Cambridge, Mass, 1997. Google ScholarDigital Library
- Calvo, R. A. and D'Mello, S. K. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1, 1 2010), 18--37. Google ScholarDigital Library
- Zeng, Z., Pantic, M., Roisman, G. and Huang, T. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 1 2009), 39--58. Google ScholarDigital Library
- Marsella, M., Gratch, J. and Petta., P. Computational Models of Emotion. Oxford University Press, City, 2010.Google Scholar
- Picard, R. Affective Computing: From Laughter to IEEE. IEEE Transactions on Affective Computing, 1, 1 2010), 1117. Google ScholarDigital Library
- Pantic, M. and Rothkrantz, L. Toward an affectsensitive multimodal human-computer interaction. Proc. IEEE, 91, 9 (Sep 2003), 1370--1390.Google ScholarCross Ref
- Ortony, A., Clore, G. and Collins, A. The cognitive structure of emotions. Cambridge University Press., New York, 1988.Google ScholarCross Ref
- Ekman, P. An argument for basic emotions. Cognition & Emotion, 6, 3--4 (May-Jul 1992), 169--200.Google ScholarCross Ref
- Plutchik, R. The nature of emotions. American Scientist, 89, 4 2001), 344--350.Google ScholarCross Ref
- Barrett, L. Are emotions natural kinds? Perspectives on Psychological Science 12006), 28--58.Google Scholar
- Russell, J. Core affect and the psychological construction of emotion. Psychological Review, 1102003), 145--172.Google Scholar
- Rozin, P. and Cohen, A. High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of maturally occurring facial expressions of Americans. Emotion, 32003), 68--75.Google Scholar
- D'Mello, S. and Kory, J. Consistent but Modest: Comparing multimodal and unimodal affect detection accuracies from 30 studies. ACM City, 2012.Google Scholar
- D'Mello, S., Craig, S., Sullins, J. and Graesser, A. Predicting affective states expressed through an emotealoud procedure from AutoTutor's mixed-initiative dialogue. International Journal of Artificial Intelligence in Education, 16, 1 2006), 3--28. Google ScholarDigital Library
- Graesser, A., Chipman, P., Haynes, B. and Olney, A. AutoTutor: An intelligent tutoring system with mixedinitiative dialogue. IEEE Transactions on Education, 48, 4 (Nov 2005), 612--618. Google ScholarDigital Library
- Xu, Y. J., Meyer, K. A. and Morgan, D. D. A mixedmethods assessment of using an online commercial tutoring system to teach introductory statistics. Journal of Statistics Education, 17, 2 2009), 1--17.Google ScholarCross Ref
- D'Mello, S., Lehman, B. and Person, N. Monitoring affect states during effortful problem solving activities. International Journal of Artificial Intelligence In Education, 20, 4 2010), 361--389. Google ScholarDigital Library
- D'Mello, S. and Mills, C. Emotions during emotional and non-emotional writing (in review).Google Scholar
- Mills, C. and D'Mello, S. K. Emotions during writing on topics that align or misalign with personal beliefs. Springer-Verlag, City, 2012.Google ScholarDigital Library
- Cohen, J. A power primer. Psychological Bulletin, 112, 1 (Jul 1992), 155--159.Google ScholarCross Ref
- D'Mello, S. A selective meta-analysis on the relative incidence of discrete affective states during learning with technology (in review).Google Scholar
- Yannakakis, G. N., Martínez, H. P. and Jhala, A. Towards affective camera control in games. User Modeling and User-Adapted Interaction, 20, 4 2010), 1--28. Google ScholarDigital Library
- Paiva, A., Dias, J., Sobral, D., Aylett, R., Woods, S., Hall, L. and Zoll, C. Learning by feeling: Evoking empathy with synthetic characters. Appl. Artif. Intell., 19, 3--4 2005), 235--266. \Google ScholarCross Ref
Index Terms
- Beyond the basic emotions: what should affective computing compute?
Recommendations
Quantifying the Links Between Personality Sub-traits and the Basic Emotions
Computational Science and Its Applications – ICCSA 2020AbstractThis article describes an exploratory study that aimed to analyse the relationship between personality traits and emotions. In particular, it investigates to what extent the sub-traits of the Five Factor Model has an empirically quantifiable ...
Acting emotions: physiological correlates of emotional valence and arousal dynamics in theatre
IMX '22: Proceedings of the 2022 ACM International Conference on Interactive Media ExperiencesProfessional theatre actors are highly specialized in controlling their own expressive behaviour and non-verbal emotional expressiveness, so they are of particular interest in fields of study such as affective computing. We present Acting Emotions, an ...
Expressing emotions as emoticons for online intelligent agents
HCI '16: Proceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!Without emotional annotation, online communication can be ambiguous and lead to misunderstandings. This paper addresses the questions of which emotions are commonly expressed online, how these emotions can be encapsulated in emoticons, and how people ...
Comments