Abstract
One of the primary goals of affective computing is enabling computers to recognize human emotion. To do this we need accurately labeled affective data. This is challenging to obtain in real situations where affective events are not scripted and occur simultaneously with other activities and feelings. Affective labels also rely heavily on subject self-report for which can be problematic. This paper reports on methods for obtaining high quality emotion labels with reduced bias and variance and also shows that better training sets for machine learning algorithms can be created by combining multiple sources of evidence. During a 7 day, 13 participant field study we found that recognition accuracy for physiological activation improved from 63% to 79% with two sources of evidence and in an additional pilot study this improved to 100% accuracy for one subject over 10 days when context evidence was also included.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Healey, J., Nachman, L., Subramanian, S., Shahabdeen, J., Morris, M.E.: Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life. In: Floréen, P., Krüger, A., Spasojevic, M. (eds.) Pervasive Computing. LNCS, vol. 6030, pp. 156–173. Springer, Heidelberg (2010)
Shimmer sensing platform, http://shimmer-research.com/wordpress/?page_id=20
Picard, R.: Affective Computing. MIT Press, Cambridge (1997)
van den Broek, E., Janssen, J.H., Westerink, J.H.D.M.: Guidelines for Affective Signal Processing (ASP): From Lab to Life. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, September 10-12, vol. 1, pp. 217–222. IEEE, Los Alamitos (2009)
Oatley, K., Duncan, E.: The Experience of Emotion in Everyday Life: Cognition & Emotion, vol. 8(4), pp. 369–381. Psychology Press, San Diego (1994)
Morris, M., Guilak, F.: Mobile Heart Health: Project Highlights. IEEE Pervasive Computing 8(2), 57–61 (2009)
Fahrenberg, J., Myrtek, M. (eds.): Progress in Ambulatory Assessment. Hogrefe and Huber Publishers (2001)
Hofmann, S.G., Barlow, D.H.: Ambulatory psychophysiological monitoring: A potentially useful tool when treating panic relapse. Cognitive and Behavioral Practice 3(1), 53–61 (1996)
Westerink, J., Ouwerkerk, M., de Vries, G., de Waele, S., van den Eerenbeemd, J., van Boven, M.: Emotion measurement platform for daily life situations. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, September 10-12, vol. 1, pp. 704–708. IEEE, Los Alamitos (2009)
Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems 6(2), 156–166 (2005)
Laird, J.D., Bresler, C.: The Process of Emotional Feeling: A Self-Perception theory. In: Clark, M. (ed.) Emotion: Review of Personality and Social Psychology, vol. 13, pp. 223–234 (1992)
Cooper, D.G., Arroyo, I., Park Woolf, B., Muldner, K., Burleson, W., Christopherson, R.: Sensors Model Student Self Concept in the Classroom. In: Proceedings 17th Intl. Conference on User Modeling Adaptation and Personalization and Trento, Italy, June 22-26, pp. 30–41 (2009)
Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology 70, 205–218 (1996)
Choudhury, T., Consolvo, S., Harrison, B., Hightower, J., LaMarca, A., LeGrand, L., Rahimi, A., Rea, A., Bordello, G., Hemingway, B., Klasnja, P., Koscher, K., Landay, J.A., Lester, J., Wyatt, D., Haehnel, D.: The Mobile Sensing Platform: An Embedded Activity Recognition System. IEEE Pervasive Computing 7(2), 32–41 (2008)
Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. Journal of Research in Personality 11, 273–294 (1977)
Morris, M.: Technologies for Heart and Mind: New Directions in Embedded Assesssment. Intel Technology Journal 11(1) (2007)
Lang, P.J., Greenwald, M.K., Bradley, M.M., Hamm, A.O.: Looking at pictures: affective, facial, visceral and behavioral reactions. Psychophysiology 20(3), 261–273 (1993)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Healey, J. (2011). Recording Affect in the Field: Towards Methods and Metrics for Improving Ground Truth Labels. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6974. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24600-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-24600-5_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24599-2
Online ISBN: 978-3-642-24600-5
eBook Packages: Computer ScienceComputer Science (R0)