Wioleta Szwoch
ABSTRACT
In this paper the problem of emotion recognition using physiological signals is presented. Firstly the problems with acquisition of physiological signals related to specific human emotions are described. It is not a trivial problem to elicit real emotions and to choose stimuli that always, and for all people, elicit the same emotion. Also different kinds of physiological signals for emotion recognition are considered. A set of the most helpful biosignals is chosen. An experiment is described that was performed in order to verify the possibility of eliciting real emotions using specially prepared multimedia presentations, as well as finding physiological signals that are most correlated with human emotions. The experiment was useful for detecting and identifying many problems and helping to find their solutions. The results of this research can be used for creation of affect-aware applications, for instance video games, that will be able to react to user's emotions.
- Picard, R. 2010. Affective Computing: From Laughter to IEEE, IEEE Transactions On Affective Computing, Vol. 1, No. 1, (2010) Google Scholar
Digital Library
- Landowska, A. 2013. Affect-awareness Framework for Intelligent Tutoring Systems, Proc. of the 6th International Conference on Human System Interaction, (2013), 540--547Google ScholarCross Ref
- Wróbel, M.R. 2013. Emotions in the software development process, Proc. of 6th International Conference on Human System Interaction, (2013), 518--523Google ScholarCross Ref
- Gunes, H. and Piccardi, M. 2005. Affect Recognition from Face and Body: Early Fusion vs. Late Fusion, IEEE International Conference on Systems, Man and Cybernetics, vol. 4, (2005), 3437--3443Google ScholarCross Ref
- Zeng, Z., Pantic, M., Roisman, G. and Huang, T. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), (2009), 39--58 Google ScholarDigital Library
- Vizer, LM., Zhou, L. and A. Sears, 2009. "Automated stress detection using keystroke and linguistic features", Int. Journal of Human-Computer Studies 67:, (2009), 870--886 Google ScholarDigital Library
- Kołakowska, A. 2013. A review of emotion recognition methods based on keystroke dynamics and mouse movements, Proc. of 6th International Conference on Human System Interaction, (2013), 548--555Google ScholarCross Ref
- Szwoch, W. 2013. Using Physiological Signals for Emotion Recognition, Proc. of the 6th International Conference on Human System Interaction, (2013), 556--561Google Scholar
- Rattanyu, K., Ohkura, M. and Mizukawa, M. 2010. Emotion Monitoring from Physiological Signals for Service Robots in the Living Space, International Conference on Control, Automation and Systems, (2010), 580--583Google Scholar
- Kim, J. and Andre, E. 2008. Emotion Recognition Based on Physiological Changes in Music Listening, IEEE Transactions On Pattern Analysis And Machine Intelligence, Vol. 30, No. 12, (2008), 2067--2083 Google ScholarDigital Library
- Lan Li and Ji-hua Chen. 2006. Emotion Recognition Using Physiological Signals, International Conference on Intelligent Information Hiding and Multimedia Signal Processing, (2006), 355--358 Google ScholarDigital Library
- Nakasone, A., Prendinger, H. and Ishizuka, M. 2005. Emotion recognition from electromyography and skin conductance, Proc of the 5th International Workshop on Biosignal Interpretation, (2005), 219--222Google Scholar
- Katsis, Ch.D., Katertsidis, N., Ganiatsas, G. and Fotiadis, D.I. 2008. Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach, IEEE Transactions On Systems, Man, And Cybernetics Part A: Systems And Humans, Vol. 38, No. 3, (2008), 502--512 Google ScholarDigital Library
- Szwoch, M. 2014. On Facial Expressions and Emotions RGB-D Database, 10th International Conference, BDAS 2014, Springer Verlag (2014), 384--394Google ScholarCross Ref
- http://www.thefreedictionary.comGoogle Scholar
- Chanel, G., Kronegg, J., Grandjean, D. and Pun T. 2006. Emotion assessment: arousal evaluation using EEG's and peripheral physiological signals, Proc. Int. Workshop on Multimedia Content Representation, Classification and Security, Springer, LNCS, (2006), 530--537 Google ScholarDigital Library
- Mehrabian, A. 1997. Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression, Journal of psychopathology and behavioral assessment, 19(4), (1997), 331--357Google Scholar
- Lang. P.J. 1995. The emotion probe: Studies of motivation and attention, American Psychologist, 50(5), (1995), 372--385Google Scholar
- Chrea, C., Grandjean D., Delplanque S., Cayeux I., Le Calvé B., Aymard L., et al. 2009. Mapping the semantic space for the subjective experience of emotional responses to odors, Chemical Senses, 34(1), (2009), 49--62Google ScholarCross Ref
- Lang, P.J., Bradley, M.M. and Cuthbert, B.N. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual, Technical Report A-8. University of Florida, Gainesville, FL., (2008)Google Scholar
- Bradley, M.M. and Lang, P.J. 2007. The International Affective Digitized Sounds (2nd Edition; IADS-2): Affective ratings of sounds and instruction manual, Technical report B-3. University of Florida, Gainesville, Fl., (2007)Google Scholar
- Nakasone, A., Prendinger, H. and Ishizuka, M. 2005. Emotion recognition from electromyography and skin conductance, Proc of the 5th International Workshop on Biosignal Interpretation, (2005), 219--222Google Scholar
- Brouwer, A.M., van Wouwe, N., Mühl, Ch., van Erp, J. and Toet, A. 2013. Perceiving blocks of emotional pictures and sounds: effects on physiological variables, Front Hum Neurosci, 7: 295, (2013), Published online 2013 June 21. doi: 10.3389/fnhum.2013.00295Google Scholar
- Szwoch, M. and Szwoch, W. 2015. Emotion Recognition for Affect Aware Video Games, 6th International Conference on Image Processing & Communications, Springer Verlag, (2015), 227--236Google Scholar
- http://www.thoughttechnology.com/Google Scholar
- Landowska, A. 2014. Emotion Monitoring -- Verification of Physiological Characteristics Measurement Procedures, Metrology and Measurement Systems, Volume 21, Issue 4, (2014), 719--732Google ScholarCross Ref
- Bradley, M. M. and Lang, P. J. 1994. Measuring emotion: The self-assessment manikin and the semantic differential, Journal of Behavior Therapy and Experimental Psychiatry, vol. 25, no. 1, (1994), 49--59Google ScholarCross Ref
- https://www.knime.org/Google Scholar
- Khalili, Z. and Moradi, M.H. 2008. Emotion detection using brain and peripheral signals, Biomedical Engineering Conference CIBEC, (2008),1--4Google Scholar
Recommendations
Affective ranking of movie scenes using physiological signals and content analysis
MS '08: Proceedings of the 2nd ACM workshop on Multimedia semanticsIn this paper, we propose an approach for affective ranking of movie scenes based on the emotions that are actually felt by spectators. Such a ranking can be used for characterizing the affective, or emotional, content of video clips. The ranking can ...
Manga content analysis using physiological signals
MANPU '16: Proceedings of the 1st International Workshop on coMics ANalysis, Processing and UnderstandingRecently, the physiological signals have been analyzed more and more, especially in the context of everyday life activities such as watching video or looking at pictures. Tracking these signals gives access to the mental state of the user (interest, ...
Mobile Emotion Recognition via Multiple Physiological Signals using Convolution-augmented Transformer
ICMR '22: Proceedings of the 2022 International Conference on Multimedia RetrievalRecognising and monitoring emotional states play a crucial role in mental health and well-being management. Importantly, with the widespread adoption of smart mobile and wearable devices, it has become easier to collect long-term and granular emotion-...
Comments