Ballistocardiographic Responses to Dynamic Facial Displays of Emotion While Sitting on the EMFi Chair
Abstract
The aim of the present paper was to study heart rate changes during a video stimulation depicting two actors (male and female) producing dynamic facial expressions of happiness, sadness, and a neutral expression. We measured ballistocardiographic emotion-related heart rate responses with an unobtrusive measurement device called the EMFi chair. Ratings of subjective responses to the video stimuli were also collected. The results showed that the video stimuli evoked significantly different ratings of emotional valence and arousal. Heart rate decelerated in response to all stimuli and the deceleration was the strongest during negative stimulation. Furthermore, stimuli from the male actor evoked significantly larger arousal ratings and heart rate responses than the stimuli from the female actor. The results also showed differential responding between female and male participants. The present results support the hypothesis that heart rate decelerates in response to films depicting dynamic negative facial expressions. The present results also support the idea that the EMFi chair can be used to perceive emotional responses from people while they are interacting with technology.
References
(2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1(1), 21–62.
(2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16, 403–410.
(2005). Emotions and heart rate while sitting on a chair. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2005, 491–499.
(2007). Music, heart rate, and emotions in the context of stimulating technologies. Springer Lecture Notes on Computer Science, 4738, 290–301.
(2002). Auditory emotional feedback facilitates human-computer interaction. Proceedings of HCI 2002, 337–349. London: Springer.
(2008). Real-time classification of evoked emotions using facial feature tracking and physiological responses. International Journal of Human-Computer Studies, 66, 303–317.
(2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research, 171, 1–6.
(2001). Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1, 276–298.
(2001). Emotion and motivation II: Sex differences in picture processing. Emotion, 1, 300–319.
(1996). Picture media and emotion: Effects of a sustained affective content. Psychophysiology, 33, 662–670.
(1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49–59.
(1999). International affective digitized sounds (IADS): Stimuli, instruction manual, and affective ratings. Technical Report, B-2. Gainesville, FL: University of Florida, The Center for Research in Psychophysiology.
(2000). Affective reactions to acoustic stimuli. Psychophysiology, 37, 204–215.
(2002). The classification of “fear” from faces is associated with face recognition skill in women. Neuropsychologia, 40, 575–584.
(2004). Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach. International Journal of Psychophysiology, 51, 143–153.
(1984). Heart rate and attention: The intake-rejection hypothesis and beyond. In , Psychophysiological perspectives: Festschrift for Beatrice and John Lacey (pp. 276–294). New York: Van Nostrand Reinhold.
(2000). Cerebral correlates of autonomic cardiovascular arousal: A functional neuroimaging investigation in humans. Journal of Physiology, 523, 259–270.
(2005). Activity in the human brain predicting differential heart rate responses to emotional facial expressions. NeuroImage, 24, 751–762.
(1998). “Roll ’em!: The effects of picture motion on emotional responses.” Journal of Broadcasting and Electronic Media, 42(1), 113–128.
(2006). Facial EMG responses to dynamic emotional facial expressions in boys with disruptive behavior disorders. Journal of Psychiatric Research, 40, 112–121.
(1982). Facial reactions to facial expressions. Psychophysiology, 19, 643–647.
(1986). Autonomic reactions to social and neutral stimuli in subjects high and low in public speaking fear. Biological Psychology, 23, 223–233.
(2000). Unconscious facial reactions to emotional facial expressions. Psychological Science, 11, 86–89.
(1988). Differentiation of vicariously induced emotional reactions in children. Developmental Psychology, 24, 237–246.
(1992). An argument for basic emotions. Cognition and Emotion, 6, 169–200.
(1978). Facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
(1983). Autonomic nervous system activity distinguishes among emotions. Science, 221, 1208–1209.
(2005). The impact of music on subjective and physiological measures of emotion while viewing films. Psychomusicology, 19, 15–40.
(1992). Facial emotion discrimination: I. Task construction and behavioral findings in normal subjects. Psychiatry Research, 42, 231–240.
(2004). Respiratory sinus arrhythmia as an index of emotional response in young adults. Psychophysiology, 41, 75–83.
(2000). The undoing effect of positive emotions. Motivation and Emotion, 24, 237–258.
(1994). Human facial expression: An evolutionary view. San Diego, CA: Academic Press.
(1953). The understanding of facial expression of emotion. Acta Psychologica, 9, 294–362.
(1986). The emotions. Cambridge, MA: Cambridge University Press.
(2004). Affective and physiological responses to environmental noises and music. International Journal of Psychophysiology, 53, 91–103.
(1995). Emotion elicitation using films. Cognition and Emotion, 9(1), 87–108.
(1997). Hiding feelings: The acute effects of inhibiting negative and positive emotion. Journal of Abnormal Psychology, 10(1), 95–103.
(2004). Sex differences in functional activation patterns revealed by increased emotion processing demands. NeuroReport, 15, 219–223.
(1978). Gender effects in decoding nonverbal cues. Psychological Bulletin, 85, 845–857.
(1971). Autonomic responses to affective visual stimulation. Psychophysiology, 7, 408–417.
(2002). The amygdala response to emotional stimuli: A comparison of faces and scenes. NeuroImage, 17, 317–323.
(1999). Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal of Mental Retardation, 104, 270–278.
(1994). Emotional contagion. Cambridge, MA: Cambridge University Press.
(1991). Autonomic, neuroendocrine, and subjective responses to emotion-inducing film stimuli. International Journal of Psychophysiology, 11, 131–140.
(1993). Expression is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia, 31, 173–181.
(1990). The influence of positive and negative affect on cognitive organization: Some implications for development. In , Psychological and biological approaches to emotion (pp. 75–94). Hillsdale, NJ: Erlbaum.
(1995). Affective judgment of the Ekman faces: A dimensional approach. Journal of Psychophysiology, 9, 193–202.
(2001). Dynamic properties influence the perception of facial expressions. Perception, 30, 875–887.
(2003). Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions. NeuroImage, 18, 156–168.
(2004). Emotion recognition system using short-term monitoring of physiological signals. Medical and Biological Engineering and Computing, 42, 419–427.
(2007). Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology, 44, 787–806.
(2003). Central control of heart rate changes during visual affective processing as revealed by fMRI. Acta Neurobiologiae Experimentalis, 63, 39–48.
(2005). Age differences in emotional reactivity: The sample case of sadness. Psychology and Aging, 20, 47–59.
(2006). Human recognition of basic emotions from posed and animated dynamic facial expressions. A Dissertation from Helsinki University of Technology Laboratory of Computational Engineering, Report B59.
(2003). Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex, 13, 1023–1033.
(1974). Studies of heart rate and other bodily processes in sensorimotor behavior. In , Cardiovascular psychophysiology: Current issues in response mechanisms, biofeedback, and methodology (pp. 538–564). Chicago: Aldine.
(1990). Emotion, attention, and the startle reflex. Psychological Review, 97, 377–395.
(1992). A motivational analysis of emotion: Reflex-cortex connections. Psychological Science, 3(1), 44–49.
(1997). Motivated attention: Affect, activation, and action. In , Attention and orienting – Sensory and motivational processes (pp. 97–135). Mahwah, NJ: Erlbaum.
(2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. Gainesville, FL: University of Florida.
(1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30, 261–273.
(2002). Gender differences in neural correlates of recognition of happy and sad faces in humans assessed by functional magnetic resonance imaging. Neuroscience Letters, 333, 13–16.
(1988). Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. In , Social psychophysiology and emotion: Theory and clinical applications (pp. 17–42). New York: Wiley.
(1990). Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology, 27, 363–384.
(2000). A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychological Bulletin, 126, 424–453.
(2005). Sex differences in the perception of affective facial expressions: Do men really lack emotional sensitivity. Cognitive Processing, 6, 136–141.
(2004). Emotion recognition from physiological signals using wireless sensors for presence technologies. Cognition, Technology, and Work, 6(1), 4–14.
(1983). Hemispheric asymmetries in processing emotional expressions. Neuropsychologia, 21, 555–565.
(2000). Electromechanical Film (EMFi) – A new multipurpose electret material. Sensors and Actuators, 84, 95–102.
(2000). Cardiac responses associated with affective processing of unpleasant film stimuli. International Journal of Psychophysiology, 36, 45–57.
(1993). Physiology, perceived emotion, and memory: Responding to film sequences. In , The structure of emotions (pp. 156–168). Toronto: Hogrefe & Huber.
(2004). The effects of affective interventions in human-computer interaction. Interacting with Computers, 16, 295–309.
(2006). Real-time estimation of emotional experiences from facial expressions. Interacting with Computers, 18, 208–226.
(1997). Affective computing. Cambridge, MA: MIT Press.
(2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1175–1190.
(2004). Sex, sexual orientation, and identification of positive and negative facial affect. Brain and Cognition, 54, 179–185.
(1996). The media equation: How people treat computers, television, and new media like real people and places. New York: Cambridge University Press.
(1988). Sex differences in the encoding and decoding of negative facial emotions. Journal of Nonverbal Behavior, 12, 139–148.
(2004). Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study. Cognitive Brain Research, 20, 81–91.
(2007). Enhanced experience of emotional arousal in response to dynamic facial expressions. Journal of Nonverbal Behavior, 31, 119–135.
(1999). Emotion processing in three systems: The medium and the message. Psychophysiology, 36, 619–627.
(2000). Image motion and context: A between- and within-subjects comparison. Psychophysiology, 37, 706–710.
(2004). Emotion regulation in action: Emotional reactivity in experimental avoidance. Behavior Research and Therapy, 42, 1257–1270.
(1998). Facial and emotional reactions to Duchenne and non-Duchenne smiles. International Journal of Psychophysiology, 29, 23–33.
(2000). Autonomic, subjective, and expressive responses to emotional films in older and younger Chinese Americans and European Americans. Psychology and Aging, 15, 684–693.
(2000). Perceptual user interfaces (introduction). Communications of the ACM, 43, 32–34.
(2004). Reactions to facial expressions: Effects of social context and speech anxiety on responses to neutral, anger, and joy expressions. Biological Psychology, 66, 63–78.
(2000). Frontal electrocortical and cardiovascular reactivity during happiness and anger. Biological Psychology, 55, 3–23.
(2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78, 105–119.
(2006). Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology, 43, 450–453.
(2001). Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: Quality, quantity, time course, and gender differences. Psychiatry Research, 102, 109–124.
(1984). Facial and autonomic manifestations of the dimensional structure of emotion. Journal of Experimental Social Psychology, 20, 195–216.
(1995). Psychophysiological responses as indices of affective dimensions. Psychophysiology, 32, 436–443.
