Voluntary facial activations regulate physiological arousal and subjective experiences during virtual social stimulation
Article No.: 1, Pages 1 - 21
Abstract
Exposure to distressing computer-generated stimuli and feedback of physiological changes during exposure have been effective in the treatment of anxiety disorders (e.g., social phobia). Here we studied voluntary facial activations as a method for regulating more spontaneous physiological changes during virtual social stimulation. Twenty-four participants with a low or high level of social anxiety activated either the corrugator supercilii (used in frowning) or the zygomaticus major (used in smiling) facial muscle to keep a female or a male computer character walking towards them. The more socially anxious participants had a higher level of skin conductance throughout the trials as compared to less anxious participants. Within both groups, short-term skin conductance responses were enhanced both during and after facial activations; and corrugator supercilii activations facilitated longer term electrodermal relaxation. Zygomaticus major activations had opposite effects on subjective emotional ratings of the less and the more socially anxious. In sum, voluntary facial activations were effective in regulating emotional arousal during virtual social exposure. Corrugator supercilii activation was found an especially promising method for facilitating autonomic relaxation.
References
[1]
Anderson, P., Rothbaum, B. O., and Hodges, L. F. 2003. Virtual reality exposure in the treatment of social anxiety. Cognitive Behav. Pract. 10, 3, 240--247.
[2]
Beale, R. and Creed, C. 2009. Affective interaction: How emotional agents affect users. Int. J. Hum.-Comput. Stud. 67, 75--776.
[3]
Beck, L. G., Palyo, S. A., Winer, E. H., Schwagler, B. E., and Ang, E. J. 2007. Virtual reality exposure therapy for PTSD symptoms after a road accident: An uncontrolled case series. Behav. Therapy 38, 1, 39--48.
[4]
Boiten, F. 1996. Autonomic response patterns during voluntary facial action. Psychophysiology 33, 123--131.
[5]
Bradley, M. M. 2000. Emotion and motivation. In Handbook of Psychophysiology 2nd Ed. Cambridge University Press, Cambridge, UK, 602--642.
[6]
Bradley, M. M., Codispoti, M., Cuthbert, B. N., and Lang, P. J. 2001. Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion 1, 3, 276--298.
[7]
Bradley, M. M. and Lang, P. J. 1994. Measuring emotions: The self-assessment manikin and the semantic differential. J. Behav.Therapy Exper. Psych. 25, 1, 49--59.
[8]
Cacioppo, J. T., Berntson, G. G., Larsen, J. T., Poehlmann, K. M., and Lro, T. A. 2000. The Handbook of Emotion. Guildford Press, New York, 173--191.
[9]
Carroll, J. M. and Russell, J. A. 1997. Facial expressions in Hollywood,Äôs portrayal of emotion. J. Personality Social Psychol. 72, 164--176.
[10]
Cl-Iristie, I. C. and Friedman, B. H. 2004. Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach. Int. J. Psychophysiology 51, 2, 143--153.
[11]
Coan, J. A., Allen, J. J. B., and Harmon-Jones, E. 2001. Voluntary facial expression and hemispheric asymmetry over the frontal cortex. Psychophysiology 38, 912--925.
[12]
Codispoti, M. and De Cesarei, A. 2007. Arousal and attention: Picture size and emotional reactions. Psychophysiology 44, 680--686.
[13]
Connor, K. M., Davidson, J. R. T., Churchill, L. E., Sherwood, A., Foa, E., and Weisler, R. H. 2000. Psychometric properties of the social phobia inventory (SPIN). British J. Psychiatry 176, 379--386.
[14]
Courgeon, M., Buisine, S., and Martin, J.-C. 2009. Impact of expressive wrinkles on perception of a virtual characters facial expressions of emotions. In Intelligent Virtual Agents, Lecture Notes in Computer Science, vol. 5773, Springer, Berlin, 201--214.
[15]
Courgeon, M., Martin, J.-C., and Jacquemin, C. 2008. MARC: A multimodal affective and reactive character. In Proceedings of the ICM}-MLMI 2008 Workshop on Affective Interaction in Natural Environments.
[16]
Courtney, C. G., Dawson, M. E., Schell, A. M., Iyer, A., and Parsons, T. D. 2010. Better than the real thing: Eliciting fear with moving and static computer-generated stimuli. Int. J. Psychophysiology 78, 2, 107--114.
[17]
Dawson, M. E., Schell, A. M., and Filion, D. L. 2000. The Electrodermal system. In Handbook of Psychophysiology. Cambridge University Press, Cambridge, UK, 200--223.
[18]
Ekman, P. 1979. Human Ethology. Cambridge University Press, Cambridge, UK.
[19]
Ekman, P. 1993. An argument for basic emotions. Cognition and Emotion 6, 3, 169--200.
[20]
Ekman, P. 2004. Language, Knowledge, and Representation. Kluwer, Amsterdam, 39--50.
[21]
Foa, E. B. and Kozak, M. J. 1986. Emotional processing of fear: Exposure to corrective information. Psychol. Bull. 99, 1, 20--35.
[22]
Fowles, D. C. 1988. Psychophysiology and psychopathology: A motivational approach. Psychophysiology 25, 373--391.
[23]
Fridlund, A. J. and Cacioppo, J. T. 1986. Guidelines for human electromyographic research. Psychophysiology 23, 567--589.
[24]
Frith, C. D. and Allen, H. A. 1983. The skin conductance orienting response as an index of attention. Biol. Psychol. 17, 1, 27--39.
[25]
Garcia-Palacios, A., Botella, C., Hoffman, H. G., and Fabregat, S. 2007. Comparing acceptance and refusal rates of virtual reality exposure vs. in vivo exposure by patients with specific phobias. CyberPsychol. Behav. 10, 5, 722--724.
[26]
Gatchel, R. J. and Proctor, J. D. 1976. Effectiveness of voluntary heart rate control in reducing speech anxiety. J. Consult. Clinical Psychol. 44, 3, 381--389.
[27]
Geary, D. C., Frensch, P. A., and Wiley, J. G. 1993. Simple and complex mental subtraction: Strategy choice and speed-of-processing differences in younger and older adults. Psychol. Aging 8, 2, 242--256.
[28]
Gerardi, M., Ciikor, J., Difede, J., Rizzo, A., and Rothbaum, B. O. 2010. Virtual reality exposure therapy for post-traumatic stress disorder and other anxiety disorders. Current Psych. Rep. 12, 4, 298--305.
[29]
Gramer, M. and Saria, K. 2007. Effects of social anxiety and evaluative threat on cardiovascular responses to active performance situations. Biol. Psychol. 74, 1, 67--74.
[30]
Grayson, J., Foa, E., and Steketee, G. 1982. Habituation during exposure treatment: Distraction vs attention~focusing. Behav. Res.Therapy 20, 4, 323--328.
[31]
Harris, S. R., Kemmerlxng, R. L., and North, M. M. 2002. Brief virtual reality therapy for public speaking anxiety. CyberPsychol. Behav. 5, 6, 543--550.
[32]
Heimberg, R. G., Dodge, C. S., Hope, D. A., Kennedy, C. R., Zollo, L. J., and Becker, R. E. 1990. Cognitive behavioral treatment of social phobia: Comparison to a credible placebo control. Cognitive Therapy Res. 14, 1--23.
[33]
Hellstrcm, K. and Ost, L.-G. 1995. One-session therapist directed exposure vs two forms of manual directed self-exposure in the treatment of spider phobia. Behav. Res. Therapy 33, 8, 959--965.
[34]
Hess, U., Adams, R. B., Jr., and Kleck, R. E. 2004. Facial appearance, gender, and emotion expression. Emotion 4, 4, 378--388.
[35]
Hietanen, J. K., Surakka, V., and Linnankoskx, I. 1998. Facial electromyographic responses to vocal affect expressions. Psychophysiology 35, 530--536.
[36]
James, L., Lin, C., Steed, A., Swapp, D., and Slater, M. 2003. Social anxiety in virtual environments: Results of a pilot study. CyberPsychol. Behav. 6, 3, 237--243.
[37]
Losman, N., Reisberg, A., Weiss, P. L., Garcia-Palacios, A., and Hoffman, H. G. 2008. Busworld: An analog pilot test of a virtual environment designed to treat posttraumatic stress disorder originating from a terrorist suicide bomb attack. CyberPsychol. Behav. 11, 6, 775--777.
[38]
Kessler, R. C. 2003. The impairments caused by social phobia in the general population: Implications for intervention. Acta Psychiatiica Scandinavica 108, 19--27.
[39]
Kozak, M. J., Foa, E. B., and Steketee, G. 1988. Process and outcome of exposure treatment with obsessive-compulsives: Psychophysiological indicators of emotional processing. Behav. Therapy 1.9, 2, 15--169.
[40]
Krijn, M., Emmelkamp, P., Olafsson, R., and Biemond, R. 2004. Virtual reality exposure therapy of anxiety disorders: A review. Clinical Psychol. Rev. 24, 259--281.
[41]
Larkin, K. T., Ciano-Federoff, L. M., and Hammel, D. 1998. Effects of gender of observer and fear of negative evaluation on cardiovascular reactivity to mental stress in college men. Int. J. Psychophysiol. 29, 311--318.
[42]
Larsen, J. T., Norris, C. J., and Cacioppo, J. T. 2003. Effects of positive and negative affect on electromyographic activity over the zygomaticus major and corrugator supercilii. Psychophysiology 40, 776--785.
[43]
Levenson, R. W. and Ekman, P. 2002. Difficulty does not account for emotion-specific heart rate changes in the directed facial action task. Psychophysiology 3, 9, 397--405.
[44]
Levenson, R. W., Ekman, P., Heider, K., and Friesen, W. V. 1992. Emotion and autonomic nervous system activity in the Minangkabau of West Sumatra. J. Personality Social Psychol. 62, 972--988.
[45]
Levenson, R. W., Ekman, P., and Friesen, W. V. 1990. Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology 27, 363--384.
[46]
Llobera, J., Spanlang, B., Ruffini, G., and Slater, M. 2010. Proxemics with multiple dynamic characters in an immersive virtual environment. ACM Trans. Appl. Percept. 8, 1--12.
[47]
Loftus, G. R. and Harley, E. M. 2005. Why is it easier to identify someone close than far away? Psychonomic Bull. Rev. 12, 43--65.
[48]
Mauss, I. B., Levenson, R. W., McCarter, L., Wilhelm, F. H., and Gnoss, J. J. 2005. The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion 5, 2, 175--190.
[49]
Mauss, I. B. and Robinson, M. D. 2009. Measures of emotion: A review. Cognition Emotion 23, 2, 209--237.
[50]
Mick, M. A. and Telch, M. J. 1998. Social anxiety and history of behavioral inhibition in young adults. J. Anxiety Disorders 12, 1, 1--20.
[51]
Nass, S., Steuer, J., and Tauber, E. R. 1994. Computers are social actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'94). ACM, New York.
[52]
Niedenthal, P. M. 2007. Embodying emotion. Science 316, 1002--1005.
[53]
North, M., North, S., and Coble, J. 1998. Virtual reality therapy: An effective treatment for phobias. Stud. Health Technol. Informatics 58, 112--119.
[54]
Olfson, M., Guardino, M., Struening, E., Schneier, F. R., Hellman, F., and Klein, D. F. 2000. Barriers to the treatment of social anxiety. Amer. J. Psych. 157, 521--527.
[55]
Ost, L.-G. 1989. One-session treatment for specific phobias. Behav. Res.Therapy 27, 1, 1--7.
[56]
Partala, T., Surakka, V., and Lahti, J. 2004. Affective effects of agent proximity in conversational systems. In Proceedings of the 3rd Nordic Conference on Human Computer Interaction (NordiCHI'04). ACM, New York.
[57]
Partala, T., Surakka, V., and Vanhala, T. 2006. Real-time estimation of emotional experiences from facial expressions. Interact. Comput. 18, 208--226.
[58]
Pertaub, D.-P., Slater, M., and Barker, C. 2002. An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators Virtual Environ. 11, 1, 68--78.
[59]
Powers, M. B. and Emmelkamp, P. M. G. 2008. Virtual reality exposure therapy for anxiety disorders: A meta-analysis. J. Anxiety Disorders 22, 3, 561--569.
[60]
Rainville, P., Bechara, A., Naqvi, N., and Damasio, A. R. 2006. Basic emotions are associated with distinct patterns of cardiorespiratory activity. Int. J. Psychophysiology 61, 5--18.
[61]
Ranta, K., Kaltiala-Heino, R., Rantanen, P., Tuomisto, M. T., and Marttunen, M. 2007. Screening social phobia in adolescents from general population: The validity of the social phobia inventory (spin) against a clinical interview. European Psych. 22, 4, 244--251.
[62]
Rapee, R. M. and Heimberg, R. G. 1997. A cognitive-behavioral model of anxiety in social phobia. Behav. Res. Therapy 35, 8, 741--756.
[63]
Reeves, B., Lang, A., Kim, E. Y., and Tatar, D. 1999. The effects of screen size and message content on attention and arousal. Media Psychol. 1, 49--67.
[64]
Rinck, M., Rortgen, T., Lange, W.-G., Dotsch, R., Wigboldus, D. H. J., and Becker, E. S. 2010. Social anxiety predicts avoidance behaviour in virtual encounters. Cognition Emotion 24, 7, 1269--1276.
[65]
Rothbaum, B. O., Hodges, L., Smith, S., Lee, J. H., and Price, L. 2000. A controlled study of virtual reality exposure therapy for the fear of flying. J. Consult. Clinical Psychol. 68, 6, 1020--1026.
[66]
Schlosberg, H. 1954. Three dimensions of emotion. Psychol. Rev. 61, 2, 81--88.
[67]
Schuemie, M. J., Van Der Straaten, P., Krijn, M., and Van Der Mast, C. A. P. G. 2001. Research on presence in virtual reality: a survey. CyberPsychol. Behav. 4, 2, 183--201.
[68]
Tassinary, L. G. and Cacioppo, J. T. 2000. The skeletomotor system: Surface electromyography. In Handbook of Psychophysiology. Cambridge University Press, Cambridge, UK, 163--199.
[69]
Teghtsoonian, R. and Frost, R. O. 1982. The effects of viewing distance on fear of snakes. J. Behav. Therapy Exper. Psych. 13, 3, 181--190.
[70]
Van Boxtel, A. and Jessurun, M. 1993. Amplitude and bilateral coherency of facial and jaw-elevator EMG activity as an index of effort during a two-choice serial reaction task. Psychophysiology 30, 6, 589--604.
[71]
Vanhala, T. and Surakka, V. 2007. Facial activation control effect (FACE). In Ajffective Computing and Intelligent Interaction, A. Paiva et al. Eds., Springer, Berlin, 278--289.
[72]
Vanhala, T. and Surakka, V. 2008. Ajfective computing. In Tech Education and Publishing, 405--420.
[73]
Vanhala, T., Surakka, V., Siirtola, H., Raiha, K.-J., Morel, B., and Ach, L. 2010. Virtual proximity and facial expressions of computer agents regulate human emotions and attention. Comput. Animation Virtual Worlds 21, 3-4, 215--224.
[74]
Ward, R. D. and Marsden, P. H. 2003. Physiological responses to different web page designs. Int. J. Hum.-Comput. Stud. 59, 199--212.
[75]
Waterink, W. and Van Boxtel, A. 1994. Facial and jaw-elevator EMG activity in relation to changes in performance level during a sustained information processing task. Biol. Psychol. 37, 183--198
[76]
Wiederhold, B. K. and Rizzo, A. 2005. Virtual reality and applied psychophysiology. Appl. Psychophysiol. Biofeedback 30, 3, 183--185.
[77]
Wiederhold, B. K. and Wiederhold, M. D. 2003. Three-year follow-up for virtual reality exposure for fear of flying. CyberPsychol. Behav. 6, 441--445.
[78]
Witvliet, C. V. and Vrana, S. R. 1995. Psychophysiological responses as indices of affective dimensions. Psychophysiology 5, 436--443.
[79]
Zanbaka, C. A., Ulinski, A. C., Goolkasian, P., and Hodges, L. F. 2007. Social responses to virtual humans: implications for future interface design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07), ACM, New York, 1561--1570.
Index Terms
- Voluntary facial activations regulate physiological arousal and subjective experiences during virtual social stimulation
Recommendations
Social anxiety and physiological arousal during computer mediated vs. face to face communication
We evaluated socially anxiety in computer mediated vs. face to face communication.An experimental interaction task used subjective and physiological measures.Both CMC and FTF produced similar increases in physiological arousal.Subjective anxiety and ...
Acting emotions: physiological correlates of emotional valence and arousal dynamics in theatre
IMX '22: Proceedings of the 2022 ACM International Conference on Interactive Media ExperiencesProfessional theatre actors are highly specialized in controlling their own expressive behaviour and non-verbal emotional expressiveness, so they are of particular interest in fields of study such as affective computing. We present Acting Emotions, an ...
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...
Comments
Information & Contributors
Information
Published In
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 March 2012
Accepted: 01 May 2011
Revised: 01 February 2011
Received: 01 November 2010
Published in TAP Volume 9, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 627Total Downloads
- Downloads (Last 12 months)16
- Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in