Tanja Schneeberger
ABSTRACT
Coping with stress is critical to mental health. Prolonged mental stress is the psychological and physiological response to a high frequency of or continuous stressors, which has a negative impact on health. This paper presents a virtual stress management training using biofeedback derived from the cardiovascular response of the heart rate variability (HRV) with an interactive social agent as biofeedback trainer. The evaluation includes both, a subject-matter expert interview and an experiment with 71 participants. In the experiment, we compared our novel stress management training to a stress management training using stress diaries. The results indicate that our social agent-based stress management training using biofeedback significantly decreased the self-assessed stress levels immediately after the training, as well as in a socially stressful task. Moreover, we found a significant correlation between stress level and the assessment of one’s performance in a socially stressful task. Participants that received our training assessed their performance higher than participants getting stress diaries. Taken this together, our novel virtual stress management training with an interactive social agent as a trainer can be evaluated as a valid method for learning techniques on how to cope with stressful situations.
- Wendy K Alford, John M Malouff, and Kristy S Osland. 2005. Written Emotional Expression as a Coping Method in Child Protective Services Officers.International Journal of Stress Management 12, 2 (2005), 177.Google Scholar
- A-M Bao, G Meynen, and DF Swaab. 2008. The stress system in depression and neurodegeneration: focus on the human hypothalamus. Brain Research Reviews 57, 2 (2008), 531–553.Google ScholarCross Ref
- Luciano Bernardi, Cesare Porta, Alessandra Gabutti, Lucia Spicuzza, and Peter Sleight. 2001. Modulatory effects of respiration. Autonomic Neuroscience 90, 1-2 (2001), 47–56.Google ScholarCross Ref
- Timothy Bickmore, Amanda Gruber, and Rosalind Picard. 2005. Establishing the computer–patient working alliance in automated health behavior change interventions. Patient Education and Counseling 59, 1 (2005), 21–30.Google ScholarCross Ref
- Nicholas Blouin, John Deaton, Erin Richard, and Paul Buza. 2014. Effects of stress on perceived performance of collegiate aviators. Aviation Psychology and Applied Human Factors 4, 1 (2014), 40–49.Google ScholarCross Ref
- Tibor Bosse, Charlotte Gerritsen, and Jeroen de Man. 2016. An intelligent system for aggression de-escalation training. In Proceedings of the Twenty-second European Conference on Artificial Intelligence. IOS Press, 1805–1811.Google ScholarDigital Library
- Barbara B Brown. 1977. Stress and the art of biofeedback.Harper & Row.Google Scholar
- Charles S Carver, Michael F Scheier, and Jagdish K Weintraub. 1989. Assessing coping strategies: a theoretically based approach.Journal of Personality and Social Psychology 56, 2(1989), 267.Google Scholar
- Rossana Castaldo, Paolo Melillo, Umberto Bracale, M Caserta, Maria Triassi, and Leandro Pecchia. 2015. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomedical Signal Processing and Control 18 (2015), 370–377.Google ScholarCross Ref
- Alberto Chiesa and Alessandro Serretti. 2009. Mindfulness-based stress reduction for stress management in healthy people: a review and meta-analysis. The Journal of Alternative and Complementary Medicine 15, 5 (2009), 593–600.Google ScholarCross Ref
- Luca Chittaro and Riccardo Sioni. 2014. Affective computing vs. affective placebo: Study of a biofeedback-controlled game for relaxation training. International Journal of Human-Computer Studies 72, 8-9 (2014), 663–673.Google ScholarDigital Library
- Sheldon Cohen, Denise Janicki-Deverts, and Gregory E Miller. 2007. Psychological stress and disease. Jama 298, 14 (2007), 1685–1687.Google ScholarCross Ref
- Sheldon Cohen, T Kamarck, R Mermelstein, 1994. Perceived Stress Scale. Measuring stress: A guide for health and social scientists 10 (1994).Google Scholar
- Mick P Couper, Roger Tourangeau, Frederick G Conrad, and Eleanor Singer. 2006. Evaluating the effectiveness of visual analog scales: A web experiment. Social Science Computer Review 24, 2 (2006), 227–245.Google ScholarDigital Library
- Elise S Dan-Glauser and Klaus R Scherer. 2011. The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behavior Research Methods 43, 2 (2011), 468.Google ScholarCross Ref
- Martha Davis and Dean Hadiks. 1994. Nonverbal aspects of therapist attunement. Journal of Clinical Psychology 50, 3 (1994), 393–405.Google ScholarCross Ref
- E Ron De Kloet, Marian Joëls, and Florian Holsboer. 2005. Stress and the brain: from adaptation to disease. Nature Reviews Neuroscience 6, 6 (2005), 463–475.Google ScholarCross Ref
- Anita DeLongis, Susan Folkman, and Richard S Lazarus. 1988. The impact of daily stress on health and mood: psychological and social resources as mediators.Journal of personality and social psychology 54, 3(1988), 486.Google Scholar
- Daniel A Donnelly and Edward J Murray. 1991. Cognitive and emotional changes in written essays and therapy interviews. Journal of Social and Clinical psychology 10, 3 (1991), 334–350.Google ScholarCross Ref
- Dwain L Eckberg. 1983. Human sinus arrhythmia as an index of vagal cardiac outflow. Journal of Applied Physiology 54, 4 (1983), 961–966.Google ScholarCross Ref
- Paul Ekman. 1992. An argument for basic emotions. Cognition & Emotion 6, 3-4 (1992), 169–200.Google ScholarCross Ref
- Patrick Gebhard, Gregor Mehlmann, and Michael Kipp. 2012. Visual SceneMaker: a tool for authoring interactive virtual characters. Journal on Multimodal User Interfaces 6, 1-2 (2012), 3–11.Google ScholarCross Ref
- Patrick Gebhard, Tanja Schneeberger, Tobias Baur, and Elisabeth André. 2018. MARSSI: Model of Appraisal, Regulation, and Social Signal Interpretation. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 497–506.Google Scholar
- Fay CM Geisler, Thomas Kubiak, Kerstin Siewert, and Hannelore Weber. 2013. Cardiac vagal tone is associated with social engagement and self-regulation. Biological Psychology 93, 2 (2013), 279–286.Google ScholarCross Ref
- Vera C Goessl, Joshua E Curtiss, and Stefan G Hofmann. 2017. The effect of heart rate variability biofeedback training on stress and anxiety: a meta-analysis. Psychological Medicine 47, 15 (2017), 2578–2586.Google ScholarCross Ref
- Jonathan Gratch, Sin-Hwa Kang, and Ning Wang. 2013. Using social agents to explore theories of rapport and emotional resonance. Social Emotions in Nature and Artifact 181 (2013).Google Scholar
- Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast, and Robin Duffy. 2007. Creating rapport with virtual agents. In International Workshop on Intelligent Virtual Agents. Springer, 125–138.Google ScholarDigital Library
- Constance Hammen. 2005. Stress and depression. Annu. Rev. Clin. Psychol. 1 (2005), 293–319.Google ScholarCross Ref
- Anita Lill Hansen, Bjørn Helge Johnsen, John J Sollers, Kjetil Stenvik, and Julian F Thayer. 2004. Heart rate variability and its relation to prefrontal cognitive function: the effects of training and detraining. European Journal of Applied Physiology 93, 3 (2004), 263–272.Google ScholarCross Ref
- T Islam, U Mittal, AT Nimal, and MU Sharma. 2014. High frequency surface acoustic wave (SAW) device for toxic vapor detection: Prospects and challenges. In Sensing Technology: Current Status and Future Trends II. Springer, 217–241.Google Scholar
- Sin-Hwa Kang and Jonathan Gratch. 2010. Virtual humans elicit socially anxious interactants’ verbal self-disclosure. Computer Animation and Virtual Worlds 21, 3-4 (2010), 473–482.Google ScholarCross Ref
- P Karthikeyan, M Murugappan, and S Yaacob. 2013. Detection of human stress using short-term ECG and HRV signals. Journal of Mechanics in Medicine and Biology 13, 02 (2013), 1350038.Google ScholarCross Ref
- Manolya Kavakli, Manning Li, and Tarashankar Rudra. 2012. Towards the development of a virtual counselor to tackle students’ exam stress. Journal of Integrated Design and Process Science 16, 1 (2012), 5–26.Google ScholarDigital Library
- Clemens Kirschbaum, Karl-Martin Pirke, and Dirk H Hellhammer. 1993. The Trier Social Stress Test–a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 28, 1-2 (1993), 76–81.Google ScholarCross Ref
- Mika Kivimäki, Marianna Virtanen, Marko Elovainio, Anne Kouvonen, Ari Väänänen, and Jussi Vahtera. 2006. Work stress in the etiology of coronary heart disease—a meta-analysis. Scandinavian Journal of Work, Environment & Health (2006), 431–442.Google Scholar
- Eva M Klein, Elmar Brähler, Michael Dreier, Leonard Reinecke, Kai W Müller, Gabriele Schmutzer, Klaus Wölfling, and Manfred E Beutel. 2016. The German version of the Perceived Stress Scale–psychometric characteristics in a representative German community sample. BMC Psychiatry 16, 1 (2016), 159.Google ScholarCross Ref
- Gerda Kraag, Maurice P Zeegers, Gerjo Kok, Clemens Hosman, and Huda Huijer Abu-Saad. 2006. School programs targeting stress management in children and adolescents: A meta-analysis. Journal of School Psychology 44, 6 (2006), 449–472.Google ScholarCross Ref
- David S Krantz and Melissa K McCeney. 2002. Effects of psychological and social factors on organic disease: a critical assessment of research on coronary heart disease. Annual Review of Psychology 53, 1 (2002), 341–369.Google ScholarCross Ref
- Brigitte M Kudielka, Dirk H Hellhammer, and Clemens Kirschbaum. 2007. Ten Years of Research with the Trier Social Stress Test–Revisited.(2007).Google Scholar
- Leah Lagos, Evgeny Vaschillo, Bronya Vaschillo, Paul Lehrer, Marsha Bates, and Robert Pandina. 2011. Virtual reality–assisted heart rate variability biofeedback as a strategy to improve golf performance: a case study. Biofeedback 39, 1 (2011), 15–20.Google ScholarCross Ref
- Peter J Lang, Margaret M Bradley, Bruce N Cuthbert, 1997. International affective picture system (IAPS): Technical manual and affective ratings. NIMH Center for the Study of Emotion and Attention 1 (1997), 39–58.Google Scholar
- Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and Usability Engineering Group. Springer, 63–76.Google ScholarDigital Library
- Richard S Lazarus. 1966. Psychological stress and the coping process.(1966).Google Scholar
- Richard S Lazarus. 1993. From psychological stress to the emotions: A history of changing outlooks. Annual Review of Psychology 44, 1 (1993), 1–22.Google ScholarCross Ref
- Richard S Lazarus and Susan Folkman. 1984. Stress, appraisal, and coping. Springer publishing company.Google Scholar
- Paul Lehrer. 2013. How does heart rate variability biofeedback work? Resonance, the baroreflex, and other mechanisms. Biofeedback 41, 1 (2013), 26–31.Google ScholarCross Ref
- Paul M Lehrer. 2007. Biofeedback training to increase heart rate variability. Principles and Practice of Stress Management 3 (2007), 227–248.Google Scholar
- Jane B Lemaire, Jean E Wallace, Adriane M Lewin, Jill de Grood, and Jeffrey P Schaefer. 2011. The effect of a biofeedback-based stress management tool on physician stress: a randomized controlled clinical trial. Open Medicine 5, 4 (2011), e154.Google Scholar
- Gale M Lucas, Jonathan Gratch, Aisha King, and Louis-Philippe Morency. 2014. It’s only a computer: Virtual humans increase willingness to disclose. Computers in Human Behavior 37 (2014), 94–100.Google ScholarDigital Library
- Marek Malik. 1996. Heart rate variability: Standards of measurement, physiological interpretation, and clinical use: Task force of the European Society of Cardiology and the North American Society for Pacing and Electrophysiology. Annals of Noninvasive Electrocardiology 1, 2 (1996), 151–181.Google ScholarCross Ref
- Theresa M Marteau and Hilary Bekker. 1992. The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). British Journal of Clinical Psychology 31, 3 (1992), 301–306.Google ScholarCross Ref
- Yuri Masaoka and Ikuo Homma. 1997. Anxiety and respiratory patterns: their relationship during mental stress and physical load. International Journal of Psychophysiology 27, 2 (1997), 153–159.Google ScholarCross Ref
- Carolyn M Mazure. 1998. Life stressors as risk factors in depression. Clinical Psychology: Science and Practice 5, 3 (1998), 291–313.Google ScholarCross Ref
- Peter Mikosch, Tamara Hadrawa, Kornelia Laubreiter, Josef Brandl, Jürgen Pilz, Haro Stettner, and Georg Grimm. 2010. Effectiveness of respiratory-sinus-arrhythmia biofeedback on state-anxiety in patients undergoing coronary angiography. Journal of Advanced Nursing 66, 5 (2010), 1101–1110.Google ScholarCross Ref
- Scott M Monroe and Anne D Simons. 1991. Diathesis-stress theories in the context of life stress research: implications for the depressive disorders.Psychological bulletin 110, 3 (1991), 406.Google Scholar
- Marianna Munafo, Elisabetta Patron, and Daniela Palomba. 2016. Improving managers’ psychophysical well-being: effectiveness of respiratory sinus arrhythmia biofeedback. Applied Psychophysiology and Biofeedback 41, 2 (2016), 129–139.Google ScholarCross Ref
- Udi Nussinovitch, Keren Politi Elishkevitz, Keren Katz, Moshe Nussinovitch, Shlomo Segev, Benjamin Volovitz, and Naomi Nussinovitch. 2011. Reliability of ultra-short ECG indices for heart rate variability. Annals of Noninvasive Electrocardiology 16, 2 (2011), 117–122.Google ScholarCross Ref
- World Health Organisation. 2001. World Health Report 2001. Geneva: World Health Organisation.Google Scholar
- Maman Paul and Kanupriya Garg. 2012. The effect of heart rate variability biofeedback on performance psychology of basketball players. Applied Psychophysiology and Biofeedback 37, 2 (2012), 131–144.Google ScholarCross Ref
- Gabriell E Prinsloo, Wayne E Derman, Michael I Lambert, and HG Rauch. 2013. The effect of a single episode of short duration heart rate variability biofeedback on measures of anxiety and relaxation states.International Journal of Stress Management 20, 4 (2013), 391.Google Scholar
- Gabriell E Prinsloo, HG Laurie Rauch, Michael I Lambert, Frederick Muench, Timothy D Noakes, and Wayne E Derman. 2011. The effect of short duration heart rate variability (HRV) biofeedback on cognitive performance during laboratory induced cognitive stress. Applied Cognitive Psychology 25, 5 (2011), 792–801.Google ScholarCross Ref
- Paul Ratanasiripong, Orawan Kaewboonchoo, Nop Ratanasiripong, Suda Hanklang, and Pornlert Chumchai. 2015. Biofeedback intervention for stress, anxiety, and depression among graduate students in public health nursing. Nursing Research and Practice 2015 (2015).Google Scholar
- Patrice Renaud and Jean-Pierre Blondin. 1997. The stress of Stroop performance: Physiological and emotional responses to color–word interference, task pacing, and pacing speed. International Journal of Psychophysiology 27, 2 (1997), 87–97.Google ScholarCross Ref
- Katherine M Richardson and Hannah R Rothstein. 2008. Effects of occupational stress management intervention programs: a meta-analysis.Journal of Occupational Health Psychology 13, 1 (2008), 69.Google Scholar
- Christoph Rockstroh, Johannes Blum, and Anja S Göritz. 2019. Virtual reality in the application of heart rate variability biofeedback. International Journal of Human-Computer Studies 130 (2019), 209–220.Google ScholarDigital Library
- Alan Rozanski, James A Blumenthal, and Jay Kaplan. 1999. Impact of psychological factors on the pathogenesis of cardiovascular disease and implications for therapy. Circulation 99, 16 (1999), 2192–2217.Google ScholarCross Ref
- Priyanka Satish, Krishnan Muralikrishnan, Kabali Balasubramanian, 2015. Heart rate variability changes during stroop color and word test among genders. Indian J. Physiol. Pharmacol. 59, 1 (2015), 9–15.Google Scholar
- Esther Judith Schek, Fabrizia Mantovani, Olivia Realdon, Joao Dias, Ana Paiva, Sarit Schramm-Yavin, and Ruth Pat-Horenczyk. 2017. Positive technologies for promoting emotion regulation abilities in adolescents. In eHealth 360°. Springer, 169–174.Google Scholar
- Tanja Schneeberger, Patrick Gebhard, Tobias Baur, and Elisabeth André. 2019. PARLEY: a transparent virtual social agent training interface. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion. ACM, 35–36.Google Scholar
- Tanja Schneeberger, Naomi Sauerwein, Manuel S. Anglet, and Patrick Gebhard. 2020. Developing a Social Biofeedback Training System for Stress Management Training. In Companion Publication of the 2020 International Conference on Multimodal Interaction(Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 472–476. https://doi.org/10.1145/3395035.3425222Google ScholarDigital Library
- Tanja Schneeberger, Mirella Scholtes, Bernhard Hilpert, Markus Langer, and Patrick Gebhard. 2019. Can Social Agents elicit Shame as Humans do?. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 164–170.Google ScholarCross Ref
- Mark S Schwartz and Frank Andrasik. 2017. Biofeedback: A practitioner’s guide. Guilford Publications.Google Scholar
- Hans Selye. 1946. The general adaptation syndrome and the diseases of adaptation. The Journal of Clinical Endocrinology 6, 2 (1946), 117–230.Google ScholarCross Ref
- Hans Selye. 2013. Stress in health and disease. Butterworth-Heinemann.Google Scholar
- Ameneh Shamekhi, Ha Trinh, Timothy W Bickmore, Tamara R DeAngelis, Theresa Ellis, Bethlyn V Houlihan, and Nancy K Latham. 2016. A virtual self-care coach for individuals with spinal cord injury. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. 327–328.Google ScholarDigital Library
- Leslie Sherlin, Richard Gevirtz, Sarah Wyckoff, and Fred Muench. 2009. Effects of respiratory sinus arrhythmia biofeedback versus passive biofeedback control.International Journal of Stress Management 16, 3 (2009), 233.Google Scholar
- Mark A Staal. 2004. Stress, cognition, and human performance: A literature review and conceptual framework. (2004).Google Scholar
- J Ridley Stroop. 1935. Studies of interference in serial verbal reactions.Journal of Experimental Psychology 18, 6 (1935), 643.Google Scholar
- Auditya Purwandini Sutarto, Muhammad Nubli Abdul Wahab, and Nora Mat Zin. 2010. Heart Rate Variability (HRV) biofeedback: A new training approach for operator’s performance enhancement. Journal of Industrial Engineering and Management 3, 1 (2010), 176–198.Google ScholarCross Ref
- Joachim Taelman, Steven Vandeput, Arthur Spaepen, and Sabine Van Huffel. 2009. Influence of mental stress on heart rate and heart rate variability. In 4th European Conference of the International Federation for Medical and Biological Engineering. Springer, 1366–1369.Google ScholarCross Ref
- Myrthe L Tielman, Mark A Neerincx, Rafael Bidarra, Ben Kybartas, and Willem-Paul Brinkman. 2017. A therapy system for post-traumatic stress disorder using a virtual agent and virtual storytelling to reconstruct traumatic memories. Journal of Medical Systems 41, 8 (2017), 125.Google ScholarDigital Library
- Philip M Ullrich and Susan K Lutgendorf. 2002. Journaling about stressful events: Effects of cognitive processing and emotional expression. Annals of Behavioral Medicine 24, 3 (2002), 244–250.Google ScholarCross Ref
- Johannes Wagner, Florian Lingenfelser, Tobias Baur, Ionut Damian, Felix Kistler, and Elisabeth André. 2013. The Social Signal Interpretation (SSI) Framework: Multimodal Signal Processing and Recognition in Real-time. In Proceedings of the 21st ACM International Conference on Multimedia(MM ’ 13). ACM, New York, NY, USA, 831–834.Google ScholarDigital Library
- Zhe Zhang, Ha Trinh, Qiong Chen, and Timothy Bickmore. 2015. Adapting a Geriatrics Health Counseling Virtual Agent for the Chinese Culture. In International Conference on Intelligent Virtual Agents. Springer, 275–278.Google ScholarCross Ref
Index Terms
- Stress Management Training using Biofeedback guided by Social Agents
Index terms have been assigned to the content through auto-classification.
Recommendations
Developing a Social Biofeedback Training System for Stress Management Training
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionMental stress is the psychological and physiological response to a high frequency of or continuous stressors. If prolonged and not regulated successfully, it has a negative impact on health. Developing stress coping techniques, as an emotion regulation ...
Biofeedback as a stress management tool: a systematic review
Inappropriate management of acute stress can negatively affect cognition and task performance. Frequently occurring acute stress encounters can lead to cardiovascular and immunity deficiencies, and psychological disorders such as depression, fatigue, ...
The effectiveness of social agents in reducing user frustration
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing SystemsA study was conducted to evaluate the effectiveness of social agents in reducing user frustration. The particular type of agent studied reacted to users' facial expressions while they browsed through a shopping website. While highly frustrated users ...
Comments