Jason Raether
ABSTRACT
Wrist-worn vibrotactile feedback has been heralded as a promising intervention for reducing state anxiety during stressor events. However, current work has focused on the continuous delivery of the vibrotactile stimulus, which entails the risk of habituation to the potentially relieving effects of the feedback. This paper examines the just-in-time administration of vibrotactile feedback during a public speaking task in an effort to reduce communication apprehension. We evaluate two types of vibrotactile feedback delivery mechanisms compared to a control in a between-subjects design – one that delivers stimulus over random time points and one that delivers stimulus during moments of heightened physiological reactivity, as determined by changes in electrodermal activity. The results from these interventions indicate that vibrotactile feedback administered during high physiological arousal improves stress-related physiological measures (e.g., heart rate) and self-reported stress annotations early on in the intervention, and contributes to increased vocal stability during the public speaking task, but these effects diminish over time. Delivering the vibrotactile feedback over random points in time appears to worsen stress-related measures overall.
- John Allen. 2007. Photoplethysmography and its application in clinical physiological measurement. Physiological measurement 28, 3 (2007), R1.Google Scholar
- Mike Allen, John E Hunter, and William A Donohue. 1989. Meta-analysis of self-report data on the effectiveness of public speaking anxiety treatment techniques. Communication Education 38, 1 (1989), 54–76.Google ScholarCross Ref
- Agnès Alsius, Jordi Navarra, and Salvador Soto-Faraco. 2007. Attention to touch weakens audiovisual speech integration. Experimental Brain Research 183, 3 (2007), 399–404.Google ScholarCross Ref
- Brandon J Auer, Jessica L Calvi, Nicolas M Jordan, David Schrader, and Jennifer Byrd-Craven. 2018. Communication and social interaction anxiety enhance interleukin-1 beta and cortisol reactivity during high-stakes public speaking. Psychoneuroendocrinology 94 (2018), 83–90.Google ScholarCross Ref
- Ruben T Azevedo, Nell Bennett, Andreas Bilicki, Jack Hooper, Fotini Markopoulou, and Manos Tsakiris. 2017. The calming effect of a new wearable device during the anticipation of public speech. Scientific reports 7, 1 (2017), 1–7.Google Scholar
- Sangwon Bae, Tammy Chung, Denzil Ferreira, Anind K Dey, and Brian Suffoletto. 2018. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions. Addictive behaviors 83(2018), 42–47.Google Scholar
- Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software 67, 1 (2015), 1–48. https://doi.org/10.18637/jss.v067.i01Google ScholarCross Ref
- Ulf Berglund and Birgitta Berglund. 1970. Adaptation and recovery in vibrotactile perception. Perceptual and motor skills 30, 3 (1970), 843–853.Google Scholar
- Morten Birket-Smith, N Hasle, and HH Jensen. 1993. Electrodermal activity in anxiety disorders. Acta Psychiatrica Scandinavica 88, 5 (1993), 350–355.Google ScholarCross Ref
- Graham D Bodie. 2010. A racing heart, rattling knees, and ruminative thoughts: Defining, explaining, and treating public speaking anxiety. Communication education 59, 1 (2010), 70–105.Google Scholar
- Kerry Bodine and Francine Gemperle. 2003. Effects of functionality on perceived comfort of wearables. In Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings. Citeseer, 57–57.Google ScholarCross Ref
- Steven Booth-Butterfield and Malloy Gould. 1986. The communication anxiety inventory: Validation of state-and context-communication apprehension. Communication Quarterly 34, 2 (1986), 194–205.Google ScholarCross Ref
- Wolfram Boucsein. 2012. Electrodermal activity. Springer Science & Business Media.Google Scholar
- Jason J Braithwaite, Derrick G Watson, Robert Jones, and Mickey Rowe. 2013. A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.Google Scholar
- Rossana Castaldo, Paolo Melillo, Umberto Bracale, M Caserta, Maria Triassi, and Leandro Pecchia. 2015. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomedical Signal Processing and Control 18 (2015), 370–377.Google ScholarCross Ref
- Rossana Castaldo, Luis Montesinos, Paolo Melillo, C James, and Leandro Pecchia. 2019. Ultra-short term HRV features as surrogates of short term HRV: a case study on mental stress detection in real life. BMC medical informatics and decision making 19, 1 (2019), 1–13.Google Scholar
- John A Chalmers, Daniel S Quintana, Maree J Abbott, Andrew H Kemp, 2014. Anxiety disorders are associated with reduced heart rate variability: a meta-analysis. Frontiers in psychiatry 5 (2014), 80.Google Scholar
- Dianne L Chambless, G Craig Caputo, Priscilla Bright, and Richard Gallagher. 1984. Assessment of fear of fear in agoraphobics: the body sensations questionnaire and the agoraphobic cognitions questionnaire.Journal of consulting and clinical psychology 52, 6(1984), 1090.Google Scholar
- Kyung Yun Choi and Hiroshi Ishii. 2020. ambienBeat: Wrist-worn mobile tactile biofeedback for heart rate rhythmic regulation. In Proceedings of the fourteenth international conference on tangible, embedded, and embodied interaction. 17–30.Google ScholarDigital Library
- Woohyeok Choi, Sangkeun Park, Duyeon Kim, Youn-kyung Lim, and Uichin Lee. 2019. Multi-stage receptivity model for mobile just-in-time health intervention. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 1–26.Google ScholarDigital Library
- David A Clark. 2013. Cognitive restructuring. The Wiley handbook of cognitive behavioral therapy (2013), 1–22.Google ScholarCross Ref
- Jean Costa, Alexander T Adams, Malte F Jung, François Guimbretière, and Tanzeem Choudhury. 2016. EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 758–769.Google ScholarDigital Library
- Jean Costa, François Guimbretière, Malte F Jung, and Tanzeem Choudhury. 2019. BoostMeUp: Improving cognitive performance in the moment by unobtrusively regulating emotions with a smartwatch. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 1–23.Google ScholarDigital Library
- Fred Cummins. 2009. Rhythm as an affordance for the entrainment of movement. Phonetica 66, 1-2 (2009), 15–28.Google ScholarCross Ref
- Ella Dagan, Elena Márquez Segura, Ferran Altarriba Bertran, Miguel Flores, Robb Mitchell, and Katherine Isbister. 2019. Design framework for social wearables. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1001–1015.Google ScholarDigital Library
- John A Daly, Anita L Vangelisti, and Samuel G Lawrence. 1989. Self-focused attention and public speaking anxiety. Personality and Individual Differences 10, 8 (1989), 903–913.Google ScholarCross Ref
- Nem Khan Dim and Xiangshi Ren. 2017. Investigation of suitable body parts for wearable vibration feedback in walking navigation. International Journal of Human-Computer Studies 97 (2017), 34–44.Google ScholarCross Ref
- Empatica. 2018. E4 Streaming Server.Google Scholar
- Empatica. 2022. Empatica E4 Wristband.Google Scholar
- Florian Eyben, Klaus R Scherer, Björn W Schuller, Johan Sundberg, Elisabeth André, Carlos Busso, Laurence Y Devillers, Julien Epps, Petri Laukka, Shrikanth S Narayanan, 2015. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing. IEEE transactions on affective computing 7, 2 (2015), 190–202.Google Scholar
- Florian Eyben, Martin Wöllmer, and Björn Schuller. 2010. Opensmile: the munich versatile and fast open-source audio feature extractor. In Proceedings of the 18th ACM international conference on Multimedia. 1459–1462.Google ScholarDigital Library
- FIFINE. 2022. FIFINE Lapel Microphone.Google Scholar
- Esther Foo and Brad Holschuh. 2018. Dynamic Compression in Affective Haptics. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 577–583.Google ScholarDigital Library
- Jürgen Gepperth. 2012. Smart things: Wearables & clothing. Smart Things 3, 2012 (2012), 41–48.Google Scholar
- Giorgos Giannakakis, Dimitris Grigoriadis, Katerina Giannakaki, Olympia Simantiraki, Alexandros Roniotis, and Manolis Tsiknakis. 2019. Review on psychological stress detection using biosignals. IEEE Transactions on Affective Computing(2019).Google ScholarCross Ref
- Jeffrey M Girard. 2014. CARMA: Software for continuous affect rating and media annotation. Journal of open research software 2, 1 (2014).Google Scholar
- Stephanie P Goldstein, Brittney C Evans, Daniel Flack, Adrienne Juarascio, Stephanie Manasse, Fengqing Zhang, and Evan M Forman. 2017. Return of the JITAI: applying a just-in-time adaptive intervention framework to the development of m-health solutions for addictive behaviors. International journal of behavioral medicine 24, 5 (2017), 673–682.Google ScholarCross Ref
- Matthew S Goodwin, Carla A Mazefsky, Stratis Ioannidis, Deniz Erdogmus, and Matthew Siegel. 2019. Predicting aggression to others in youth with autism using a wearable biosensor. Autism research 12, 8 (2019), 1286–1296.Google Scholar
- John HL Hansen and Sanjay Patil. 2007. Speech under stress: Analysis, modeling and recognition. In Speaker classification I. Springer, 108–137.Google Scholar
- Victoria Hollis, Alon Pekurovsky, Eunika Wu, and Steve Whittaker. 2018. On being told how we feel: how algorithmic sensor feedback influences emotion perception. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1–31.Google ScholarDigital Library
- Esther Howe, Jina Suh, Mehrab Bin Morshed, Daniel McDuff, Kael Rowan, Javier Hernandez, Marah Ihab Abdin, Gonzalo Ramos, Tracy Tran, and Mary Czerwinski. 2022. Design of Digital Workplace Stress-Reduction Intervention Systems: Effects of Intervention Type and Timing. In CHI 2022. https://www.microsoft.com/en-us/research/publication/design-of-digital-workplace-stress-reduction-intervention-systems-effects-of-intervention-type-and-timing/Google Scholar
- Heidi Johansen-Berg, Donna M Lloyd, 2000. The physiology and psychology of selective attention to touch. Front Biosci 5(2000), D894–D904.Google ScholarCross Ref
- Oliver P John, Sanjay Srivastava, 1999. The Big-Five trait taxonomy: History, measurement, and theoretical perspectives. Vol. 2. University of California Berkeley.Google Scholar
- John R Johnson and Nancy Szczupakiewicz. 1987. The public speaking course: Is it preparing students with work related public speaking skills?Communication Education 36, 2 (1987), 131–137.Google Scholar
- Christos D Katsis, Nikolaos S Katertsidis, and Dimitrios I Fotiadis. 2011. An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders. Biomedical Signal Processing and Control 6, 3 (2011), 261–268.Google ScholarCross Ref
- Everlyne Kimani, Timothy Bickmore, Ha Trinh, and Paola Pedrelli. 2019. You’ll be great: Virtual agent-based cognitive restructuring to reduce public speaking anxiety. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 641–647.Google ScholarCross Ref
- Paul E King, Melissa J Young, and Ralph R Behnke. 2000. Public speaking performance improvement as a function of information processing in immediate and delayed feedback interventions. Communication Education 49, 4 (2000), 365–374.Google ScholarCross Ref
- Sander L Koole and Klaus Rothermund. 2011. “I feel better but I don’t know why”: The psychology of implicit emotion regulation. Cognition and Emotion 25, 3 (2011), 389–399.Google ScholarCross Ref
- Alain B Labrique, Lavanya Vasudevan, Erica Kochi, Robert Fabricant, and Garrett Mehl. 2013. mHealth innovations as health system strengthening tools: 12 common applications and a visual framework. Global health: science and practice 1, 2 (2013), 160–171.Google Scholar
- Mark R Leary. 1983. A brief version of the Fear of Negative Evaluation Scale. Personality and social psychology bulletin 9, 3 (1983), 371–375.Google Scholar
- Philip Leifeld. 2013. texreg: Conversion of Statistical Model Output in R to LaTeX and HTML Tables. Journal of Statistical Software 55, 8 (2013), 1–24. http://dx.doi.org/10.18637/jss.v055.i08Google ScholarCross Ref
- Yun Liu and Siqing Du. 2018. Psychological stress level detection based on electrodermal activity. Behavioural brain research 341 (2018), 50–53.Google Scholar
- Choubeila Maaoui and Alain Pruski. 2010. Emotion recognition through physiological signals for human-machine communication. Cutting Edge Robotics 2010, 317-332 (2010), 11.Google Scholar
- Dominique Makowski, Tam Pham, Zen J Lau, Jan C Brammer, François Lespinasse, Hung Pham, Christopher Schölzel, and SH Annabel Chen. 2021. NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior Research Methods(2021), 1–8.Google Scholar
- Jack Marquez, Jhorman Villanueva, Zeida Solarte, and Alexander Garcia. 2016. IoT in education: Integration of objects with virtual academic communities. In New advances in information systems and technologies. Springer, 201–212.Google Scholar
- James C McCroskey. 1970. Measures of communication-bound anxiety. (1970).Google Scholar
- James C McCroskey. 1993. An introduction to rhetorical communication. Prentice Hall.Google Scholar
- Inbal Nahum-Shani, Shawna N Smith, Bonnie J Spring, Linda M Collins, Katie Witkiewitz, Ambuj Tewari, and Susan A Murphy. 2018. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine 52, 6 (2018), 446–462.Google ScholarCross Ref
- Balu Relaxing Nature. 2017. Beautiful Jellyfish Aquarium for Relaxation in 4K - Sleep Relax Meditation Music 2 Hours Screensaver. https://www.youtube.com/watch?v=95Tc8qIJRuI&ab_channel=Balu-RelaxingNaturein4K.Google Scholar
- Wendy Nilsen, Santosh Kumar, Albert Shar, Carrie Varoquiers, Tisha Wiley, William T Riley, Misha Pavel, and Audie A Atienza. 2012. Advancing the science of mHealth. Journal of health communication 17, sup1 (2012), 5–10.Google Scholar
- Oculus. 2022. Oculus Rift.Google Scholar
- Virtual Orator. 2022. Virtual Orator.Google Scholar
- Maryann E Owens and Deborah C Beidel. 2015. Can virtual reality effectively elicit distress associated with social anxiety disorder?Journal of Psychopathology and Behavioral Assessment 37, 2(2015), 296–305.Google Scholar
- Leo F Parvis. 2001. The importance of communication and public-speaking skills. Journal of Environmental Health 63, 9 (2001), 44–44.Google Scholar
- Mitesh S Patel, David A Asch, and Kevin G Volpp. 2015. Wearable devices as facilitators, not drivers, of health behavior change. Jama 313, 5 (2015), 459–460.Google ScholarCross Ref
- Rosalind W Picard and Jennifer Healey. 1997. Affective wearables. Personal technologies 1, 4 (1997), 231–240.Google Scholar
- Maili Pörhölä. 1997. Trait anxiety, experience, and the public speaking state responses of Finnish university students. Communication research reports 14, 3 (1997), 367–384.Google Scholar
- Halley P Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don’t mind me touching my wrist: a case study of interacting with on-body technology in public. In Proceedings of the 2013 International Symposium on Wearable Computers. 89–96.Google ScholarDigital Library
- Jason Raether. 2022. e4stream.Google Scholar
- Tauhidur Rahman, Mary Czerwinski, Ran Gilad-Bachrach, and Paul Johns. 2016. Predicting" about-to-eat" moments for just-in-time eating intervention. In Proceedings of the 6th International Conference on Digital Health Conference. 141–150.Google ScholarDigital Library
- Jessica Marie Ross and Ramesh Balasubramaniam. 2014. Physical and neural entrainment to rhythm: human sensorimotor coordination across tasks and effector systems. Frontiers in human neuroscience 8 (2014), 576.Google Scholar
- Lizawati Salahuddin, Jaegeol Cho, Myeong Gi Jeong, and Desok Kim. 2007. Ultra short term analysis of heart rate variability for monitoring mental stress in mobile settings. In 2007 29th annual international conference of the ieee engineering in medicine and biology society. IEEE, 4656–4659.Google Scholar
- Björn Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini, 2016. The interspeech 2016 computational paralinguistics challenge: Deception, sincerity & native language. In 17TH Annual Conference of the International Speech Communication Association (Interspeech 2016), Vols 1-5. 2001–2005.Google Scholar
- Fred Shaffer and Jay P Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in public health(2017), 258.Google Scholar
- Matthew Smuck, Charles A Odonkor, Jonathan K Wilt, Nicolas Schmidt, and Michael A Swiernik. 2021. The emerging clinical role of wearables: factors for successful implementation in healthcare. NPJ Digital Medicine 4, 1 (2021), 1–8.Google ScholarCross Ref
- Joshua M Smyth and Kristin E Heron. 2016. Is providing mobile interventions" just-in-time" helpful? An experimental proof of concept study of just-in-time intervention for stress management. In 2016 IEEE Wireless Health (WH). IEEE, 1–7.Google Scholar
- Soundbrenner. 2022. Soundbrenner Pulse.Google Scholar
- Charles D Spielberger. 1983. State-trait anxiety inventory for adults. (1983).Google Scholar
- Muhammad Umair, Corina Sas, Niaz Chalabianloo, and Cem Ersoy. 2021. Exploring personalized vibrotactile and thermal patterns for affect regulation. In Designing Interactive Systems Conference 2021. 891–906.Google Scholar
- Martine Van Puyvelde, Xavier Neyt, Francis McGlone, and Nathalie Pattyn. 2018. Voice stress analysis: a new framework for voice and effort in human performance. Frontiers in psychology 9 (2018), 1994.Google Scholar
- Helene S Wallach, Marilyn P Safir, and Margalit Bar-Zvi. 2009. Virtual reality cognitive behavior therapy for public speaking anxiety: a randomized clinical trial. Behavior modification 33, 3 (2009), 314–338.Google ScholarCross Ref
- Bob G Witmer and Michael J Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence 7, 3 (1998), 225–240.Google ScholarDigital Library
- Megha Yadav, Md Nazmus Sakib, Kexin Feng, Theodora Chaspari, and Amir Behzadan. 2019. Virtual reality interfaces and population-specific models to mitigate public speaking anxiety. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 1–7.Google ScholarCross Ref
- Megha Yadav, Md Nazmus Sakib, Ehsanul Haque Nirjhar, Kexin Feng, Amir Behzadan, and Theodora Chaspari. 2020. Exploring individual differences of public speaking anxiety in real-life and virtual presentations. IEEE Transactions on Affective Computing(2020).Google Scholar
- Zhihong Zhang, Hai Su, Qiang Peng, Qing Yang, and Xiaoshu Cheng. 2011. Exam anxiety induces significant blood pressure and heart rate increase in college students. Clinical and experimental hypertension 33, 5 (2011), 281–286.Google Scholar
Index Terms
- Evaluating Just-In-Time Vibrotactile Feedback for Communication Anxiety
Recommendations
Voluntary facial activations regulate physiological arousal and subjective experiences during virtual social stimulation
Exposure to distressing computer-generated stimuli and feedback of physiological changes during exposure have been effective in the treatment of anxiety disorders (e.g., social phobia). Here we studied voluntary facial activations as a method for ...
Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios
Following the idea of using virtual environments (VEs) as mood induction procedures (MIPs), this study set out to examine whether five different virtual park scenarios would each elicit a specific affective state (i.e., joy, sadness, boredom, anger and ...
WalkingVibe: Reducing Virtual Reality Sickness and Improving Realism while Walking in VR using Unobtrusive Head-mounted Vibrotactile Feedback
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsVirtual Reality (VR) sickness is common with symptoms such as headaches, nausea, and disorientation, and is a major barrier to using VR. We propose WalkingVibe, which applies unobtrusive vibrotactile feedback for VR walking experiences, and also reduces ...
Comments