skip to main content
10.1145/3152771.3152783acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
research-article

Exploring the design space for multi-sensory heart rate feedback in immersive virtual reality

Published:28 November 2017Publication History

ABSTRACT

Virtual Reality (VR) interfaces have been shown to be able to trigger different emotions in users. However, earlier VR interfaces did not provide users with their own heart rate feedback and the effect of such a feedback on overall experience has not been investigated. In this research, we investigated whether providing heart rate feedback enhanced the participant's experience of using VR and we explored the design space of different types of multi-sensory heart rate representations. Through a within-subjects study, and using subjective measurements, we found that participants enjoyed seeing their heart rate feedback when experiencing VR environments. From the different types of heart-rate representations, audio-haptic feedback was the most preferred while visual feedback was reported as being distracting. We report on the implications of this for designing VR experiences and directions for future research1.

References

  1. R. M. Banos, C. Botella, M. Alcaniz, V. Liano, B. Guerrero and B. Rey. 2004. Immersion and Emotion: Their Impact on the Sense of Presence. Cyberpsychology & behavior : the impact of the Internet, multimedia and virtual reality on behavior and society 7, 6, 734--741.Google ScholarGoogle Scholar
  2. R. M. Banos, C. Botella, I. Rubio, S. Quero, A. Garcia-Palacios and M. Alcaniz. 2008. Presence and Emotions in Virtual Environments: The Influence of Stereoscopy. Cyberpsychology & behavior : the impact of the Internet, multimedia and virtual reality on behavior and society 11, 1, 1--8.Google ScholarGoogle Scholar
  3. Guillermo Bernal and Pattie Maes. 2017. Emotional Beasts: Visually Expressing Emotions through Avatars in Vr. In Proceedings of Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, Denver, Colorado, USA, 2395--2402. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. M. Bradley and P. J. Lang. 1994. Measuring Emotion: The Self-Assessment Manikin and the Semantic Differential. Journal of behavior therapy and experimental psychiatry 25, 1, 49--59.Google ScholarGoogle ScholarCross RefCross Ref
  5. Lennard Chua, Jeremy Goh, Zin Tun Nay, Lihui Huang, Yiyu Cai and Ruby Seah. 2017. Ict-Enabled Emotional Learning for Special Needs Education. In Simulation and Serious Games for Education, Yiyu Cai et al. Eds. Springer Singapore, Singapore, 29-45.Google ScholarGoogle Scholar
  6. J. R. Crawford and J. D. Henry. 2004. The Positive and Negative Affect Schedule (Panas): Construct Validity, Measurement Properties and Normative Data in a Large Non-Clinical Sample. Br J Clin Psychol 43, Pt 3, 245--265.Google ScholarGoogle ScholarCross RefCross Ref
  7. Arindam Dey, Thammathip Piumsomboon, Youngho Lee and Mark Billinghurst. 2017. Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay. In Proceedings of Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver, Colorado, USA, 4045--4056. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Felnhofer, O. D. Kothgassner, T. Hetterle, L. Beutl, H. Hlavacs and I. Kryspin-Exner. 2014. Afraid to Be There? Evaluating the Relation between Presence, Self-Reported Anxiety, and Heart Rate in a Virtual Public Speaking Task. Cyberpsychology, behavior and social networking 17, 5, 310--316.Google ScholarGoogle Scholar
  9. Anna Felnhofer, Oswald D. Kothgassner, Mareike Schmidt, Anna-Katharina Heinzle, Leon Beutl, Helmut Hlavacs and Ilse Kryspin-Exner. 2015. Is Virtual Reality Emotionally Arousing? Investigating Five Emotion Inducing Virtual Park Scenarios. International Journal of Human-Computer Studies 82, 48--56. http://dx.doi.org/ Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. M. Feng, A. Dey and R. W. Lindeman. Year. An Initial Exploration of a Multi-Sensory Design Space: Tactile Support for Walking in Immersive Virtual Environments. In Proceedings of 2016 IEEE Symposium on 3D User Interfaces (3DUI). 95--104.Google ScholarGoogle Scholar
  11. Lina Gega. 2017. The Virtues of Virtual Reality in Exposure Therapy. The British Journal of Psychiatry 210, 4, 245--246.Google ScholarGoogle ScholarCross RefCross Ref
  12. L. J. Gerry. 2017. Paint with Me: Stimulating Creativity and Empathy While Painting with a Painter in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4, 1418--1426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. HTC. 2017. Vive. Retrieved August, 2017 from https://www.vive.com/au/.Google ScholarGoogle Scholar
  14. Pupil Labs. 2017. Platform for Eye Tracking and Egocentric Vision Research. Retrieved August, 2017 from https://pupil-labs.com/pupil/.Google ScholarGoogle Scholar
  15. Jih-Hsuan Tammy Lin. 2017. Fear in Virtual Reality (Vr): Fear Elements, Coping Reactions, Immediate and Next-Day Fright Responses toward a Survival Horror Zombie Virtual Reality Game. Computers in Human Behavior 72, 350--361. http://dx.doi.org/ Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. E. Muñoz, T. Paulino, H. Vasanth and K. Baras. Year. Physiovr: A Novel Mobile Virtual Reality Framework for Physiological Computing. In Proceedings of 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom). 1--6.Google ScholarGoogle Scholar
  17. Pedro A. Nogueira, Vasco Torres, Rui Rodrigues, Eugénio Oliveira and Lennart E. Nacke. 2016. Vanishing Scares: Biofeedback Modulation of Affective Player Experiences in a Procedural Horror Game. Journal on Multimodal User Interfaces 10, 1, 31--62.Google ScholarGoogle ScholarCross RefCross Ref
  18. Polar. 2017. H7 Heart Rate Sensor. Retrieved August, 2017 from https://www.polar.com/au-en/products/accessories/H7_heart_rate_sensor.Google ScholarGoogle Scholar
  19. Mariano Alcañiz Raya, Rosa María Baños, Cristina Botella and Beatriz Rey. 2003. The Emma Project: Emotions as a Determinant of Presence. PsychNology Journal 1, 2, 141--150.Google ScholarGoogle Scholar
  20. G. Riva, F. Mantovani, C. S. Capideville, A. Preziosa, F. Morganti, D. Villani, A. Gaggioli, C. Botella and M. Alcaniz. 2007. Affective Interactions Using Virtual Reality: The Link between Presence and Emotions. Cyberpsychology & behavior : the impact of the Internet, multimedia and virtual reality on behavior and society 10, 1, 45--56.Google ScholarGoogle Scholar
  21. S. Seinfeld, I. Bergstrom, A. Pomes, J. Arroyo-Palacios, F. Vico, M. Slater and M. V. Sanchez-Vives. 2015. Influence of Music on Anxiety Induced by Fear of Heights in Virtual Reality. Front Psychol 6, 1969.Google ScholarGoogle Scholar
  22. Chiew Seng Sean Tan, Kris Luyten, Jan Van Den Bergh, Johannes Sch, #246, ning and Karin Coninx. 2014. The Role of Physiological Cues During Remote Collaboration. Presence: Teleoper. Virtual Environ. 23, 1, 90--107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ryoko Ueoka, Ali AlMutawa and Hikaru Katsuki. 2016. Emotion Hacking Vr (Eh-Vr): Amplifying Scary Vr Experience by Accelerating Real Heart Rate Using False Vibrotactile Biofeedback. In Proceedings of SIGGRAPH ASIA 2016 Emerging Technologies. ACM, Macau, 1--2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Volante, S. V. Babu, H. Chaturvedi, N. Newsome, E. Ebrahimi, T. Roy, S. B. Daily and T. Fasolino. 2016. Effects of Virtual Human Appearance Fidelity on Emotion Contagion in Affective Inter-Personal Simulations. IEEE Transactions on Visualization and Computer Graphics 22, 4, 1326--1335. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. David Watson, Lee A. Clark and Auke Tellegen. 1988. Development and Validation of Brief Measures of Positive and Negative Affect: The Panas Scales. Journal of Personality and Social Psychology 54, 6, 1063--1070.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Exploring the design space for multi-sensory heart rate feedback in immersive virtual reality

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human Interaction
        November 2017
        678 pages
        ISBN:9781450353793
        DOI:10.1145/3152771

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 28 November 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        OzCHI '17 Paper Acceptance Rate74of157submissions,47%Overall Acceptance Rate362of729submissions,50%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader