skip to main content
research-article

SeatmateVR: Proxemic Cues for Close Bystander-Awareness in Virtual Reality

Published: 01 November 2023 Publication History

Abstract

Prior research explored ways to alert virtual reality users of bystanders entering the play area from afar. However, in confined social settings like sharing a couch with seatmates, bystanders' proxemic cues, such as distance, are limited during interruptions, posing challenges for proxemic-aware systems. To address this, we investigated three visualizations, using a 2D animoji, a fully-rendered avatar, and their combination, to gradually share bystanders' orientation and location during interruptions. In a user study (N=22), participants played virtual reality games while responding to questions from their seatmates. We found that the avatar preserved game experiences yet did not support the fast identification of seatmates as the animoji did. Instead, users preferred the mixed visualization, where they found the seatmate's orientation cues instantly in their view and were gradually guided to the person's actual location. We discuss implications for fine-grained proxemic-aware virtual reality systems to support interaction in constrained social spaces.

Supplementary Material

Auxiliary Archive (iss23main-p8745-p-archive.zip)
This is a video figure of our accepted paper at ISS 2023.

References

[1]
Jonas Auda, Uwe Gruenefeld, Sarah Faltaous, Sven Mayer, and Stefan Schneegass. 2023. A Scoping Survey on Cross-Reality Systems. ACM Comput. Surv. (sep 2023 ). https://doi.org/10.1145/3616536
[2]
Jeremy N Bailenson, Jim Blascovich, Andrew C Beall, and Jack M Loomis. 2003. Interpersonal distance in immersive virtual environments. Personality and social psychology bulletin 29, 7 ( 2003 ), 819-833. https://doi.org/10.1177/ 0146167203029007002
[3]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS '10). Association for Computing Machinery, New York, NY, USA, 121-130. https://doi.org/10.1145/ 1936652.1936676
[4]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 ( 2006 ), 77-101. https://doi.org/10.1191/1478088706qp063oa
[5]
Liwei Chan and Kouta Minamizawa. 2017. FrontFace: Facilitating Communication between HMD Users and Outsiders Using Front-Facing-Screen HMDs. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) ( MobileHCI '17). Association for Computing Machinery, New York, NY, USA, Article 22, 5 pages. https://doi.org/10.1145/3098279.3098548
[6]
Yann Coello and Alice Cartaud. 2021. The interrelation between peripersonal action space and interpersonal social space: psychophysiological evidence and clinical implications. Frontiers in Human Neuroscience 15 ( 2021 ), 636124. https://doi.org/10.3389/fnhum. 2021.636124
[7]
Mark Cook. 1970. Experiments on orientation and proxemics. Human Relations 23, 1 ( 1970 ), 61-76.
[8]
Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz Studies: Why and How. ( 1993 ), 193-200. https://doi.org/10.1145/169891.169968
[9]
Tom Alexander Garner, Wendy Powell, and Vaughan Powell. 2018. Everyday Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1-9. https://doi.org/10.1007/978-3-319-08234-9_259-1
[10]
Ceenu George, Julia Schwuchow, and Heinrich Hussmann. 2019. Fearing Disengagement from the Real World. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) ( VRST '19). Association for Computing Machinery, New York, NY, USA, Article 8, 5 pages. https://doi.org/10.1145/3359996. 3364273
[11]
Ceenu George, Patrick Tamunjoh, and Heinrich Hussmann. 2020. Invisible Boundaries for VR: Auditory and Haptic Signals as Indicators for Real World Boundaries. IEEE Trans. Vis. Comput. Graph. 26, 12 (Dec. 2020 ), 3414-3422. https://doi.org/10.1109/TVCG. 2020.3023607
[12]
Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions 18, 1 (jan 2011 ), 42-50. https://doi.org/10.1145/1897239.1897250
[13]
Uwe Gruenefeld, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. Beyond Halo and Wedge: Visualizing out-of-View Objects on Head-Mounted Virtual and Augmented Reality Devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) ( MobileHCI '18). Association for Computing Machinery, New York, NY, USA, Article 40, 11 pages. https://doi.org/10.1145/3229434. 3229438
[14]
Jan Gugenheimer. 2016. Nomadic Virtual Reality: Exploring New Interaction Concepts for Mobile Virtual Reality Head-Mounted Displays. In Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16 Adjunct). Association for Computing Machinery, New York, NY, USA, 9-12. https://doi.org/10.1145/2984751.2984783
[15]
Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 49-60. https://doi.org/10.1145/2984511.2984576
[16]
Jan Gugenheimer, Christian Mai, Mark McGill, Julie Williamson, Frank Steinicke, and Ken Perlin. 2019. Challenges Using Head-Mounted Displays in Shared and Social Spaces. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA '19). Association for Computing Machinery, New York, NY, USA, 1-8. https://doi.org/10.1145/3290607.3299028
[17]
Jan Gugenheimer, Evgeny Stemasov, Harpreet Sareen, and Enrico Rukzio. 2018. FaceDisplay: Towards Asymmetric Multi-User Interaction for Nomadic Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3173574.3173628
[18]
Edward T. Hall, Ray L. Birdwhistell, Bernhard Bock, Paul Bohannan, A. Richard Diebold, Marshall Durbin, Munro S. Edmonson, J. L. Fischer, Dell Hymes, Solon T. Kimball, Weston La Barre, J. E. McClellan, Donald S. Marshall, G. B. Milner, Harvey B. Sarles, George L Trager, and Andrew P. Vayda. 1968. Proxemics [and Comments and Replies]. Current Anthropology 9, 2 /3 ( 1968 ), 83-108. https://doi.org/10.1086/200975
[19]
Edmund T Hall and Edward Twitchell Hall. 1966. The hidden dimension. Vol. 609. Doubleday, Garden City, NY.
[20]
Wijnand A. IJsselsteijn, Yvonne A. W. de Kort, and Karolien Poels. 2013. The Game Experience Questionnaire. Technische Universiteit Eindhoven, Eindhoven. https://research.tue.nl/nl/publications/the-game-experience-questionnaire
[21]
Adam Kendon. 2010. Spacing and Orientation in Co-present Interaction. Springer Berlin Heidelberg, Berlin, Heidelberg, 1-15. https://doi.org/10.1007/978-3-642-12397-9_1
[22]
Peter Gall Krogh, Marianne Graves Petersen, Kenton O'Hara, and Jens Emil Groenbaek. 2017. Sensitizing Concepts for Socio-Spatial Literacy in HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) ( CHI '17). Association for Computing Machinery, New York, NY, USA, 6449-6460. https: //doi.org/10.1145/3025453.3025756
[23]
Yoshiki Kudo, Anthony Tang, Kazuyuki Fujita, Isamu Endo, Kazuki Takashima, and Yoshifumi Kitamura. 2021. Towards Balancing VR Immersion and Bystander Awareness. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 484 (nov 2021 ), 22 pages. https://doi.org/10.1145/3486950
[24]
Yung-Ta Lin, Yi-Chi Liao, Shan-Yuan Teng, Yi-Ju Chung, Liwei Chan, and Bing-Yu Chen. 2017. Outside-In: Visualizing Out-of-Sight Regions-of-Interest in a 360° Video Using Spatial Picture-in-Picture Previews. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) ( UIST '17). Association for Computing Machinery, New York, NY, USA, 255-265. https://doi.org/10.1145/3126594.3126656
[25]
Matthew R. Longo, Jason Jiri Musil, and Patrick Haggard. 2012. Visuo-tactile Integration in Personal Space. Journal of Cognitive Neuroscience 24, 3 ( 03 2012 ), 543-552. https://doi.org/10.1162/jocn_a_00158
[26]
Nicolai Marquardt and Saul Greenberg. 2015. Proxemic interactions: From theory to practice. Vol. 8. Morgan & Claypool Publishers. 1-199 pages. https://doi.org/10.2200/S00619ED1V01Y201502HCI025
[27]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-Mobility and fFormations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) ( UIST '12). Association for Computing Machinery, New York, NY, USA, 13-22. https://doi.org/10. 1145/2380116.2380121
[28]
Paul Marshall, Yvonne Rogers, and Nadia Pantidi. 2011. Using F-Formations to Analyse Spatial Patterns of Interaction in Physical Environments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (Hangzhou, China) (CSCW '11). Association for Computing Machinery, New York, NY, USA, 445-454. https://doi.org/10.1145/ 1958824.1958893
[29]
Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 2143-2152. https://doi.org/10.1145/2702123.2702382
[30]
Mark McGill, Julie Williamson, Alexander Ng, Frank Pollick, and Stephen Brewster. 2020. Challenges in passenger use of mixed reality headsets in cars and other transportation. Virtual Reality 24, 4 ( 2020 ), 583-603. https://doi.org/10. 1007/s10055-019-00420-x
[31]
Daniel Medeiros, Rafael dos Anjos, Nadia Pantidi, Kun Huang, Maurício Sousa, Craig Anslow, and Joaquim Jorge. 2021. Promoting Reality Awareness in Virtual Reality through Proxemics. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, Lisboa, Portugal, 21-30. https://doi.org/10.1109/VR50410. 2021.00022
[32]
Joseph O'Hagan, Mohamed Khamis, Mark McGill, and Julie R. Williamson. 2022. Exploring Attitudes Towards Increasing User Awareness of Reality From Within Virtual Reality. In ACM International Conference on Interactive Media Experiences (Aveiro, JB, Portugal) (IMX '22). Association for Computing Machinery, New York, NY, USA, 151-160. https://doi.org/10.1145/3505284.3529971
[33]
Joseph O'Hagan and Julie R. Williamson. 2020. Reality Aware VR Headsets. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (Manchester, United Kingdom) (PerDis '20). Association for Computing Machinery, New York, NY, USA, 9-17. https://doi.org/10.1145/3393712.3395334
[34]
Joseph O'Hagan, Julie R. Williamson, and Mohamed Khamis. 2020. Bystander Interruption of VR Users. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (Manchester, United Kingdom) (PerDis '20). Association for Computing Machinery, New York, NY, USA, 19-27. https://doi.org/10.1145/3393712.3395339
[35]
Joseph O'Hagan, Julie R. Williamson, Mohamed Khamis, and Mark McGill. 2022. Exploring Manipulating In-VR Audio To Facilitate Verbal Interactions Between VR Users And Bystanders. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (Frascati, Rome, Italy) ( AVI 2022 ). Association for Computing Machinery, New York, NY, USA, Article 35, 9 pages. https://doi.org/10.1145/3531073.3531079
[36]
François Quesque, Gennaro Ruggiero, Sandra Mouta, J Santos, Tina Iachini, and Yann Coello. 2017. Keeping you at arm's length: modifying peripersonal space influences interpersonal distance. Psychological Research 81, 4 ( 2017 ), 709-720. https://doi.org/10.1007/s00426-016-0782-1
[37]
Maximilian Rettinger, Christoph Schmaderer, and Gerhard Rigoll. 2022. Do You Notice Me? How Bystanders Afect the Cognitive Load in Virtual Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Christchurch, New Zealand, 77-82. https://doi.org/10.1109/VR51125. 2022.00025
[38]
Rufat Rzayev, Sven Mayer, Christian Krauter, and Niels Henze. 2019. Notification in VR: The Efect of Notification Placement, Task and Environment. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Barcelona, Spain) ( CHI PLAY '19). Association for Computing Machinery, New York, NY, USA, 199-211. https: //doi.org/10.1145/3311350.3347190
[39]
Thereza Schmelter and Kristian Hildebrand. 2020. Analysis of interaction spaces for vr in public transport systems. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, Atlanta, GA, USA, 279-280. https://doi.org/10.1109/VRW50115. 2020.00058
[40]
Valentin Schwind, Jens Reinhardt, Rufat Rzayev, Niels Henze, and Katrin Wolf. 2018. Virtual Reality on the Go? A Study on Social Acceptance of VR Glasses. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Barcelona, Spain) (MobileHCI '18). Association for Computing Machinery, New York, NY, USA, 111-118. https://doi.org/10.1145/3236112.3236127
[41]
Mel Slater and Sylvia Wilbur. 1997. A framework for immersive virtual environments five: Speculations on the role of presence in virtual environments. Presence: Teleoper. Virtual Environ. 6, 6 (Dec. 1997 ), 603-616. https: //doi.org/10.1162/pres. 1997. 6.6. 603
[42]
Robert Sommer. 1959. Studies in personal space. Sociometry 22, 3 ( 1959 ), 247-260.
[43]
Julius von Willich, Markus Funk, Florian Müller, Karola Marky, Jan Riemann, and Max Mühlhäuser. 2019. You Invaded My Tracking Space! Using Augmented Virtuality for Spotting Passersby in Room-Scale Virtual Reality. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) ( DIS '19). Association for Computing Machinery, New York, NY, USA, 487-496. https://doi.org/10.1145/3322276.3322334
[44]
Dominik Weber, Alexandra Voit, Jonas Auda, Stefan Schneegass, and Niels Henze. 2018. Snooze! Investigating the User-Defined Deferral of Mobile Notifications. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) ( MobileHCI '18). Association for Computing Machinery, New York, NY, USA, Article 2, 13 pages. https://doi.org/10.1145/3229434.3229436
[45]
Evan James Williams. 1949. Experimental designs balanced for the estimation of residual efects of treatments. Australian Journal of Chemistry 2, 2 ( 1949 ), 149-168. https://doi.org/10.1071/CH9490149
[46]
Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-14. https://doi.org/10.1145/3290605.3300310

Index Terms

  1. SeatmateVR: Proxemic Cues for Close Bystander-Awareness in Virtual Reality

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 7, Issue ISS
    December 2023
    482 pages
    EISSN:2573-0142
    DOI:10.1145/3554314
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 November 2023
    Published in PACMHCI Volume 7, Issue ISS

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. bystander awareness
    2. constrained interaction space
    3. proxemic-aware virtual reality

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 263
      Total Downloads
    • Downloads (Last 12 months)143
    • Downloads (Last 6 weeks)18
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media