research-article

Multiplex Vision: Understanding Information Transfer and F-Formation With Extended 2-Way FOV

Authors:

Mark Armstrong,

Keitaro Tsuchiya,

Yun Suen PaiAuthors Info & Claims

VRST '20: Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology

Article No.: 33, Pages 1 - 9

https://doi.org/10.1145/3385956.3418954

Published: 01 November 2020 Publication History

Abstract

Research in sociology shows that effective conversation relates to people’s spatial and orientational relationship, namely the proxemics (distance, eye contact, synchrony) and the F-formation (orientation and arrangement). In this work, we introduce novel conversational paradigms that effects conventional F-formation by introducing the concept of multi-directional conversation. Multiplex Vision is a head-mounted device capable of providing a 360° field-of-view (FOV) and facilitating multi-user interaction multi-directionally, thereby providing novel methods on how people can interact with each other. We propose 3 possible new forms of interactions from our prototype: one-to-one, one-to-many, and many-to-many. To facilitate them, we manipulate 2 key variables, which are the viewing parameter and the display parameter. To gather feedback for our system, we conducted a study to understand information transfer between various modes, as well as a user study on how different proposed paradigms effect conversation. Finally, we discuss present and future use cases that can benefit from our system.

Supplementary Material

MP4 File (a33-armstrong-supplement1.mp4)

Download
19.69 MB

MP4 File (a33-armstrong-supplement2.mp4)

Download
7.18 MB

References

[1]

Jérôme Ardouin, Anatole Lécuyer, Maud Marchal, Clément Riant, and Eric Marchand. 2012. FlyVIZ: a novel display device to provide humans with 360 vision by coupling catadioptric camera with hmd. In Proceedings of the 18th ACM symposium on Virtual reality software and technology. 41–44.

Digital Library

[2]

Liwei Chan and Kouta Minamizawa. 2017. FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–5.

Digital Library

[3]

Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Multi-view proxemics: distance and position sensitive interaction. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays. 1–6.

Digital Library

[4]

Kevin Fan, Jochen Huber, Suranga Nanayakkara, and Masahiko Inami. 2014. SpiderVision: extending the human field of view for augmented awareness. In Proceedings of the 5th Augmented Human International Conference. 1–8.

Digital Library

[5]

Tian Gan, Yongkang Wong, Daqing Zhang, and Mohan S Kankanhalli. 2013. Temporal encoded F-formation system for social interaction detection. In Proceedings of the 21st ACM international conference on Multimedia. 937–946.

Digital Library

[6]

Maia Garau, Mel Slater, Simon Bee, and Martina Angela Sasse. 2001. The Impact of Eye Gaze on Communication Using Humanoid Avatars. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’01). Association for Computing Machinery, New York, NY, USA, 309–316. https://doi.org/10.1145/365024.365121

Digital Library

[7]

Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The Impact of Avatar Realism and Eye Gaze Control on Perceived Quality of Communication in a Shared Immersive Virtual Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 529–536. https://doi.org/10.1145/642611.642703

Digital Library

[8]

Jens Emil Grønbundefinedk, Christine Linding, Anders Kromann, Thomas Fly Hylddal Jensen, and Marianne Graves Petersen. 2019. Proxemics Play: Exploring the Interplay between Mobile Devices and Interiors. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (San Diego, CA, USA) (DIS ’19 Companion). Association for Computing Machinery, New York, NY, USA, 177–181. https://doi.org/10.1145/3301019.3323886

Digital Library

[9]

Uwe Gruenefeld, Tim Claudius Stratmann, Lars Prädel, and Wilko Heuten. 2018. MonoculAR: a radial light display to point towards out-of-view objects on augmented reality devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. 16–22.

Digital Library

[10]

Jan Gugenheimer, Evgeny Stemasov, Harpreet Sareen, and Enrico Rukzio. 2018. FaceDisplay: towards asymmetric multi-user interaction for nomadic virtual reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[11]

Edward T Hall. 1963. A system for the notation of proxemic behavior. American anthropologist 65, 5 (1963), 1003–1026.

[12]

Hooman Hedayati, Daniel Szafir, and Sean Andrist. 2019. Recognizing F-formations in the open world. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 558–559.

[13]

Hayley Hung and Ben Kröse. 2011. Detecting f-formations as dominant sets. In Proceedings of the 13th international conference on multimodal interfaces. 231–238.

Digital Library

[14]

Shunichi Kasahara, Mitsuhito Ando, Kiyoshi Suganuma, and Jun Rekimoto. 2016. Parallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing. In ACM SIGGRAPH 2016 VR Village (Anaheim, California) (SIGGRAPH ’16). Association for Computing Machinery, New York, NY, USA, Article 16, 2 pages. https://doi.org/10.1145/2929490.2929495

Digital Library

[15]

Adam Kendon. 1990. Conducting interaction: Patterns of behavior in focused encounters. Vol. 7. CUP Archive.

[16]

Feng Liang, Stevanus Kevin, Kai Kunze, and Yun Suen Pai. 2019. PanoFlex: Adaptive panoramic vision to accommodate 360° Field-of-view for humans. In 25th ACM Symposium on Virtual Reality Software and Technology. 1–2.

Digital Library

[17]

Christian Mai, Lukas Rambold, and Mohamed Khamis. 2017. TransparentHMD: revealing the HMD user’s face to bystanders. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. 515–520.

Digital Library

[18]

Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 13–22.

Digital Library

[19]

Paul Marshall, Yvonne Rogers, and Nadia Pantidi. 2011. Using F-formations to analyse spatial patterns of interaction in physical environments. In Proceedings of the ACM 2011 conference on Computer supported cooperative work. 445–454.

Digital Library

[20]

Kana Misawa and Jun Rekimoto. 2015. Chameleonmask: Embodied physical and social telepresence using human surrogates. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. 401–411.

Digital Library

[21]

Florian Mueller, Sophie Stellmach, Saul Greenberg, Andreas Dippon, Susanne Boll, Jayden Garner, Rohit Khot, Amani Naseem, and David Altimira. 2014. Proxemics Play: Understanding Proxemics for Designing Digital Play Experiences. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 533–542. https://doi.org/10.1145/2598510.2598532

Digital Library

[22]

Jonathan Mumm and Bilge Mutlu. 2011. Human-Robot Proxemics: Physical and Psychological Distancing in Human-Robot Interaction. In Proceedings of the 6th International Conference on Human-Robot Interaction (Lausanne, Switzerland) (HRI ’11). Association for Computing Machinery, New York, NY, USA, 331–338. https://doi.org/10.1145/1957656.1957786

Digital Library

[23]

Jason Orlosky, Qifan Wu, Kiyoshi Kiyokawa, Haruo Takemura, and Christian Nitschke. 2014. Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 54–61.

Digital Library

[24]

Yun Suen Pai, Benjamin I Outram, Benjamin Tag, Megumi Isogai, Daisuke Ochi, and Kai Kunze. 2017. GazeSphere: navigating 360-degree-video environments in VR using head rotation and eye gaze. In ACM SIGGRAPH 2017 Posters. 1–2.

Digital Library

[25]

Magdalena Rychlowska, Leah Zinner, Serban C Musca, and Paula M Niedenthal. 2012. From the eye to the heart: eye contact triggers emotion simulation. In Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction. 1–7.

Digital Library

[26]

Lichao Shen, MHD Yamen Saraji, Kai Kunze, and Kouta Minamizawa. 2018. Unconstrained neck: Omnidirectional observation from an extra robotic neck. In Proceedings of the 9th Augmented Human International Conference. 1–2.

Digital Library

[27]

Dana Tokmurzina, Nurbolat Sagitzhan, Abzal Nurgaliyev, and Anara Sandygulova. 2018. Exploring Child-Robot Proxemics. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (Chicago, IL, USA) (HRI ’18). Association for Computing Machinery, New York, NY, USA, 257–258. https://doi.org/10.1145/3173386.3177083

Digital Library

[28]

Pamela Whitten, Debra J Ford, Nancy Davis, Renee Speicher, and Bart Collins. 1998. Comparison of face-to-face versus interactive video continuing medical education delivery modalities. Journal of Continuing Education in the Health Professions 18, 2(1998), 93–99.

[29]

Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. 143–146.

Digital Library

[30]

Katrin Wolf and Lars Lischke. 2014. Urban proxemics for public guidance. In Proceedings of the NordiCHI Workshop on Ubicomp beyond Devices: People, Objects, Space and Meaning, ACM, Vol. 10. 2639189–2654842.

[31]

Dingding Zheng, Laura Lugaresi, George Chernyshov, Benjamin Tag, Masa Inakage, and Kai Kunze. 2017. Wearable aura: an interactive projection on personal space to enhance communication. In Proceedings of the 2017 ACM UbiComp Adjunct. 141–144.

Digital Library

Cited By

Teo TSakurada KSugimoto M(2023)Exploring Enhancements towards Gaze Oriented Parallel Views in Immersive Tasks2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00077(620-630)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00077
Schjerlund JHornbæk KBergström J(2022)OVRlap: Perceiving Multiple Locations Simultaneously to Improve Interaction in VRProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501873(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501873

Recommendations

Using F-formations to analyse spatial patterns of interaction in physical environments
CSCW '11: Proceedings of the ACM 2011 conference on Computer supported cooperative work

There are few conceptual tools available to analyse physical spaces in terms of their support for social interactions and their potential for technological augmentation. In this paper, we describe how we used Adam Kendon's characterisation of the F-...
Head-mounted Displays, Smartphones, or Smartwatches? -- Augmenting Conversations with Digital Representation of Self

Technologies that augment face-to-face interactions with a digital sense of self have been used to support conversations. That work has employed one homogenous technology, either 'off-the-shelf' or with a bespoke prototype, across all participants. ...
ChromaGlasses: Computational Glasses for Compensating Colour Blindness
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Prescription glasses are used by many people as a simple, and even fashionable way, to correct refractive problems of the eye. However, there are other visual impairments that cannot be treated with an optical lens in conventional glasses. In this work ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '20: Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology

November 2020

429 pages

ISBN:9781450376198

DOI:10.1145/3385956

Editors:
Robert J. Teather
Carleton University, Canada
,
Chris Joslin
Carleton University, Canada
,
Wolfgang Stuerzlinger
Simon Fraser University, Canada
,
Pablo Figueroa
Universidad de los Andes, Colombia
,
Yaoping Hu
University of Calgary, Canada
,
Anil Ufuk Batmaz
Simon Fraser University, Canada
,
Wonsook Lee
University of Ottawa, Canada
,
Francisco Ortega
Colorado State University, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRST '20

Sponsor:

VRST '20: 26th ACM Symposium on Virtual Reality Software and Technology

November 1 - 4, 2020

Virtual Event, Canada

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
289
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)16

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Teo TSakurada KSugimoto M(2023)Exploring Enhancements towards Gaze Oriented Parallel Views in Immersive Tasks2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00077(620-630)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00077
Schjerlund JHornbæk KBergström J(2022)OVRlap: Perceiving Multiple Locations Simultaneously to Improve Interaction in VRProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501873(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501873

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten