research-article

The Impact of Remote User’s Role in a Mixed Reality Mixed Presence System

Authors:

Mitchell Norman,

Mark BillingurstAuthors Info & Claims

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Article No.: 2, Pages 1 - 9

https://doi.org/10.1145/3359997.3365691

Published: 14 November 2019 Publication History

Abstract

Research has shown that Mixed Presence (MP) systems are a valuable collaboration tool. However current research into MP systems is limited to a handful of tabletop and Virtual Reality (VR) systems with no exploration of Head-Mounted Display (HMD) based Mixed Reality (MR) solutions. In this paper, we present a prototype HMD based MR Mixed Presence system we designed and developed. We conducted a user study to investigate how different role assignment affects coordination and engagement in a group task with two local users using MR HMDs, and one remote user with a desktop-based Augmented Reality (AR) interface. The results indicated that the role of coordinator significantly increased the remote user’s engagement with increased usage of visual communication cues. This is further supported by the mental effort and perceived dominance reported by users. Feedback from users also indicated visual communication cues are valuable for remote users in MP systems.

References

[1]

Stephan Beck, Andre Kunert, Alexander Kulik, and Bernd Froehlich. 2013. Immersive group-to-group telepresence. IEEE Transactions on Visualization and Computer Graphics 19, 4 (4 2013), 616–625. https://doi.org/10.1109/TVCG.2013.33

Digital Library

[2]

Anastasia Bezerianos, Maxime Cordeil, Todd Margolis, and Mark Billinghurst. 2018. Collaborative Immersive Analytics. 221–257 pages. https://doi.org/10.1007/978-3-030-01388-2_8

[3]

Frank Biocca and Chad Harms. 2002. Defining and Measuring Social Presence - Contribution to the Networked Minds Theory and Measure. In Proceedings of PRESENCE 2002. 1–36. https://doi.org/10.1.1.84.8350

[4]

John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7. https://doi.org/10.1002/hbm.20701

[5]

Barrett Ens, Joel Lanir, Anthony Tang, Scott Bateman, Gun Lee, Thammathip Piumsomboon, and Mark Billinghurst. 2019. Revisiting Collaboration through Mixed Reality: The Evolution of Groupware. International Journal of Human-Computer Studies (5 2019). https://doi.org/10.1016/j.ijhcs.2019.05.011

Digital Library

[6]

Susan R. Fussell, Robert E. Kraut, and Jane Siegel. 2000. Coordination of communication. In Proceedings of the 2000 ACM conference on Computer supported cooperative work - CSCW ’00. ACM Press, New York, New York, USA, 21–30. https://doi.org/10.1145/358916.358947

Digital Library

[7]

Lei Gao, Huidong Bai, Gun Lee, and Mark Billinghurst. 2016. An oriented point-cloud view for MR remote collaboration. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications on - SA ’16. ACM Press, New York, New York, USA, 1–4. https://doi.org/10.1145/2999508.2999531

Digital Library

[8]

Steffen Gauglitz, Cha Lee, Matthew Turk, and Tobias Höllerer. 2012. Integrating the physical environment into mobile remote collaboration. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services - MobileHCI ’12. ACM Press, New York, New York, USA, 241. https://doi.org/10.1145/2371574.2371610

Digital Library

[9]

Steffen Gauglitz, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2014. In touch with the remote world. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology - VRST ’14. ACM Press, New York, New York, USA, 197–205. https://doi.org/10.1145/2671015.2671016

Digital Library

[10]

Kunal Gupta, Gun A. Lee, and Mark Billinghurst. 2016. Do you see what i see? the effect of gaze tracking on task space remote collaboration. IEEE Transactions on Visualization and Computer Graphics 22, 11 (11 2016), 2413–2422. https://doi.org/10.1109/TVCG.2016.2593778

Digital Library

[11]

Peter Hutterer, B.S. Close, and B.H. Thomas. 2006. Supporting Mixed Presence Groupware in Tabletop Applications. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP ’06), Vol. 50. IEEE, 63–70. https://doi.org/10.1109/TABLETOP.2006.30

Digital Library

[12]

Andrew Johnson, Maria Roussos, Jason Leigh, Christina Vasilakis, Craig Barnes, and Thomas Moher. 1998. The NICE project: learning together in a virtual world. In Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180). IEEE Comput. Soc, 176–183. https://doi.org/10.1109/VRAIS.1998.658487

[13]

Shunichi Kasahara, Shohei Nagai, and Jun Rekimoto. 2017. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera. IEEE Transactions on Visualization and Computer Graphics 23, 3(2017), 1222–1234. https://doi.org/10.1109/TVCG.2016.2642947

Digital Library

[14]

Seungwon Kim, Gun Lee, Nobuchika Sakata, and Mark Billinghurst. 2014. Improving co-presence with augmented visual communication cues for sharing experience through video conference. In ISMAR 2014 - IEEE International Symposium on Mixed and Augmented Reality - Science and Technology 2014, Proceedings. IEEE, 83–92. https://doi.org/10.1109/ISMAR.2014.6948412

[15]

Ryohei Komiyama, Takashi Miyaki, and Jun Rekimoto. 2017. JackIn space: Designing a Seamless Transition Between First and Third Person View for Effective Telepresence Collaborations. Proceedings of the 8th Augmented Human International Conference on - AH ’17 (2017), 1–9. https://doi.org/10.1145/3041164.3041183

Digital Library

[16]

Robert E. Kraut, Darren Gergle, and Susan R. Fussell. 2002. The use of visual information in shared visual spaces. Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW ’02 (2002), 31–40. https://doi.org/10.1145/587078.587084

Digital Library

[17]

Hideaki Kuzuoka. 1992. Spatial workspace collaboration. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI ’92. ACM Press, New York, New York, USA, 533–540. https://doi.org/10.1145/142750.142980

Digital Library

[18]

Wallace Lages. 2016. Ray, camera, action! A technique for collaborative 3D manipulation. In 2016 IEEE Symposium on 3D User Interfaces, 3DUI 2016 - Proceedings. IEEE, 281–282. https://doi.org/10.1109/3DUI.2016.7460080

[19]

Gun Lee, Seungwon Kim, Youngho Lee, Arindam Dey, Thammatip Piumsomboon, Mitchell Norman, and Mark Billinghurst. 2017. Improving Collaboration in Augmented Video Conference using Mutually Shared Gaze. In ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments. The Eurographics Association, Adelaide, 197–204. https://doi.org/10.2312/egve.20171359

[20]

Thomas Marrinan, Luc Renambot, Angus Forbes, Steve Jones, and Andrew Johnson. 2017. Mixed Presence Collaboration using Scalable Visualizations in Heterogeneous Display Spaces. Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing(2017), 2236–2245. https://doi.org/10.1145/2998181.2998346

Digital Library

[21]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: a class of displays on the reality-virtuality continuum. In Proceedings Volume 2351, Telemanipulator and Telepresence Technologies, Hari Das (Ed.), Vol. 2351. International Society for Optics and Photonics, 282–292. https://doi.org/10.1117/12.197321

[22]

Marvin Minsky. 1980. Telepresence. OMNI (6 1980). https://web.media.mit.edu/~minsky/papers/Telepresence.html

[23]

Mitchell Norman, Gun Lee, Ross Smith, and Mark Billinghurst. 2019. A Mixed Presence Collaborative Mixed Reality System. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka.

[24]

T. Ohshima, K. Satoh, H. Yamamoto, and H. Tamura. 1998. AR/sup 2/Hockey: a case study of collaborative augmented reality. In Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180). IEEE Comput. Soc, 268–275. https://doi.org/10.1109/VRAIS.1998.658505

[25]

Fred G.W.C. Paas. 1992. Training Strategies for Attaining Transfer of Problem-Solving Skill in Statistics: A Cognitive-Load Approach. Journal of Educational Psychology 84, 4 (1992), 429–434. https://doi.org/10.1037/0022-0663.84.4.429

[26]

Ye Pan, David Sinclair, and Kenny Mitchell. 2018. Empowerment and embodiment for collaborative mixed reality systems. Computer Animation and Virtual Worlds 29, 3-4 (5 2018), e1838. https://doi.org/10.1002/cav.1838

[27]

Thammathip Piumsomboon, Gun A. Lee, Jonathon D. Hart, Barrett Ens, Robert W. Lindeman, Bruce H. Thomas, and Mark Billinghurst. 2018. Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, New York, New York, USA, 1–13. https://doi.org/10.1145/3173574.3173620

Digital Library

[28]

Irene Rae, Gina Venolia, John C. Tang, and David Molnar. 2015. A Framework for Understanding and Designing Telepresence. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW ’15(2015), 1552–1566. https://doi.org/10.1145/2675133.2675141

Digital Library

[29]

Gerhard Reitmayr, Ethan Eade, and Tom W. Drummond. 2007. Semi-automatic Annotations in Unknown Environments. In 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, 1–4. https://doi.org/10.1109/ISMAR.2007.4538827

Digital Library

[30]

Matthew Tait and Mark Billinghurst. 2015. The Effect of View Independence in a Collaborative AR System. Computer Supported Cooperative Work: CSCW: An International Journal 24, 6 (12 2015), 563–589. https://doi.org/10.1007/s10606-015-9231-8

Digital Library

[31]

Anthony Tang, Michael Boyle, and Saul Greenberg. 2004. Understanding and Mitigating Display and Presence Disparity in Mixed Presence Groupware. In Journal of Research and Practice in Information Technology, Vol. 37. 73–82. http://www.hcitang.org/papers/2005-jrpit-tang-display-and-presence-disparity.pdfhttp://portal.acm.org/citation.cfm?id=976310.976320&coll=ACM&dl=GUIDE&CFID=57852429&CFTOKEN=82483745%5Cnhttp://portal.acm.org/ft_gateway.cfm?id=976320&type=pdf&coll=ACM&dl=GU

[32]

Philip Tuddenham and Peter Robinson. 2007. T3: Rapid prototyping of high-resolution and mixed-presence tabletop applications. In Tabletop 2007 - 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems. IEEE, 11–18. https://doi.org/10.1109/TABLETOP.2007.32

[33]

Xiangyu Wang, Peter E.D. Love, Mi Jeong Kim, and Wei Wang. 2014. Mutual awareness in collaborative design: An Augmented Reality integrated telepresence system. Computers in Industry 65, 2 (2014), 314–324. https://doi.org/10.1016/j.compind.2013.11.012

Digital Library

[34]

Shanyang Zhao. 2003. Toward a Taxonomy of Copresence. Presence: Teleoperators and Virtual Environments 12, 5 (10 2003), 445–455. https://doi.org/10.1162/105474603322761261

Digital Library

Cited By

Wang YGong DXiao RWu XZhang H(2024)A Systematic Review on Extended Reality-Mediated Multi-User Social EngagementSystems10.3390/systems1210039612:10(396)Online publication date: 26-Sep-2024
https://doi.org/10.3390/systems12100396
Norman MLee GSmith RBillinghurst M(2024)Avatar and Gaze Cues for Mixed Reality Mixed Presence Groupware2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00163(569-570)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00163
Wang LLi XWu JZhou DSio Kei IPopescu V(2024)AVICol: Adaptive Visual Instruction for Remote Collaboration Using Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.231392041:2(1260-1279)Online publication date: 18-Feb-2024
https://doi.org/10.1080/10447318.2024.2313920
Show More Cited By

Index Terms

The Impact of Remote User’s Role in a Mixed Reality Mixed Presence System

Index terms have been assigned to the content through auto-classification.

Recommendations

Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

A common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

The Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
Headset removal for virtual and mixed reality
SIGGRAPH '17: ACM SIGGRAPH 2017 Talks

Virtual Reality (VR) has advanced significantly in recent years and allows users to explore novel environments (both real and imaginary), play games, and engage with media in a way that is unprecedentedly immersive. However, compared to physical reality,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

November 2019

354 pages

ISBN:9781450370028

DOI:10.1145/3359997

Conference Chairs:
Joaquim Jorge
INESC/ID & Univ Lisboa, Portugal
,
June Kim
University of New South Wales, Australia
,
Herman Van Eyken
Griffith University, Queensland, Australia
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Mashhuda Glencross
University of Queensland, Australia
,
Kenny Mitchell
Disney Research, USA and Edinburgh Napier University, UK
,
Takuji Narumi
University of Tokyo, Japan

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRCAI '19

Sponsor:

SIGGRAPH

VRCAI '19: The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry

November 14 - 16, 2019

QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
633
Total Downloads

Downloads (Last 12 months)122
Downloads (Last 6 weeks)14

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang YGong DXiao RWu XZhang H(2024)A Systematic Review on Extended Reality-Mediated Multi-User Social EngagementSystems10.3390/systems1210039612:10(396)Online publication date: 26-Sep-2024
https://doi.org/10.3390/systems12100396
Norman MLee GSmith RBillinghurst M(2024)Avatar and Gaze Cues for Mixed Reality Mixed Presence Groupware2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00163(569-570)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00163
Wang LLi XWu JZhou DSio Kei IPopescu V(2024)AVICol: Adaptive Visual Instruction for Remote Collaboration Using Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.231392041:2(1260-1279)Online publication date: 18-Feb-2024
https://doi.org/10.1080/10447318.2024.2313920
Haiderzai MVranić VVranić VBrown KYoder JGabriel R(2023)Patterns of Organizing Remote Users with Agile TeamsProceedings of the 30th Conference on Pattern Languages of Programs10.5555/3721041.3721061(1-8)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.5555/3721041.3721061
Yoon BShin JKim HYoung Oh SKim DWoo W(2023)Effects of Avatar Transparency on Social Presence in Task-Centric Mixed Reality Remote CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332025829:11(4578-4588)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320258
Ghamandi RHmaiti YNguyen TGhasemaghaei AKattoju RTaranta ELaViola J(2023)What And How Together: A Taxonomy On 30 Years Of Collaborative Human-Centered XR Tasks2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00047(322-335)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00047
Satkowski MMéndez J(2023)Fantastic Hybrid User Interfaces and How to Define Them2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00057(247-250)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00057
Biener VOfek EPahud MKristensson PGrubert J(2023)Extended Reality for Knowledge Work in Everyday EnvironmentsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_2(21-56)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_2
Otsuki MWang TKuzuoka H(2022)Assessment of Instructor’s Capacity in One-to-Many AR Remote Instruction GivingProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565631(1-5)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565631
Schäfer AReis GStricker D(2022)A Survey on Synchronous Augmented, Virtual, andMixed Reality Remote Collaboration SystemsACM Computing Surveys10.1145/353337655:6(1-27)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3533376
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten