research-article

Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration*

Authors:

Theophilus Teo,

Mark Billinghurst,

Matt AdcockAuthors Info & Claims

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Article No.: 4, Pages 1 - 9

https://doi.org/10.1145/3359997.3365687

Published: 14 November 2019 Publication History

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration*

Pages 1 - 9

Abstract
References

Abstract

In this paper, we investigate the social aspects and effects of various visual cues in a 360 panorama-based Mixed Reality remote collaboration system. We conducted a series of user studies using a prototype system to compare the effects of different combinations of visual cues including hand gestures, ray pointing and drawing in a remote collaborative task. We found that adding ray pointing and drawing can enhance the social aspects of a remote collaborative experience and also can lower the required task mental effort. We discuss the findings and suggest directions for future research.

References

[1]

M. Adcock, D. Ranatunga, R. Smith, and B. H. Thomas, “Object-based touch manipulation for remote guidance of physical tasks,” in Proceedings of the 2nd ACM symposium on Spatial user interaction - SUI ’14, 2014, pp. 113–122.

Digital Library

[2]

S. Gauglitz, B. Nuernberger, M. Turk, and T. Höllerer, “In touch with the remote world,” Proc. 20th ACM Symp. Virtual Real. Softw. Technol. - VRST ’14, pp. 197–205, 2014.

Digital Library

[3]

S. Günther, S. Kratz, D. Avrahami, and M. Mühlhäuser, “Exploring Audio, Visual, and Tactile Cues for Synchronous Remote Assistance,” in Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference on - PETRA ’18, 2018, pp. 339–344.

Digital Library

[4]

C. Harms and F. Biocca, “Internal Consistency and Reliability of the Networked Minds Measure of Social Presence,” Seventh Annu. Int. Work. Presence, no. 2004, pp. 246–251, 2004.

[5]

S. Kasahara and J. Rekimoto, “JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration,” Proc. 21st ACM Symp. Virtual Real. Softw. Technol., vol. 23, no. 3, pp. 217–225, 2015.

Digital Library

[6]

H. Kawasaki, H. Iizuka, S. Okamoto, H. Ando, and T. Maeda, “Collaboration and skill transmission by first-person perspective view sharing system,” Proc. - IEEE Int. Work. Robot Hum. Interact. Commun., pp. 125–131, 2010.

[7]

G. A. Lee, T. Teo, S. Kim, and M. Billinghurst, “A User Study on MR Remote Collaboration Using Live 360 Video,” in2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2018, pp. 153–164.

[8]

G. A. Lee, T. Teo, S. Kim, and M. Billinghurst, “Mixed reality collaboration through sharing a live panorama,” SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications. ACM, Bangkok, Thailand, pp. 1–4, 2017.

Digital Library

[9]

W. W. P. Vorderer, F. R. Gouveia, F. Biocca, T. Saari, F. Jäncke, S. Böcking, H. Schramm, A. Gysbers, T. Hartmann, C. Klimmt, J. Laarni, N. Ravaja, A. Sacau, T. Baumgartner, and P. Jäncke, “MEC Spatial Presence Questionnaire (MEC- SPQ): Short Documentation and Instructions for Application.” 2004.

[10]

T. Piumsomboon, A. Day, B. Ens, Y. Lee, G. Lee, and M. Billinghurst, “Exploring enhancements for remote mixed reality collaboration,” SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications on - SA ’17. ACM, Bangkok, Thailand, pp. 1–5, 2017.

[11]

T. Piumsomboon, G. A. Lee, J. D. Hart, B. Ens, R. W. Lindeman, B. H. Thomas and M. Billinghurst, “Mini-Me,” Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM, Montreal QC, Canada, pp. 1–13, 2018.

Digital Library

[12]

K. Robert, D. Zhu, W. Huang, L. Alem, and T. Gedeon, “MobileHelper,” in SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications on - SA ’13, 2013, pp. 1–5.

Digital Library

[13]

B. Ryskeldiev, M. Cohen, and J. Herder, “Applying rotational tracking and photospherical imagery to immersive mobile telepresence and live video streaming groupware,” in SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications on - SA ’17, 2017, pp. 1–2.

Digital Library

[14]

F. Tecchia, L. Alem, and W. Huang, “3D Helping Hands : a Gesture Based MR System for Remote Collaboration,” VRCAI - Virtual Real. Contin. its Appl. Ind., vol. 1, no. 212, pp. 323–328, 2012.

[15]

T. Teo, G. A. Lee, M. Billinghurst, and M. Adcock, “Hand gestures and visual annotation in live 360 panorama-based mixed reality remote collaboration,” in Proceedings of the 30th Australian Conference on Computer-Human Interaction - OzCHI ’18, 2018, pp. 406–410.

Digital Library

[16]

J. O. Wobbrock, L. Findlater, D. Gergle, and J. J. Higgins, “The aligned rank transform for nonparametric factorial analyses using only anova procedures,” in Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11, 2011, p. 143.

Digital Library

[17]

F. R. H. Zijlstra, “Efficiency in work behaviour: A design approach for modern tools.” 1993.

Cited By

Gutzmann JDossena GWeber VRüdel TPrilla M(2024)Minerva Potenziale und ProduktvisionMinerva Potentials and Product VisionHMD Praxis der Wirtschaftsinformatik10.1365/s40702-024-01120-061:6(1490-1504)Online publication date: 4-Nov-2024
https://doi.org/10.1365/s40702-024-01120-0
Bautista Isaza CEnriquez DMoon HJeon MLee S(2024)Understanding Multi-user, Handheld Mixed Reality for Group-based MR GamesProceedings of the ACM on Human-Computer Interaction10.1145/36536888:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653688
Ghamandi RKattoju RHmaiti YMaslych MTaranta EMcMahan RLaViola J(2024)Unlocking Understanding: An Investigation of Multimodal Communication in Virtual Reality CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642491(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642491
Show More Cited By

Index Terms

Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration*

Index terms have been assigned to the content through auto-classification.

Recommendations

A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Supporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her ...
A Technique for Mixed Reality Remote Collaboration using 360 Panoramas in 3D Reconstructed Scenes
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

Mixed Reality (MR) remote collaboration provides an enhanced immersive experience where a remote user can provide verbal and nonverbal assistance to a local user to increase the efficiency and performance of the collaboration. This is usually achieved ...
Hand gestures and visual annotation in live 360 panorama-based mixed reality remote collaboration
OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human Interaction

In this paper, we investigate hand gestures and visual annotation cues overlaid in a live 360 panorama-based Mixed Reality remote collaboration. The prototype system captures 360 live panorama video of the surroundings of a local user and shares it with ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

November 2019

354 pages

ISBN:9781450370028

DOI:10.1145/3359997

Conference Chairs:
Joaquim Jorge
INESC/ID & Univ Lisboa, Portugal
,
June Kim
University of New South Wales, Australia
,
Herman Van Eyken
Griffith University, Queensland, Australia
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Mashhuda Glencross
University of Queensland, Australia
,
Kenny Mitchell
Disney Research, USA and Edinburgh Napier University, UK
,
Takuji Narumi
University of Tokyo, Japan

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRCAI '19

Sponsor:

SIGGRAPH

VRCAI '19: The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry

November 14 - 16, 2019

QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
805
Total Downloads

Downloads (Last 12 months)126
Downloads (Last 6 weeks)19

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gutzmann JDossena GWeber VRüdel TPrilla M(2024)Minerva Potenziale und ProduktvisionMinerva Potentials and Product VisionHMD Praxis der Wirtschaftsinformatik10.1365/s40702-024-01120-061:6(1490-1504)Online publication date: 4-Nov-2024
https://doi.org/10.1365/s40702-024-01120-0
Bautista Isaza CEnriquez DMoon HJeon MLee S(2024)Understanding Multi-user, Handheld Mixed Reality for Group-based MR GamesProceedings of the ACM on Human-Computer Interaction10.1145/36536888:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653688
Ghamandi RKattoju RHmaiti YMaslych MTaranta EMcMahan RLaViola J(2024)Unlocking Understanding: An Investigation of Multimodal Communication in Virtual Reality CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642491(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642491
Wang LLi XWu JZhou DSio Kei IPopescu V(2024)AVICol: Adaptive Visual Instruction for Remote Collaboration Using Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.231392041:2(1260-1279)Online publication date: 18-Feb-2024
https://doi.org/10.1080/10447318.2024.2313920
Rinnert TWalsh JFleury CCoppin GDuval TThomas B(2023)AR Presentation of Team Members’ Performance and Inner Status to Their Leader: A Comparative StudyApplied Sciences10.3390/app1401012314:1(123)Online publication date: 22-Dec-2023
https://doi.org/10.3390/app14010123
Bailly CCastet J(2023)WIM-Drone: Combining a World-In-Miniature and Micro-Gestures for Teleoperation in Augmented RealityProceedings of the 34th Conference on l'Interaction Humain-Machine10.1145/3583961.3583972(1-11)Online publication date: 3-Apr-2023
https://dl.acm.org/doi/10.1145/3583961.3583972
Faridan MKumari BSuzuki R(2023)ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on ClassroomsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581381(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581381
Zaman FAnslow CChalmers ARhee T(2023)MRMAC: Mixed Reality Multi-user Asymmetric Collaboration2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00074(591-600)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00074
Ghamandi RHmaiti YNguyen TGhasemaghaei AKattoju RTaranta ELaViola J(2023)What And How Together: A Taxonomy On 30 Years Of Collaborative Human-Centered XR Tasks2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00047(322-335)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00047
Chen CZhai W(2023)Effects of visual cue state and type on the mobile user interface of shopping apps with 360° panoramasDisplays10.1016/j.displa.2023.10252580(102525)Online publication date: Dec-2023
https://doi.org/10.1016/j.displa.2023.102525
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten