abstract

A Mixed Reality Telepresence System for Dissimilar Spaces Using Full-Body Avatar

Authors:

Leonard Yoon,

Dongseok Yang,

Choongho Chung,

Sung-Hee LeeAuthors Info & Claims

SA '20: SIGGRAPH Asia 2020 XR

Article No.: 9, Pages 1 - 2

https://doi.org/10.1145/3415256.3421487

Published: 17 November 2020 Publication History

Get Access

Abstract

We present a novel mixed reality (MR) telepresence system, which enables a local user to interact with a remote user through full-body avatars in their own rooms. If the remote rooms have different size and furniture arrangement, directly applying the user’s motion to the avatar leads to mismatch of placement and deictic gesture. To overcome this problem, we retarget the placement, arm gesture and head movement of the local user to the avatar in remote room to preserve the environment and interaction context of the local user. This allows avatars to utilize real furniture and interact with the local user and shared objects as if they were in the same room.

Supplementary Material

MP4 File (a9-yoon-video.mp4)

Download
127.02 MB

MP4 File (3415256.3421487.mp4)

Presentation video

Download
127.02 MB

References

[1]

Dee Dong. 2017. Solar-System-Unity3D. https://github.com/PatwinchIR/Solar-System-Unity3D.

Google Scholar

[2]

Dongsik Jo, Ki-Hong Kim, and Gerard Jounghyun Kim. 2015. SpaceTime: Adaptive Control of the Teleported Avatar for Improved AR Tele-conference Experience. Comput. Animat. Virtual Worlds 26, 3-4, 259–269. https://doi.org/10.1002/cav.1645

Digital Library

Google Scholar

[3]

Nicolas H. Lehment, Daniel Merget, and Gerhard Rigoll. 2014. Creating automatically aligned consensus realities for AR videoconferencing. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 201–206. https://doi.org/10.1109/ISMAR.2014.6948428

Crossref

Google Scholar

[4]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 741–754.

Digital Library

Google Scholar

[5]

Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW ’16). ACM, New York, NY, USA, 1716–1725. https://doi.org/10.1145/2818048.2819965

Digital Library

Google Scholar

[6]

Spatial.2020. Retrieved May 06, 2020 from http://https://spatial.io/

Google Scholar

[7]

Leonard Yoon, Dongseok Yang, Jaehyun Kim, Choongho Chung, and Sung-Hee Lee. 2020. Placement Retargeting of Virtual Avatars to Dissimilar Indoor Environments. IEEE Transactions on Visualization and Computer Graphics (2020). https://doi.org/10.1109/TVCG.2020.3018458

Crossref

Google Scholar

Cited By

View all

Wong EGrønbæk JVelloso E(2024)The Jamais Vu Effect: Understanding the Fragile Illusion of Co-Presence in Mixed RealityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661574(2227-2246)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661574
Wong ESánchez Esquivel JLeiva GGrønbæk JVelloso E(2024)Practice-informed Patterns for Organising Large Groups in Distributed Mixed Reality CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642502(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642502
Choi SHong SCho KKim CNoh J(2023)Online Avatar Motion Adaptation to Morphologically‐similar SpacesComputer Graphics Forum10.1111/cgf.1474042:2(13-24)Online publication date: 23-May-2023
https://doi.org/10.1111/cgf.14740
Show More Cited By

Recommendations

Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
The presence of an avatar can reduce cybersickness in Virtual Reality
Abstract
Virtual Reality (VR) applications are increasingly being utilized for research, healthcare, and education. Despite their benefits, many VR users report motion sickness-like sensations (cybersickness), such as headache, disorientation, or nausea. ...

Comments

Information & Contributors

Information

Published In

SA '20: SIGGRAPH Asia 2020 XR

December 2020

30 pages

ISBN:9781450381116

DOI:10.1145/3415256

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2020

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

SA '20

Sponsor:

SIGGRAPH

SA '20: SIGGRAPH Asia 2020

December 4 - 13, 2020

Virtual Event, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 119 of 549 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
339
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)7

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wong EGrønbæk JVelloso E(2024)The Jamais Vu Effect: Understanding the Fragile Illusion of Co-Presence in Mixed RealityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661574(2227-2246)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661574
Wong ESánchez Esquivel JLeiva GGrønbæk JVelloso E(2024)Practice-informed Patterns for Organising Large Groups in Distributed Mixed Reality CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642502(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642502
Choi SHong SCho KKim CNoh J(2023)Online Avatar Motion Adaptation to Morphologically‐similar SpacesComputer Graphics Forum10.1111/cgf.1474042:2(13-24)Online publication date: 23-May-2023
https://doi.org/10.1111/cgf.14740
Kang JYang DKim TLee YLee S(2023)Real-time Retargeting of Deictic Motion to Virtual Avatars for Augmented Reality Telepresence2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00104(885-893)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00104
Luo HZhou ZCao TNa YNie JBai RWang D(2023)Evaluation of Vibrotactile Glove and Handheld Controller in a Visuo-Haptic VR Space Station2023 2nd International Conference on Automation, Robotics and Computer Engineering (ICARCE)10.1109/ICARCE59252.2024.10492528(1-6)Online publication date: 14-Dec-2023
https://doi.org/10.1109/ICARCE59252.2024.10492528
Kim DJo D(2022)Effects on Co-Presence of a Virtual Human: A Comparison of Display and Interaction TypesElectronics10.3390/electronics1103036711:3(367)Online publication date: 26-Jan-2022
https://doi.org/10.3390/electronics11030367
Brown GHust JBüttner SPrilla M(2022)The Impact of Varying Resolution and Motion Realism of Avatars in Augmented Reality-Supported, Virtually Co-located Sales ConsultationsProceedings of Mensch und Computer 202210.1145/3543758.3543772(255-264)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543772

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Cited By

Recommendations

Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration

Merging environments for shared spaces in mixed reality

The presence of an avatar can reduce cybersickness in Virtual Reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations