skip to main content
10.1145/3568294.3580043acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
short-paper

Holobot: Hologram based Extended Reality Telepresence Robot

Published: 13 March 2023 Publication History

Abstract

Nowadays, telepresence systems based on the Extended Reality (XR) system are actively developed and used for remote collaboration due to COVID-19. Still, several issues, such as limited traversable space in Virtual Reality (VR) and require all participants to wear head-mounted display (HMD), stop these systems from being used in our daily life. On the other hand, telepresence robots have been used in various fields before the pandemic. However, these robots also have a limitation in that the current form is incapable of delivering non-verbal expressions, which is essential for social interaction. Therefore, we present a Holobot, a telepresence robot based on the XR system. A remote user connects to the Holobot through VR HMDs, and the Holobot augments a virtual avatar that projects users' facial and gesture expressions. We developed a prototype and conducted a simple field test in the exhibition to receive feedback. VR participants enjoyed exploring remote spaces and interacting with each other through Holobot. Furthermore, remote space participants mentioned that a 1:1 scale avatar helped to build co-presence with the VR user. Based on these insights, we think Holobot could provide design guideline for future telepresence robot. For further approach, we plan to improve our prototype and conduct user test for structured evaluation of our system.

Supplementary Material

MP4 File ([HRI23] Holobot presentation.mp4)
HRI 2023 LBW_Holobot: Hologram based Extended Reality Telepresence Robot - Presentation video

References

[1]
Nadine Aburumman, Marco Gillies, Jamie A Ward, and Antonia F de C Hamilton. 2022. Nonverbal communication in virtual reality: Nodding as a social signal in virtual interactions. International Journal of Human-Computer Studies 164 (2022), 102819.
[2]
Henny Admoni and Brian Scassellati. 2017. Social eye gaze in human-robot interaction: a review. Journal of Human-Robot Interaction 6, 1 (2017), 25--63.
[3]
Ashwaq Z Amat, Huan Zhao, Amy Swanson, Amy S Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2021. Design of an interactive virtual reality system, InViRS, for joint attention practice in autistic children. IEEE Transactions on Neural Systems and Rehabilitation Engineering 29 (2021), 1866--1876.
[4]
Lindsey Arnold. 2016. Emobie?: A robot companion for children with anxiety. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 413--414.
[5]
Sung Ho Choi, Kyeong-Beom Park, Dong Hyeon Roh, Jae Yeol Lee, Mustafa Mohammed, Yalda Ghasemi, and Heejin Jeong. 2022. An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robotics and Computer-Integrated Manufacturing 73 (2022), 102258.
[6]
Munjal Desai, Katherine M Tsui, Holly A Yanco, and Chris Uhlik. 2011. Essential features of telepresence robots. In 2011 IEEE Conference on Technologies for Practical Robot Applications. IEEE, 15--20.
[7]
Massimiliano Di Luca, Hasti Seifi, Simon Egan, and Mar Gonzalez-Franco. 2021. Locomotion vault: the extra mile in analyzing vr locomotion techniques. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--10.
[8]
Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence. In Seventh annual international workshop: Presence, Vol. 2004. Universidad Politecnica de Valencia Valencia, Spain.
[9]
Lawrence J Hettinger and Gary E Riccio. 1992. Visually induced motion sickness in virtual environments. Presence: Teleoperators & Virtual Environments 1, 3 (1992), 306--310.
[10]
Kwangmin Jeong, Jihyun Sung, Hae-Sung Lee, Aram Kim, Hyemi Kim, Chanmi Park, Yuin Jeong, JeeHang Lee, and Jinwoo Kim. 2018. Fribo: A social networking robot for increasing social connectedness through sharing daily home activities from living noise data. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. 114--122.
[11]
Allison Jing, Kieran May, Gun Lee, and Mark Billinghurst. 2021. Eye See What You See: Exploring How Bi-Directional Augmented Reality Gaze Visualisation Influences Co-Located Symmetric Collaboration. Frontiers in Virtual Reality 2 (2021), 79.
[12]
Dongsik Jo, Ki-Hong Kim, and Gerard Jounghyun Kim. 2016. Effects of avatar and background representation forms to co-presence in mixed reality (MR) teleconference systems. In SIGGRAPH ASIA 2016 virtual reality meets physical reality: modelling and simulating virtual humans and environments. 1--4.
[13]
Steven Johnson, Irene Rae, Bilge Mutlu, and Leila Takayama. 2015. Can you see me now? How field of view affects collaboration in robotic telepresence. In Proceedings of the 33rd annual acm conference on human factors in computing systems. 2397--2406.
[14]
Mohammad Keshavarzi, Michael Zollhoefer, Allen Y Yang, Patrick Peluse, and Luisa Caldas. 2022. Mutual Scene Synthesis for Mixed Reality Telepresence. arXiv preprint arXiv:2204.00161 (2022).
[15]
Dooyoung Kim, Jae-eun Shin, Jeongmi Lee, and Woontack Woo. 2021. Adjusting Relative Translation Gains According to Space Size in Redirected Walking for Mixed Reality Mutual Space Generation. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 653--660. https://doi.org/10.1109/VR50410.2021.00091
[16]
Jinwook Kim, Kyungwon Baek, and Jinkyu Jang. 2020. Petbe: Projecting a real being onto a social robot using contextual data for a pet monitoring method. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 290--292.
[17]
Iolanda Leite, André Pereira, Samuel Mascarenhas, Carlos Martinho, Rui Prada, and Ana Paiva. 2013. The influence of empathy in human--robot relations. International journal of human-computer studies 71, 3 (2013), 250--260.
[18]
Divine Maloney, Guo Freeman, and Donghee Yvette Wohn. 2020. "Talking without a Voice" Understanding Non-verbal Communication in Social Virtual Reality. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1--25.
[19]
Thammathip Piumsomboon, Gun A Lee, Jonathon D Hart, Barrett Ens, Robert W Lindeman, Bruce H Thomas, and Mark Billinghurst. 2018. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1--13.
[20]
David J Roberts, Allen J Fairchild, Simon P Campion, John O'Hare, Carl M Moore, Rob Aspin, Tobias Duckworth, Paolo Gasparello, and Franco Tecchia. 2015. with you- an experimental end-to-end telepresence system using video-based reconstruction. IEEE Journal of Selected Topics in Signal Processing 9, 3 (2015), 562--574.
[21]
Houssem Saidi, Emmanuel Dubois, and Marcos Serrano. 2021. Holobar: Rapid command execution for head-worn ar exploiting around the field-of-view interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--17.
[22]
Katherine MTsui, Munjal Desai, and Holly A Yanco. 2012. Towards measuring the quality of interaction: communication through telepresence robots. In Proceedings of the workshop on performance metrics for intelligent systems. 101--108.
[23]
Mika Yasuoka, Marko Zivko, Hiroshi Ishiguro, Yuichiro Yoshikawa, and Kazuki Sakai. 2022. Effects of Digital Avatar on Perceived Social Presence and Copresence in Business Meetings Between the Managers and Their Co-workers. In International Conference on Collaboration Technologies and Social Computing. Springer, 83--97.
[24]
Boram Yoon, Hyung-il Kim, Gun A Lee, Mark Billinghurst, and Woontack Woo. 2019. The effect of avatar appearance on social presence in an augmented reality remote collaboration. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 547--556.
[25]
Leonard Yoon, Dongseok Yang, Jaehyun Kim, Choongho Chung, and Sung-Hee Lee. 2020. Placement retargeting of virtual avatars to dissimilar indoor environments. IEEE Transactions on Visualization and Computer Graphics (2020).
[26]
Ghazal Zand, Yuan Ren, and Ahmed Sabbir Arif. 2022. TiltWalker: operating a telepresence robot with one-hand by tilt controls on a smartphone. Proceedings of the ACM on Human-Computer Interaction 6, ISS (2022), 381--406.
[27]
Guangtao Zhang and John Paulin Hansen. 2022. Telepresence Robots for People with Special Needs: A Systematic Review. International Journal of Human--Computer Interaction (2022), 1--17.

Cited By

View all
  • (2024)VR-SSVEPeripheral: Designing Virtual Reality Friendly SSVEP Stimuli using Peripheral Vision Area for Immersive and Comfortable ExperienceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651084(1-7)Online publication date: 11-May-2024
  • (2024)Viewer2Explorer: Designing a Map Interface for Spatial Navigation in Linear 360 Museum Exhibition VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642952(1-15)Online publication date: 11-May-2024
  • (2024)Towards Unlimited Task Coverage and Direct (far-off) Manipulation in eXtended Reality Remote CollaborationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640737(745-749)Online publication date: 11-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
March 2023
612 pages
ISBN:9781450399708
DOI:10.1145/3568294
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 360 camera
  2. augmented reality
  3. copresence
  4. locomotion
  5. social robot
  6. telepresence
  7. virtual reality

Qualifiers

  • Short-paper

Funding Sources

Conference

HRI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)112
  • Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)VR-SSVEPeripheral: Designing Virtual Reality Friendly SSVEP Stimuli using Peripheral Vision Area for Immersive and Comfortable ExperienceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651084(1-7)Online publication date: 11-May-2024
  • (2024)Viewer2Explorer: Designing a Map Interface for Spatial Navigation in Linear 360 Museum Exhibition VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642952(1-15)Online publication date: 11-May-2024
  • (2024)Towards Unlimited Task Coverage and Direct (far-off) Manipulation in eXtended Reality Remote CollaborationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640737(745-749)Online publication date: 11-Mar-2024
  • (2023)An Avatar Robot Overlaid with the 3D Human Model of a Remote Operator2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS55552.2023.10341890(7061-7068)Online publication date: 1-Oct-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media