Meejin Kim
ABSTRACT
The avatar-mediated 3D telepresence system aims to enable a user in local space to interact with a remote user through a virtual avatar representing the remote user. In this system, the avatar’s movement should convey the meaning of the remote user’s movement to the local space. If the local and remote spaces have different spatial configurations, the remote user’s placement and motion should be adapted to the local space so as to preserve the motion semantics of the remote user. To this end, this paper presents a method to generate the placement and deictic gestures of the avatar. First, we develop a method to predict the probability of the avatar’s placement in the local space according to the placement of the remote user. From this, we find the optimal placement of the avatar given the configuration of the local space and the remote user’s placement. Second, we develop a simple yet effective method to retarget the remote user’s deictic gesture to his/her avatar. User study shows that our method improves user engagement and social presence in the tested telepresence scenarios.
- Weidong Huang, Leila Alem, and Franco Tecchia. 2013. HandsIn3D: supporting remote guidance with immersive virtual environments. In IFIP Conference on Human-Computer Interaction. Springer, 70–77.Google Scholar
Cross Ref
- Dongsik Jo, Ki-Hong Kim, and Gerard Jounghyun Kim. 2015. SpaceTime: adaptive control of the teleported avatar for improved AR tele-conference experience. Computer Animation and Virtual Worlds 26, 3-4 (2015), 259–269.Google ScholarDigital Library
- Kangsoo Kim, Divine Maloney, Gerd Bruder, Jeremy N Bailenson, and Gregory F Welch. 2017. The effects of virtual human’s spatial and behavioral coherence with physical objects on social presence in AR. Computer Animation and Virtual Worlds 28, 3-4 (2017), e1771.Google ScholarCross Ref
- Yeonjoon Kim, Hangil Park, Seungbae Bang, and Sung-Hee Lee. 2016. Retargeting human-object interaction to virtual avatars. IEEE transactions on visualization and computer graphics 22, 11(2016), 2405–2412.Google ScholarDigital Library
- Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan, and Bruno Arnaldi. 2016. Vishnu: Virtual immersive support for helping users-an interaction paradigm for collaborative remote guiding in mixed reality. In 3DCVE 2016: International Workshop on Collaborative Virtual Environments. IEEE, 1–5.Google Scholar
- Matthew Lombard, Theresa B Ditton, and Lisa Weinstein. 2009. Measuring presence: the temple presence inventory. In Proceedings of the 12th Annual International Workshop on Presence. 1–15.Google Scholar
- Andrew Maimone and Henry Fuchs. 2012. Real-time volumetric 3D capture of room-sized scenes for telepresence. In 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2012. IEEE, 1–4.Google Scholar
- Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner, and Barbara Tversky. 2015. Virtual replicas for remote assistance in virtual and augmented reality. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 405–415.Google ScholarDigital Library
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 741–754.Google ScholarDigital Library
- Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW ’16). ACM, New York, NY, USA, 1716–1725. https://doi.org/10.1145/2818048.2819965Google ScholarDigital Library
- Franco Tecchia, Leila Alem, and Weidong Huang. 2012. 3D helping hands: a gesture based MR system for remote collaboration. In Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. ACM, 323–328.Google ScholarDigital Library
Recommendations
VROOM: Virtual Robot Overlay for Online Meetings
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsTelepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online ...
Unwinding Rotations Improves User Comfort with Immersive Telepresence Robots
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot InteractionWe propose unwinding the rotations experienced by the user of an immersive telepresence robot to improve comfort and reduce VR sickness of the user. By immersive telepresence we refer to a situation where a 360\textdegree~camera on top of a mobile robot ...
Telepresence: Immersion with the iCub Humanoid Robot and the Oculus Rift
Living Machines 2015: Proceedings of the 4th International Conference on Biomimetic and Biohybrid Systems - Volume 9222In this paper we present an architecture for the study of telepresence and human-robot interaction. The telepresence system uses the visual and gaze control systems of the iCub humanoid robot coupled with the Oculus Rift virtual reality system. The ...
Comments