Manuel Rebol
Krzysztof Pietroszek
ABSTRACT
We design a volumetric communication system for remote assistance of procedural medical tasks. The system allows a remote expert to spatially guide a local operator using a real-time volumetric representation of the patient. Guidance is provided by voice, virtual hand metaphor, and annotations performed in situ. We include the feedback we received from the medical professionals and early NASA TLX [5] data on the cognitive load of the system.
- 2022. Microsoft Azure Kinect. https://azure.microsoft.com/en-us/services/kinect-dk/#overview.Google Scholar
- 2022. Microsoft Hololens 2. https://www.microsoft.com/en-us/hololens/buy.Google Scholar
- Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, 2021. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14..Google ScholarDigital Library
- Pavel Gurevich, Joel Lanir, Benjamin Cohen, and Ran Stone. 2012. TeleAdvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 619–622..Google ScholarDigital Library
- Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications Sage CA: Los Angeles, CA, 904–908..Google ScholarCross Ref
- D. Mourtzis, V. Zogopoulos, and E. Vlachou. 2017. Augmented Reality Application to Support Remote Maintenance as a Service in the Robotics Industry. Procedia CIRP (2017), 46 – 51..Google Scholar
- Manuel Rebol, Christian Güti, and Krzysztof Pietroszek. 2021. Passing a non-verbal turing test: Evaluatina gesture animations generated from speech. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 573–581..Google Scholar
- Manuel Rebol, Christian Gütl, and Krzysztof Pietroszek. 2021. Real-Time Gesture Animation Generation from Speech for Virtual Human Interaction. Association for Computing Machinery..Google Scholar
- Manuel Rebol, Colton Hood, Claudia Ranniger, Adam Rutenberg, Neal Sikka, Erin Maria Horan, Christian Gütl, and Krzysztof Pietroszek. 2021. Remote Assistance with Mixed Reality for Procedural Tasks. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 653–654. https://doi.org/10.1109/VRW52623.2021.00209.Google Scholar
- G. Suciu, S. Stefanescu, C. Beceanu, and M. Ceaparu. 2020. WebRTC role in real-time communication and video conferencing. In 2020 Global Internet of Things Summit (GIoTS). 1–6..Google Scholar
- S. Wang, M. Parsons, Jordan Stone-McLean, P. Rogers, S. Boyd, K. Hoover, O. Pastor, Minglun Gong, and A. Smith. 2017. Augmented Reality as a Telemedicine Platform for Remote Procedural Training. Sensors (Basel, Switzerland) 17 (2017)..Google Scholar
Recommendations
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality ConferenceIn this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Vision and Graphics in Producing Mixed Reality Worlds
CVVRHC '98: Proceedings of the 1998 Workshop on Computer Vision for Virtual Reality Based Human Communications (CVVRHC '98)This paper introduces prominent topics of our Mixed Reality (MR) project and states what kind of role computer vision and graphics play in the project. MR is a part of VR in broader sense, but it treats the physical space as well as the virtual space ...
Comments