Yiming Luo
ABSTRACT
This paper addresses the relations between the artifacts, tools, and technologies that we make to fulfill user-centered teleoperations in the cyber-physical environment. We explored the use of a virtual reality (VR) interface based on customized concepts of Worlds-in-Miniature (WiM) to teleoperate unmanned ground vehicles (UGVs). Our designed system supports teleoperators in their interaction with and control of a miniature UGV directly on the miniature map. Both moving and rotating can be done via body motions. Our results showed that the miniature maps and UGV represent a promising framework for VR interfaces.
- Andrew Bluff and Andrew Johnston. 2019. Don’t Panic: Recursive Interactions in a Miniature Metaworld. In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry. 1–9.Google Scholar
Digital Library
- Pierre Bourdieu. 2020. Outline of a Theory of Practice. In The new social theory reader. Routledge, 80–86.Google Scholar
- Junshen Chen, Marc Glover, Chenguang Yang, Chunxu Li, Zhijun Li, and Angelo Cangelosi. 2017. Development of an Immersive Interface for Robot Teleoperation. In Towards Autonomous Robotic Systems, Yang Gao, Saber Fallah, Yaochu Jin, and Constantina Lekakou (Eds.). Springer International Publishing, Cham, 1–15.Google Scholar
- Kurtis Danyluk, Barrett Ens, Bernhard Jenny, and Wesley Willett. 2021a. A Design Space Exploration of Worlds in Miniature. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 122, 15 pages.Google ScholarDigital Library
- Kurtis Danyluk, Barrett Ens, Bernhard Jenny, and Wesley Willett. 2021b. A design space exploration of worlds in miniature. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.Google ScholarDigital Library
- Olaf Diegel, Aparna Badve, Glen Bright, Johan Potgieter, and Sylvester Tlale. 2002. Improved mecanum wheel design for omni-directional robots. In Proc. 2002 Australasian conference on robotics and automation, Auckland. 117–121.Google Scholar
- Christophe Domingues, Mouna Essabbah, Nader Cheaib, Samir Otmane, and Alain Dinis. 2012. Human-Robot-Interfaces based on Mixed Reality for Underwater Robot Teleoperation. IFAC Proceedings Volumes 45, 27 (2012), 212–215. 9th IFAC Conference on Manoeuvring and Control of Marine Craft.Google ScholarCross Ref
- John V. Draper, David B. Kaber, and John M. Usher. 1998. Telepresence. Human Factors 40, 3 (1998), 354–375. PMID: 9849099.Google ScholarCross Ref
- Adam Drogemuller, Andrew Cunningham, James Walsh, Bruce H Thomas, Maxime Cordeil, and William Ross. 2020. Examining virtual reality navigation techniques for 3D network visualisations. Journal of Computer Languages 56 (2020), 100937.Google ScholarCross Ref
- Lisa A Elkin, Matthew Kay, James J Higgins, and Jacob O Wobbrock. 2021. An aligned rank transform procedure for multifactor contrast tests. In The 34th Annual ACM Symposium on User Interface Software and Technology. 754–768.Google ScholarDigital Library
- Mohamed Elobaid, Yue Hu, Giulio Romualdi, Stefano Dafarra, Jan Babic, and Daniele Pucci. 2019. Telexistence and teleoperation for walking humanoid robots. In Proceedings of SAI Intelligent Systems Conference. Springer, 1106–1121.Google Scholar
- Sara Falcone, Gwenn Englebienne, Jan Van Erp, and Dirk Heylen. 2022. Toward Standard Guidelines to Design the Sense of Embodiment in Teleoperation Applications: A Review and Toolbox. Human–Computer Interaction 0, 0 (2022), 1–30.Google Scholar
- Gal Gorjup, Anany Dwivedi, Nathan Elangovan, and Minas Liarokapis. 2019. An intuitive, affordances oriented telemanipulation framework for a dual robot arm hand system: On the execution of bimanual tasks. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 3611–3616.Google ScholarDigital Library
- Simone Grassini, Karin Laumann, and Martin Rasmussen Skogstad. 2020. The Use of Virtual Reality Alone Does Not Promote Training Performance (but Sense of Presence Does). Frontiers in Psychology 11 (2020).Google Scholar
- Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.Google ScholarCross Ref
- Rebecca Hetrick, Nicholas Amerson, Boyoung Kim, Eric Rosen, Ewart J. de Visser, and Elizabeth Phillips. 2020. Comparing Virtual Reality Interfaces for the Teleoperation of Robots. In 2020 Systems and Information Engineering Design Symposium (SIEDS). 1–7.Google Scholar
- Matthias Hirschmanner, Christiana Tsiourti, Timothy Patten, and Markus Vincze. 2019. Virtual reality teleoperation of a humanoid robot using markerless human upper body pose imitation. In 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids). IEEE, 259–265.Google ScholarDigital Library
- Muthukkumar S. Kadavasal and James H. Oliver. 2009. Virtual Reality Interface Design for Multi-Modal Teleoperation(World Conference on Innovative Virtual Reality, Vol. ASME-AFM 2009 World Conference on Innovative Virtual Reality). 169–174.Google Scholar
- Peter Kazanzides, Balazs P Vagvolgyi, Will Pryor, Anton Deguet, Simon Leonard, and Louis L Whitcomb. 2021. Teleoperation and Visualization Interfaces for Remote Intervention in Space. Frontiers in Robotics and AI 8 (2021).Google Scholar
- Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and usability engineering group. Springer, 63–76.Google ScholarDigital Library
- Ziming Li, Yiming Luo, Jialin Wang, Yushan Pan, Lingyun Yu, and Hai-Ning Liang. 2022. Collaborative Remote Control of Unmanned Ground Vehicles in Virtual Reality. In 2022 International Conference on Interactive Media, Smart Systems and Emerging Technologies (IMET). 1–8. https://doi.org/10.1109/IMET54801.2022.9929783Google Scholar
- Yiming Luo, Jialin Wang, Hai-Ning Liang, Shan Luo, and Eng Gee Lim. 2021. Monoscopic vs. Stereoscopic Views and Display Types in the Teleoperation of Unmanned Ground Vehicles for Object Avoidance. In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). IEEE, 418–425.Google Scholar
- Yiming Luo, Jialin Wang, Rongkai Shi, Hai-Ning Liang, and Shan Luo. 2022. In-Device Feedback in Immersive Head-Mounted Displays for Distance Perception During Teleoperation of Unmanned Ground Vehicles. IEEE Transactions on Haptics 15, 1 (2022), 79–84. https://doi.org/10.1109/TOH.2021.3138590Google ScholarCross Ref
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems 77, 12 (1994), 1321–1329.Google Scholar
- Abdeldjallil Naceri, Dario Mazzanti, Joao Bimbo, Yonas T Tefera, Domenico Prattichizzo, Darwin G Caldwell, Leonardo S Mattos, and Nikhil Deshpande. 2021. The Vicarios Virtual Reality Interface for Remote Robotic Teleoperation. Journal of Intelligent & Robotic Systems 101, 4 (2021), 1–16.Google ScholarDigital Library
- Nicolas Nostadt, David A. Abbink, Oliver Christ, and Philipp Beckerle. 2020. Embodiment, Presence, and Their Intersections: Teleoperation and Beyond. J. Hum.-Robot Interact. 9, 4, Article 28 (may 2020), 19 pages.Google ScholarDigital Library
- R. Ott, M. Gutierrez, D. Thalmann, and F. Vexo. 2005. VR haptic interfaces for teleoperation: an evaluation study. In IEEE Proceedings. Intelligent Vehicles Symposium, 2005.789–794.Google Scholar
- Yushan Pan. 2021. Reflexivity of Account, Professional Vision, and Computer-Supported Cooperative Work: Working in the Maritime Domain. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 370 (oct 2021), 32 pages. https://doi.org/10.1145/3479514Google ScholarDigital Library
- Yushan Pan, Arnfinn Oksavik, and Hans Petter Hildre. 2021. Making Sense of Maritime Simulators Use: A Multiple Case Study in Norway. Technology, Knowledge and Learning 26, 3 (2021), 661–686.Google ScholarCross Ref
- Richard Stoakley, Matthew J Conway, and Randy Pausch. 1995. Virtual reality on a WIM: interactive worlds in miniature. In Proceedings of the SIGCHI conference on Human factors in computing systems. 265–272.Google ScholarDigital Library
- Michail Theofanidis, Saif Iftekar Sayed, Alexandros Lioulemes, and Fillia Makedon. 2017. Varm: Using virtual reality to program robotic manipulators. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. 215–221.Google ScholarDigital Library
- Nhan Tran, Josh Rands, and Tom Williams. 2018. A hands-free virtual-reality teleoperation interface for wizard-of-oz control. In Proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI).Google Scholar
- Ramón Trueba, Carlos Andujar, and Ferran Argelaguet. 2009. Complexity and occlusion management for the world-in-miniature metaphor. In International Symposium on Smart Graphics. Springer, 155–166.Google ScholarDigital Library
- Michael E. Walker, Hooman Hedayati, and Daniel Szafir. 2019. Robot Teleoperation with Augmented Reality Virtual Surrogates. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 202–210.Google Scholar
- Xian Wang, Diego Monteiro, Lik-Hang Lee, Pan Hui, and Hai-Ning Liang. 2022. VibroWeight: Simulating Weight and Center of Gravity Changes of Objects in Virtual Reality for Enhanced Realism. In 2022 IEEE Haptics Symposium (HAPTICS). 1–7. https://doi.org/10.1109/HAPTICS52432.2022.9765609Google Scholar
- Chadwick A Wingrave, Yonca Haciahmetoglu, and Doug A Bowman. 2006. Overcoming world in miniature limitations by a scaled and scrolling WIM. In 3D User Interfaces (3DUI’06). IEEE, 11–16.Google Scholar
- Murphy Wonsick and Taşkın Padır. 2021. Human-humanoid robot interaction through virtual reality interfaces. In 2021 IEEE Aerospace Conference (50100). IEEE, 1–7.Google ScholarCross Ref
Index Terms
- Teleoperation of a Fast Omnidirectional Unmanned Ground Vehicle in the Cyber-Physical World via a VR Interface
Recommendations
The Cyber-Physical Control Room: A Mixed Reality Interface for Mobile Robot Teleoperation and Human-Robot Teaming
HRI '24: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot InteractionIn this work, we present the design and evaluation of an immersive Cyber-Physical Control Room interface for remote mobile robots that provides users with both robot-egocentric and robot-exocentric 3D perspectives. We evaluate the Cyber-Physical Control ...
Robot teleoperation with augmented reality virtual surrogates
HRI '19: Proceedings of the 14th ACM/IEEE International Conference on Human-Robot InteractionTeleoperation remains a dominant control paradigm for human interaction with robotic systems. However, teleoperation can be quite challenging, especially for novice users. Even experienced users may face difficulties or inefficiencies when operating a ...
Virtual and Augmented Reality with Head-Tracking for Efficient Teleoperation of Groups of Robots
CW '08: Proceedings of the 2008 International Conference on CyberworldsThis paper deals with the usage of Virtual and Augmented Reality techniques in the field of teleoperation. The global context is a project for collaborative teleoperation of real robots groups. The aim is to enable to a group of teleoprators to control ...
Comments