David Goedicke
Wendy Ju
ABSTRACT
Rerun is a software system to support post-facto analysis in simulation research. In this submission, we show it working inside a multiplayer driving simulator. Rerun is built in Unity 3D and captures the virtual behavior of participants and their interactions with virtual objects. These recorded behaviors can then be played back from any perspective in the virtual space. This is useful in multi-agent interaction studies because researchers can sift through scenarios carefully from each participant's perspective or even from an outside observer's perspective. This enables a fine-grained understanding of implicit and explicit signaling between participants and other human or AI-controlled agents.
Supplemental Material
- Benoit Bideau, Richard Kulpa, Nicolas Vignais, Sébastien Brault, Franck Multon, and Cathy Craig. 2009. Using virtual reality to analyze sports performance. IEEE Computer Graphics and Applications 30, 2 (2009), 14--21.Google Scholar
- Roberta Etzi, Siyuan Huang, Giulia Wally Scurati, Shilei Lyu, Francesco Ferrise, Alberto Gallace, Andrea Gaggioli, Alice Chirico, Marina Carulli, and Monica Bordegoni. 2019. Using virtual reality to test human-robot interaction during a collaborative task. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 59179. American Society of Mechanical Engineers, V001T02A080.Google ScholarCross Ref
- David Goedicke, Carmel Zolkov, Natalie Friedman, Talia Wise, Avi Parush, and Wendy Ju. 2022. Strangers in a Strange Land: New Experimental System for Understanding Driving Culture Using VR. IEEE Transactions on Vehicular Technology 71, 4 (2022), 3399--3413. https://doi.org/10.1109/TVT.2022.3152611Google ScholarCross Ref
- Maxim Kolesnikov, Milos Zefran, Arnold D Steinberg, and Philip G Bashook. 2009. PerioSim: Haptic virtual reality simulator for sensorimotor skill acquisition in dentistry. In 2009 IEEE International Conference on Robotics and Automation. IEEE, 689--694.Google ScholarCross Ref
- Oliver Liu, Daniel Rakita, Bilge Mutlu, and Michael Gleicher. 2017. Understanding human-robot interaction in virtual reality. In 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, 751--757.Google ScholarDigital Library
- Thomas Lopez, Olivier Dumas, Fabien Danieau, Bertrand Leroy, Nicolas Mollet, and Jean-François Vial. 2017. A playback tool for reviewing VR experiences. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1--2.Google ScholarDigital Library
- Gustavo Silvera, Abhijat Biswas, and Henny Admoni. 2022. DReyeVR: Democratizing Virtual Reality Driving Simulation for Behavioural & Interaction Research.. In HRI. 639--643.Google Scholar
- Daniel Szafir. 2019. Mediating human-robot interactions with virtual, augmented, and mixed reality. In International Conference on Human-Computer Interaction. Springer, 124--149.Google ScholarDigital Library
- Tom Williams, Daniel Szafir, Tathagata Chakraborti, Ong Soh Khim, Eric Rosen, Serena Booth, and Thomas Groechel. 2020. Virtual, augmented, and mixed reality for human-robot interaction (vam-hri). In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 663--664.Google ScholarDigital Library
- Hangyu Zhou, Yuichiro Fujimoto, Masayuki Kanbara, and Hirokazu Kato. 2020. Effectiveness of Virtual Reality Playback in Public Speaking Training. In Companion Publication of the 2020 International Conference on Multimodal Interaction. 462--466.Google Scholar
Index Terms
- ReRun: Enabling Multi-Perspective Analysis of Driving Interaction in VR
Recommendations
Rerun: Enabling Multi-Perspective Analysis of Driving Interaction in VR
AutomotiveUI '22: Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsRerun is a software system to support post-facto analysis of driving simulation research. It is built in Unity 3D, and captures virtual driving behavior so that it can be played back. A unique feature of Rerun is that the playback can be rendered from ...
Extending ReRun, Annotating Interactions in VR
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot InteractionIn the rapidly evolving field of autonomous vehicle (AV) technology, virtual reality (VR) simulations have proven to be an effective method in interaction research. This paper addresses the significant gap in existing tools for annotating and analyzing ...
Gender Differences in Simulation Sickness in Static vs. Moving Platform VR Automated Driving Simulation
HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience DesignAbstractSimulation sickness is a condition of physiological discomfort felt during or after exposure to any virtual environment. An immersive virtual environment can be accessed through a head mounted display, which provides the user with an entrance to ...
Comments