Exploring Immersive Debriefing in Virtual Reality Training: A Comparative Study
Article No.: 37, Pages 1 - 10
Abstract
Simulation and debriefing are two essential and inseparable phases of virtual reality training. With the widespread adoption of these training tools, it is crucial to define the best pedagogical approaches for trainers and learners to maximize their effectiveness. However, despite their educational benefits, virtual reality-specific debriefing methods remain underexplored in research. This article proposes an architecture and interface for an all-in-one immersive debriefing module that is adaptable to different types of training, including a complete system for recording, replaying, and redoing actions. A study with 36 participants compared this immersive debriefing system with traditional discussion-based and video-supported debriefing. Participants were divided into three groups to evaluate the effectiveness of each method. The results showed no significant differences between these debriefing methods across several criteria, such as satisfaction, motivation, or information retention. Immersive debriefing is as usable and retentive as traditional or video debriefing in this context. The next step will be to evaluate the redo system in other training courses involving more dynamic scenarios.
References
[1]
[n. d.]. Intrinsic Motivation Inventory (IMI) – selfdeterminationtheory.org. https://selfdeterminationtheory.org/intrinsic-motivation-inventory/
[2]
2019. Guide méthodologique : simulation en santé et gestion des risque. https://www.has-sante.fr/jcms/c_2905932/fr/guide-methodologique-simulation-en-sante-et-gestion-des-risque
[3]
Vaia T. Abatzis and Keith E. Littlewood. 2015. Debriefing in Simulation and Beyond. International Anesthesiology Clinics 53, 4 (2015), 151–162. https://doi.org/10.1097/AIA.0000000000000070
[4]
Sonal Arora, Maria Ahmed, John Paige, Debra Nestel, Jane Runnacles, Louise Hull, Ara Darzi, and Nick Sevdalis. 2012. Objective Structured Assessment of Debriefing: Bringing Science to the Art of Debriefing in Surgery. Annals of Surgery 256, 6 (Dec. 2012), 982–988. https://doi.org/10.1097/SLA.0b013e3182610c91
[5]
Aaron Bangor. 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. 4, 3 (2009).
[6]
Cynthia Sherraden Bradley and Kristina Thomas Dreifuerst. 2016. Pilot Testing the Debriefing for Meaningful Learning Evaluation Scale. Clinical Simulation in Nursing 12, 7 (July 2016), 277–280. https://doi.org/10.1016/j.ecns.2016.01.008
[7]
Klara Brandstätter and Anthony Steed. 2023. Dialogues For One: Single-User Content Creation Using Immersive Record and Replay. In 29th ACM Symposium on Virtual Reality Software and Technology. ACM, Christchurch New Zealand, 1–11. https://doi.org/10.1145/3611659.3615695
[8]
Marisa Brett-Fleegler, Jenny Rudolph, Walter Eppich, Michael Monuteaux, Eric Fleegler, Adam Cheng, and Robert Simon. 2012. Debriefing Assessment for Simulation in Healthcare: Development and Psychometric Properties. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 7, 5 (Oct. 2012), 288–294. https://doi.org/10.1097/SIH.0b013e3182620228
[9]
Kimberly Dudas and Jana Wheeler. 2020. Faculty Re-enactment Videos as a Tool in Simulation Debriefing. Clinical Simulation in Nursing 40 (March 2020), 25–30. https://doi.org/10.1016/j.ecns.2019.11.007
[10]
Walter Eppich and Adam Cheng. 2015. Promoting Excellence and Reflective Learning in Simulation (PEARLS): Development and Rationale for a Blended Approach to Health Care Simulation Debriefing. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 10, 2 (April 2015), 106–115. https://doi.org/10.1097/SIH.0000000000000072
[11]
Ruth M. Fanning and David M. Gaba. 2007. The Role of Debriefing in Simulation-Based Learning. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 2, 2 (2007), 115–125. https://doi.org/10.1097/SIH.0b013e3180315539
[12]
Roxane Gardner. 2013. Introduction to debriefing. Seminars in Perinatology 37, 3 (June 2013), 166–174. https://doi.org/10.1053/j.semperi.2013.02.008
[13]
Geoffrey Gorisse, Olivier Christmann, and Charlotte Dubosc. 2022. REC: A Unity Tool to Replay, Export and Capture Tracked Movements for 3D and Virtual Reality Applications. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces(AVI 2022). Association for Computing Machinery, New York, NY, USA, 1–3. https://doi.org/10.1145/3531073.3534472
[14]
Guillaume Gronier and Alexandre Baudet. 2021. Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability Scale. International Journal of Human–Computer Interaction 37, 16 (Oct. 2021), 1571–1582. https://doi.org/10.1080/10447318.2021.1898828
[15]
Ramnarayan Paragi Gururaja, Tong Yang, John T. Paige, and Sheila W. Chauvin. 2008. Examining the Effectiveness of Debriefing at the Point of Care in Simulation-Based Operating Room Team Training. In Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools). Agency for Healthcare Research and Quality (US). https://www.ncbi.nlm.nih.gov/books/NBK43676/
[16]
Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9 (Oct. 2006), 904–908. https://doi.org/10.1177/154193120605000909
[17]
Jeffrey Hogue, R. Allen, Jerry MacDonald, Cliff Schmucker, Steve Markham, and Arvid Harmsen. 2001. Virtual reality parachute simulation for training and mission rehearsal. In 16th AIAA Aerodynamic Decelerator Systems Technology Conference and Seminar. American Institute of Aeronautics and Astronautics, Boston,MA,U.S.A.https://doi.org/10.2514/6.2001-2061
[18]
Scott Ronald Howie and Marco Gilardi. 2019. Virtual Observation of Virtual Reality Simulations. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312836
[19]
Charles Javerliat, Sophie Villenave, Pierre Raimbaud, and Guillaume Lavoué. 2024. PLUME: Record, Replay, Analyze and Share User Behavior in 6DoF XR Experiences. IEEE Transactions on Visualization and Computer Graphics 30, 5 (May 2024), 2087–2097. https://doi.org/10.1109/TVCG.2024.3372107
[20]
Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 2019. Simulator Sickness Questionnaire. https://doi.org/10.1037/t04669-000 Institution: American Psychological Association.
[21]
Sang Suk Kim and Jennie C. De Gagne. 2018. Instructor-led vs. peer-led debriefing in preoperative care simulation using standardized patients. Nurse Education Today 71 (Dec. 2018), 34–39. https://doi.org/10.1016/j.nedt.2018.09.001
[22]
Linda Costigan Lederman. 1992. Debriefing: Toward a Systematic Assessment of Theory and Practice. Simulation & Gaming 23, 2 (June 1992), 145–160. https://doi.org/10.1177/1046878192232003
[23]
Thomas Lopez, Olivier Dumas, Fabien Danieau, Bertrand Leroy, Nicolas Mollet, and Jean-François Vial. 2017. A playback tool for reviewing VR experiences. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. ACM, Gothenburg Sweden, 1–2. https://doi.org/10.1145/3139131.3141776
[24]
Guido Makransky, Stefan Borre‐Gude, and Richard E. Mayer. 2019. Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. Journal of Computer Assisted Learning 35, 6 (Dec. 2019), 691–707. https://doi.org/10.1111/jcal.12375
[25]
Peter M Markulis and Daniel R Strang. 2003. A BRIEF ON DEBRIEFING: WHAT IT IS AND WHAT IT ISN’T. 30 (2003), 8.
[26]
Ivette Motola, Luke A. Devine, Hyun Soo Chung, John E. Sullivan, and S. Barry Issenberg. 2013. Simulation in healthcare education: A best evidence practical guide. AMEE Guide No. 82. Medical Teacher 35, 10 (Oct. 2013), e1511–e1530. https://doi.org/10.3109/0142159X.2013.818632
[27]
James Nicholson, Ross Gillespie, Suzanne Bickerdike, Gareth Frith, and Taj Hassan. 2019. OP13 Immersive video for simulation debriefing: ‘record and review’ in 360-degrees using a virtual reality headset. BMJ Simulation and Technology Enhanced Learning 5, Suppl 1 (July 2019). https://doi.org/10.1136/bmjstel-2019-heeconf.13 Number: Suppl 1 Publisher: BMJ Specialist Journals Section: Oral Presentations.
[28]
Sai Akhil Penumudi, Veera Aneesh Kuppam, Jeong Ho Kim, and Jaejin Hwang. 2020. The effects of target location on musculoskeletal load, task performance, and subjective discomfort during virtual reality interactions. Applied Ergonomics 84 (April 2020), 103010. https://doi.org/10.1016/j.apergo.2019.103010
[29]
Jody Piro and Catherine O’Callaghan. 2020. Constructive Destabilization in the Liminal Space: Doing, Debriefing and Deliberating in Mixed Reality Simulations. 21 (Dec. 2020), 178–208.
[30]
Shelly J. Reed. 2012. Debriefing Experience Scale: Development of a Tool to Evaluate the Student Learning Experience in Debriefing. Clinical Simulation in Nursing 8, 6 (July 2012), e211–e217. https://doi.org/10.1016/j.ecns.2011.11.002
[31]
Shelly J. Reed. 2020. Measuring Learning and Engagement during Debriefing: A New Instrument. Clinical Simulation in Nursing 46 (Sept. 2020), 15–21. https://doi.org/10.1016/j.ecns.2020.03.002
[32]
Shelly J. Reed, Claire M. Andrews, and Patricia Ravert. 2013. Debriefing Simulations: Comparison of Debriefing with Video and Debriefing Alone. Clinical Simulation in Nursing 9, 12 (Dec. 2013), e585–e591. https://doi.org/10.1016/j.ecns.2013.05.007
[33]
Georges L. Savoldelli, Viren N. Naik, Jason Park, Hwan S. Joo, Roger Chow, and Stanley J. Hamstra. 2006. Value of Debriefing during Simulated Crisis Management. Anesthesiology 105, 2 (Aug. 2006), 279–285. https://doi.org/10.1097/00000542-200608000-00010
[34]
Taylor Lee Sawyer and Shad Deering. 2013. Adaptation of the US Army’s After-Action Review for Simulation Debriefing in Healthcare. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 8, 6 (Dec. 2013), 388–397. https://doi.org/10.1097/SIH.0b013e31829ac85c
[35]
Jennifer L Saylor, Susan Flannery Wainwright, E Adel Herge, and Ryan T Pohlig. 2017. Development of an Instrument to Assess the Clinical Effectiveness of the Debriefer in Simulation Education. (2017).
[36]
Julia C Seelandt, Bastian Grande, Sarah Kriech, and Michaela Kolbe. 2018. DE-CODE: a coding scheme for assessing debriefing interactions. BMJ Simulation and Technology Enhanced Learning 4, 2 (April 2018), 51–58. https://doi.org/10.1136/bmjstel-2017-000233
[37]
Jon N. Van Heukelom, Tomer Begaz, and Robert Treat. 2010. Comparison of Postsimulation Debriefing Versus In-Simulation Debriefing in Medical Simulation. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 5, 2 (April 2010), 91–97. https://doi.org/10.1097/SIH.0b013e3181be0d17
[38]
Jeanine I.D. Vlasblom, Helena J.M. Pennings, Jelke Van Der Pal, and Esther A.P.B. Oprins. 2020. Competence retention in safety-critical professions: A systematic literature review. Educational Research Review 30 (June 2020), 100330. https://doi.org/10.1016/j.edurev.2020.100330
[39]
Cheng Yao Wang, Mose Sakashita, Upol Ehsan, Jingjin Li, and Andrea Stevenson Won. 2019. RelivelnVR: Capturing and Reliving Virtual Reality Experiences Together. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 1217–1218. https://doi.org/10.1109/VR.2019.8798363
[40]
Séamas Weech, Sophie Kenny, and Michael Barnett-Cowan. 2019. Presence and Cybersickness in Virtual Reality Are Negatively Related: A Review. Frontiers in Psychology 10 (Feb. 2019), 158. https://doi.org/10.3389/fpsyg.2019.00158
Index Terms
- Exploring Immersive Debriefing in Virtual Reality Training: A Comparative Study
Recommendations
Towards an Immersive Debriefing of Serious Games in Virtual Reality: A Framework Concept
Games and Learning AllianceAbstractDebriefing and simulation are two complementary and indivisible phases for the use of serious game. However, practices of debriefing vary depending on the objectives and the context. With the advent of new virtual reality simulations, it is ...
Teaching training in a mixed-reality integrated learning environment
In this mixed-method study, we examined the design and potential impact of a mixed-reality integrated learning environment (MILE) in providing the simulated and immersive teaching practice for university teaching assistants. A virtual-reality-based ...
Cyber sickness in low-immersive, semi-immersive, and fully immersive virtual reality
AbstractIt is known that virtual reality (VR) experience may cause cyber sickness. One aspect of VR is an immersion or otherwise sense of presence, the sense of feeling oneself in a virtual world. In this paper an experiment which was conducted in order ...
Comments
Information & Contributors
Information
Published In
October 2024
633 pages
ISBN:9798400705359
DOI:10.1145/3641825
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
VRST '24: 30th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2024
Trier, Germany
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 126Total Downloads
- Downloads (Last 12 months)126
- Downloads (Last 6 weeks)29
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format