Abstract
Auditory and haptic cues play an important role in medical simulation for developing cognitive and motor skills. For example, medical training whereby trainees practice drilling-related surgeries requires the use of force feedback haptic devices in conjunction with computer-based simulations that provide audiovisual cues. Traditionally, this practice requires trainees to be co-located and work in groups within a simulation laboratory. While virtual reality (VR) is providing opportunities for developing digital replicas that can be used without depending on access to the training site, VR equipment including haptic devices, and high fidelity head-mounted displays, are not widely available. Due to the need for specialized equipment and restrictions placed on in-person user testing due to the COVID-19 pandemic, here we describe an experiment that examined the simulation of a virtual drilling task conducted remotely. The experimental results are not discussed. Rather, we report our findings with respect to the various challenges faced when rethinking audio-haptic perceptual immersive user-based experiments during COVID-19. We also describe a future experiment that will be conducted to test the usability of a serious game and will also be conducted entirely online.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J-M.: VR–CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput.-Aid. Des. 42(5), 445–461, (2010)
Yu, P., Pan, J., Qin, H., Hao, A., Wang, H.: Real-time suturing simulation for virtual reality medical training. Comput. Anim. Virt. Worlds, 31(4–5), e1940 (2020)
Rassie, K.: The apprenticeship model of clinical medical education: time for structural change. New Zealand Med. J. 130(1461), 66 (2017)
Willaert, W.I.M., Aggarwal, R., Van Herzeele, I., Cheshire, N.J., Vermassen, F.E.: Recent advancements in medical simulation: patient-specific virtual reality simulation. World J. Surg. 36(7), 1703–1712 (2012)
Xia, P., Lopes, A.M., Restivo, M.T.: Virtual reality and haptics for dental surgery: a personal review. Vis. Comput. 29(5), 433–447 (2013)
Våpenstad, C., Hofstad, E.F., Langø, T., Mårvik, R., Chmarra, M.K.: Perceiving haptic feedback in virtual reality simulators. Surg. Endosc. 27(7), 2391–2397 (2013)
Kapralos, B., Moussa, F., Collins, K., Dubrowski, A.: Levels of fidelity and multimodal interactions. In: Wouters, P., van Oostendorp, H., (Eds.) Techniques to Improve the Effectiveness of Serious Games, Springer Advances in Game-based Learning Book Series, Ch. 5, pp. 79–101 (2017)
Cucinotta, D., Vanelli, M.: WHO declares COVID-19 a pandemic. Acta Biomed. 91(1), 157–160 (2020)
Lateef, F.: Simulation-based learning: Just like the real thing. J. Emerg. Trauma, Shock 3(4), 348–352 (2010). https://doi.org/10.4103/0974-2700.70743
Esposito, C.P., Sullivan, K.: Maintaining clinical continuity through virtual simulation during the COVID-19 pandemic. J. Nurs. Educ. 59(9), 522–525 (2020)
Brydges, R., et al.:. Lessons learned in preparing for and responding to the early stages of the COVID-19 pandemic: one simulation’s program experience adapting to the new normal. BMC Adv. Simul. 5(8), 1-10 (2020). https://doi.org/10.1186/s41077-020-00128-y
Hu, H., Xiao, Y., Li, H.: The effectiveness of a serious game versus online lectures for Improving medical students coronavirus disease 2019 Knowledge. Games Health J. 10(2), 139–144 (2021). https://doi.org/10.1089/g4h.2020.0140
Gaspar, J.D., Lage, E.M., Silva, F.J., Mineiro, É, Oliveira, I.J., Oliveira, I., Reis, Z.S.: A mobile serious game about the pandemic (COVID-19 - did you know?): design and evaluation study. JMIR Ser. Games 8(4), e25226 (2020). https://doi.org/10.2196/25226
Sauro, J.: A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices. CreateSpace Independent Publishing Platform, California, USA (2011)
Melaisi, M., Rojas, D., Kapralos, B., Uribe-Quevedo, A., Collins, K.: Multimodal interaction of con-textual and non-contextual sound and haptics in virtual simulations. Informatics 5(4), 43 (2018). https://doi.org/10.3390/informatics5040043
Maclntyre, B., Smith, T.F.: Thoughts on the future of WebXR and the immersive web. In: Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 16–20 (2018)
Acknowledgements
The financial support of the Natural Sciences and Engineering Research Council of Canada (NSERC), in the form of Discovery Grants to B. Kapralos and A. Quevedo, and the Research Center for Biomedical Engineering and Research Institute of Electronics, Shizuoka University, Japan is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ning, G. et al. (2022). Rethinking Audio-Haptic Perceptual Immersion from In-Person to Remote Testing During COVID-19. In: Auer, M.E., Tsiatsos, T. (eds) New Realities, Mobile Systems and Applications. IMCL 2021. Lecture Notes in Networks and Systems, vol 411. Springer, Cham. https://doi.org/10.1007/978-3-030-96296-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-96296-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-96295-1
Online ISBN: 978-3-030-96296-8
eBook Packages: EngineeringEngineering (R0)