Abstract
Spatial audio is an integral aspect of virtual reality (VR) experiences as it enhances sensory immersion. Serious games often face the problem of effective player guidance and progress without disrupting gameplay. This study presents the results of a mixed-methods comparative experimental study. A system with audio cues was tested (nā=ā30) in a serious escape room game on a STEM subject in immersive VR. The breakout room game explored the physics of audio and sound. The introduction of audio cues improved object location and enhanced spatial auditory awareness, yet these benefits did not consistently extend to other aspects of the VR experience.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Geng, J., Jong, M.S.-Y., Chai, C.S.: Hong Kong teachersā self-efficacy and concerns about STEM education. Asia Pac. Educ. Res. 28, 35ā45 (2019). https://doi.org/10.1007/s40299-018-0414-1
Pittinsky, T.L., Diamante, N.: Going beyond fun in STEM. Phi Delta Kappan. 97, 47ā51 (2015). https://doi.org/10.1177/0031721715610091
Karageorgiou, Z., Mavrommati, E., Fotaris, P.: Escape room design as a game-based learning process for STEAM education. In: Proceedings of the 12th European Conference on Game Based Learning, p. 46. ACPI (2019). https://doi.org/10.34190/GBL.19.190
Makri, A., Vlachopoulos, D., Martina, R.A.: Digital escape rooms as innovative pedagogical tools in education: a systematic literature review. Sustainability 13, 4587 (2021). https://doi.org/10.3390/su13084587
Hickman, C.: Hyper-Reality: The Art of Designing Impossible Experiences. Amazon Digital Services LLC ā Kdp (2023)
Chen, J.-C., et al.: Developing a hands-on activity using virtual reality to help students learn by doing. J. Comput. Assist. Learn. (2019). https://doi.org/10.1111/jcal.12389
Lathwesen, C., Belova, N.: Escape rooms in STEM teaching and learningāprospective field or declining trend? a literature review. Educ. Sci. 11, 308 (2021). https://doi.org/10.3390/educsci11060308
Christopoulos, A., Mystakidis, S., Cachafeiro, E., Laakso, M.-J.: Escaping the cell: virtual reality escape rooms in biology education. Behav. Inform. Technol. 42, 1434ā1451 (2023). https://doi.org/10.1080/0144929X.2022.2079560
Mystakidis, S., Cachafeiro, E., Hatzilygeroudis, I.: Enter the serious e-scape room: a cost-effective serious game model for deep and meaningful e-learning. In: 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1ā6. IEEE, Patras, 15ā17 July 2019. https://doi.org/10.1109/IISA.2019.8900673
Stohlmann, M.S.: Mathematical digital escape rooms. School Sci. Math. 123(1), 26ā30 (2023). https://doi.org/10.1111/ssm.12564
Kern, A.C., Ellermeier, W.: Audio in VR: effects of a soundscape and movement-triggered step sounds on presence. Front. Robot. AI. 7, 20 (2020). https://doi.org/10.3389/frobt.2020.00020
Fuchs, P.: Virtual Reality Headsets ā A Theoretical and Pragmatic Approach. CRC Press (2017). https://doi.org/10.1201/9781315208244
Murphy, D., Neff, F.: Spatial sound for computer games and virtual reality. In: Grimshaw, M. (ed.) Game Sound Technology and Player Interaction: Concepts and Developments, pp. 287ā312. IGI Global (2011). https://doi.org/10.4018/978-1-61692-828-5.ch014
RumiÅski, D.: An experimental study of spatial sound usefulness in searching and navigating through AR environments. Virtual Reality 19, 223ā233 (2015). https://doi.org/10.1007/s10055-015-0274-4
Kailas, G., Tiwari, N.: Design for immersive experience: role of spatial audio in extended reality applications. In: Chakrabarti, A., Poovaiah, R., Bokil, P., Kant, V. (eds.) Design for Tomorrowāvol. 2: Proceedings of ICoRD 2021, pp. 853ā863. Springer Singapore, Singapore (2021). https://doi.org/10.1007/978-981-16-0119-4_69
Hong, J., He, J., Lam, B., Gupta, R., Gan, W.-S.: Spatial audio for soundscape design: recording and reproduction. Appl. Sci. 7, 627 (2017). https://doi.org/10.3390/app7060627
Cassidy, C.A., Fabola, A., Rhodes, E., Miller, A.: The Making and Evaluation of Picts and Pixels: Mixed Exhibiting in the Real and the Unreal. Presented at the Immersive Learning Research Network, Cham (2018)
Reimer, K.M., Khosmood, F.: Inducing emotional response in interactive media: a pilot study. In: Allison, C., Morgado, L., Pirker, J., Beck, D., Richter, J., GĆ¼tl, C. (eds.) Immersive Learning Research Network: Second International Conference, iLRN 2016 Santa Barbara, CA, USA, June 27 ā July 1, 2016 Proceedings, pp. 122ā131. Springer International Publishing, Cham (2016). https://doi.org/10.1007/978-3-319-41769-1_10
Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., Holmes, G.: ONTRACK: dynamically adapting music playback to support navigation. Pers. Ubiquit. Comput. 12, 513ā525 (2008). https://doi.org/10.1007/s00779-007-0155-2
Robern, G., Uribe-Quevedo, A., Sukhai, M., Coppin, P., Lee, T., Ingino, R.: Work-in-progress-exploring VR conference navigation employing audio cues. In: 2021 7th International Conference of the Immersive Learning Research Network (iLRN), pp. 1ā3. IEEE (2021). https://doi.org/10.23919/iLRN52045.2021.9459330
Mystakidis, S., Theologi-Gouti, P., Iliopoulos, I.: STEAM project exhibition in the Metaverse for deaf high school studentsā affective empowerment: the power of student museum exhibitions in social virtual reality. In: Bourguet, M.-L., KrĆ¼ger, J.M., Pedrosa, D., Dengel, A., PeƱa-Rios, A., Richter, J. (eds.) Immersive Learning Research Network: 9th International Conference, iLRN 2023, San Luis Obispo, USA, June 26ā29, 2023, Revised Selected Papers, pp. 239ā249. Springer Nature Switzerland, Cham (2024). https://doi.org/10.1007/978-3-031-47328-9_18
Alatrash, S., Arnab, S., Antlej, K.: Communicating engineering heritage through immersive technology: a VR framework for enhancing usersā interpretation process in virtual immersive environments. Comput. Educ.: X Reality 3, 100040 (2023). https://doi.org/10.1016/j.cexr.2023.100040
Bubar, E., Agolini, S., Jaber, D., Wright, A.: Three methods for adapting physical games to virtual formats in STEM courses ā easy (google suite), medium (web GL games in unity) and hard (virtual reality). In: Stephanidis, C., Antona, M., Ntoa, S. (eds.) HCI International 2021 ā Posters: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24ā29, 2021, Proceedings, Part III, pp. 141ā147. Springer International Publishing, Cham (2021). https://doi.org/10.1007/978-3-030-78645-8_18
Christopoulos, A., Mystakidis, S.: Gamification in Education. Encyclopedia. 3, 1223ā1243 (2023). https://doi.org/10.3390/encyclopedia3040089
Field, A.: Discovering Statistics Using IBM SPSS Statistics. SAGE Publications (2018)
Siegel, S., Castellan, N.J.: Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill (1988)
Yang, J., Sasikumar, P., Bai, H., Barde, A., Sƶrƶs, G., Billinghurst, M.: The effects of spatial auditory and visual cues on mixed reality remote collaboration. J. Multimodal User Interfaces 14, 337ā352 (2020). https://doi.org/10.1007/s12193-020-00331-1
Anmarkrud, Ć., Andresen, A., BrĆ„ten, I.: Cognitive load and working memory in multimedia learning: conceptual and measurement issues. Educ. Psychol. 54, 61ā83 (2019). https://doi.org/10.1080/00461520.2018.1554484
Mutlu-Bayraktar, D., Cosgun, V., Altan, T.: Cognitive load in multimedia learning environments: a systematic review. Comput. Educ. 141, 103618 (2019). https://doi.org/10.1016/j.compedu.2019.103618
Breitkreutz, C., Brade, J., Winkler, S., Bendixen, A., Klimant, P., Jahn, G.: Spatial updating in virtual reality ā auditory and visual cues in a cave automatic virtual environment. In: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 719ā727. IEEE, Christchurch, New Zealand (2022). https://doi.org/10.1109/VR51125.2022.00093
Burte, H., Turner, B.O., Miller, M.B., Hegarty, M.: The neural basis of individual differences in directional sense. Front. Hum. Neurosci. 12, 410 (2018). https://doi.org/10.3389/fnhum.2018.00410
Souza, R.H.C.E., Naves, E.L.M.: Attention detection in virtual environments using EEG signals: a scoping review. Front. Physiol. 12, 727840 (2021). https://doi.org/10.3389/fphys.2021.727840
Bartlett, K.A., Camba, J.D.: Gender differences in spatial ability: a critical review. Educ. Psychol. Rev. 35, 8 (2023). https://doi.org/10.1007/s10648-023-09728-2
Fialho, L., Oliveira, J., Filipe, A., Luz, F.: Soundspace VR: spatial navigation using sound in virtual reality. Virtual Reality 27, 397ā405 (2023). https://doi.org/10.1007/s10055-021-00597-0
Roettl, J., Terlutter, R.: The same video game in 2D, 3D or virtual reality ā How does technology impact game evaluation and brand placements? PLoS ONE 13, e0200724 (2018). https://doi.org/10.1371/journal.pone.0200724
Marinaci, T., et al.: An inclusive workplace approach to disability through assistive technologies: a systematic review and thematic analysis of the literature. Societies 13, 231 (2023). https://doi.org/10.3390/soc13110231
Shao, Z., Mei, X., Wu, Y., Bao, J., Tang, H.: Design and implementation of a semantic information expression device based on vibrotactile coding. Appl. Sci. 13, 11756 (2023). https://doi.org/10.3390/app132111756
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
Ā© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Vontzalidis, G., Mystakidis, S., Christopoulos, A., Moustakas, K. (2025). Spatial Audio Cues in an Immersive Virtual Reality STEM Escape Room Game: A Comparative Study. In: KrĆ¼ger, J.M., et al. Immersive Learning Research Network. iLRN 2024. Communications in Computer and Information Science, vol 2271. Springer, Cham. https://doi.org/10.1007/978-3-031-80475-5_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-80475-5_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-80474-8
Online ISBN: 978-3-031-80475-5
eBook Packages: EducationEducation (R0)