Skip to main content

Spatial Audio Cues in an Immersive Virtual Reality STEM Escape Room Game: A Comparative Study

  • Conference paper
  • First Online:
Immersive Learning Research Network (iLRN 2024)

Abstract

Spatial audio is an integral aspect of virtual reality (VR) experiences as it enhances sensory immersion. Serious games often face the problem of effective player guidance and progress without disrupting gameplay. This study presents the results of a mixed-methods comparative experimental study. A system with audio cues was tested (nā€‰=ā€‰30) in a serious escape room game on a STEM subject in immersive VR. The breakout room game explored the physics of audio and sound. The introduction of audio cues improved object location and enhanced spatial auditory awareness, yet these benefits did not consistently extend to other aspects of the VR experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Geng, J., Jong, M.S.-Y., Chai, C.S.: Hong Kong teachersā€™ self-efficacy and concerns about STEM education. Asia Pac. Educ. Res. 28, 35ā€“45 (2019). https://doi.org/10.1007/s40299-018-0414-1

    Article  Google Scholar 

  2. Pittinsky, T.L., Diamante, N.: Going beyond fun in STEM. Phi Delta Kappan. 97, 47ā€“51 (2015). https://doi.org/10.1177/0031721715610091

    Article  Google Scholar 

  3. Karageorgiou, Z., Mavrommati, E., Fotaris, P.: Escape room design as a game-based learning process for STEAM education. In: Proceedings of the 12th European Conference on Game Based Learning, p. 46. ACPI (2019). https://doi.org/10.34190/GBL.19.190

  4. Makri, A., Vlachopoulos, D., Martina, R.A.: Digital escape rooms as innovative pedagogical tools in education: a systematic literature review. Sustainability 13, 4587 (2021). https://doi.org/10.3390/su13084587

    Article  Google Scholar 

  5. Hickman, C.: Hyper-Reality: The Art of Designing Impossible Experiences. Amazon Digital Services LLC ā€“ Kdp (2023)

    Google Scholar 

  6. Chen, J.-C., et al.: Developing a hands-on activity using virtual reality to help students learn by doing. J. Comput. Assist. Learn. (2019). https://doi.org/10.1111/jcal.12389

    Article  Google Scholar 

  7. Lathwesen, C., Belova, N.: Escape rooms in STEM teaching and learningā€”prospective field or declining trend? a literature review. Educ. Sci. 11, 308 (2021). https://doi.org/10.3390/educsci11060308

    Article  Google Scholar 

  8. Christopoulos, A., Mystakidis, S., Cachafeiro, E., Laakso, M.-J.: Escaping the cell: virtual reality escape rooms in biology education. Behav. Inform. Technol. 42, 1434ā€“1451 (2023). https://doi.org/10.1080/0144929X.2022.2079560

    Article  Google Scholar 

  9. Mystakidis, S., Cachafeiro, E., Hatzilygeroudis, I.: Enter the serious e-scape room: a cost-effective serious game model for deep and meaningful e-learning. In: 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1ā€“6. IEEE, Patras, 15ā€“17 July 2019. https://doi.org/10.1109/IISA.2019.8900673

  10. Stohlmann, M.S.: Mathematical digital escape rooms. School Sci. Math. 123(1), 26ā€“30 (2023). https://doi.org/10.1111/ssm.12564

    Article  Google Scholar 

  11. Kern, A.C., Ellermeier, W.: Audio in VR: effects of a soundscape and movement-triggered step sounds on presence. Front. Robot. AI. 7, 20 (2020). https://doi.org/10.3389/frobt.2020.00020

    Article  Google Scholar 

  12. Fuchs, P.: Virtual Reality Headsets ā€“ A Theoretical and Pragmatic Approach. CRC Press (2017). https://doi.org/10.1201/9781315208244

    Book  Google Scholar 

  13. Murphy, D., Neff, F.: Spatial sound for computer games and virtual reality. In: Grimshaw, M. (ed.) Game Sound Technology and Player Interaction: Concepts and Developments, pp. 287ā€“312. IGI Global (2011). https://doi.org/10.4018/978-1-61692-828-5.ch014

    Chapter  Google Scholar 

  14. Rumiński, D.: An experimental study of spatial sound usefulness in searching and navigating through AR environments. Virtual Reality 19, 223ā€“233 (2015). https://doi.org/10.1007/s10055-015-0274-4

    Article  Google Scholar 

  15. Kailas, G., Tiwari, N.: Design for immersive experience: role of spatial audio in extended reality applications. In: Chakrabarti, A., Poovaiah, R., Bokil, P., Kant, V. (eds.) Design for Tomorrowā€”vol. 2: Proceedings of ICoRD 2021, pp. 853ā€“863. Springer Singapore, Singapore (2021). https://doi.org/10.1007/978-981-16-0119-4_69

    Chapter  Google Scholar 

  16. Hong, J., He, J., Lam, B., Gupta, R., Gan, W.-S.: Spatial audio for soundscape design: recording and reproduction. Appl. Sci. 7, 627 (2017). https://doi.org/10.3390/app7060627

    Article  Google Scholar 

  17. Cassidy, C.A., Fabola, A., Rhodes, E., Miller, A.: The Making and Evaluation of Picts and Pixels: Mixed Exhibiting in the Real and the Unreal. Presented at the Immersive Learning Research Network, Cham (2018)

    Google Scholar 

  18. Reimer, K.M., Khosmood, F.: Inducing emotional response in interactive media: a pilot study. In: Allison, C., Morgado, L., Pirker, J., Beck, D., Richter, J., GĆ¼tl, C. (eds.) Immersive Learning Research Network: Second International Conference, iLRN 2016 Santa Barbara, CA, USA, June 27 ā€“ July 1, 2016 Proceedings, pp. 122ā€“131. Springer International Publishing, Cham (2016). https://doi.org/10.1007/978-3-319-41769-1_10

    Chapter  Google Scholar 

  19. Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., Holmes, G.: ONTRACK: dynamically adapting music playback to support navigation. Pers. Ubiquit. Comput. 12, 513ā€“525 (2008). https://doi.org/10.1007/s00779-007-0155-2

    Article  Google Scholar 

  20. Robern, G., Uribe-Quevedo, A., Sukhai, M., Coppin, P., Lee, T., Ingino, R.: Work-in-progress-exploring VR conference navigation employing audio cues. In: 2021 7th International Conference of the Immersive Learning Research Network (iLRN), pp. 1ā€“3. IEEE (2021). https://doi.org/10.23919/iLRN52045.2021.9459330

  21. Mystakidis, S., Theologi-Gouti, P., Iliopoulos, I.: STEAM project exhibition in the Metaverse for deaf high school studentsā€™ affective empowerment: the power of student museum exhibitions in social virtual reality. In: Bourguet, M.-L., KrĆ¼ger, J.M., Pedrosa, D., Dengel, A., PeƱa-Rios, A., Richter, J. (eds.) Immersive Learning Research Network: 9th International Conference, iLRN 2023, San Luis Obispo, USA, June 26ā€“29, 2023, Revised Selected Papers, pp. 239ā€“249. Springer Nature Switzerland, Cham (2024). https://doi.org/10.1007/978-3-031-47328-9_18

    Chapter  Google Scholar 

  22. Alatrash, S., Arnab, S., Antlej, K.: Communicating engineering heritage through immersive technology: a VR framework for enhancing usersā€™ interpretation process in virtual immersive environments. Comput. Educ.: X Reality 3, 100040 (2023). https://doi.org/10.1016/j.cexr.2023.100040

    Article  Google Scholar 

  23. Bubar, E., Agolini, S., Jaber, D., Wright, A.: Three methods for adapting physical games to virtual formats in STEM courses ā€“ easy (google suite), medium (web GL games in unity) and hard (virtual reality). In: Stephanidis, C., Antona, M., Ntoa, S. (eds.) HCI International 2021 ā€“ Posters: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24ā€“29, 2021, Proceedings, Part III, pp. 141ā€“147. Springer International Publishing, Cham (2021). https://doi.org/10.1007/978-3-030-78645-8_18

    Chapter  Google Scholar 

  24. Christopoulos, A., Mystakidis, S.: Gamification in Education. Encyclopedia. 3, 1223ā€“1243 (2023). https://doi.org/10.3390/encyclopedia3040089

    Article  Google Scholar 

  25. Field, A.: Discovering Statistics Using IBM SPSS Statistics. SAGE Publications (2018)

    Google Scholar 

  26. Siegel, S., Castellan, N.J.: Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill (1988)

    Google Scholar 

  27. Yang, J., Sasikumar, P., Bai, H., Barde, A., Sƶrƶs, G., Billinghurst, M.: The effects of spatial auditory and visual cues on mixed reality remote collaboration. J. Multimodal User Interfaces 14, 337ā€“352 (2020). https://doi.org/10.1007/s12193-020-00331-1

    Article  Google Scholar 

  28. Anmarkrud, Ƙ., Andresen, A., BrĆ„ten, I.: Cognitive load and working memory in multimedia learning: conceptual and measurement issues. Educ. Psychol. 54, 61ā€“83 (2019). https://doi.org/10.1080/00461520.2018.1554484

    Article  Google Scholar 

  29. Mutlu-Bayraktar, D., Cosgun, V., Altan, T.: Cognitive load in multimedia learning environments: a systematic review. Comput. Educ. 141, 103618 (2019). https://doi.org/10.1016/j.compedu.2019.103618

    Article  Google Scholar 

  30. Breitkreutz, C., Brade, J., Winkler, S., Bendixen, A., Klimant, P., Jahn, G.: Spatial updating in virtual reality ā€“ auditory and visual cues in a cave automatic virtual environment. In: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 719ā€“727. IEEE, Christchurch, New Zealand (2022). https://doi.org/10.1109/VR51125.2022.00093

  31. Burte, H., Turner, B.O., Miller, M.B., Hegarty, M.: The neural basis of individual differences in directional sense. Front. Hum. Neurosci. 12, 410 (2018). https://doi.org/10.3389/fnhum.2018.00410

    Article  Google Scholar 

  32. Souza, R.H.C.E., Naves, E.L.M.: Attention detection in virtual environments using EEG signals: a scoping review. Front. Physiol. 12, 727840 (2021). https://doi.org/10.3389/fphys.2021.727840

    Article  Google Scholar 

  33. Bartlett, K.A., Camba, J.D.: Gender differences in spatial ability: a critical review. Educ. Psychol. Rev. 35, 8 (2023). https://doi.org/10.1007/s10648-023-09728-2

    Article  Google Scholar 

  34. Fialho, L., Oliveira, J., Filipe, A., Luz, F.: Soundspace VR: spatial navigation using sound in virtual reality. Virtual Reality 27, 397ā€“405 (2023). https://doi.org/10.1007/s10055-021-00597-0

    Article  Google Scholar 

  35. Roettl, J., Terlutter, R.: The same video game in 2D, 3D or virtual reality ā€“ How does technology impact game evaluation and brand placements? PLoS ONE 13, e0200724 (2018). https://doi.org/10.1371/journal.pone.0200724

    Article  Google Scholar 

  36. Marinaci, T., et al.: An inclusive workplace approach to disability through assistive technologies: a systematic review and thematic analysis of the literature. Societies 13, 231 (2023). https://doi.org/10.3390/soc13110231

    Article  Google Scholar 

  37. Shao, Z., Mei, X., Wu, Y., Bao, J., Tang, H.: Design and implementation of a semantic information expression device based on vibrotactile coding. Appl. Sci. 13, 11756 (2023). https://doi.org/10.3390/app132111756

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stylianos Mystakidis .

Editor information

Editors and Affiliations

Ethics declarations

Disclosure of Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vontzalidis, G., Mystakidis, S., Christopoulos, A., Moustakas, K. (2025). Spatial Audio Cues in an Immersive Virtual Reality STEM Escape Room Game: A Comparative Study. In: KrĆ¼ger, J.M., et al. Immersive Learning Research Network. iLRN 2024. Communications in Computer and Information Science, vol 2271. Springer, Cham. https://doi.org/10.1007/978-3-031-80475-5_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-80475-5_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-80474-8

  • Online ISBN: 978-3-031-80475-5

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics