Skip to main content
SpringerLink
Log in

Failure Stories and Surprising Findings: Learning from When VR Did Not Work

  • Conference paper
  • First Online:
Immersive Learning Research Network (iLRN 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1904))

Included in the following conference series:

  • 330 Accesses

Abstract

It is easy to assume that virtual reality will naturally lead to improved learning outcomes, as there is a tendency to view VR, as an exciting new technology, as a “silver bullet” that can dramatically enhance learning. However, several research studies reveal surprising or counter-intuitive findings – for example, when low-immersion media led to better learning outcomes than VR. We provide a systematic review and discuss specific cases in which results were not as expected. Factors that adversely affect learning include novelty effects, VR sickness, low interaction fidelity, cognitive overload, or other environmental or classroom factors. Through this study, we argue that designers and educators can avoid pitfalls by studying the times when VR did not work as expected. We also provide recommendations based upon these findings. In this way, we can gain insights on how to actually obtain desirable outcomes from the new technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hamilton, D., McKechnie, J., Edgerton, E., Wilson, C.: Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. J. Comput. Educ. 8(1), 1–32 (2021)

    Article  Google Scholar 

  2. Meyer, O.A., Omdahl, M.K., Makransky, G.: Investigating the effect of pre-training when learning through immersive virtual reality and video: a media and methods experiment. Comput. Educ. 140, 103603 (2019)

    Article  Google Scholar 

  3. Slater, M., Usoh, M., Steed, A.: Depth of presence in virtual environments. Presence. 3, 130–144 (1994)

    Article  Google Scholar 

  4. Wilson, C.J., Soranzo, A.: The use of virtual reality in psychology: a case study in visual perception. Comput. Math. Meth. Med. 2015, 151702 (2015)

    Article  Google Scholar 

  5. Clark, R.E.: When teaching kills learning: research on mathemathantics. In: Mandl, H., De Corte, E., Bennett, N., Friedrich, H.F. (eds.) Learning and Instruction. European Research in an International Context, vol. II. Pergamon, Oxford (1989)

    Google Scholar 

  6. Makransky, G., Terkildsen, T.S., Mayer, R.E.: Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn. Instr. 60, 225–236 (2019)

    Article  Google Scholar 

  7. Lohman, D.F.: Predicting mathemathantic effects in the teaching of higher-order thinking skills. Educ. Psychol. 21(3), 191–208 (1986)

    Article  Google Scholar 

  8. Clark, R.E., Feldon, D.F., Jeong, S.: Fifteen common but questionable principles of multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning (Chapter 3). Cambridge University Press, New York (In Press)

    Google Scholar 

  9. Hu-Au, E., Lee, J.J.: Virtual reality in education: a tool for learning in the experience age. Int. J. Innov. Educ. 4(4), 215–226 (2017)

    Article  Google Scholar 

  10. Cummings, J.J., Bailenson, J.N.: How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychol. 19(2), 272–309 (2016)

    Article  Google Scholar 

  11. Murcia-López, M., Steed, A.: The effect of environmental features, self-avatar, and immersion on object location memory in virtual environments. Front. ICT 3, 24 (2016)

    Article  Google Scholar 

  12. Chiu, W.K.: Pedagogy of emerging technologies in chemical education during the era of digitalization and artificial intelligence: a systematic review. Educ. Sci. 11(11), 709 (2021)

    Article  Google Scholar 

  13. Peixoto, B., Pinto, R., Melo, M., Cabral, L., Bessa, M.: Immersive virtual reality for foreign language education: a prisma systematic review. IEEE Access. 9, 48952–48962 (2021)

    Article  Google Scholar 

  14. Coban, M., Bolat, Y.I., Goksu, I.: The potential of immersive virtual reality to enhance learning: a meta-analysis. Educ. Res. Rev. 36, 100452 (2022)

    Article  Google Scholar 

  15. Luo, H., Li, G., Feng, Q., Yang, Y., Zuo, M.: Virtual reality in K-12 and higher education: a systematic review of the literature from 2000 to 2019. J. Comput. Assist. Learn. 37(3), 887–901 (2021)

    Article  Google Scholar 

  16. Di Natale, A.F., Repetto, C., Riva, G., Villani, D.: Immersive virtual reality in K-12 and higher education: a 10-year systematic review of empirical research. Br. J. Edu. Technol. 51(6), 2006–2033 (2020)

    Article  Google Scholar 

  17. Pellas, N., Mystakidis, S., Kazanidis, I.: Immersive virtual reality in K-12 and higher education: a systematic review of the last decade scientific literature. Virtual Reality 25(3), 835–861 (2021)

    Article  Google Scholar 

  18. Wu, B., Yu, X., Gu, X.: Effectiveness of immersive virtual reality using head-mounted displays on learning performance: a meta-analysis. Br. J. Edu. Technol. 51(6), 1991–2005 (2020)

    Article  Google Scholar 

  19. Spector, J.M.: Trends and research issues in educational technology. Malays. Online J. Educ. Technol. 1(3), 1–9 (2013)

    Google Scholar 

  20. Chen, X., et al.: ImmerTai: immersive motion learning in VR environments. J. Vis. Commun. Image Represent. 58, 416–427 (2019)

    Article  Google Scholar 

  21. Cheng, A., Yang, L., Andersen, E.: Teaching language and culture with a virtual reality game. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 541–549 (2017)

    Google Scholar 

  22. Hu-Au, E., Okita, S.: Exploring differences in student learning and behavior between real-life and virtual reality chemistry laboratories. J. Sci. Educ. Technol. 30(6), 862–876 (2021)

    Article  Google Scholar 

  23. Leder, J., Horlitz, T., Puschmann, P., Wittstock, V., Schütz, A.: Comparing immersive virtual reality and powerpoint as methods for delivering safety training: impacts on risk perception, learning, and decision making. Saf. Sci. 111, 271–286 (2019)

    Article  Google Scholar 

  24. Parong, J., Mayer, R.E.: Learning science in immersive virtual reality. J. Educ. Psychol. 110(6), 785–797 (2018)

    Article  Google Scholar 

  25. Passig, D., Eden, S., Heled, M.: The impact of virtual reality on the awareness of teenagers to social and emotional experiences of immigrant classmates. Educ. Inf. Technol. 12(4), 267–280 (2007)

    Article  Google Scholar 

  26. Srivastava, P., Rimzhim, A., Vijay, P., Singh, S., Chandra, S.: Desktop VR is better than non-ambulatory HMD VR for spatial learning. Front. Robot. AI 6, 50 (2019)

    Article  Google Scholar 

  27. Wang, C., Daniel, B.K., Asil, M., Khwaounjoo, P., Cakmak, Y.O.: A randomised control trial and comparative analysis of multi-dimensional learning tools in anatomy. Sci. Rep. 10(1), 1–10 (2020)

    Google Scholar 

  28. Zhao, J., Lin, L., Sun, J., Liao, Y.: Using the summarizing strategy to engage learners: empirical evidence in an immersive virtual reality environment. Asia Pac. Educ. Res. 29(5), 473–482 (2020)

    Article  Google Scholar 

  29. Roettl, J., Terlutter, R.: The same video game in 2D, 3D or virtual reality-how does technology impact game evaluation and brand placements? PLoS ONE 13, e0200724 (2018)

    Article  Google Scholar 

  30. Sharples, S., Cobb, S., Moody, A., Wilson, J.R.: Virtual reality induced symptoms and effects (VRISE): comparison of head mounted display (HMD), desktop and projection display systems. Displays 29, 58–69 (2008)

    Article  Google Scholar 

  31. Brown, J.S., Collins, A., Duguid, P.: Situated cognition and the culture of learning. Educ. Res. 18(1), 288–305 (1989)

    Article  Google Scholar 

  32. Moreno, R., Mayer, R.E.: Learning science in virtual reality multimedia environments: role of methods and media. J. Educ. Psychol. 94(3), 598–610 (2002)

    Article  Google Scholar 

  33. Clark, R.E., Yates, K., Early, S., Moulton, K.: An analysis of the failure of electronic media and discovery‐based learning: evidence for the performance benefits of guided training methods. In: Handbook of Improving Performance in the Workplace, vol. 1–3, pp. 263-297 (2009)

    Google Scholar 

  34. Dewey, J.: Interest and Effort in Education. Houghton Mifflin, Cambridge (1913)

    Book  Google Scholar 

  35. Van Der Heijden, H.: User acceptance of hedonic information systems. MIS Q. 28(4), 695–704 (2004)

    Article  Google Scholar 

  36. Itō, M.: Hanging Out, Messing Around, and Geeking Out: Kids Living and Learning With New Media. MIT Press, MIT Press (2010)

    Google Scholar 

  37. Castaneda, L., Pacampara, M.: Virtual reality in the classroom-an exploration of hardware, management, content and pedagogy. In: Society for Information Technology & Teacher Education International Conference, pp. 527–534. Association for the Advancement of Computing in Education (AACE) (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Teachers College, Columbia University, New York, NY, 10027, USA

    Xichen Li & Joey J. Lee

Authors
  1. Xichen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joey J. Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xichen Li .

Editor information

Editors and Affiliations

  1. Queen Mary University of London, London, UK

    Marie-Luce Bourguet

  2. University of Potsdam, Potsdam, Germany

    Jule M. Krüger

  3. University of Aveiro, Aveiro, Portugal

    Daniela Pedrosa

  4. Goethe University Frankfurt, Frankfurt am Main, Germany

    Andreas Dengel

  5. British Telecom Research Labs, Ipswich, UK

    Anasol Peña-Rios

  6. University of Montana, Missoula, MT, USA

    Jonathon Richter

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, X., Lee, J.J. (2024). Failure Stories and Surprising Findings: Learning from When VR Did Not Work. In: Bourguet, ML., Krüger, J.M., Pedrosa, D., Dengel, A., Peña-Rios, A., Richter, J. (eds) Immersive Learning Research Network. iLRN 2023. Communications in Computer and Information Science, vol 1904. Springer, Cham. https://doi.org/10.1007/978-3-031-47328-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47328-9_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47327-2

  • Online ISBN: 978-3-031-47328-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation