Skip to main content
SpringerLink
Log in

Critical Review of Extended Reality Applications in Aviation

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13318))

Included in the following conference series:

Abstract

In recent years, the growing availability of extended reality (XR) technology through mobile, tablet, headset, and wearable devices has led to increased research and development on XR applications in aviation. XR has the potential to enrich the task and training environment of pilots, air traffic controllers, maintenance technicians, and flight crews by augmenting elements of the physical world, enabling remote task support, and providing immersive, controllable environments for safety-critical training. This technology can also improve human factors experiments as it allows for the emulation of environments and systems in various areas of aviation. As this technology develops and new trends emerge, understanding the current state of research can illuminate best practices, limitations, and key considerations to support the application of XR. The purpose of this paper is to provide a critical review of XR applications within the field of aviation through two means: a scientometric analysis and qualitative review of recent scientific studies. Common trends, themes, and applications are identified in the existing literature providing a snapshot of the research at this time. Implications of these findings for future research directions and applications within aviation are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Safi, M., Chung, J., Pradhan, P.: Review of augmented reality in aerospace industry. Aircr. Eng. Aerosp. Technol. 91(9), 1187–1194 (2019)

    Article  Google Scholar 

  2. Cipresso, P., Giglioli, I.A.C., Raya, M.A., Riva, G.: The past, present, and future of virtual and augmented reality research: a network and cluster analysis of the literature. Front. Psychol. 9, 2086 (2018)

    Article  Google Scholar 

  3. Skarbez, R., Smith, M., Whitton, M.C.: Revisiting the Milgram and Kishino’s reality-virtuality continuum. Front. Virtual Real. 2, 647997 (2021)

    Article  Google Scholar 

  4. Speicher, M., Hall, B.D., Nabelling, M.: What is mixed reality? In: CHI Conference on Human Factors in Computing Systems Proceedings Glasgow, Scotland, UK, pp. 1–15. ACM New York, NY, USA (2019)

    Google Scholar 

  5. Alizadehsalehiu, S., Hadavi, A., Huang, J.C.: From BIM to extended reality in AEC industry. Autom. Constr. 116, 103254 (2020)

    Article  Google Scholar 

  6. Brown, L.J.: Professional reflection – mixed reality to augment the next generation of aviation professionals. In: Kearns, S.K., Mavin, T.J., Hodge, S. (eds.) Engaging the Next Generation of Aviation Professionals, pp. 163–180. Routledge, New York, NY (2020)

    Google Scholar 

  7. Palmarini, R., Erkouncu, J.A., Roy, R.: A systematic review of augmented reality applications in maintenance. Robot. Comput. Integr. Manuf. 49, 215–228 (2018)

    Article  Google Scholar 

  8. Eschen, H., Kötter, T., Rodeck, R., Harnisch, M., Shüppstuhl, T.: Augmented and virtual reality for inspection and maintenance processes in the aviation industry. Proc. Manuf. 19, 156–163 (2018)

    Google Scholar 

  9. Bernard, F., Zare, M., Sagot, J.: Using digital and physical simulation to focus on human factors and ergonomics in aviation maintainability. Hum. Factors 62(1), 37–54 (2020)

    Article  Google Scholar 

  10. Bagassi, S., De Crescenzio, F., Lucchi, F., Masotti, N.: Augmented and virtual reality in the airport control tower. In: 30th Congress of the International Council of the Aeronautical Sciences, pp. 1–8, Daejeon, South Korea (2016)

    Google Scholar 

  11. Bailey, S.K.T., Johnson, C.I., Schroeder, B.L., Marraffino, M.D.: Using virtual reality for training maintenance procedures. In: Interservice/Industry Training, Simulation, and Education Conference (I/TSEC) 2017, vol. 17108, pp. 1–11 (2017)

    Google Scholar 

  12. Buttussi, F., Chittaro, L.: A comparison of procedural safety training in three conditions: virtual reality headset, smartphone, and printed materials. IEEE Trans. Learn. Technol. 14(1), 1–15 (2021)

    Article  Google Scholar 

  13. Kaplan, A.D., Cruit, J., Endsley, M., Beers, S.M., Swayer, B.D., Hancock, P.A.: The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: a meta-analysis. Hum. Factors 63(4), 706–726 (2021)

    Article  Google Scholar 

  14. Schaffernak, H., Moesl, B., Vorraber, W., Koglbauer, I.V.: Potential augmented reality application areas for pilot education: an exploratory study. Educ. Sci. 10(4), 86 (2020)

    Article  Google Scholar 

  15. Luisier, J., Tsong, C. K., Yooyen, S.: XR training and confidence levels in undergraduate logistics management programs. In: 2nd Innovation Aviation and Aerospace Indsutry-International Conference, pp. 30–34 (2021)

    Google Scholar 

  16. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  17. Markowitz, D.M., Bailenson, J.N.: Virtual reality and emotion: a 5-year systematic review of empirical research (2015–2019). In: Nabi, R., Myrick, J. (eds.): Our Online Emotional Selves: The Link Between Digital Media and Emotional Experience. Oxford University Press (2021). (in press)

    Google Scholar 

  18. Ceruti, A., Marzocca, P., Liverani, A., Bil, C.: Maintenance in aeronautics in an Industry 4.0 context: the role of augmented reality and additive manufacturing. J. Comput. Des. Eng. 6, 516–526 (2019)

    Google Scholar 

  19. Han, K., Shah, S.H.H., Lee, J.W.: Holographic mixed reality system for air traffic control and management. Appl. Sci. 9, 3370 (2019)

    Article  Google Scholar 

  20. Van Eck, N.J., Waltman, L.: Software survey: VOS viewer, a computer program for bibliometric mapping. Scientometrics 84(2), 523–538 (2010)

    Article  Google Scholar 

  21. Yong, S.W., Sung, A.N.: A mobile application of augmented reality for aircraft maintenance of fan cowl door opening. Int. J. Comput. Netw. Inf. Secur. 11(6), 38–44 (2019)

    Google Scholar 

  22. Hebert Jr, T.: The impacts of using augmented reality to support aircraft maintenance. Master's thesis, Air Force Institute of Technology (2019)

    Google Scholar 

  23. Borgen, K.B., Ropp, T.D., Weldon, W.T.: Assessment of augmented reality technology’s impact on speed of learning and task performance in aeronautical engineering technology education. Int. J. Aerosp. Psychol. 31(3), 219–229 (2021)

    Article  Google Scholar 

  24. Wang, Y., Anne, A., Ropp, T.: Applying the technology acceptance model to understand aviation students’ perceptions toward augmented reality maintenance training instruction. Int. J. Aviat. Aeronaut. Aerosp. 3(4), 3 (2016)

    Google Scholar 

  25. Papakostas, C., Troussas, C., Krouska, A., Sgouropoulou, C.: Measuring user experience, usability, and interactivity of a personalized mobile augmented reality training system. Sensors 21, 3888 (2021)

    Article  Google Scholar 

  26. Gangabissoon, T., Bekaroo, G., Moedeen, W.: Application of augmented reality in aviation: Improving engagement of cabin crew during emergency procedures training. In Proceedings of the 2nd International Conference on Intelligent and Innovative Computing Applications, pp. 1–8, September 2020

    Google Scholar 

  27. Moesl, B., Schaffernak, H., Vorraber, W., Braunstingl, R., Herrele, T., Koglbauer, I.V.: A research agenda for implementing augmented reality in Ab Initio Pilot training. Aviat. Psychol. Appl. Human Factors 11(2), 118–126 (2021)

    Article  Google Scholar 

  28. Anne, A., Wang, Y., Ropp, T.D.: Using augmented reality and computer-generated three-dimensional models to improve training and technical tasks in aviation. In: 18th International Symposium on Aviation Psychology, p. 452 (2015)

    Google Scholar 

  29. Brown, L.: The next generation classroom: Transforming aviation training with augmented reality (2017)

    Google Scholar 

  30. Brown, C., Hicks, J., Rinaudo, C.H., Burch, R.: The use of augmented reality and virtual reality in ergonomic applications for education, aviation, and maintenance (2021)

    Google Scholar 

  31. Biggs, A.T., Geyer, D.J., Schroeder, V.M., Robinson, F.E., Bradley, J.L.: Adapting virtual reality and augmented reality systems for naval aviation training (Report No. NAMRU-D-9-13), Naval Medical Research Unit Dayton (2018)

    Google Scholar 

  32. Girdler, A., Georgiou, O.: Mid-air haptics in aviation–creating the sensation of touch where there is nothing but thin air. arXiv preprint arXiv: 2001.01445 (2020)

    Google Scholar 

  33. Kim, D.H., Go, Y.G., Choi, S.M.: An aerial mixed-reality environment for first-person-view drone flying. Appl. Sci. 10(16), 5436 (2020)

    Article  Google Scholar 

  34. Brown, L.J.: Professional reflection–mixed reality to augment the next generation of aviation professionals. In: Engaging the Next Generation of Aviation Professionals, pp. 163–180, Routledge (2019)

    Google Scholar 

  35. Siyaev, A., Jo, G.: Towards aircraft maintenance metaverse using speech interactions with virtual objects in mixed reality. Sensors 21, 2066 (2021)

    Article  Google Scholar 

  36. Tsykunov, E., Ibrahimov, R., Vasquez, D., Tsetserukou, D.: SlingDrone: mixed reality system for pointing and interaction using a single drone. In 25th ACM Symposium on Virtual Reality Software and Technology, pp. 1–5, November 2019

    Google Scholar 

  37. D’Anniballe, A., Silva, J., Marzocca, P., Ceruti, A.: The role of augmented reality in air accident investigation and practitioner training. Reliab. Eng. Syst. Saf. 204, 1–11 (2020)

    Article  Google Scholar 

  38. Meister, P., Wang, K, Dorneich, M.C., Winer, E., Brown, L., Whitehurst, G.: Applying Augmented Reality Capabilities to Enhance General Aviation Weather Training. AIAA Aviation Forum (2021)

    Google Scholar 

  39. Landas, E.L.: The next generation of aviation maintenance training: game based and virtual reality augmented learning. Naval Postgraduate School Monterey United States (2018)

    Google Scholar 

  40. Chittaro, L., Corbett, C.L., McLean, G.A., Zangrando, N.: Safety knowledge transfer through mobile virtual reality: a study of aviation life preserver donning. Saf. Sci. 102, 159–168 (2018)

    Article  Google Scholar 

  41. Oberhauser, M., Dreyer, D., Braunstingl, R., Koglbauer, I.: What’s real about virtual reality flight simulation? Aviation Psychol. Appl. Human Factors 8(1), 22–34 (2018)

    Article  Google Scholar 

  42. Thomas, R.L., et al.: Usability of the virtual reality aviation trainer for runway-width illusions. Colleg. Aviat. Rev. Int. 39(2), 163–179 (2021)

    Google Scholar 

  43. Haritos, T., Fussell, S.G.: Implementing immersive virtual reality in an aviation/aerospace teaching and learning paradigm (2018)

    Google Scholar 

  44. Geyer, D.J., Biggs, A.T.: The persistent issue of simulator sickness in naval aviation training. Aerosp. Med. Human Perform. 89(4), 396–405 (2018)

    Article  Google Scholar 

  45. Irvin, W., Goldie, C., O’Brien, C., Aura, C., Temme, L., Wilson, M.: A virtual reality aviation emergency procedure (EP) testbed. In Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations II, vol. 11759, p. 1175909. International Society for Optics and Photonics, April 2021

    Google Scholar 

  46. Fussell, S.G., Truong, D.: Using virtual reality for dynamic learning: an extended technology acceptance model. Virtual Real. 26, 1–19 (2021). https://doi.org/10.1007/s10055-021-00554-x

    Article  Google Scholar 

  47. Syiem, B.V., Kelly, R.M., Goncalves, J., Velloso, E., Dingler, T.: Impact of task on attentional tunneling in handheld augmented reality. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 1–14. Yokohama, Japan (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Civil Aerospace Medical Institute, Oklahoma City, OK, 73169, USA

    Brett Torrence & Jeffrey Dressel

Authors
  1. Brett Torrence
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jeffrey Dressel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Brett Torrence .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Torrence, B., Dressel, J. (2022). Critical Review of Extended Reality Applications in Aviation. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06015-1_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06014-4

  • Online ISBN: 978-3-031-06015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation