Abstract
Extended reality (XR) training offers pilots unlimited access to familiarize themselves with aircraft systems, instrument procedures, Head-Up Display (HUD) symbology, and Enhanced Flight Vision System (EFVS) features before entering full flight simulator (FFS) training. Historically, HUD training has been accomplished through computer-based training (CBT), paper-based training (PBT), and lower-level flight training devices, but the future of HUD and EFVS training will be through highly immersive XR training. This is an outline for current use cases, software and hardware best practices, and training outlines that are elevated through the use of XR. Collins has set a precedent in the aviation industry by proposing XR training to be approved for ground and flight training in the FAA's Boeing 737 FSB Report. This inclusion of XR in the report is a formal way for the FAA to acknowledge XR as an acceptable way to train pilots, paving the way for the wider adoption of XR solutions in pilot training programs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Unreal Engine. CAE Pivots to Unreal Engine for Next-Gen Flight Simulators (2022). www.unrealengine.com/en-US/spotlights/cae-pivots-to-unreal-engine-for-next-gen-flight-simulators
Cooper, N., et al.: Transfer of training-virtual reality training with augmented multisensory cues improves user experience during training and task performance in the real world. PLOS ONE. Public Library of Science (2021). https://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0248225
Federal Aviation Administration, Advisory Circular 90–106B, Enhanced Flight Vision System Operations (2017)
Federal Aviation Administration. Flight Simulator Qualification Test Guide (2019)
Federal Aviation Administration. Code of Federal Regulations, Part 60 (2023)
Federal Aviation Administration, Boeing 737 Flight Standardization Board Report (2021)
Jamalian, N., Gillies, M., Leymarie, F.F., Pan, X.: The effects of hand tracking on user performance: an experimental study of an object selection based memory game. In: 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 768–776. Singapore, (2022). https://doi.org/10.1109/ISMAR55827.2022.00095
Josephs, L.: A severe pilot shortage in the U.S. leaves airlines scrambling for solutions, CNBC, CNBC (2022). https://www.cnbc.com/2022/05/15/us-pilot-shortage-forces-airlines-to-cut-flights-scramble-for-solutions.html. Accessed 20 Dec 20 2022
Khronos Group. OpenXR. (2020). https://www.khronos.org/openxr/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Morrison, K., Perkins, A., Hanson, A. (2023). HUD Training and Extended Reality Solutions. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. HCII 2023. Lecture Notes in Computer Science, vol 14027. Springer, Cham. https://doi.org/10.1007/978-3-031-35634-6_40
Download citation
DOI: https://doi.org/10.1007/978-3-031-35634-6_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35633-9
Online ISBN: 978-3-031-35634-6
eBook Packages: Computer ScienceComputer Science (R0)