Skip to main content
SpringerLink
Log in

Preliminary Findings: Application of Maintenance Instructions Displayed in Augmented Reality

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13318))

Included in the following conference series:

Abstract

This paper explores the use of Augmented Reality (AR) in aviation maintenance and describes a new research study conducted in partnership with a manufacturer and a Part 121 operator. The study aims to understand the applicability of displaying maintenance instructions on a head-worn AR device. In the current study, four aviation maintenance technicians interacted with novel AR technology while performing a landing gear lubrication task. Participants reported generally positive perceptions of usability and user experience. However, some ergonomic/comfort and safety concerns were identified, along with considerations and practical applications for the AR technology. These preliminary findings illustrate the possible utility of AR in aviation maintenance, but further work is needed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note: rates vary depending on factors such as the database, aircraft type, years of study, etc.

  2. 2.

    The response options were: Strongly disagree (1); Somewhat disagree (2); Neither disagree or agree (3); Somewhat agree (4); Strongly agree (5).

References

  1. Avers, K.E., Johnson, W.B., Banks, J.O., Nei, D.: Prioritizing Mx human factors challenges and solutions. In: Workshop Proceedings (Report No. DOT/FAA/AM-11/11). Federal Aviation Administration Office of Aerospace Medicine, Washington, DC (2011)

    Google Scholar 

  2. Baron, R.I.: An exploration of deviations in aircraft maintenance procedures. Int. J. Appl. Aviat. Stud. 9(1), 197–206 (2009)

    Google Scholar 

  3. Bowling, S.R., Khasawneh, M.T., Kaewkuekool, S., Jiang, X., Gramopadhye, A.K.: Evaluating the effects of virtual training in an aircraft maintenance task. Int. J. Aviat. Psychol. 18(1), 104–116 (2008). https://doi.org/10.1080/10508410701749506

    Article  Google Scholar 

  4. Boyd, D., Stolzer, A.: Causes and trends in mx-related accidents in FAA-certified single engine piston aircraft. J. Aviat. Technol. Eng. 5(1), 17–24 (2015)

    Article  Google Scholar 

  5. Braly, A.M., Nuernberger, B., Kim, S.Y.: Augmented reality improves procedural work on an International Space Station science instrument. Hum. Factors 61(6), 866–878 (2019). https://doi.org/10.1177/0018720818824464

    Article  Google Scholar 

  6. Brooke, J.: SUS: a quick and dirty usability scale. Usabil. Eval. Indust. 189(194), 4–7 (1996)

    Google Scholar 

  7. Buderath, M., McDonald, N., Grommes, P., Morrison, R.: The operational impact to the maintainer (ground crew support and human factors). In: IET Seminar on Aircraft Health Management and New Operational and Enterprise Solutions, London (2008). https://doi.org/10.1049/ic:20080633

  8. Civil Aviation Authority: CAP 1036 - Global fatal accident review 2002 to 2011. United Kingdom (2013)

    Google Scholar 

  9. De Crescenzio, F., Fantini, M., Persiani, F., Di Stefano, L., Azzari, P., Salti, S.: Augmented reality for aircraft maintenance training and operations support. IEEE Comput. Graphics Appl. 31(1), 96–101 (2011). https://doi.org/10.1049/ic:20080633

    Article  Google Scholar 

  10. Eschen, H., Kötter, T., Rodeck, R., Harnisch, M., Schüppstuhl, T.: Augmented and virtual reality for inspection and maintenance processes in the aviation industry. Proc. Manuf. 19, 156–163 (2018). https://doi.org/10.1016/j.promfg.2018.01.022

    Article  Google Scholar 

  11. Goldman, S.M., Fiedler, E.R., King, R.E.: General aviation maintenance-related accidents: a review of ten years of NTSB data (Report No. DOT/FAA/AM-02/23). Federal Aviation Administration, Office of Aerospace Medicine (2002)

    Google Scholar 

  12. Hebert, T.R.: The impacts of using augmented reality to support aircraft maintenance. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio (2019)

    Google Scholar 

  13. Henderson, S.J., Feiner, S.K.: Augmented reality in the psychomotor phase of a procedural task. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland (2011). https://doi.org/10.1109/ISMAR.2011.6092386

  14. Hobbs, A., Williamson, A.: Aircraft maintenance survey results. Australian Transport Safety Bureau (2000)

    Google Scholar 

  15. Jo, G-S., et al.: A unified framework for augmented reality and knowledge-based systems in maintaining aircraft. In: Proceedings of the Twenty-Sixth Annual Conference on Innovative Applications of Artificial Intelligence, pp. 2990–2997 (2014)

    Google Scholar 

  16. Keesling, R.B.: Exploratory analysis of the potential use of augmented reality in aircraft maintenance. Theses and Dissertations, Air Force Institute of Technology, 2305 (2019)

    Google Scholar 

  17. Langer, M., Braithwaite, G.R.: The development and deployment of a maintenance operations safety survey. Hum. Factors 58(7), 986–1006 (2016). https://doi.org/10.1177/0018720816656085

    Article  Google Scholar 

  18. Loizeau, Q., Danglade, F., Ababsa, F., Merienne, F.: Methodology for the field evaluation of the impact of augmented reality tools for maintenance workers in the aeronautic industry. Front. Virtual Real. 1, 603189 (2021). https://doi.org/10.3389/frvir.2020.603189

    Article  Google Scholar 

  19. Marais, K.B., Robichaud, M.R.: Analysis of trends in aviation maintenance risk: an empirical approach. Reliab. Eng. Syst. Saf. 106, 104–118 (2012)

    Article  Google Scholar 

  20. Palmarini, R., Erkoyuncu, J.A., Roy, R.: An innovative process to select augmented reality (AR) technology for maintenance. Proc. CIRP 59, 23–28 (2017). https://doi.org/10.1016/j.procir.2016.10.001

    Article  Google Scholar 

  21. Pozzi, J.: Will Virtual Reality Shape the Future of MRO Training? (2016). http://www.mro-network.com/

  22. Rankin, W.: Failure to follow procedures: airline engineering and maintenance safety. In: Flightglobal and Flight International in Partnership with the Flight Safety Foundation Airline Engineering and Maintenance Safety, London, England (2013)

    Google Scholar 

  23. Schmidt, J., Lawson, D., Figlock, R.: Human Factors Analysis and Classification System-Maintenance Extension (HFACS-ME) Review of Select NTSB Maintenance Mishaps: An Update (2012). https://www.faa.gov/about/initiatives/Mx_hf/library/documents/media/hfacs/ntsb_hfacs-me_updated_study_report.pdf

  24. Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 73–80 (2003). https://doi.org/10.1145/642611.642626

  25. Tang, K.S., Cheng, D.L., Mi, E., Greenberg, P.: Augmented reality in medical education: a systematic review. Canadian Med. Educ. J. 11(1), e81–e96 (2020)

    Google Scholar 

  26. Taylor, M.: TATEM: technologies and techniques for new maintenance concepts. Published Summary. http://cordis.europa.eu/publication/rcn/11816_en.html

  27. Ward, M., Gaynor, D., Nuget, T., Morrison, R.: HILAS maintenance solutions: challenges and potentials for the aircraft maintenance industry. In: 2008 IET Seminar on Aircraft Health Management for New Operational and Enterprise Solutions, London. (2008). https://doi.org/10.1049/ic:20080643

  28. Wiedenmaier, S., Oehme, O., Schmidt, L., Luczak, H.: Augmented reality (AR) for assembly processes design and experimental evaluation. Int. J. Human Comput. Interact. 16(3), 497–514 (2003). https://doi.org/10.1207/S15327590IJHC1603_7

    Article  Google Scholar 

  29. Williams, M.A., McVeigh, J., Handa, A.I., Lee, R.: Augmented reality in surgical training: a systematic review. Postgraduate Med. J. 96(1139), 537–542 (2020)

    Article  Google Scholar 

  30. Worsfold, M., Asseman, P.: TATEM’s contribution to a future health managed enterprise (overview, context and emerging operational needs). In: IET Seminar on AHM for New Operational Enterprise Solutions. IET, Savoy Place, London, UK (2008). https://doi.org/10.1049/ic:20080631

Download references

Author information

Authors and Affiliations

  1. Civil Aerospace Medical Institute, Federal Aviation Administration, Oklahoma City, OK, 73125, USA

    Kylie Key & Katrina Avers

  2. The Boeing Company, Seal Beach, CA, 90740, USA

    Maggie Ma, Chris Towne, Steven C. Franzman & David R. Aguilar

  3. Cherokee Nation Support, Service and Solutions, Oklahoma City, OK, 73125, USA

    Inchul Choi, Peter T. Hu & David J. Schroeder

Authors
  1. Kylie Key
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maggie Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chris Towne
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Inchul Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peter T. Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Steven C. Franzman
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. David R. Aguilar
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. David J. Schroeder
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Katrina Avers
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kylie Key .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2022 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Key, K. et al. (2022). Preliminary Findings: Application of Maintenance Instructions Displayed in Augmented Reality. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06015-1_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06014-4

  • Online ISBN: 978-3-031-06015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation