Skip to main content

Military Applications of Augmented Reality

  • Chapter
  • First Online:
Handbook of Augmented Reality

Abstract

This chapter reviews military benefits and requirements that have led to a series of research efforts in augmented reality (AR) and related systems for the military over the past few decades, beginning with the earliest specific application of AR. While by no means a complete list, we note some themes from the various projects and discuss ongoing research at the Naval Research Laboratory. Two of the most important thrusts within these applications are the user interface and human factors. We summarize our research and place it in the context of the field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ai Z, Livingston MA (2009) Integration of georegistered information on a virtual globe. In: IEEE International Symposium on Mixed and Augmented Reality 2009 (Poster Session)

    Google Scholar 

  2. Azuma RT (1997) A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(4):355–385

    Google Scholar 

  3. Baillot Y, Julier SJ, Brown D, Livingston MA (2003) A tracker alignment framework for augmented reality. In: IEEE International Symposium on Mixed and Augmented Reality, pp 142–150

    Google Scholar 

  4. Bane R, Höllerer T (2004) Interactive tools for virtual x-ray vision in mobile augmented reality. In: International Symposium on Mixed and Augmented Reality, pp 231–239

    Google Scholar 

  5. Barham P, Plamondon B, Dumanoir P, Garrity P (2002) VICTER: An embedded virtual simulation system for land warrior. In: 23rd Army Science Conference

    Google Scholar 

  6. Benford S, Fahlén L (1993) A spatial model of interaction in large virtual environments. In: Third European Conference on Computer-Supported Cooperative Work, pp 109–124

    Google Scholar 

  7. Bolstad CA, Endsley MR (2002) Tools for supporting team sa and collaboration in army operations. Tech. rep., SA Technologies

    Google Scholar 

  8. Bowman E, Cosenzo K, Hill SG, Grynovicki J, Branscome TA, Brelsford M, Savage-Knepshield P (2006) C4ISR on-the-move testbed 2005 experiment: Human factors analysis. Tech. rep., Army Research Laboratory, Human Research and Engineering Directorate

    Google Scholar 

  9. Brown DG, Baillot Y, Julier SJ, Maassel P, Armoza D, Livingston MA, Rosenblum LJ (2004a) Building a mobile augmented reality system for embedded training: Lessons learned. In: Interservice/Industry Training, Simulation, and Education Conference

    Google Scholar 

  10. Brown DG, Julier SJ, Baillot Y, Livingston MA, Rosenblum LJ (2004b) Event-based data distribution for mobile augmented reality and virtual environments. Presence: Teleoperators and Virtual Environments 13(2):211–221

    Article  Google Scholar 

  11. Brown DG, Baillot Y, Bailey MP, Pfluger KC, Maassel P, Thomas J, Julier SJ (2005) Using augmented reality to enhance fire support team training. In: Interservice/Industry Training, Simulation, and Education Conference

    Google Scholar 

  12. Brown DG, Stripling R, Coyne JT (2006) Augmented reality for urban skills training. In: IEEE Virtual Reality Conference

    Google Scholar 

  13. Cox M (2008) Land warrior: Now or later? Army Times Retrieved from http://www.armytimes.com/news/2008/10/army_landwarrior_101308w/, 22 December 2010

  14. Cubic Corp (2011) Combatredi®; . Retrieved 12 January 2011 from http://www.cubic.com/cda1/prod_&_serv/defense/training_products/virtual_training/combatredi.html

  15. Curtis D, Mizell D, Gruenbaum P, Janin A (1998) Several devils in the details: Making and AR application work in the airplane factory. In: Augmented Reality: Placing Artificial Objects in Real Scenes (Proceedings of the First International Workshop on Augmented Reality

    Google Scholar 

  16. Defense Advanced Research Projects Agency (2010) Urban leader tactical response, awareness and visualization. http://www.darpa.mil/i2o/programs/uvis/uvis.asp, retrieved 22 December 2010

  17. Department of the Army (2001) Operational requirements document (revised) for land warrior

    Google Scholar 

  18. DISA Standards Management Branch (2008) Department of Defense interface standard: Common warfighting symbology. http://assist.daps.dla.mil/quicksearch/basic_profile.cfm?ident_number=114934

  19. Division UMCD (1998) Military operations on urbanized terrain (MOUT). Marine Corps Warfighting Publication No. MCWP 3-35.3

    Google Scholar 

  20. Feiner S, MacIntyre B, Höllerer T, Webster A (1997) A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In: First International Symposium on Wearable Computing (ISWC), pp 74–81

    Google Scholar 

  21. Furness LTA (1969) The application of head-mounted displays to airborne reconnaissance and weapon delivery. Tech. Rep. TR-69-241, U.S. Air Force Avionics Laboratory, Wright-Patterson AFB

    Google Scholar 

  22. Furness TA (1986) The super cockpit and its human factors challenges. In: Proceedings of the Human Factors Society 30th Annual Meeting, Human Factors and Ergonomics Society, pp 48–52

    Google Scholar 

  23. Gabbard JL, Swan II JE, Hix D, Lanzagorta M, Livingston MA, Brown D, Julier S (2002) Usability engineering: Domain analysis activities for augmented reality systems. In: Woods AJ, Bolas MT, Merritt JO, Benton SA (eds) Proceedings of SPIE: Stereoscopic Displays and Virtual Reality Systems IX, Vol. 4660, pp 445–457

    Google Scholar 

  24. Gardley M, Bishop L, McCollon B, Clemons L, Mayberry R, Kohler T (2008) Loadmaster training utilizing augmented reality. Tech. rep., Air Education and Training Command, Randolph AFB

    Google Scholar 

  25. General Dynamics Corp (2010) Virtual warrior. Retrieved 02 December 2010 from http://www.gdc4s.com/content/detail.cfm?item=d3ae855e-74ab-4af0-8c56-abad8be8ea0 f&page=1&ParentPageID=177d49b8-73c6-479f-94e8-f79826e1d422

  26. Gould J (2010) Infantry battalion tests nett warrior. Army Times Retrieved from http://www.armytimes.com/news/2010/10/infantry-battalion-tests-nett-war%rior-103010w/, 22 December 2010

    Google Scholar 

  27. Gumm M, Marshakm W, Branscome T, McWesler M, Patton D, Mullins L (1998) A comparison of solider performance using current land navigation equipment with information integrated on a helmet-mounted display. Tech. Rep. ARL-TR-1604, Army Research Laboratory, Aberdeen Proving Ground

    Google Scholar 

  28. Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research, North Holland Press, pp 239–250

    Google Scholar 

  29. Henderson SJ, Feiner S (2011) Exploring the benefits of augmented reality documentation for maintenance and repair. To appear in IEEE Transactions on Visualization and Computer Graphics http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.245

  30. Hughes CE, Stapleton CB, Moshell JM, Micikevicius P (2002) Challenges and opportunities simulating future combat systems via mixed reality. In: 23rd Army Science Conference

    Google Scholar 

  31. Julier S, Lanzagorta M, Baillot Y, Brown D (2002) Projects in VR: Information filtering for mobile augmented reality. IEEE Computer Graphics & Applications 22(5):12–15

    Article  Google Scholar 

  32. Julier S, Livingston MA, Swan II JE, Baillot Y, Brown D (2003) Adaptive user interfaces in augmented reality. In: Proceedings of Workshop on Software Technology for Augmented Reality Systems

    Google Scholar 

  33. Livingston MA (2006) Quantification of visual capabilities using augmented reality displays. In: IEEE International Symposium on Mixed and Augmented Reality, pp 3–12

    Google Scholar 

  34. Livingston MA, Ai Z (2008) The effect of registration error on tracking distant augmented objects. In: International Symposium on Mixed and Augmented Reality

    Google Scholar 

  35. Livingston MA, Rosenblum LJ, Julier SJ, Brown D, Baillot Y, Swan II JE, Gabbard JL, Hix D (2002) An augmented reality system for military operations in urban terrain. In: Interservice/Industry Training, Simulation, and Education Conference

    Google Scholar 

  36. Livingston MA, Swan II JE, Gabbard JL, Höllerer TH, Hix D, Julier SJ, Baillot Y, Brown D (2003) Resolving multiple occluded layers in augmented reality. In: IEEE International Symposium on Mixed and Augmented Reality, pp 56–65

    Google Scholar 

  37. Livingston MA, Swan II JE, Julier SJ, Baillot Y, Brown D, Rosenblum LJ, Gabbard JL, Höllerer TH, Hix D (2004) Evaluating system capabilities and user performance in the battlefield augmented reality system. In: Performance Metrics for Intelligent Systems Workshop (PerMIS), National Institute of Standards and Technology

    Google Scholar 

  38. Livingston MA, Zanbaka C, Swan II JE, Smallman HS (2005) Objective measures for the effectiveness of augmented reality. In: IEEE Virtual Reality, pp 287–288

    Google Scholar 

  39. Livingston MA, Brown D, Julier SJ, Schmidt GS (2006a) Mobile augmented reality: Applications and human factors evaluations. In: Virtual Media for Military Applications (RTO Meeting Proceedings No. RTO-MP-HFM-136), Research and Technology Organisation, Neuilly-sur-Seine, France, pp 25–1—25–16

    Google Scholar 

  40. Livingston MA, Julier SJ, Brown D (2006b) Situation awareness for teams of dismounted warfighters and unmanned vehicles. In: Proceedings of SPIE: Enhanced and Synthetic Vision, Vol. 6266

    Google Scholar 

  41. Livingston MA, Lederer A, Ellis SR, White SM, Feiner SK (2006c) Vertical vergence calibration for augmented reality displays. In: IEEE Virtual Reality (Poster Session)

    Google Scholar 

  42. Livingston MA, Ai Z, Decker J (2009a) A user study towards understanding stereo perception in head-worn augmented reality displays. In: IEEE International Symposium on Mixed and Augmented Reality, pp 53–56

    Google Scholar 

  43. Livingston MA, Ai Z, Swan II JE, Smallman HS (2009b) Indoor vs. outdoor depth perception for mobile augmented reality. In: IEEE Virtual Reality

    Google Scholar 

  44. Livingston MA, Barrow JH, Sibley CM (2009c) Quantification of contrast sensitivity and color perception using head-worn augmented reality displays. In: IEEE Virtual Reality

    Google Scholar 

  45. Livingston MA, Ai Z, Karsch K, Gibson, MSC, USN LO (2011) User interface design for military ar applications. Virtual Reality (UK)

    Google Scholar 

  46. MacIntyre B, Coelho EM, Julier S (2002) Estimating and adapting to registration errors in augmented reality systems. In: IEEE Virtual Reality, pp 73–80

    Google Scholar 

  47. Mohl R (1981) Cognitive space in the interactive movie map: An investigation of spatial learning in virtual environments. PhD thesis, Massachusetts Institute of Technology

    Google Scholar 

  48. Muller P (2010) The future immersive training environment (FITE) JCTD: Improving readiness through innovation. In: Interservice/Industry Training, Simulation, and Education Conference

    Google Scholar 

  49. Naimark M (1979) Spatial correspondence – a study in environmental media. Master’s thesis, Massachusetts Institute of Technology

    Google Scholar 

  50. Office of Naval Research (2010) Human performance training and education thrust. http://www.onr.navy.mil/Science-Technology/Departments/Code-30/All-Programs/Human-Performance-Training.aspx, retrieved 22 December 2010

  51. Orasanu J (2005) What neeeds to be shared in shared situation models? In: DoD Human Factors Engineering Technical Advisory Group Meeting 54

    Google Scholar 

  52. Quantum3D, Inc (2010) Expeditiondi®; . Retrieved 02 December 2010 from http://www.quantum3d.com/solutions/immersive/expedition_di.html

  53. Schmidt GS, Brown DG, Tomlin EB, Swan II JE, Baillot Y (2006) Probabilistic algorithms, integration, and empirical evaluation for disambiguating multiple selections in frustum-based pointing. Journal of Multimedia 1(3):1–12

    Article  Google Scholar 

  54. Schmorrow C, Cohn L, Stripling R, Kruse A (2004) Enhancing virtual environments using sensory-multiplexing. In: Interservice/Industry Training, Simulation, and Education Conference

    Google Scholar 

  55. State A, Livingston MA, Hirota G, Garrett WF, Whitton MC, Pisano ED, Fuchs H (1996) Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies. In: SIGGRAPH ’96: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp 439–446

    Google Scholar 

  56. Stix G (1992) See-through view: Virtual reality may guide physician’s hands. Scientific American 267(3):166

    Article  Google Scholar 

  57. Sutherland IE (1965) The ultimate display. In: Proceedings of the IFIP Conference, pp 506–508

    Google Scholar 

  58. Sutherland IE (1968) A head-mounted three-dimensional display. In: AFIPS’68: Fall Joint Computer Conference, pp 757–764

    Google Scholar 

  59. Swan II JE, Livingston MA, Smallman HS, Brown D, Baillot Y, Gabbard JL, Hix D (2006) A perceptual matching technique for depth judgments in optical, see-through augmented reality. In: IEEE Virtual Reality, pp 19–26

    Google Scholar 

  60. Van Riper PK (1997) A concept for future military operations on urbanized terrain. Available from http://www.globalsecurity.org/military/library/policy/usmc/mout.pdf

Download references

Acknowledgements

A complex system such as BARS cannot be constructed by even a modest-sized team such as the author list of this text. Numerous employees, interns, and university collaborators have been an integral part of the research over the past decade: Marco Lanzagorta, Doug Maxwell, Steven Feiner, Blaine Bell, Deborah Hix, Joseph L. Gabbard, Tobias Höllerer, Blair MacIntyre, Enylton Coelho, Ulrich Neumann, Suya You, Reinhold Behringer, Catherine Zanbaka, Aaron Kotranza, Robert Dickerson, Jane Barrow, Evan Suma, Brent Daugherty, Dennis Lin, Bryan Hurley, Elliot Cooper-Balis, Adam Lederer, Jason Jerald, Erik Tomlin, Eric Burns, Donald Charity, Joshua Eliason, Jesus Arango, and Scott Frees. In addition, the authors would like to thank Henry Fuchs, Pete Muller, Steven Feiner, and Randy Mayberry for assistance in the preparation of this manuscript.

Current affiliations for the authors no longer affiliated with the Naval Research Laboratory are: Lawrence J. Rosenblum, National Science Foundation; Simon J. Julier, University College London; Dennis G. Brown, USAF Materiel Command, Warner Robins Air Logistics Center; Gregory S. Schmidt, SPADAC, Inc.; Yohan Baillot, Simulation3D, LLC; J. Edward Swan II, Mississippi State University; Paul Maassel, Reallaer, LLC. Interested readers may contact Mark A. Livingston for further information.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark A. Livingston .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Livingston, M.A. et al. (2011). Military Applications of Augmented Reality. In: Furht, B. (eds) Handbook of Augmented Reality. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0064-6_31

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-0064-6_31

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-0063-9

  • Online ISBN: 978-1-4614-0064-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics