Skip to main content
SpringerLink
Log in

Head-Mounted Projection Display Technology and Applications

  • Chapter
  • First Online:
Handbook of Augmented Reality

Abstract

Recent advances in microelectronics and the rapid growth of digital information have led to exciting new display technologies which are suitable to a wide variety of application domains. Head-mounted projection display (HMPD) has been actively developed in the recent decade as an alternative to conventional eyepiece-type head-mounted displays. HMPD replaces the eyepiece-type optics with a projection lens and employs a retroreflective screen instead of the diffusing screens typical to standalone projection-based systems. This unique combination of projection and retroreflection gives HMPD technology several remarkable advantages that make it suitable for collaborative visualization and augmented reality applications. In this chapter, we will review the fundamentals of HMPD technology and outline design considerations relating to the human visual system. We will summarize recent technological advancements, including efforts to improve the field of view and enhance image brightness. We will examine the significance of the retroreflective materials and their effects on imaging resolution and user perception. Finally, we will discuss a variety of application directions and user interface capabilities that have been enabled through HMPD technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. Macintyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, 21(6), 34–47, 2001.

    Article  Google Scholar 

  2. F. Biocca and J.P. Rolland, “Teleportal Face-to-Face System,” U.S. Patent 6,774,869, August 10, 2004.

    Google Scholar 

  3. E. Bier, M. Stone, K. Pier, W. Buxton, and T. DeRose, “Toolglass and Magic Lenses: The See-through Interface,” Proc. of ACM Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), p. 73–80, 1993.

    Google Scholar 

  4. L.D. Brown, H. Hua, “A Widget Framework for Augmented Interaction in SCAPE,” CHI Letters/Proc. of ACM International Symposium on User Interface Software and Technology (UIST), 5(2), 1–10, 2003.

    Google Scholar 

  5. L.D. Brown and H. Hua, “Toward a Tangible Interface for Multi-Modal Interior Design Using SCAPE,” Proc. of IEEE Virtual Reality (IEEE VR) Workshop on 3D User Interfaces: Beyond Wand & Glove-Based Interaction (3DUI), Chicago, IL, p. 79–83, 2004.

    Google Scholar 

  6. L.D. Brown and H. Hua, “Magic Lenses for Augmented Virtual Environments,” IEEE Computer Graphics & Applications, 26(4), 64–73, 2006.

    Article  Google Scholar 

  7. O. Cakmakci and J. Rolland, “Head-work displays: a review,” J. of Display Technology, 2(3),199–216, 2006.

    Article  Google Scholar 

  8. A. Cameron, “The application of holographic optical waveguide technology to Q − SightTM family of helmet mounted display,” Proc. of SPIE, V. 7326, 73260H-1, 2009.

    Article  Google Scholar 

  9. C. Cruz-Neira, D. J. Sandin, T.A. DeFanti, R.V. Kenyon, and J. C. Cart, “The CAVE: Audio visual experience automatic virtual environments”. Communications of the ACM, 35(6), 65–72, 1992.

    Article  Google Scholar 

  10. L. Davis, J.P. Rolland, F. Hamza-Lup, Y. Ha, J. Norfleet, B. Pettitt, and C. Imielinska, “Enabling a Continuum of Virtual Environment Experiences” IEEE Computer Graphics and Applications, 23(2), 10–12, 2003.

    Google Scholar 

  11. J. G. Droessler, D. J. Rotier, “Tilted cat helmet-mounted display,” Opt. Eng., V. 29, 849, 1990.

    Article  Google Scholar 

  12. H. Eckhardt, “Simple model of corner reflector phenomena,” Applied Optics v. 10, 1559–1566, 1971.

    Article  Google Scholar 

  13. J. Fergason, “Optical system for head mounted display using a retro-reflector and method of displaying an image,” U.S. patent 5,621,572, 1997.

    Google Scholar 

  14. R. Fisher, “Head-mounted projection display system featuring beam splitter and method of making same,” U.S. Patent 5,572,229, 1996.

    Google Scholar 

  15. C. Fidopiastis, C. Fuhrman, C. Meyer, and J. P. Rolland, “Methodology for iterative evaluation of prototype head-mounted displays in virtual environments: visual acuity metrics,” Presence: Teleoperators and Virtual Environments, v. 14(5), 2005.

    Google Scholar 

  16. Y. Ha, H. Hua, R. Martins, and J.P. Rolland, “Design of a wearable wide-angle projection color display,” Proc. of International Optical Design Conference 2002 (IODC), 2002.

    Google Scholar 

  17. F. Hamza-Lup, L. Davis, and J.P. Rolland, “The ARC Display: An Augmented Reality Visualization Center,” Proc. of IEEE International Augmented reality Toolkit Workshop, Darmstadt, Germany, September, 2002.

    Google Scholar 

  18. H. Hua, A. Girardot, C. Gao, and J.P. Rolland, “Engineering of head-mounted projective displays,”Applied Optics, 39 (22), 3814–3824, 2000.

    Article  Google Scholar 

  19. H. Hua, C. Gao, F. Biocca, and J.P. Rolland, “An ultra-light and compact design and implementation of Head-Mounted Projective Displays”, Proc. IEEE Virtual Reality Annual International Symposium 2001, p.175–182, 2001.

    Google Scholar 

  20. H. Hua and J.P. Rolland, “Compact lens assembly for the teleportal augmented reality system,” US Patent 6,731,734 B1, May 2004.

    Google Scholar 

  21. H. Hua, C. Gao, L.D. Brown, N Ahuja, and J. P. Rolland. “Using a Head-Mounted Projective Display in Interactive Augmented Environments,” Proc. of IEEE International Symposium on Augmented Reality, 217–223, 2001.

    Google Scholar 

  22. H. Hua, C. Gao, and L.D. Brown, “A Testbed for Precise Registration, Natural Occlusion, and Interaction in an Augmented Environment Using Head-Mounted Projective Display,” Proc. of IEEE Virtual Reality, p. 81–89, 2002.

    Google Scholar 

  23. H. Hua, C. Gao, and J.P. Rolland, “Study of the imaging properties of retro-reflective materials used in head-mounted projective displays (HMPDs),” in SPIE Aerosense 2002, Orlando, FL, April 1–5, 2002.

    Google Scholar 

  24. H. Hua, L.D. Brown and C. Gao, “A New Collaborative Infrastructure: SCAPE,” Proc. of IEEE Virtual Reality (IEEE VR), p. 171–179, 2003.

    Google Scholar 

  25. H. Hua, Y. Ha, and J. P. Rolland, “Design of an ultralight and compact projection lens,” Applied Optics, 42, 97–107, 2003.

    Google Scholar 

  26. H. Hua, L.D. Brown, and C. Gao, “SCAPE: Supporting Stereoscopic Collaboration in Augmented and Projective Environments,” IEEE Computer Graphics and Applications, 24(1), p. 66–75, 2004.

    Article  Google Scholar 

  27. H. Hua, L.D. Brown, and C. Gao, “System and Interface Framework for SCAPE as a Collaborative Infrastructure,” Presence: Teleoperators and Virtual Environments, 13(2), p. 234–250, 2004.

    Article  Google Scholar 

  28. H. Hua and C. Gao, “A polarized head-mounted projective display,” Proceedings of 2005 IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 32–35, Oct. 2005.

    Google Scholar 

  29. H. Hua, “Merging the Worlds of Atoms and Bits: Augmented Virtual Environments,” Optics and Photonics News, 17(10), 26–33, 2006.

    Google Scholar 

  30. H. Hua and C. Gao, “Design of a bright polarized headmounted projection display” Appl. Opt. 46, 2600–2610, 2007.

    Google Scholar 

  31. M. Inami, N. Kawakami, D. Sekiguchi, Y. Yanagida, T. Maeda, and S. Tachi, “Visuo-Haptic Display Using Head-Mounted Projector,” Proc. of IEEE Virtual Reality, p. 233–240, 2000.

    Google Scholar 

  32. K. Inoguchi, H. Morishima, N. Nanaba, S. Takeshita, and Y. Yamazaki, “Fabrication and evaluation of HMD optical system consisting of aspherical mirrors without rotation symmetry,” Japan Optics’95, Extended Abstracts, 20pB06, pp. 19–20, 1995.

    Google Scholar 

  33. H. Ishii and B. Ullmer, “Tangible Bits: Towards Seamless Interfaces Between People, Bits, and Atoms,” Proc. of ACM Conference on Human Factors in Computing (CHI), p. 234–241, 1997.

    Google Scholar 

  34. N. Kawakami, M. Inami, D. Sekiguchi, Y. Yanagida, T. Maeda and S. Tachi, “Object-Oriented Displays: A New Type of Display Systems, from Immersive Display to Object-Oriented Displays,” Proc. of IEEE Systems, Man, and Cybernetics, (IEEE SMC), v.5, p. 1066–1069, 1999.

    Google Scholar 

  35. R. Kijima and M. Hirose, “A Compound Virtual Environment Using the Projective Head-Mounted Display,” Proc. of ACM International Conference on Artificial Reality and Tele-Existence/ ACM Conference on Virtual Reality Software and Technology (ICAT/VRST), p. 111–121, 1995.

    Google Scholar 

  36. R. Kijima and T. Ojika, “Transition between Virtual Environment and Workstation Environment with Projective Head-Mounted Display,” Proc. of IEEE Virtual Reality Annual International Symposium (VRAIS), p.130–137, 1997.

    Google Scholar 

  37. R. Kijima, K. Haza, Y. Tada, and T. Ojika, “Distributed Display Approach Using PHMD with Infrared Camera,” Proc. of IEEE Virtual Reality (IEEE VR), p. 33–40, 2002.

    Google Scholar 

  38. H. Kim and B. Lee, “Optimal design of retroreflection corner-cube sheets by geometric optics analysis,” Opt. Eng. (Bellingham) 46, 094002 (2007).

    Google Scholar 

  39. K. Kiyokawa, “A wide field-of-view head mounted projective display using hyperbolic half-silvered mirrors,” Proc. of IEEE International Symposium on Mixed & Augmented Reality (ISMAR), 2007.

    Google Scholar 

  40. K. Kiyokawa, M. Billinghurst, B. Campbell, E. Woods, “An occlusion-capable optical see-through head mount display for supporting colocated collaboration,” Proc. of IEEE International Symposium on Mixed & Augmented Reality (ISMAR), 133–141, 2003.

    Google Scholar 

  41. S.Y. Lee and H. Hua, “Effects of Viewing Conditions and Rotation Methods in a Collaborative Tabletop AR Environment,” Proc. of IEEE Virtual Reality (IEEE VR), p. 163–170, 2010.

    Google Scholar 

  42. J. Looser and M. Billinghurst, “Through the Looking Glass: Use of Lenses as an Interface Tool for AR Interfaces,” Proc. of ACM Conference on Computer Graphics and Interactive Techniques in Australia and South East Asia (GRAPHITE), p. 204–211, 2004.

    Google Scholar 

  43. R. Martins, V. Shaoulov, Y. Ha, and J.P. Rolland, “A mobile head-worn projection display,” Optics Express, 15(22), 14530–38, 2007.

    Article  Google Scholar 

  44. P. Milgram and F. Kishino, “Augmented Reality: A Class of Displays on the Reality-Virtuality Continuum,” SPIE Telemanipulator and Telepresence Technologies, v. 2351(34), p. 42–48, 1994.

    Google Scholar 

  45. K. Minamizawa, M. Shinmeimae, H. Kajimoto, N. Kawakami and S. Tachi, “Study of Telexistence (XXXXVI): Optical System for Mutual Telexistence Using Retro-reflective Projection Technology,” Journal of Asia Society of Art Science, v.2 (1), p. 31–36, 2006.

    Google Scholar 

  46. M. D. Missig, and G. M. Morris, “Diffractive optics applied to eyepiece design,” Appl. Opt. 34, 2452–2461, 1995.

    Article  Google Scholar 

  47. J.Y. Oh and H. Hua, “User Evaluations on Form Factors of Tangible Magic Lenses,” Proc. of IEEE International Symposium on Mixed and Augmented Reality (ISMAR), p. 23–32, 2006.

    Google Scholar 

  48. J.Y. Oh and H. Hua, “Usability of Multi-Scale Interfaces for 3D Workbench Displays,” Presence: Teleoperators and Virtual Environments, v. 17 (5), MIT Press, p. 415–440, 2008.

    Google Scholar 

  49. J. P. Rolland, “Wide-angle, off-axis, see-through head-mounted display,” Opt. Eng., Vol. 39, 1760, 2000.

    Article  Google Scholar 

  50. J.P. Rolland and H. Fuchs, “Optical versus video see-through head-mounted displays in medical visualization,” Presence: Teleoperators and Virtual Environments(MIT Press), 9(3), 287–309, 2000.

    Google Scholar 

  51. J.P. Rolland, L. Davis, F. Hamza-Lup, J. Daly, Y. Ha, G. Martin, J. Norfleet, R. Thumann, and C. Imielinska, “Development of a Training Tool for Endotracheal Intubation: Distributed Augmented Reality,” Proc. of Medicine Meets Virtual Reality 2003 (MMVR), Studies in Health Technology and Informatics, v. 98, p. 288–294, 2003.

    Google Scholar 

  52. J.P. Rolland, F. Biocca, H. Hua, Y. Ha, C. Gao, and O. Harrisson, “Teleportal Augmented Reality System: Integrating Virtual Objects, Remote Collaborators, and Physical Reality for Distributed Networked Manufacturing,” Virtual and Augmented Reality Applications in Manufacturing (Ch. 11), Eds. S.K. Ong and A.Y.C. Nee, Springer-Verlag: London, p. 183–202, 2004.

    Google Scholar 

  53. J.P. Rolland, and H. Hua, “Head-mounted displays,” Encyclopedia of Optical Engineering, R. Barry Johnson and Ronald G. Driggers, Eds, 2005.

    Google Scholar 

  54. J.P. Rolland, F. Biocca, F. Hamza-Lup, Y. Ha, and R. Martins, “Development of Head-Mounted Projection Displays for Distributed, Collaborative Augmented Reality Applications,”Presence: Teleoperators and Virtual Environments, v. 14(5), p. 528–549, 2005.

    Article  Google Scholar 

  55. A.P. Santhanam, T.R. Willoughby, I. Kaya, A.P. Shah, S.L. Meeks, J.P. Rolland, and P. Kupelian, “A Display Framework for Visualizing Real-time 3D Lung Tumor Radiotherapy,” Journal of Display Technology (Special Issue on Medical Displays), 4(4), 473–482, 2008.

    Google Scholar 

  56. J. Schwiegerling, Field Guide to Visual and Ophthalmic Optics, SPIE Press, 2004.

    Google Scholar 

  57. I.E. Sutherland, “A head-mounted three-dimensional display,” Proc. ofFall Joint Comput. Conf. AFIPS, 33, 757–764, 1968.

    Google Scholar 

  58. S. Tachi, N. Kawakami, M. Inami and Y. Zaitsu, “Mutual Telexistence System Using Retro-reflective Projection Technology,” International Journal of Humanoid Robotics, 1 (1), p. 45–64, 2004.

    Article  Google Scholar 

  59. S. Tachi, N. Kawakami, H. Nii, K. Watanabe and K. Minamizawa, “TELEsarPHONE: Mutual Telexistence Master Slave Communication System Based on Retroreflective Projection Technology,” SICE Journal of Control, Measurement, and System Integration, 1(5), p. 335–344, 2008.

    Google Scholar 

  60. J. Viega, M.J. Conway, G Williams, and R. Pausch, “3D Magic Lenses,” Proc. of ACM International Symposium on User Interface Software and Technology (UIST), p. 51–58, 1996.

    Google Scholar 

  61. R. Zhang and H. Hua, “Characterizing polarization management in a p-HMPD system,” Applied Optics, 47(4):512–522, Jan. 2008.

    Article  Google Scholar 

  62. R. Zhang, and H. Hua, “Design of a polarized head-mounted projection display using ferroelectric liquid-crystal-on-silicon microdisplays,” Applied Optics, 47(15): 2888–96, 2008.

    Article  Google Scholar 

  63. R. Zhang and H. Hua, “Imaging quality of a retroreflective screen in head-mounted projection displays,” Journal of Optical Society of America: A, 26(5): 1240–1249, May 2009.

    Article  Google Scholar 

  64. R. Zhang, Development and Assessment of Polarized Head Mounted Projection Displays, Ph.D. Dissertation, University of Arizona, 2010.

    Google Scholar 

  65. R. Zhang and H. Hua, “Effects of a Retroreflective Screen on Depth Perception in a Head-mounted Projection Display,” Proc. of 2010 IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’2010), 2010.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Optical Sciences, The University of Arizona, Tucson, Arizona, USA

    Hong Hua & Rui Zhang

  2. Department of Computer Science, The University of Arizona, Tucson, Arizona, USA

    Leonard D. Brown

Authors
  1. Hong Hua
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Leonard D. Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rui Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hong Hua .

Editor information

Editors and Affiliations

  1. Dept. of Computer Science & Engineering, Florida Atlantic University, Boca Raton, 33431, Florida, USA

    Borko Furht

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Hua, H., Brown, L.D., Zhang, R. (2011). Head-Mounted Projection Display Technology and Applications. In: Furht, B. (eds) Handbook of Augmented Reality. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0064-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-0064-6_5

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-0063-9

  • Online ISBN: 978-1-4614-0064-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation