Kazuki Otao
Yuta Itoh
Kazuki Takazawa
Yoichi Ochiai
ABSTRACT
We propose a novel method of implementing an optical see-through (OST) head-mounted display (HMD) with a wide viewing angle and high resolution for augmented reality, called an Air Mounted Eyepiece (AME). In past years, many optical elements, such as transmissive liquid-crystal display (LCD), half-mirror, and waveguide have been adopted for OST-HMD. To achieve the AME design, we employ an off-the-shelf HMD and Transmissive Mirror Device (TMD), which is used in aerial real-imaging systems, instead of conventional optical elements. In the proposed method, we present 'Virtual lens," which has the same function as the HMD lens in front of the eyes. By using TMD, it is possible to shorten the optical length between the virtual lens and the eye. Therefore, the aerial lens provides an immersive image with see-through capability. In this paper, we describe a detailed design method of TMD-based HMD, and compare it to previous half mirror-based HMD and convex mirror-based HMD. Then, we construct a fabricated prototype of the OST-HMD using TMD. We aim to contribute to the field of human-computer interaction and the research on eyepiece interfaces by discussing the advantages and the limitations through simulations and experiments.
- Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoper. Virtual Environ. 6, 4 (Aug. 1997), 355--385. Google Scholar
Digital Library
- Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Found. Trends Hum.-Comput. Interact. 8, 2--3 (March 2015), 73--272. Google ScholarDigital Library
- Alexander A Cameron. 2012. Optical waveguide technology and its application in head mounted displays. In Proc. SPIE, Vol. 8383. 83830E.Google ScholarCross Ref
- Dewen Cheng, Yongtian Wang, Hong Hua, and Jose Sasian. 2011. Design of a wide-angle, lightweight head-mounted display using free-form optics tiling. Opt. Lett. 36, 11 (Jun 2011), 2098--2100.Google ScholarCross Ref
- Dewen Cheng, Yongtian Wang, Hong Hua, and M. M. Talha. 2009. Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism. Appl. Opt. 48, 14 (May 2009), 2655--2668.Google ScholarCross Ref
- Yoshikazu Furuyama, Yasutoshi Makino, and Hiroyuki Shinoda. 2015. X-dimensional Display: Superimposing 2D Cross Sectional Image Inside 3D Wire-frame Aerial Image. In SIGGRAPH Asia 2015 Emerging Technologies (SA '15). ACM, New York, NY, USA, Article 28, 2 pages. Google ScholarDigital Library
- Yoshikazu Furuyama, Atsushi Matsubayashi, Yasutoshi Makino, and Hiroyuki Shinoda. 2016. X-SectionScope: Cross-section Projection in Light Field Clone Image. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH '16). ACM, New York, NY, USA, Article 22, 2 pages. Google ScholarDigital Library
- F. Huang, K. Chen, and G. Wetzstein. 2015. The Light Field Stereoscope: Immersive Computer Graphics via Factored Near-Eye Light Field Displays with Focus Cues. ACM Trans. Graph. (SIGGRAPH) 4 (2015). Issue 34. Google ScholarDigital Library
- Qiang Ji and Xiaojie Yang. 2002. Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance. Real-Time Imaging 8, 5 (2002), 357--377. Google ScholarDigital Library
- Hanyuool Kim, Issei Takahashi, Hiroki Yamamoto, Satoshi Maekawa, and Takeshi Naemura. 2014. MARIO: Mid-air Augmented Reality Interaction with Objects. Entertainment Computing 5, 4 (2014), 233--241.Google ScholarCross Ref
- Kiyoshi Kiyokawa. 2007. A Wide Field-of-view Head Mounted Projective Display Using Hyperbolic Half-silvered Mirrors. In Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '07). IEEE Computer Society, Washington, DC, USA, 1--4. Google ScholarDigital Library
- Naoya Koizumi. 2017. Sunny Day Display: Mid-air Image Formed by Solar Light. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 126--131. Google ScholarDigital Library
- Naoya Koizumi and Takeshi Naemura. 2016. Passive Mid-air Display. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (ACE '16). ACM, New York, NY, USA, Article 39, 6 pages. Google ScholarDigital Library
- Gang Li, Dukho Lee, Youngmo Jeong, Jaebum Cho, and Byoungho Lee. 2016. Holographic display for see-through augmented reality using mirror-lens holographic optical element. Opt. Lett. 41, 11 (Jun 2016), 2486--2489.Google Scholar
- A. Maimone and H. Fuchs. 2013. Computational augmented reality eyeglasses. In 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 29--38.Google Scholar
- Andrew Maimone, Andreas Georgiou, and Joel S. Kollin. 2017. Holographic Near-eye Displays for Virtual and Augmented Reality. ACM Trans. Graph. 36, 4, Article 85 (July 2017), 16 pages. Google ScholarDigital Library
- Andrew Maimone, Douglas Lanman, Kishore Rathinavel, Kurtis Keller, David Luebke, and Henry Fuchs. 2014. Pinlight Displays: Wide Field of View Augmented Reality Eyeglasses Using Defocused Point Light Sources. ACM Trans. Graph. 33, 4, Article 89 (July 2014), 11 pages. Google ScholarDigital Library
- Yasutoshi Makino, Yoshikazu Furuyama, Seki Inoue, and Hiroyuki Shinoda. 2016. HaptoClone (Haptic-Optical Clone) for Mutual Tele-Environment by Real-time 3D Image Transfer with Midair Force Feedback. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1980--1990. Google ScholarDigital Library
- Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, and Hiroyuki Shinoda. 2014. HaptoMime: Mid-air Haptic Interaction with a Floating Virtual Screen. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 663--667. Google ScholarDigital Library
- Carlos H. Morimoto and Marcio R.M. Mimica. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98, 1 (2005), 4--24. Special Issue on Eye Detection and Tracking Google ScholarDigital Library
- Hiroshi Mukawa, Katsuyuki Akutsu, Ikuo Matsumura, Satoshi Nakano, Takuji Yoshida, Mieko Kuwahara, and Kazuma Aiki. 2009. A full-color eyewear display using planar waveguides with reflection volume holograms. Journal of the Society for Information Display 17, 3 (2009), 185--193.Google ScholarCross Ref
- Yoichi Ochiai, Kazuki Otao, and Yoichi Ochiai. 2017. Air Mounted Eyepiece: Design Methods for Aerial Optical Functions of Near-Eye and See-Through Display using Transmissive Mirror Device. ArXiv e-prints (Oct. 2017). arXiv:cs.HC/1710.03889Google Scholar
- Kazuki Otao, Yuta Itoh, Hiroyuki Osone, Kazuki Takazawa, Shunnosuke Kataoka, and Yoichi Ochiai. 2017. Light Field Blender: Designing Optics and Rendering Methods for See-through and Aerial Near-eye Display. In SIGGRAPH Asia 2017 Technical Briefs (SA '17). ACM, New York, NY, USA, Article 9, 4 pages. Google ScholarDigital Library
- Osamu Matoba Satoshi Maekawa, Kouichi Nitta. 2006. Transmissive optical imaging device with micromirror array. (2006), 6392--6392 - 8 pages.Google Scholar
- Shoichi Shimizu and Hironobu Fujiyoshi. 2011. Acquisition of 3D Gaze Information from Eyeball Movements Using Inside-out Camera. In Proceedings of the 2Nd Augmented Human International Conference (AH '11). ACM, New York, NY, USA, Article 6, 7 pages. Google ScholarDigital Library
- Hiroki Yamamoto, Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2015. EnchanTable: Displaying a Vertically Standing Mid-air Image on a Table Surface Using Reflection. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 397--400. Google ScholarDigital Library
- T. Yamane, S. Maekawa, Y. Utsumi, I. Okada, and A. Yamaguchi. 2015. Fabrication and evaluation of Dihedral Corner Reflector Array for floating image manufactured by synchrotron radiation. In 2015 International Conference on Electronics Packaging and iMAPS All Asia Conference (ICEP-IAAC). 436--439.Google Scholar
- Han-Ju Yeom, Hee-Jae Kim, Seong-Bok Kim, HuiJun Zhang, BoNi Li, Yeong-Min Ji, Sang-Hoo Kim, and Jae-Hyeung Park. 2015. 3D holographic head mounted display using holographic optical elements with astigmatism aberration compensation. 23(12 2015), 32025.Google Scholar
Index Terms
- Air Mounted Eyepiece: Optical See-Through HMD Design with Aerial Optical Functions
Recommendations
Light field blender: designing optics and rendering methods for see-through and aerial near-eye display
SA '17: SIGGRAPH Asia 2017 Technical BriefsIn this study, we propose a novel head-mounted display (HMD) design for near-eye light field display which achieves a see-through and wide field of view for augmented reality. In the past years, many optical elements such as half-mirror, beamsplitter, ...
Transmissive mirror device based near-eye displays with wide field of view
SIGGRAPH '18: ACM SIGGRAPH 2018 Emerging TechnologiesWe present a transmissive mirror device (TMD) based near-eye see-through displays with a wide viewing angle and high resolution for virtual reality and augmented reality. In past years, many optical elements, such as transmissive liquid-crystal display (...
Head-mounted display with mid-air tactile feedback
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and TechnologyVirtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the ...
Comments