Yuta Itoh
ABSTRACT
Vision is our primary, essential sense to perceive the real world. Human beings have been keen to enhance the limit of the eye function by inventing various vision devices such as corrective glasses, sunglasses, telescopes, and night vision goggles. Recently, Optical See-Through Head-Mounted Displays (OST-HMD) have penetrated in the commercial market. While the traditional devices have improved our vision by altering or replacing it, OST-HMDs can augment and mediate it. We believe that future OST-HMDs will dramatically improve our vision capability, combined with wearable sensing systems including image sensors.
For taking a step toward this future, this paper investigates Vision Enhancement (VE) techniques via OST-HMDs. We aim at correcting optical defects of human eyes, especially defocus, by overlaying a compensation image on the user's actual view so that the filter cancels the aberration. Our contributions are threefold. Firstly, we formulate our method by taking the optical relationships between OST-HMD and human eye into consideration. Secondly, we demonstrate the method in proof-of-concept experiments. Lastly and most importantly, we provide a thorough analysis of the results including limitations of the current system, potential research issues necessary for realizing practical VE systems, and possible solutions for the issues for future research.
- Amano, T., and Kato, H. Appearance control by projector camera feedback for visually impaired. In CVPRW, IEEE (2010), 57--63.Google Scholar
Cross Ref
- Asai, N., Matsuda, R., Watanabe, M., Takayama, H., Yamada, S., Mase, A., Shikida, M., Sato, K., Lebedev, M., and Akedo, J. Novel high resolution optical scanner actuated by aerosol deposited pzt films. In Micro Electro Mechanical Systems (MEMS), IEEE (2003), 247--250.Google ScholarCross Ref
- Avery, B., Sandor, C., and Thomas, B. H. Improving spatial perception for augmented reality x-ray vision. In VR (2009), 79--82.Google ScholarCross Ref
- Baričević, D., Lee, C., Turk, M., Höllerer, T., and Bowman, D. A. A hand-held ar magic lens with user-perspective rendering. In ISMAR (2012), 197--206. Google ScholarDigital Library
- Bennett, M., and Quigley, A. Creating personalized digital human models of perception for visual analytics. In User Modeling, Adaption and Personalization. Springer, 2011, 25--37. Google ScholarDigital Library
- Bimber, O., and Iwai, D. Superimposing dynamic range. In TOG, vol. 27 (2008), 150. Google ScholarDigital Library
- Bimber, O., Iwai, D., Wetzstein, G., and Grundhöfer, A. The visual computing of projector-camera systems. In Computer Graphics Forum, vol. 27, Wiley Online Library (2008), 2219--2245.Google ScholarDigital Library
- Broecker, M., Smith, R. T., and Thomas, B. H. Adaptive substrate for enhanced spatial augmented reality contrast and resolution. In ISMAR (2011), 251--252. Google ScholarDigital Library
- David Hincapie-Ramos, J., Ivanchuk, L., Sridharan, S. K., and Irani, P. Smartcolor: Real-time color correction and contrast for optical see-through head-mounted displays. In ISMAR (2014), 187--194.Google ScholarCross Ref
- Fujimori, N., and Ando, S. Super-resolution reconstruction algorithm using vibro-imaging and correlation image sensor. In Society of Instrument and Control Engineers (SICE), Annual Conference on, IEEE (2012), 2028--2033.Google Scholar
- Giusti, A., Taddei, P., Corani, G., Gambardella, L., Magli, C., and Gianaroli, L. Artificial defocus for displaying markers in microscopy z-stacks. In TVCG, vol. 17 (2011), 1757--1764. Google ScholarDigital Library
- Grimm, B., Goelz, S., Bille, J. F., et al. Objective measurement of wave aberrations of the human eye with the use of a hartmann-shack wave-front sensor. The Journal of the Optical Society of America A (JOSA A) 11, 7 (1994), 1949--1957.Google Scholar
- Huang, F.-C., Wetzstein, G., Barsky, B. A., and Raskar, R. Computational light field display for correcting visual aberrations. In SIGGRAPH Posters (2013), 40. Google ScholarDigital Library
- Hwang, A. D., and Peli, E. An augmented-reality edge enhancement application for google glass. Optometry & Vision Science 91, 8 (2014), 1021--1030.Google ScholarCross Ref
- Itoh, Y., and Klinker, G. Interaction-free calibration for optical see-through head-mounted displays based on 3d eye localization. In 3DUI (2014), 75--82.Google Scholar
- Koizumi, N., Sugimoto, M., Nagaya, N., Inami, M., and Furukawa, M. Stop motion goggle: augmented visual perception by subtraction method using high speed liquid crystal. In AH (2012), 14. Google ScholarDigital Library
- Lombardo, M., and Lombardo, G. Wave aberration of human eyes and new descriptors of image optical quality and visual performance. Journal of Cataract & Refractive Surgery (JCRS) 36, 2 (2010), 313--331.Google Scholar
- Nitschke, C., Nakazawa, A., and Takemura, H. Corneal imaging revisited: An overview of corneal reflection analysis and applications. Information and Media Technologies 8, 2 (2013), 389--406.Google Scholar
- Oskiper, T., Sizintsev, M., Branzoi, V., Samarasekera, S., and Kumar, R. Augmented reality binoculars. In ISMAR (Oct 2013), 219--228.Google ScholarCross Ref
- Oyamada, Y., and Saito, H. Defocus blur correcting projector-camera system. In Advanced Concepts for Intelligent Vision Systems, Springer (2008), 453--464. Google ScholarDigital Library
- Pamplona, V. F., Mohan, A., Oliveira, M. M., and Raskar, R. Netra: interactive display for estimating refractive errors and focal range. In TOG, vol. 29 (2010), 77. Google ScholarDigital Library
- Pamplona, V. F., Oliveira, M. M., Aliaga, D. G., and Raskar, R. Tailored displays to compensate for visual aberrations. In TOG, vol. 31 (2012), 81. Google ScholarDigital Library
- Peli, E. Vision multiplexing: an engineering approach to vision rehabilitation device development. Optometry & Vision Science 78, 5 (2001), 304--315.Google ScholarCross Ref
- Peli, E. Treating with spectacle lenses: a novel idea!? Optometry & Vision Science 79, 9 (2002), 569--580.Google ScholarCross Ref
- Platt, B. C., et al. History and principles of shack-hartmann wavefront sensing. Journal of Refractive Surgery 17, 5 (2001), S573--S577.Google ScholarCross Ref
- Sajadi, B., Gopi, M., and Majumder, A. Edge-guided resolution enhancement in projectors via optical pixel sharing. In TOG, vol. 31 (2012), 79. Google ScholarDigital Library
- Shimizu, S., and Fujiyoshi, H. Acquisition of 3d gaze information from eyeball movements using inside-out camera. In AH (2011), 6. Google ScholarDigital Library
- Sridharan, S. K., Hincapié-Ramos, J. D., Flatla, D. R., and Irani, P. Color correction for optical see-through displays using display color profiles. In VRST (2013), 231--240. Google ScholarDigital Library
- Suryakumar, R., Meyers, J. P., Irving, E. L., and Bobier, W. R. Application of video-based technology for the simultaneous measurement of accommodation and vergence. Vision research 47, 2 (2007), 260--268.Google Scholar
- Tomioka, M., Ikeda, S., and Sato, K. Approximated user-perspective rendering in tablet-based augmented reality. In ISMAR (2013), 21--28.Google ScholarCross Ref
- Westheimer, G. The maxwellian view. Vision research 6, 11 (1966), 669--682.Google Scholar
Index Terms
- Vision enhancement: defocus correction via optical see-through head-mounted displays
Recommendations
ChromaGlasses: Computational Glasses for Compensating Colour Blindness
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsPrescription glasses are used by many people as a simple, and even fashionable way, to correct refractive problems of the eye. However, there are other visual impairments that cannot be treated with an optical lens in conventional glasses. In this work ...
AdaptiVisor: assisting eye adaptation via occlusive optical see-through head-mounted displays
AH '17: Proceedings of the 8th Augmented Human International ConferenceBrightness adaptation is a fundamental ability in human visual system, and adjusts various levels of darkness and light. While this ability is continuously used, and it can mostly handle sudden lighting changes in the environment, the adaptation could ...
Experiencing Social Augmented Reality in Public Spaces
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable ComputersWe present various views on the future use of augmented reality in public spaces. The views address enhanced walking, social activity, appropriation of public spaces, and futuristic social aspects of future outdoor augmented reality. Although we often ...
Comments