skip to main content
research-article

Eyeglasses-free display: towards correcting visual aberrations with computational light field displays

Published: 27 July 2014 Publication History

Abstract

Millions of people worldwide need glasses or contact lenses to see or read properly. We introduce a computational display technology that predistorts the presented content for an observer, so that the target image is perceived without the need for eyewear. By designing optics in concert with prefiltering algorithms, the proposed display architecture achieves significantly higher resolution and contrast than prior approaches to vision-correcting image display. We demonstrate that inexpensive light field displays driven by efficient implementations of 4D prefiltering algorithms can produce the desired vision-corrected imagery, even for higher-order aberrations that are difficult to be corrected with glasses. The proposed computational display architecture is evaluated in simulation and with a low-cost prototype device.

Supplementary Material

ZIP File (a59-huang.zip)
Supplemental material.
MP4 File (a59-sidebyside.mp4)

References

[1]
Akeley, K., Watt, S. J., Girshick, A. R., and Banks, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Trans. Graph. (SIGGRAPH) 23, 3, 804--813.
[2]
Alonso Jr., M., and Barreto, A. B. 2003. Pre-compensation for high-order aberrations of the human eye using on-screen image deconvolution. In IEEE Engineering in Medicine and Biology Society, vol. 1, 556--559.
[3]
Archand, P., Pite, E., Guillemet, H., and Trocme, L., 2011. Systems and methods for rendering a display to compensate for a viewer's visual impairment. International Patent Application PCT/US2011/039993.
[4]
Byrd, R. H., Lu, P., Nocedal, J., and Zhu, C. 1995. A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comput. 16, 5 (Sept.), 1190--1208.
[5]
Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In ACM SIGGRAPH, 307--318.
[6]
Cossairt, O. S., Napoli, J., Hill, S. L., Dorval, R. K., and Favalora, G. E. 2007. Occlusion-capable multiview volumetric three-dimensional display. Applied Optics 46, 8, 1244--1250.
[7]
Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. In Proc. SIGGRAPH, 1115--1126.
[8]
Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In Proc. SIGGRAPH, SIGGRAPH '96, 43--54.
[9]
Hecht, E. 2001. Optics (Fourth Edition). Addison-Wesley.
[10]
Hirsch, M., Wetzstein, G., and Raskar, R. 2014. A compressive light field projection system. ACM Trans. Graph. (SIGGRAPH) 33.
[11]
Huang, F.-C., and Barsky, B. 2011. A framework for aberration compensated displays. Tech. Rep. UCB/EECS-2011-162, University of California, Berkeley, December.
[12]
Huang, F.-C., Lanman, D., Barsky, B. A., and Raskar, R. 2012. Correcting for optical aberrations using multilayer displays. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, 185:1--185:12.
[13]
Ives, F. E., 1903. Parallax stereogram and process of making same. U.S. Patent 725,567.
[14]
Jones, A., McDowall, I., Yamada, H., Bolas, M., and Debevec, P. 2007. Rendering for an interactive 360° light field display. ACM Trans. Graph. (SIGGRAPH) 26, 40:1--40:10.
[15]
Lanman, D., and Luebke, D. 2013. Near-eye light field displays. ACM Trans. Graph. (SIGGRAPH Asia) 32, 6, 220:1--220:10.
[16]
Lanman, D., Hirsch, M., Kim, Y., and Raskar, R. 2010. Content-adaptive parallax barriers: optimizing dual-layer 3D displays using low-rank light field factorization. ACM Trans. Graph. 29, 163:1--163:10.
[17]
Levin, A., Hasinoff, S. W., Green, P., Durand, F., and Freeman, W. T. 2009. 4D frequency analysis of computational cameras for depth of field extension. ACM Trans. Graph. (SIGGRAPH) 28, 3.
[18]
Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Proc. SIGGRAPH, 31--42.
[19]
Lippmann, G. 1908. Épreuves réversibles donnant la sensation du relief. Journal of Physics 7, 4, 821--825.
[20]
Love, G., Hoffman, D., Hands, P., Gao, J., Kirby, A., and Banks, M. 2009. High-speed switchable lens enables the development of a volumetric stereoscopic display. Optics Express 17, 15716--15725.
[21]
Maimone, A., Wetzstein, G., Hirsch, M., Lanman, D., Raskar, R., and Fuchs, H. 2013. Focus 3d: Compressive accommodation display. ACM Trans. Graph. 32, 5, 153:1--153:13.
[22]
Mantiuk, R., Kim, K. J., Rempel, A. G., and Heidrich, W. 2011. Hdr-vdp-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions. In Proc. ACM SIGGRAPH, 40:1--40:14.
[23]
Masia, B., Wetzstein, G., Didyk, P., and Gutierrez, D. 2013. A survey on computational displays: Pushing the boundaries of optics, computation, and perception. Computers & Graphics 37, 8, 1012--1038.
[24]
Ng, R., and Hanrahan, P. 2006. Digital correction of lens aberrations in light field photography. In Proc. SPIE International Optical Design.
[25]
Ng, R. 2005. Fourier slice photography. In ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, SIGGRAPH '05, 735--744.
[26]
Pamplona, V. F., Mohan, A., Oliveira, M. M., and Raskar, R. 2010. Netra: interactive display for estimating refractive errors and focal range. ACM Trans. Graph. (SIGGRAPH) 29, 77:1--77:8.
[27]
Pamplona, V. F., Passos, E. B., Zizka, J., Oliveira, M. M., Lawson, E., Clua, E., and Raskar, R. 2011. Catra: interactive measuring and modeling of cataracts. ACM Trans. Graph. (SIGGRAPH) 30, 4, 47:1--47:8.
[28]
Pamplona, V., Oliveira, M., Aliaga, D., and Raskar, R. 2012. Tailored displays to compensate for visual aberrations. ACM Trans. Graph. (SIGGRAPH) 31.
[29]
Ramamoorthi, R., Mahajan, D., and Belhumeur, P. 2007. A first-order analysis of lighting, shading, and shadows. ACM Trans. Graph. 26, 1.
[30]
Takaki, Y. 2006. High-Density Directional Display for Generating Natural Three-Dimensional Images. Proc. IEEE 94, 3.
[31]
Vitale, S., Sperduto, R. D., and Ferris, III, F. L. 2009. Increased prevalence of myopia in the United States between 1971--1972 and 1999--2004. Arch. Ophthalmology 127, 12, 1632--1639.
[32]
Wetzstein, G., Lanman, D., Heidrich, W., and Raskar, R. 2011. Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays. ACM Trans. Graph. (SIGGRAPH) 30, 4.
[33]
Wetzstein, G., Lanman, D., Hirsch, M., and Raskar, R. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graph. (SIGGRAPH) 31.
[34]
Wong, T. Y., Foster, P. J., Hee, J., Ng, T. P., Tielsch, J. M., Chew, S. J., Johnson, G. J., and Seah, S. K. 2000. Prevalence and risk factors for refractive errors in adult chinese in singapore. Invest Ophthalmol Vis Sci 41, 9, 2486--94.
[35]
Yellott, J. I., and Yellott, J. W. 2007. Correcting spurious resolution in defocused images. Proc. SPIE 6492.

Cited By

View all
  • (2024)A SharpView Font with Enhanced Out-of-Focus Text Legibility for Augmented Reality Systems2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00027(31-41)Online publication date: 16-Mar-2024
  • (2024)Three-dimensional light field display for view density enhancement based on lenticular lens time-multiplexed stitching and views compression fitting methodOptics and Lasers in Engineering10.1016/j.optlaseng.2023.107895172(107895)Online publication date: Jan-2024
  • (2024)Virtual home staging and relighting from a single panorama under natural illuminationMachine Vision and Applications10.1007/s00138-024-01559-735:4Online publication date: 11-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 33, Issue 4
July 2014
1366 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2601097
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2014
Published in TOG Volume 33, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational ophthalmology
  2. displays
  3. light fields

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)123
  • Downloads (Last 6 weeks)12
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A SharpView Font with Enhanced Out-of-Focus Text Legibility for Augmented Reality Systems2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00027(31-41)Online publication date: 16-Mar-2024
  • (2024)Three-dimensional light field display for view density enhancement based on lenticular lens time-multiplexed stitching and views compression fitting methodOptics and Lasers in Engineering10.1016/j.optlaseng.2023.107895172(107895)Online publication date: Jan-2024
  • (2024)Virtual home staging and relighting from a single panorama under natural illuminationMachine Vision and Applications10.1007/s00138-024-01559-735:4Online publication date: 11-Jul-2024
  • (2024)Zero-Shot Image Feature Consensus with Deep Functional MapsComputer Vision – ECCV 202410.1007/978-3-031-72970-6_16(277-293)Online publication date: 29-Sep-2024
  • (2023)A systematic review: Virtual-reality-based techniques for human exercises and health improvementFrontiers in Public Health10.3389/fpubh.2023.114394711Online publication date: 23-Mar-2023
  • (2023)Integral imaging-based tabletop light field 3D display with large viewing angleOpto-Electronic Advances10.29026/oea.2023.220178(220178-220178)Online publication date: 2023
  • (2023)Light field displays with computational vision correction for astigmatism and high-order aberrations with real-time implementationOptics Express10.1364/OE.48554731:4(6262)Online publication date: 7-Feb-2023
  • (2023)ChromaCorrect: prescription correction in virtual reality headsets through perceptual guidanceBiomedical Optics Express10.1364/BOE.48577614:5(2166)Online publication date: 21-Apr-2023
  • (2023)Rendering algorithms for aberrated human vision simulationVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-023-00132-96:1Online publication date: 17-Mar-2023
  • (2023)Perceptual Tolerance of Split-Up Effect for Near-Eye Light Field Display2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00032(177-184)Online publication date: 16-Oct-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media