research-article

Diffusion coded photography for extended depth of field

Authors:

Oliver Cossairt,

Shree NayarAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 29, Issue 4

Article No.: 31, Pages 1 - 10

https://doi.org/10.1145/1778765.1778768

Published: 26 July 2010 Publication History

Abstract

In recent years, several cameras have been introduced which extend depth of field (DOF) by producing a depth-invariant point spread function (PSF). These cameras extend DOF by deblurring a captured image with a single spatially-invariant PSF. For these cameras, the quality of recovered images depends both on the magnitude of the PSF spectrum (MTF) of the camera, and the similarity between PSFs at different depths. While researchers have compared the MTFs of different extended DOF cameras, relatively little attention has been paid to evaluating their depth invariances. In this paper, we compare the depth invariance of several cameras, and introduce a new camera that improves in this regard over existing designs, while still maintaining a good MTF.

Our technique utilizes a novel optical element placed in the pupil plane of an imaging system. Whereas previous approaches use optical elements characterized by their amplitude or phase profile, our approach utilizes one whose behavior is characterized by its scattering properties. Such an element is commonly referred to as an optical diffuser, and thus we refer to our new approach as diffusion coding. We show that diffusion coding can be analyzed in a simple and intuitive way by modeling the effect of a diffuser as a kernel in light field space. We provide detailed analysis of diffusion coded cameras and show results from an implementation using a custom designed diffuser.

Supplementary Material

JPG File (tp028-10.jpg)

Download
15.00 KB

Supplemental material. (031.zip)

Download
36.51 MB

MP4 File (tp028-10.mp4)

Download
97.83 MB

References

[1]

Ashok, A., and Neifeld, M. 2003. Information-based analysis of simple incoherent imaging systems. Opt. Express 11, 18, 2153--2162.

[2]

Ashok, A., and Neifeld, M. A. 2007. Pseudorandom phase masks for superresolution imaging from subpixel shifting. Appl. Opt. 46, 12, 2256--2268.

[3]

Baek, J. 2010. Transfer Efficiency and Depth Invariance in Computational Cameras. In to appear in Proc. ICCP.

[4]

Caulfield, H. J. 1971. Kinoform Diffusers. In SPIE Conference Series, vol. 25, 111.

[5]

Chi, W., and George, N. 2001. Electronic imaging using a logarithmic asphere. Opt. Lett. 26, 12, 875--877.

[6]

Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. 2008. Image restoration by sparse 3D transform-domain collaborative filtering. In SPIE Conference Series, vol. 6812, 681207.

[7]

Dowski, E. R., and Cathey, W. T. 1995. Extended depth of field through wave-front coding. Appl. Opt. 34, 11, 1859--1866.

[8]

Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. In SIGGRAPH '05, 1115--1126.

Digital Library

[9]

Freeman, W., Fergus, R., Torralba, A., and Freeman, W. 2006. Random Lens Imaging. MIT CSAIL.

[10]

García-Guerrero, E. E., Méndez, E. R., Escamilla, H. M., Leskova, T. A., and Maradudin, A. A. 2007. Design and fabrication of random phase diffusers for extending the depth of focus. Opt. Express 15, 3, 910--923.

[11]

Goodman, J. W. 1985. Statistical optics. Wiley series in pure and applied optics.

[12]

Hasinoff, S., Kutulakos, K., Durand, F., and Freeman, W. 2009. Time-constrained photography. In Proc. ICCV, 1--8.

[13]

Häusler, G. 1972. A method to increase the depth of focus by two step image processing. Optics Communications 6 (Sep), 38--42.

[14]

Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. In SIGGRAPH '07, 70.

Digital Library

[15]

Levin, A., Hasinoff, S., Green, P., Durand, F., and Freeman, W. T. 2009. 4d frequency analysis of computational cameras for depth of field extension. In SIGGRAPH '09, 1--14.

Digital Library

[16]

Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH '96, 31--42.

Digital Library

[17]

Nagahara, H., Kuthirummal, S., Zhou, C., and Nayar, S. 2008. Flexible Depth of Field Photography. In ECCV '08, 73.

Digital Library

[18]

Ng, R. 2005. Fourier slice photography. In SIGGRAPH '05, 735--744.

Digital Library

[19]

Ojeda-Castaneda, J., Landgrave, J. E. A., and Escamilla, H. M. 2005. Annular phase-only mask for high focal depth. Opt. Lett. 30, 13, 1647--1649.

[20]

Sales, T. R. M. 2003. Structured microlens arrays for beam shaping. Optical Engineering 42, 11, 3084--3085.

[21]

Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. In SIGGRAPH '07, 69.

Digital Library

[22]

Zhou, C., and Nayar, S. 2009. What are Good Apertures for Defocus Deblurring? In ICCP '09.

Cited By

He TZhang QZhang CKou TShen J(2023)Learned digital lens enabled single optics achromatic imagingOptics Letters10.1364/OL.48183348:3(831)Online publication date: 31-Jan-2023
https://doi.org/10.1364/OL.481833
Kou TZhang QZhang CHe TShen J(2022)Large depth-of-field computational imaging with multi-spectral and dual-aperture opticsOptics Express10.1364/OE.47003730:18(32540)Online publication date: 19-Aug-2022
https://doi.org/10.1364/OE.470037
Kou TShen JZhang QChen W(2022)Learned NIR&VISCAM: multi-spectral fusion for large depth-of-field computational imagingOptical Design and Testing XII10.1117/12.2642517(19)Online publication date: 21-Dec-2022
https://doi.org/10.1117/12.2642517
Show More Cited By

Index Terms

Diffusion coded photography for extended depth of field
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation

Recommendations

Image and depth from a conventional camera with a coded aperture

A conventional camera captures blurred versions of scene information away from the plane of focus. Camera systems have been proposed that allow for recording all-focus images, or for extracting depth, but to record both simultaneously has required more ...
Diffusion coded photography for extended depth of field
SIGGRAPH '10: ACM SIGGRAPH 2010 papers

In recent years, several cameras have been introduced which extend depth of field (DOF) by producing a depth-invariant point spread function (PSF). These cameras extend DOF by deblurring a captured image with a single spatially-invariant PSF. For these ...
Flexible Depth of Field Photography

The range of scene depths that appear focused in an image is known as the depth of field (DOF). Conventional cameras are limited by a fundamental trade-off between depth of field and signal-to-noise ratio (SNR). For a dark scene, the aperture of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 29, Issue 4

July 2010

942 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1778765

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010

Published in TOG Volume 29, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Office of Naval Research

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
2,028
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

He TZhang QZhang CKou TShen J(2023)Learned digital lens enabled single optics achromatic imagingOptics Letters10.1364/OL.48183348:3(831)Online publication date: 31-Jan-2023
https://doi.org/10.1364/OL.481833
Kou TZhang QZhang CHe TShen J(2022)Large depth-of-field computational imaging with multi-spectral and dual-aperture opticsOptics Express10.1364/OE.47003730:18(32540)Online publication date: 19-Aug-2022
https://doi.org/10.1364/OE.470037
Kou TShen JZhang QChen W(2022)Learned NIR&VISCAM: multi-spectral fusion for large depth-of-field computational imagingOptical Design and Testing XII10.1117/12.2642517(19)Online publication date: 21-Dec-2022
https://doi.org/10.1117/12.2642517
Gu YGuan YXiao ZDai HLiu CWang S(2022)Deep fusion prior for plenoptic super-resolution all-in-focus imagingOptical Engineering10.1117/1.OE.61.12.12310361:12Online publication date: 1-Dec-2022
https://doi.org/10.1117/1.OE.61.12.123103
Yu MGu YJiang ZHe XKong YLiu CAi LWang S(2021)REPAID: resolution-enhanced plenoptic all-in-focus imaging using deep neural networksOptics Letters10.1364/OL.43027246:12(2896)Online publication date: 14-Jun-2021
https://doi.org/10.1364/OL.430272
Tan JBoominathan VBaraniuk RVeeraraghavan A(2021)EDoF-ToF: extended depth of field time-of-flight imagingOptics Express10.1364/OE.44151529:23(38540)Online publication date: 3-Nov-2021
https://doi.org/10.1364/OE.441515
Akpinar USahin EMeem MMenon RGotchev A(2021)Learning Wavefront Coding for Extended Depth of Field ImagingIEEE Transactions on Image Processing10.1109/TIP.2021.306016630(3307-3320)Online publication date: 2021
https://doi.org/10.1109/TIP.2021.3060166
González-Amador EPadilla-Vivanco AArines JOlvera-Angeles MAcosta E(2020) Choice of Jacobi–Fourier phase masks for wavefront coding under different f -number Japanese Journal of Applied Physics10.35848/1347-4065/ab965259:SO(SOOD04)Online publication date: 15-Jun-2020
https://doi.org/10.35848/1347-4065/ab9652
Elmalem SGiryes RMarom E(2020)Motion deblurring using spatiotemporal phase aperture codingOptica10.1364/OPTICA.3995337:10(1332)Online publication date: 5-Oct-2020
https://doi.org/10.1364/OPTICA.399533
Li YMcKay GDurr NTian L(2020)Diffuser-based computational imaging funduscopeOptics Express10.1364/OE.39511228:13(19641)Online publication date: 19-Jun-2020
https://doi.org/10.1364/OE.395112
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents