skip to main content
10.1145/3214907.3214920acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
abstract

Real-time non-line-of-sight imaging

Published: 12 August 2018 Publication History

Abstract

Non-line-of-sight (NLOS) imaging aims at recovering the shape of objects hidden outside the direct line of sight of a camera. In this work, we report on a new approach for acquiring time-resolved measurements that are suitable for NLOS imaging. The system uses a confocalized single-photon detector and pulsed laser. As opposed to previously-proposed NLOS imaging systems, our setup is very similar to LIDAR systems used for autonomous vehicles and it facilitates a closed-form solution of the associated inverse problem, which we derive in this work. This algorithm, dubbed the Light Cone Transform, is three orders of magnitude faster and more memory efficient than existing methods. We demonstrate experimental results for indoor and outdoor scenes captured and reconstructed with the proposed confocal NLOS imaging system.

Supplementary Material

MP4 File (14-336.mp4)

References

[1]
Mauro Buttafava, Jessica Zeman, Alberto Tosi, Kevin Eliceiri, and Andreas Velten. 2015. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 16 (2015), 20997--21011.
[2]
Otkrist Gupta, Thomas Willwacher, Andreas Velten, Ashok Veeraraghavan, and Ramesh Raskar. 2012. Reconstruction of hidden 3D shapes using diffuse reflections. Opt. Express 20, 17 (2012), 19096--19108.
[3]
Felix Heide, Lei Xiao, Wolfgang Heidrich, and Matthias B. Hullin. 2014. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. Proc. CVPR (2014), 3222--3229.
[4]
Ahmed Kirmani, Tylor Hutchison, James Davis, and Ramesh Raskar. 2009. Looking around the corner using transient imaging. Proc. ICCV (2009), 159--166.
[5]
Matthew O'Toole, Felix Heide, David B. Lindell, Kai Zang, Steven Diamond, and Gordon Wetzstein. 2017. Reconstructing transient images from single-photon sensors. Proc. CVPR (2017).
[6]
Matthew O'Toole, David B. Lindell, and Gordon Wetzstein. 2018. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555 (2018), 338--341.
[7]
Andreas Velten, Thomas Willwacher, Otkrist Gupta, Ashok Veeraraghavan, Moungi G. Bawendi, and Ramesh Raskar. 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications 3 (2012).
[8]
Di Wu, Gordon Wetzstein, Christopher Barsi, Thomas Willwacher, Matthew O'Toole, Nikhil Naik, Qionghai Dai, Kyros Kutulakos, and Ramesh Raskar. 2012. Frequency analysis of transient light transport with applications in bare sensor imaging. Proc. ECCV (2012), 542--555.

Cited By

View all
  • (2024)Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD DataSensors10.3390/s2420652224:20(6522)Online publication date: 10-Oct-2024
  • (2024)Enhancing the spatial resolution of time-of-flight based non-line-of-sight imaging via instrument response function deconvolutionOptics Express10.1364/OE.51876732:7(12303)Online publication date: 19-Mar-2024
  • (2024)Physics-constrained deep-inverse point spread function model: toward non-line-of-sight imaging reconstructionAdvanced Photonics Nexus10.1117/1.APN.3.2.0260103:02Online publication date: 1-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '18: ACM SIGGRAPH 2018 Emerging Technologies
August 2018
48 pages
ISBN:9781450358101
DOI:10.1145/3214907
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2018

Check for updates

Author Tags

  1. computational photography
  2. non-line-of-sight imaging
  3. single-photon sensors
  4. time-of-flight imaging

Qualifiers

  • Abstract

Conference

SIGGRAPH '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)3
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD DataSensors10.3390/s2420652224:20(6522)Online publication date: 10-Oct-2024
  • (2024)Enhancing the spatial resolution of time-of-flight based non-line-of-sight imaging via instrument response function deconvolutionOptics Express10.1364/OE.51876732:7(12303)Online publication date: 19-Mar-2024
  • (2024)Physics-constrained deep-inverse point spread function model: toward non-line-of-sight imaging reconstructionAdvanced Photonics Nexus10.1117/1.APN.3.2.0260103:02Online publication date: 1-Mar-2024
  • (2022)非视域成像技术分析与展望(特邀)Infrared and Laser Engineering10.3788/IRLA2022030551:8(20220305)Online publication date: 2022
  • (2022)A boundary migration model for imaging within volumetric scattering mediaNature Communications10.1038/s41467-022-30948-713:1Online publication date: 9-Jun-2022
  • (2022)Fast Non-Line-Of-Sight Imaging with Two-Step Deep RemappingACS Photonics10.1021/acsphotonics.2c001869:6(2046-2055)Online publication date: 3-Jun-2022
  • (2021)Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical PathIEEE Transactions on Computational Imaging10.1109/TCI.2020.30464727(1-12)Online publication date: 2021
  • (2020)Deep-inverse correlography: towards real-time high-resolution non-line-of-sight imagingOptica10.1364/OPTICA.3740267:1(63)Online publication date: 16-Jan-2020
  • (2020)Computational time-resolved imaging, single-photon sensing, and non-line-of-sight imagingACM SIGGRAPH 2020 Courses10.1145/3388769.3407481(1-119)Online publication date: 17-Aug-2020
  • (2020)Non-line-of-sight Reconstruction Using Efficient Transient RenderingACM Transactions on Graphics10.1145/336831439:1(1-14)Online publication date: 16-Jan-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media