skip to main content
10.1145/3214745.3214795acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
invited-talk

Confocal non-line-of-sight imaging

Published: 12 August 2018 Publication History

Abstract

Non-line-of-sight (NLOS) imaging aims at recovering the shape of objects hidden outside the direct line of sight of a camera. In this work, we report on a new approach for acquiring time-resolved measurements that are suitable for NLOS imaging. The system uses a confocalized single-photon detector and pulsed laser. As opposed to previously-proposed NLOS imaging systems, our setup is very similar to LIDAR systems used for autonomous vehicles and it facilitates a closed-form solution of the associated inverse problem, which we derive in this work. This algorithm, dubbed the Light Cone Transform, is three orders of magnitude faster and more memory efficient than existing methods. We demonstrate experimental results for indoor and outdoor scenes captured and reconstructed with the proposed confocal NLOS imaging system.

Supplementary Material

MP4 File (01-329-otoole.mp4)

References

[1]
Mauro Buttafava, Jessica Zeman, Alberto Tosi, Kevin Eliceiri, and Andreas Velten. 2015. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 16 (2015), 20997--21011.
[2]
Otkrist Gupta, Thomas Willwacher, Andreas Velten, Ashok Veeraraghavan, and Ramesh Raskar. 2012. Reconstruction of hidden 3D shapes using diffuse reflections. Opt. Express 20, 17 (2012), 19096--19108.
[3]
Felix Heide, Lei Xiao, Wolfgang Heidrich, and Matthias B. Hullin. 2014. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. Proc. CVPR (2014), 3222--3229.
[4]
Ahmed Kirmani, Tylor Hutchison, James Davis, and Ramesh Raskar. 2009. Looking around the corner using transient imaging. Proc. ICCV (2009), 159--166.
[5]
Matthew O'Toole, Felix Heide, David B. Lindell, Kai Zang, Steven Diamond, and Gordon Wetzstein. 2017. Reconstructing transient images from single-photon sensors. Proc. CVPR (2017).
[6]
Matthew O'Toole, David B. Lindell, and Gordon Wetzstein. 2018. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555 (2018), 338--341.
[7]
Andreas Velten, Thomas Willwacher, Otkrist Gupta, Ashok Veeraraghavan, Moungi G. Bawendi, and Ramesh Raskar. 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications 3 (2012).
[8]
Di Wu, Gordon Wetzstein, Christopher Barsi, Thomas Willwacher, Matthew O'Toole, Nikhil Naik, Qionghai Dai, Kyros Kutulakos, and Ramesh Raskar. 2012. Frequency analysis of transient light transport with applications in bare sensor imaging. Proc. ECCV (2012), 542--555.

Cited By

View all
  • (2024)Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD DataSensors10.3390/s2420652224:20(6522)Online publication date: 10-Oct-2024
  • (2020)Optical design for transfer of camera viewpoint using retrotransmissive optical systemOptical Review10.1007/s10043-019-00575-7Online publication date: 10-Jan-2020
  • (2019)A dataset for benchmarking time-resolved non-line-of-sight imagingACM SIGGRAPH 2019 Posters10.1145/3306214.3338583(1-2)Online publication date: 28-Jul-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '18: ACM SIGGRAPH 2018 Talks
August 2018
158 pages
ISBN:9781450358200
DOI:10.1145/3214745
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2018

Check for updates

Author Tags

  1. computational photography
  2. non-line-of-sight imaging
  3. single-photon sensors
  4. time-of-flight imaging

Qualifiers

  • Invited-talk

Conference

SIGGRAPH '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD DataSensors10.3390/s2420652224:20(6522)Online publication date: 10-Oct-2024
  • (2020)Optical design for transfer of camera viewpoint using retrotransmissive optical systemOptical Review10.1007/s10043-019-00575-7Online publication date: 10-Jan-2020
  • (2019)A dataset for benchmarking time-resolved non-line-of-sight imagingACM SIGGRAPH 2019 Posters10.1145/3306214.3338583(1-2)Online publication date: 28-Jul-2019
  • (2018)Neural network identification of people hidden from view with a single-pixel, single-photon detectorScientific Reports10.1038/s41598-018-30390-08:1Online publication date: 9-Aug-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media