Yunpu Hu
Abstract
In this study, we discuss the imaging of depth and velocity using heterodyne-mode time-of-flight (ToF) cameras. In particular, Doppler ToF (D-ToF) imaging utilizes heterodyne modulation to measure the velocity from the Doppler frequency shift, which uniquely facilitates the instantaneous radial velocity estimation. However, theoretical discussion on D-ToF is limited to orthogonal frequency and sinusoidal waveform modulation. This study extends the formulation of the D-ToF imaging, and proposes an arbitrary-frequency, arbitrary-waveform framework considering a phase-compensated, symmetrical two-dimensional correlation map. With the proposed framework, the optimal heterodyne frequency for frequency decoding is found. A differential frequency sampling and decoding method is then proposed, which computes the frequency and phase from as few as four simultaneously captured images. With an experiment platform we built, it is confirmed that the minimum velocity sensing error is half that of the orthogonal frequency method, and the sensible phase range is approximately 2.5 times larger. The conclusions in this study allow the ToF velocity imaging to be applied at the optimal sample frequencies for a wide range of ToF sensors. This pushes one step further to the practical use of ToF velocity imaging.
- 2008. Guides to the Expression of Uncertainty in Measurement. Retrieved December 28th, 2021 https://www.iso.org/sites/JCGM/GUM-introduction.htm.Google Scholar
- . 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2 (1992), 239–256.
DOI: Google ScholarDigital Library
- . 2015. Blind and reference-free fluorescence lifetime estimation via consumer time-of-flight sensors. Optica 2, 11 (
Nov. 2015), 965–973.DOI: Google ScholarCross Ref
- . 2014. Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularization. Optics Letter 39, 6 (
Mar. 2014), 1705–1708.DOI: Google ScholarCross Ref - . 2016. Signal processing for time-of-flight imaging sensors: An introduction to inverse problems in computational 3-D imaging. IEEE Signal Processing Magazine 33, 5 (2016), 45–58.
DOI: Google ScholarCross Ref - . 2007. Pseudonoise optical modulation for real-time 3-D imaging with minimum interference. IEEE Transactions on Circuits and Systems I: Regular Papers 54, 10 (2007), 2109–2119.
DOI: Google ScholarCross Ref - . 2009. Range imager performance comparison in homodyne and heterodyne operating modes. Three-Dimensional Imaging Metrology 7239, (Jan. 2009), 723905.
DOI: Google ScholarCross Ref - . 2008. Time-of-flight range detection using low-frequency intensity modulation of a cw laser diode: Application to fiber length measurement. Optical Engineering 47, 9 (2008), 093602.Google ScholarCross Ref
- . 2006. Improved modulation techniques for time-of-flight ranging cameras using pseudo random binary sequences. In 11th Annual Symposium of the IEEE/LEOS Benelux Chapter. 217.Google Scholar
- . 2018. What are optimal coding functions for time-of-flight imaging? ACM Transactions on Graphics 37, 2 (
Feb. 2018), Article13 , 18 pages.DOI: Google ScholarDigital Library - . 2015. Doppler time-of-flight imaging. ACM Transactions on Graphics. 34, 4 (
July 2015), Article36 , 11 pages.DOI: Google ScholarDigital Library - . 2014a. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’14).Google ScholarDigital Library
- . 2014b. Imaging in scattering media using correlation image sensors and sparse convolutional coding. Optics Express 22, 21 (2014), 26338–26350.Google ScholarCross Ref
- . 1981. Determining optical flow. Artificial Intelligence 17, 1-3 (1981), 185–203.Google ScholarDigital Library
- . 2017. Robust 6-DOF motion sensing for an arbitrary rigid body by multi-view laser Doppler measurements. Optics Express 25, 24 (
Nov. 2017), 30371–30387.DOI: Google ScholarCross Ref - . 2015. SpeDo: 6 DOF ego-motion sensor using speckle defocus imaging. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’15).Google ScholarDigital Library
- . 2013. Coded time of flight cameras: Sparse deconvolution to address multipath interference and recover time profiles. ACM Transactions on Graphics (ToG) 32, 6 (2013), 1–10.Google ScholarDigital Library
- . 2009. Looking around the corner using transient imaging. In 2009 IEEE 12th International Conference on Computer Vision. 159–166.
DOI: Google ScholarCross Ref - . 2018. SH-ToF: Micro resolution time-of-flight imaging with superheterodyne interferometry. In 2018 IEEE International Conference on Computational Photography (ICCP’18). 1–10.
DOI: Google ScholarCross Ref - . 2019. Frequency based radial velocity estimation in time-of-flight range imaging. In 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ’19), 1–6.
DOI: Google ScholarCross Ref - . 2008. Sift flow: Dense correspondence across different scenes. In European Conference on Computer Vision. Springer, 28–42.Google ScholarDigital Library
- . 2015. 3D motion sensing of any object without prior knowledge. ACM Transactions on Graphics 34, 6 (
Oct. 2015), Article218 , 11 pages.DOI: Google ScholarDigital Library - . 2011. Single view reflectance capture using multiplexed scattering and time-of-flight imaging. In Proceedings of the 2011 SIGGRAPH Asia Conference (SA’11). Association for Computing Machinery, New York, NY, Article
171 , 10 pages.DOI: Google ScholarDigital Library - . 2016. Computational imaging with multi-camera time-of-flight systems. ACM Transactions on Graphics 35, 4 (
July 2016), Article33 , 11 pages.DOI: Google ScholarDigital Library - . 2017a. Methods for linear radial motion estimation in time-of-flight range imaging. In Videometrics, Range Imaging, and Applications XIV, and (Eds.), Vol. 10332. International Society for Optics and Photonics, SPIE, 70–77.
DOI: Google ScholarCross Ref - . 2017b. Stochastic calculus analysis of optical time-of-flight range imaging and estimation of radial motion. Journal of the Optical Society of America A 34, 7 (2017), 1063–1072.Google ScholarCross Ref
- . 2020. Frequency estimation from limited samples: Nonlinearizing time-of-flight radial velocity estimation. IEEE Sensors Letters 4, 10 (2020), 1–4.
DOI: Google ScholarCross Ref - . 2014. Coded exposure correction of transverse motion in full-field range imaging. Optical Engineering 53, 10 (2014), 102109.Google ScholarCross Ref
- . 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications 3, 1 (2012), 1–8.Google ScholarCross Ref
- . 2015. Application of lidar techniques to time-of-flight range imaging. Applied Optics 54, 33 (
Nov. 2015), 9654–9664.DOI: Google ScholarCross Ref
Index Terms
- Differential Frequency Heterodyne Time-of-Flight Imaging for Instantaneous Depth and Velocity Estimation
Recommendations
Antipodal pilot tones in orthogonal frequency division multiplexing systems for carrier frequency offset estimation
The main factor to degrade the orthogonality of OFDM subcarriers is the carrier frequency offset (CFO) linked to the intercarrier interference problem. Hence, it is necessary to precisely estimate and suitably compensate the CFO. In this study, two pilot ...
A time-frequency decision-feedback loop for carrier frequency offset tracking in OFDM systems
Acquisition and tracking are two crucial stages necessary to the carrier frequency synchronization in orthogonal frequency division multiplexing (OFDM) systems. In this letter, by employing the rotation property of OFDM data subcarriers, a simple time-...
Noise insensitive sampling frequency offset estimation methods for DVB-T/H systems
ICUIMC '09: Proceedings of the 3rd International Conference on Ubiquitous Information Management and CommunicationA precise estimation and compensation of SFO (Sampling Frequency Offset) is an important issue in OFDM (Orthogonal Frequency Division Multiplexing) system, because sampling frequency mismatch between the transmitter and the receiver dramatically ...
Comments