Loading [a11y]/accessibility-menu.js
Scanline Resolution-Invariant Depth Completion Using a Single Image and Sparse LiDAR Point Cloud | IEEE Journals & Magazine | IEEE Xplore

Scanline Resolution-Invariant Depth Completion Using a Single Image and Sparse LiDAR Point Cloud


Abstract:

Most existing deep learning-based depth completion methods are only suitable for high (e.g. 64-scanline) resolution LiDAR measurements, and they usually fail to predict a...Show More

Abstract:

Most existing deep learning-based depth completion methods are only suitable for high (e.g. 64-scanline) resolution LiDAR measurements, and they usually fail to predict a reliable dense depth map with low resolution (4, 8, or 16-scanline) LiDAR. However, it is of great interest to reduce the number of LiDAR channels in many aspects (cost, weight of a device, power consumption). In this letter, we propose a new depth completion framework with various LiDAR scanline resolutions, which performs as well as methods built for 64-scanline resolution LiDAR inputs. For this, we define a consistency loss between the predictions from LiDAR measurements of different scanline resolutions. (i.e., 4, 8, 16, 32-scanline LiDAR measurements) Also, we design a fusion module to integrate features from different modalities. Experiments show our proposed method outperforms the current state-of-the-art depth completion methods for input LiDAR measurements of low scanline resolution and performs comparably to the methods(models) for input LiDAR measurements of 64-scanline resolution on the KITTI benchmark dataset.
Published in: IEEE Robotics and Automation Letters ( Volume: 6, Issue: 4, October 2021)
Page(s): 6961 - 6968
Date of Publication: 13 July 2021

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.