Loading [a11y]/accessibility-menu.js
An Accurate, Robust Visual Odometry and Detail-Preserving Reconstruction System | IEEE Journals & Magazine | IEEE Xplore

An Accurate, Robust Visual Odometry and Detail-Preserving Reconstruction System


Abstract:

Tracking and mapping functions in a monocular SLAM system remain active due to their challenging nature. In this paper, we propose a novel approach to perform the accurat...Show More

Abstract:

Tracking and mapping functions in a monocular SLAM system remain active due to their challenging nature. In this paper, we propose a novel approach to perform the accurate and robust ego-motion estimation and provide the detail-preserving reconstruction in indoor environments. More specifically, we design a new algorithm called synchronous event measurement (SEM) to create event-based difference images (EDIs) so as to highlight frame-to-frame (F2F) difference. The observation indicates that F2F difference is highly correlated with the camera's motion change. We hereby feed EDIs into a deep convolutional neural network, in order to infer ego-motion of the camera. Subsequently, based on a monocular reconstruction framework (REMODE), we devise an algorithm named event region search or briefly ERS, to reduce possibility of mismatch on the depth estimation stage. Evaluations on a variety of datasets demonstrate the satisfactory performance of our proposed method: the ego-motion estimation is more accurate than some geometric based Visual Odometry (VO) and learning based approaches. The results are robust under extreme situations, such as brightness variation and motion blur. Meanwhile, our approach can provide more precise depth map with relatively rich textural information.
Published in: IEEE Transactions on Multimedia ( Volume: 23)
Page(s): 2820 - 2832
Date of Publication: 21 August 2020

ISSN Information:

Funding Agency:


References

References is not available for this document.