Abstract
This paper proposes an algorithm which uses the depth information acquired from an active sensor as guidance for a block matching stereo algorithm. In the proposed implementation, the disparity search interval used for the block matching is reduced around the depth values obtained from the active sensor, which leads to an improved matching quality and denser disparity maps and point clouds. The performance of the proposed method is evaluated by carrying out a series of experiments on 3 different data sets obtained from different robotic systems. We demonstrate with experimental results that the disparity estimation is improved and denser disparity maps are generated.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Wang, J., Zhang, C., Zhu, W., Zhang, Z., Xiong, Z., Chou, P.A.: 3D scene reconstruction by multiple structured-light based commodity depth cameras. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 5429–5432 (2012)
Zhu, M.X., Scharfenberger, C., Wong, A., Clausi, D.A.: Simultaneous scene reconstruction and auto-calibration using constrained iterative closest point for 3D depth sensor array. In: 12th Conference on Computer and Robot Vision, pp. 39–45 (2015)
Gurram, P., Rhody, H., Kerekes, J., Lach, S., Saber, E.: 3D scene reconstruction through a fusion of passive video and lidar imagery. In: 36th IEEE Applied Imagery Pattern Recognition Workshop, pp. 133–138 (2007)
Moghadam, P., Wijesoma, W.S., Feng, D.J.: Improving path planning and mapping based on stereo vision and lidar. In: 10th International Conference on Control, Automation, Robotics and Vision, pp. 384–389 (2008)
Reina, G., Milella, A., Halft, W., Worst, R.: Lidar and stereo imagery integration for safe navigation in outdoor settings. In: IEEE International Symposium on Safety, Security, and Rescue Robotics, pp. 1–6 (2013)
Zhang, F., Clarke, D., Knoll, A.: Vehicle detection based on lidar and camera fusion. In: IEEE 17th International Conference on Intelligent Transportation Systems, pp. 1620–1625 (2014)
Somanath, G., Cohen, S., Price, B., Kambhamettu, C.: Stereo+kinect for high resolution stereo correspondences. In: International Conference on 3D Vision, pp. 9–16 (2013)
Badino, H., Huber, D., Kanade, T.: Integrating lidar into stereo for fast and improved disparity computation. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, pp. 405–412 (2011)
SDU University: Covis library (2007). http://covis.sdu.dk/
SDU Robotics: Safe - safe perception and behavior in autonomous agricultural machines (2014). http://caro.sdu.dk/index.php/projects/projectslist?view=project&task=show&id=20
Acat project (2013). http://www.acat-project.eu/
Graf, B., Reiser, U., Hägele, M., Mauz, K., Klein, P.: Robotic home assistant care-o-bot 3 - product vision and innovation platform. In: IEEE Workshop on Advanced Robotics and its Social Impacts, pp. 139–144 (2009)
Bradski, G.: Dr. Dobb’s Journal of Software Tools (2000)
MathWorks: Matlab stereo calibration app (2013). http://se.mathworks.com/help/vision/ug/stereo-camera-calibrator-app.html
Acknowledgement
This work was supported by the projects Patient@home and SAFE Perception which are funded by the Danish Innovation Fond.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Suvei, SD. et al. (2016). Stereo and Active-Sensor Data Fusion for Improved Stereo Block Matching. In: Campilho, A., Karray, F. (eds) Image Analysis and Recognition. ICIAR 2016. Lecture Notes in Computer Science(), vol 9730. Springer, Cham. https://doi.org/10.1007/978-3-319-41501-7_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-41501-7_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41500-0
Online ISBN: 978-3-319-41501-7
eBook Packages: Computer ScienceComputer Science (R0)