Abstract
Monocular cameras and planar lidar sensors are complementary. While monocular visual odometry (VO) is a relatively low-drift method for measuring platform egomotion, it suffers from a scale ambiguity. A planar lidar scanner, in contrast, is able to provide precise distance information with known scale. In combination, a monocular camera-2D lidar pair can be used as a performance 3D scanner, at a much lower cost than existing 3D lidar units. However, for accurate scan acquisition, the two sensors must be spatially and temporally calibrated. In this paper, we extend recent work on a calibration technique based on Rényi’s quadratic entropy (RQE) to the unified spatiotemporal calibration of monocular cameras and 2D lidars. We present simulation results indicating that calibration errors of less than 5 mm, 0.1\(^\circ \), and 0.15 ms in translation, rotation, and time delay, respectively, are readily achievable. Using real-world data, in the absence of reliable ground truth, we demonstrate high repeatability given sufficient platform motion. Unlike existing techniques, we are able to calibrate in arbitrary, target-free environments and without the need for overlapping sensor fields of view.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Anderson, S.: Batch continuous-time trajectory estimation. Ph.D. thesis, University of Toronto, Toronto, Ontario, Canada (2017)
Anderson, S., Barfoot, T.D.: Full STEAM ahead: exactly sparse Gaussian process regression for batch continuous-time trajectory estimation on SE(3). In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2015), Hamburg, Germany, pp. 157–164, September 2015
Anderson, S., Barfoot, T.D., Tong, C.H., Särkkä, S.: Batch nonlinear continuous-time trajectory estimation as exactly sparse Gaussian process regression. Auton. Robot. 39(3), 221–238 (2015)
Bok, Y., Choi, D., Vasseur, P., Kweon, I.S.: Extrinsic calibration of non-overlapping camera-laser system using structured environment. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), Chicago, Illinois, USA, pp. 436–443, September 2014
Brookshire, J., Teller, S.: Automatic calibration of multiple coplanar sensors. In: Proceedings of the Robotics: Science and Systems (RSS 2011), Los Angeles, California, USA, June 2011
Brookshire, J., Teller, S.: Extrinsic calibration from per-sensor egomotion. In: Proceedings of the Robotics: Science and Systems (RSS 2012), Sydney, Australia, July 2012
Guo, C.X., Roumeliotis, S.I.: An analytical least-squares solution to the line scan lidar-camera extrinsic calibration problem. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2013), Karlsruhe, Germany, pp. 2943–2948, May 2013
Kelly, J., Roy, N., Sukhatme, G.S.: Determining the time delay between inertial and visual sensor measurements. IEEE Trans. Robot. 30(6), 1514–1523 (2014)
Lambert, J., Clement, L., Giamou, M., Kelly, J.: Entropy-based sim(3) calibration of 2D lidars to egomotion sensors. In: Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016), Baden-Baden, Germany, pp. 455–461, September 2016
Maddern, W., Harrison, A., Newman, P.: Lost in translation (and rotation): rapid extrinsic calibration for 2D and 3D lidars. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2012), Saint Paul, Minnesota, USA, pp. 3096–3102, May 2012
Martinez-Cantin, R.: BayesOpt: a Bayesian optimization library for nonlinear optimization, experimental design and bandits. J. Mach. Learn. Res. 15, 3915–3919 (2014)
Mockus, J.: Bayesian Approach to Global Optimization – Theory and Applications. Mathematics and Its Applications, vol. 37. Kluwer Academic Publishers (1989)
Mur-Artal, R., et al.: ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31(5), 1147–1163 (2015)
Pandey, G., McBride, J., Savarese, S., Eustice, R.: Automatic extrinsic calibration of vision and lidar by maximizing mutual information. J. Field Robot. 32(5), 696–722 (2014)
Rehder, J., Siegwart, R., Furgale, P.: A general approach to spatiotemporal calibration in multisensor systems. IEEE Trans. Robot. 32(2), 383–398 (2016)
Rényi, A.: On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics, pp. 547–561. University of California Press (1961)
Sheehan, M., Harrison, A., Newman, P.: Automatic self-calibration of a full field-of-view 3D n-laser scanner. In: Khatib, O., Kumar, V., Sukhatme, G. (eds.) Experimental Robotics. Springer Tracts in Advanced Robotics, vol. 79, pp. 165–178. Springer, Heidelberg (2010)
Zhang, Q., Pless, R.: Extrinsic calibration of a camera and laser range finder (improves camera calibration). In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), Sendai, Japan, vol. 3, pp. 2301–2306, September 2004
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material 1 (mp4 34104 KB)
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Marr, J., Kelly, J. (2020). Unified Spatiotemporal Calibration of Monocular Cameras and Planar Lidars. In: Xiao, J., Kröger, T., Khatib, O. (eds) Proceedings of the 2018 International Symposium on Experimental Robotics. ISER 2018. Springer Proceedings in Advanced Robotics, vol 11. Springer, Cham. https://doi.org/10.1007/978-3-030-33950-0_67
Download citation
DOI: https://doi.org/10.1007/978-3-030-33950-0_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33949-4
Online ISBN: 978-3-030-33950-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)