Hostname: page-component-8448b6f56d-mp689 Total loading time: 0 Render date: 2024-04-19T23:56:41.268Z Has data issue: false hasContentIssue false
  • English
  • Français

A Study of Sensor-Fusion Mechanism for Mobile Robot Global Localization

Published online by Cambridge University Press:  22 April 2019

Yonggang Chen ,
Weinan Chen Open the ORCID record for Weinan Chen [Opens in a new window] ,
Lei Zhu ,
Zerong Su ,
Xuefeng Zhou ,
Yisheng Guan  and
Guanfeng Liu
Yonggang Chen
Affiliation:
School of Electro-mechanical Engineering, Guangdong University of Technology, Guangzhou, China. E-mails: leizhu1016@gmail.com, ysguan@gdut.edu.cn Department of Electro-mechanical Engineering, Dongguan Polytechnic, Dongguan, China. E-mail: yonggang44@163.com
Weinan Chen*
Affiliation:
School of Electro-mechanical Engineering, Guangdong University of Technology, Guangzhou, China. E-mails: leizhu1016@gmail.com, ysguan@gdut.edu.cn
Lei Zhu
Affiliation:
School of Electro-mechanical Engineering, Guangdong University of Technology, Guangzhou, China. E-mails: leizhu1016@gmail.com, ysguan@gdut.edu.cn
Zerong Su
Affiliation:
Guangdong Key Laboratory of Modern Control Technology, Guangdong Institute of Intelligent Manufacturing, Guangzhou, China. E-mails: zr.su@giim.ac.cn, xuefengzhou@vip.qq.com
Xuefeng Zhou
Affiliation:
Guangdong Key Laboratory of Modern Control Technology, Guangdong Institute of Intelligent Manufacturing, Guangzhou, China. E-mails: zr.su@giim.ac.cn, xuefengzhou@vip.qq.com
Yisheng Guan
Affiliation:
School of Electro-mechanical Engineering, Guangdong University of Technology, Guangzhou, China. E-mails: leizhu1016@gmail.com, ysguan@gdut.edu.cn
Guanfeng Liu
Affiliation:
Guangdong Polytechnic Normal University, Guangzhou, China. E-mail: liugf1004@gmail.com
*
*Corresponding author. E-mail: weinanchen1991@gmail.com
Get access Rights & Permissions [Opens in a new window]

Summary

Estimating the robot state within a known map is an essential problem for mobile robot; it is also referred to “localization”. Even LiDAR-based localization is practical in many applications, it is difficult to achieve global localization with LiDAR only for its low-dimension feedback, especially in environments with repetitive geometric features. A sensor-fusion-based localization system is introduced in this paper, which has the capability of addressing the global localization problem. Both LiDAR and vision sensors are integrated, making use of the rich information introduced by vision sensor and the robustness from LiDAR. A hybrid grid-map is built for global localization, and a visual global descriptor is applied to speed up the localization convergence, combined with a pose refining pipeline for improving the localization accuracy. Also, a trigger mechanism is introduced to solve kidnapped problem and verify the relocalization result. The experiments under different conditions are designed to evaluate the performance of the proposed approach, as well as a comparison with the existing localization systems. According to the experimental results, our system is able to solve the global localization problem, and the sensor-fusion mechanism in our system has an improved performance.

Keywords

Mobile robotGlobal localizationSensor fusion
Type
Articles
Information
Robotica , Volume 37 , Issue 11 , November 2019 , pp. 1835 - 1849
Copyright
© Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The first two authors contributed equally to this work.

References

Sebastian, T., Wolfram, B. and Dieter, F., Probabilistic Robotics (MIT Press, Cambridge, MA, USA, 2005).Google Scholar
Ben, G., Jamie, S., Antonio, C. and Shahram, I., “Real-time RGB-D camera relocalization via randomized ferns for keyframe encoding,” IEEE Trans. Visual. Comput. Graph. 21(5), 571–583 (2015).Google Scholar
Raúl, M. and Juan, T. D., “ORB-SLAM: a versatile and accurate monocular SLAM system,” IEEE Trans. Robot. 31(5), 1147–1163 (2015).Google Scholar
Jakob, E., Thomas, S. and Daniel, C., “LSD-SLAM: Large-scale Direct Monocular SLAM,” European Conference on Computer Vision, Zürich, Switzerland (2014) pp. 834–849.Google Scholar
Christian, F., Matia, P. and Davide, S., “SVO: Fast Semi-direct Monocular Visual Odometry,” Robotics and Automation (ICRA), 2014 IEEE International Conference, Hong Kong, China (2014) pp. 15–22.Google Scholar
Wolfgang, H., Damon, K., Holger, R. and Daniel, A., “Real-time loop closure in 2D LIDAR SLAM,” Robotics and Automation (ICRA), 2016 IEEE International Conference, Stockholm, Sweden (2016) pp. 1271–1278.Google Scholar
Karel, K., Vojtech, V., Miroslav, K. and Libor, P., “Comparison of shape matching techniques for place recognition,” Mobile Robots (ECMR), 2013 European Conference, Barcelona, Spain (2013) pp. 107–112.Google Scholar
Guillaume, B. and Remi, M., “Robust large scale monocular visual SLAM,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA (2015) pp. 1638–1647.Google Scholar
Charbel, A., “Efficient Image-Based Localization Using Context,” University of Waterloo (2015).Google Scholar
Mustafa, O., Michael, C., Vincent, L. and Pascal, F., “Fast keypoint recognition using random ferns,” IEEE Trans. Pattern Anal. Machine Intelligence 32(3), 448–461 (2010).Google Scholar
Torsten, S., Bastian, L. and Leif, K., “Fast image-based localization using direct 2d-to-3d matching,” Computer Vision (ICCV), 2011 IEEE International Conference, Barcelona, Spain (2011) pp. 667–674.Google Scholar
Mark, C., Paul, N., Vincent, L. and Pascal, F., “FAB-MAP: probabilistic localization and mapping in the space of appearance,” Int. J. Robot. Res. 27(6), 647–665 (2008).Google Scholar
Gautam, S. and , K. J, “Visual loop closing using gist descriptors in manhattan world,” ICRA Omnidirectional Vision Workshop, Anchorage, AK, USA (2010).Google Scholar
Sebastian, T., Dieter, F., Wolfram, B. and Frank, D., “Robust Monte Carlo localization for mobile robots,” Artif. Intelligence 128(1–2), 99–141 (2001).Google Scholar
Yang, L. and Hong, Z., “Visual loop closure detection with a compact image descriptor,” Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference, Vilamoura, Portugal (2012) pp. 1051–1056.CrossRefGoogle Scholar
Charbel, A., Daniel C, A., Adel H, F. and John S, Z., “Filtering 3D Keypoints Using GIST For Accurate Image-Based Localization,” Proceedings of the British Machine Vision Conference (BMVC), York, UK (2016) pp. 127.1–127.12.Google Scholar
José, M., Andrew, C. and Walterio, M., “Enhancing 6D visual relocalisation with depth cameras,” Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference, Tokyo, Japan (2013) pp. 899–906.Google Scholar
Jungho, K., Kuk-Jin, Y. and In, K. So, “Bayesian filtering for keyframe-based visual SLAM,” Int. J. Robot. Res. 34(4–5), 99–141 (2015).Google Scholar
Cristiano, P. and Urbano, N., “Fusing LIDAR, camera and semantic information: a context-based approach for pedestrian detection,” Int. J. Robot. Res. 32(3), 371–384 (2013).Google Scholar
Nicholas, C., Anush, M., James R, M. and Ryan M, E., “Visual localization in fused image and laser range data,” Intelligent Robots and Systems (IROS), 2011 IEEE/RSJ International Conference, San Francisco, CA, USA (2011) pp. 4378–4385.Google Scholar
Colin, M., Paul, F. and Timothy, B. D, “Towards lighting-invariant visual navigation: an appearance-based approach using scanning laser-rangefinders,” Robot. Autonom. Syst. 61(8), 836–852 (2013).Google Scholar
Giorgio, G., Cyrill, S. and Wolfram, B., “Improved techniques for grid mapping with rao-blackwellized particle filters,” IEEE Trans. Robot. 23(1), 34–46 (2007).Google Scholar
“Gmapping ROS package,” https://github.com/ros-perception/slam_gmapping (2018).Google Scholar
“Karto SLAM ROS package,” https://github.com/ros-perception/slam_karto/ (2017).Google Scholar
“Cartographer ROS package,” https://github.com/googlecartographer/cartographer (2018).Google Scholar
Antonio, T., Aude, O, Monica S, C. and John M, H., “Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search,” Psychol. Rev. 113(4), 766 (2006).Google Scholar
Jing, L., Research on the Fast Scene Classification based on Gist of a Scene (Jilin University, Jilin, China, 2013).Google Scholar
Laurent, K., Davide, S. and Roland, S., “A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation,” Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference, CO, USA (2011) pp. 2969–2976.Google Scholar
Ethan, R., Vincent, R., Kurt, K. and Gary, B., “ORB: An efficient alternative to SIFT or SURF,” Computer Vision (ICCV), 2011 IEEE International Conference, Barcelona, Spain (2011) pp. 2564–2571.Google Scholar
Yunpeng, L., Noah, S. and Daniel, H. P, “Location recognition using prioritized feature matching,” European conference on computer vision (2010) pp. 791–804.Google Scholar
Su, Z., Zhou, X., Cheng, T., Zhang, H., Xu, B. and Chen, W., “Global localization of a mobile robot using lidar and visual features,” Robotics and Biomimetics (ROBIO), 2017 IEEE International Conference, Macau, China (2017) pp. 2377–2383.CrossRefGoogle Scholar
Perea, D., Hernandez, J., Morell, A. and et. at, “MCL with sensor fusion based on a weighting mechanism versus a particle generation approach,” International IEEE Conference on Intelligent Transportation Systems, 2013, The Hague, Netherlands (2013) pp. 166–171.Google Scholar
Yim, B., Lee, Y. and Song, J. and Chung, W., “Mobile Robot Localization Using Fusion of Object Recognition and Range Information,” IEEE International Conference on Robotics and Automation, Rome, Italy (2007) pp. 3533–3538.Google Scholar

Chen et al. supplementary material

Chen et al. supplementary material

Download Chen et al. supplementary material(Video)
Video 69.9 MB