Skip to main content

Advertisement

Springer Nature Link
Log in

Visual Slam in Dynamic Scenes Based on Object Tracking and Static Points Detection

  • Short paper
  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Simultaneously Localization and Mapping (SLAM) plays a key role in tasks such as mobile robots navigation and path planning. How to achieve high localization accuracy in various scenarios is particularly important. This paper proposes a visual Semantic SLAM algorithm based on object tracking and static points detection, in order to eliminate the influence of dynamic objects on localization and mapping. This algorithm is improved on the framework of ORB-SLAM2. For continuously acquired input images, tracking algorithm is combined with the object detection to achieve the inter-frame correlation of objects in the scene. Then, epipolar geometry is used to detect static points on each object, and depth constraint is introduced to improve robustness. After excluding dynamic objects, the static points are sent to the tracking thread to achieve more accurate localization result. Finally, we record the pose of the dynamic objects for robots autonomous navigation in the future. Experiments on the public datasets TUM and KITTI show that in dynamic scenes, the proposed algorithm has reduced the relative index of absolute trajectory error (ATE) by more than 90% compared with ORB-SLAM2. Our system is also superior than DynaSLAM and DS-SLAM in most cases, which proves that the proposed algorithm can effectively improve the localization accuracy of visual SLAM in dynamic scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The data that support the findings of this study are available from the corresponding author Prof. Songlin Chen upon reasonable request.

Code Availability

Our source code is available at https://gitee.com/wizard_hai/slam-dynamic.git.

References

  1. Fuentes-Pacheco, J., Ruiz-Ascencio, J., Rendón-Mancha, J.M.: Visual simultaneous locallization and mapping: a survey. Artif. Intell. Rev. 43(1), 55 (2015)

    Article  Google Scholar 

  2. Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: MonoSLAM: Real-time single camera SLAM. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 1052–1067 (2007)

    Article  Google Scholar 

  3. Klein, G., Murray, D.: “Parallel tracking and mapping for small AR workspaces,” in Proc. IEEE ACM Int. Symp. Mixed Augmented Reality, 1-10 (2007)

  4. Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot. 33(5), 1255–1262 (2017)

    Article  Google Scholar 

  5. Engel, J., Schöps, T., Cremers, D.: “LSD-SLAM: Large-scale direct monocular SLAM,” in Proc. Eur. Conf. Comput. Vis., 834-849 (2014)

  6. Fang, Y., Dai, B.: An Improved Moving Target Detecting and Tracking Based on Optical Flow Technique and Kalman Filter [C]// Proceedings of the 2009 4th International Conference on Computer Science & Education, pp. 1197–1202. IEEE, Piscataway (2009)

    Google Scholar 

  7. Bakkay, M.C., Majdi, A., Zagrouba, E.: Dense 3D SLAM in Dynamic Scenes Using Kinect[C]// 7th Iberian Conference IbPRIA, Pattern Recognition and Image Analysis, Lecture Notes in Computer Science, pp. 121–129. Springer, Cham (2015)

    Google Scholar 

  8. Kundu, A., Krishna, K. M., Sivaswamy, J.: “Moving object detection by multi-view geometric techniques from a single camera mounted robot,” in Proc. Intell. Robots Syst., 4306_4312 (2009)

  9. Zhao, L., Liu, Z., Chen, J., et al.: A compatible framework for RGB-D SLAM in dynamic scenes[J] IEEE Access, (99):1–1 (2019)

  10. Zhang, L., Wei, L., Shen, P., Wei, W., Zhu, G., Song, J.: Semantic SLAM based on object detection and improved octomap. IEEE Access. 6, 75545–75559 (2018)

    Article  Google Scholar 

  11. Xiao, L., Wang, J., Qiu, X., Rong, Z., Zou, X.: Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment. Robot. Auton. Syst. 117, 1–16 (2019)

    Article  Google Scholar 

  12. Yu, C., Liu, Z., Liu, X.-J., Xie, F., Yang, Y., Wei, Q., Fei, Q.: “DS-SLAM: A semantic visual SLAM towards dynamic environments,” in Proc. Intell. Robots Syst. 1168_1174 (2018)

  13. Bescós, B., Fácil, J.M., Civera, J., et al.: DynaSLAM: tracking, mapping and Inpainting in dynamic scenes[J]. IEEE Robot. Autom. Lett. 3(4), 1–1 (2018)

    Article  Google Scholar 

  14. Wen, C., Mu, F., Liu, Y.H., et al.: Monocular semantic SLAM in dynamic street scene based on multiple object tracking[C]// 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE (2017)

    Google Scholar 

  15. Liu, Y., Miura, J.: RDS-SLAM: real-time dynamic SLAM using semantic segmentation methods. IEEE Access. 9, 23772–23785 (2021). https://doi.org/10.1109/ACCESS.2021.3050617

    Article  Google Scholar 

  16. Wojke, N., Bewley, A., Paulus, D.: "Simple online and realtime tracking with a deep association metric," 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017). https://doi.org/10.1109/ICIP.2017.8296962

    Book  Google Scholar 

  17. Sahbani, B., Adiprawita, W.: "Kalman filter and Iterative-Hungarian Algorithm implementation for low complexity point tracking as part of fast multiple object tracking system," 2016 6th International Conference on System Engineering and Technology (ICSET), Bandung, 109–115 (2016)

Download references

Funding

This work was supported by the National Natural Science Foundation of China.

Author information

Authors and Affiliations

  1. Control and Simulation Center, Harbin Institute of Technology, Harbin, 150001, People’s Republic of China

    Gui-Hai Li & Song-Lin Chen

Authors
  1. Gui-Hai Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Song-Lin Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Guihai Li: Algorithm design, experiment, writing the manuscript; Songlin Chen: Reviewing, Supervision, Analyses and Finalizing; All authors read and approved the final manuscript.

Corresponding author

Correspondence to Song-Lin Chen.

Ethics declarations

Ethics Approval

Not applicable (this article does not contain any studies with human participants or animals performed by any of the authors).

Consent to Participate

All authors have participated in conception and design, or analysis and interpretation of the data; drafting the article or revising it critically for important intellectual content, and approval of the final version.

Consent for Publication

The authors declare no interest conflict regarding the publication of this paper.

Conflict of Interests

No conflict of interest exists in the submission of this manuscript.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, GH., Chen, SL. Visual Slam in Dynamic Scenes Based on Object Tracking and Static Points Detection. J Intell Robot Syst 104, 33 (2022). https://doi.org/10.1007/s10846-021-01563-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10846-021-01563-3

Keywords