Skip to main content
SpringerLink
Log in

Robust Airborne 3D Visual Simultaneous Localization and Mapping with Observability and Consistency Analysis

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

This paper aims to present a robust airborne 3D Visual Simultaneous Localization and Mapping (VSLAM) solution based on a stereovision system. We propose three innovative contributions to the Airborne VSLAM. The first one is the development of an alternative data fusion nonlinear H ∞ filtering scheme. This scheme is based on 3D vision observation model and avoids issues linked with the classical Extended Kalman Filtering (EKF) techniques such as the linearization errors, the initialization problem and noise statistics assumptions. The second contribution consists of a consistency and observability analysis for the Airborne VSLAM. The third contribution is a new approach to map management, based on the k-nearest landmark concept, and allowing efficient loop closure detection and map building. This approach reduces considerably the complexity of our Airborne VSLAM algorithm, which becomes independent of the map landmark number. Simulation results show the efficiency of the proposed Airborne VSLAM solution for which comparisons with other techniques are favourable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Dissanayake, M.W.M.G., Newman, P., Clark, S., Durrant-Whyte, H.F.: A solution to the simultaneous localization and map building (SLAM) problem. IEEE Trans. Robot. Autom. 17(3), 229–241 (2001), Jun

    Article  Google Scholar 

  2. Smith, R., Cheeseman, P.: On the representation and estimation of spatial uncertainty. Int. J. Rob. Res. 5(4), 56–68 (1986)

    Article  Google Scholar 

  3. Moutarlier, P., Chatila, R.: Stochastic multisensory data fusion for mobile robot location and environment modeling. In: Proc. 5th Int Symp. Robot. Research. Tokyo, Japan (1989)

  4. Davison, A.J.: Mobile robot navigation using active vision. Ph.D. dissertation, Univ. Oxford, Oxford, U.K. (1998)

  5. Bailey, T.: Mobile robot localization and mapping in extensive outdoor environments. Ph.D. dissertation, Univ. Sydney, Sydney, NSW, Australia (2002)

  6. Davison, A.J., Murray, D.W.: Simultaneous localization and map building using active vision. IEEE Trans. Pattern Anal. Mach. Intel. 24(7), 865–880 (2002), Jul

    Article  Google Scholar 

  7. Guivant, J., Nebot, E.: Optimization of the simultaneous localization and map-building algorithm and real-time implementation. IEEE Trans. Robot. Autom. 17(3), 242–257 (2001), Jun

    Article  Google Scholar 

  8. Montemerlo, M., Thrun, S., Koller, D., Wegbreit, B.: FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In: Proc. 18th Int. Joint Conf. Artif. Intell. Acapulco, Mexico (2003)

  9. Grisetti, G., Stachniss, C., Burgard, W.: Improving grid-based SLAM with Rao-Blackwellized particle filters by adaptive proposals and selective resampling. In: Proc. IEEE Int. Conf. Robot. Automat., pp. 2443–2448. Barcelona, Spain (2005)

  10. Williams, S., Dissanayake, G., Durrant-Whyte, H.F.: Towards terrain-aided navigation for underwater robotics. Adv. Robot. 15(5), 533–550 (2001)

    Article  Google Scholar 

  11. Thrun, S., Ahnel, D.H., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Baker, C., Omohundro, Z., Thayer, S., Whittaker, W.: A system for volumetric robotic mapping of abandoned mines. In: Proc. IEEE Int. Conf. Robot. Automat, pp. 4270–4275. Taipei, Taiwan, May (2003)

  12. Bryson, M., Sukkarieh, S.: Building a robust implementation of bearing-only inertial SLAM for a UAV. ARC Report Centre of Excellence in Autonomous Systems Australian Centre for Field Robotics. University of Sydney, NSW, Australia (2006)

  13. Davison, A.J., Murray, D.W.: Simultaneous localization and map building using active vision. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 865–880 (2002)

    Article  Google Scholar 

  14. Davison, A.J.: Real-time simultaneous localisation and mapping with a single camera. In: Proceedings of the 9th International Conference on Computer Vision, pp. 1403–1410 (2003)

  15. Nir, T., Bruckstein, A.M.: Causal camera motion estimation by condensation and robust statistics distance measures. In: Proceedings of the 8th European Conference on Computer Vision (2004)

  16. Thrun, S., Liu, Y.: Multi-robot SLAM with sparse extended information filters. In: Proceedings of the 11th International Symposium of Robotics Research (2003)

  17. Hajjdiab, H., Laganiere, R.: Vision-based Multi-Robot Simultaneous Localization and Mapping. In: Proceedings of the First Canadian Conference on Computer and Robot Vision, pp. 155–162 (2004)

  18. Fenwick, J.W., Newman, P.M., Leonard, J.J.: Cooperative concurrent mapping and localization. In: Proc. IEEE Conf. Robot. Automat., pp. 1810–1817. Washington, DC, May (2002)

  19. Kim, S.J.: Efficient simultaneous localization and mapping algorithms using submap networks. Ph.D. Dissertation, Dept. Ocean. Eng., Mass. Inst. Technol., Cambridge, May (2004)

  20. Julier, S.J., Uhlmann, J.K.: A counter example for the theory of simultaneous localization and map building. In: Proc. IEEE Conf. Robot. Automat., pp. 4238–4243. Seoul, Korea, May 21–26 (2001)

  21. Castellanos, J.A., Neira, J., Tardos, J.D.: Limits to the consistency of EKF-based SLAM. In: 5th IFAC Symp. Intell. Autonom. Veh., IAV’04. Lisbon, Portugal, Jul. (2004)

  22. Huang, S., Dissanayake, G.: Convergence and consistency analysis for extended Kalman filter based SLAM. IEEE Trans. Robot. 23(5), 1036–1049 (2007)

    Article  Google Scholar 

  23. Benmessaoud, M.L., Lamrani, A., Nemra, K., Souici, A.K.: Single-Camera EKF-vSLAM. In: Proceedings of World Academy of Science, Engineering and Technology PWASET Volume, ISSN 1307-6884, 30 July (2008)

  24. Ortega, J.S.: Towards visual localization, mapping and moving objects tracking by a mobile robot: a geometric and probabilistic approach. PhD Dissertation, National Polytechnic Institute of Toulouse (INPT), February (2007)

  25. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  26. Smith, R., Self, M., Cheeseman, P.: Estimating uncertain spatial relationships in robotics. In: Cox, I.J., Wilfon, G.T. (eds.) Autonomous Robot Vehicles, pp. 167–193. Springer, New York (1990)

    Google Scholar 

  27. Bryson, M., Sukkarieh, S.: Observability analysis and active control for airborne SLAM. IEEE Trans. Aerosp. Electron. Syst. 44(1), 261–280 (2008)

    Article  Google Scholar 

  28. Vidal-Calleja, T., Bryson, M., Sukkarieh, S., Sanfeliu, A., Andrade-Cetto, J.: On the Observability of Bearing-only SLAM. In: IEEE Conference on Robotics and Automation (2007)

  29. Shaked, U., Berman, N.: H∞ nonlinear filtering of discrete-time process. IEEE Trans. Signal Process. 43, 2205–2209 (1995)

    Article  Google Scholar 

  30. Petersen, I., Savkin, A.: Robust Kalman Filtering for Signals and Systems with Large Uncertainteis. Birkhauser, Boston (1999)

    Google Scholar 

  31. Basar, T., Baernard, P.: H∞ Optimal Control and Related Minimax Design Problems. A Dynamic Game Approach. Systems and Control: Foundations and Applications. Birkhauser (1991)

  32. Einicke, G., White, L.: Robust extended kalman filtering. IEEE Trans. Signal Process. 47(9), 2596–2599 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  33. Castellanos, J.A., Martinez-Cantin, R., Tardos, J.D., Neira, J.: Robocentric map joining: improving the consistency of EKF-SLAM. Robot. Auton. Syst. 55, 21–29 (2007)

    Article  Google Scholar 

  34. Bailey, T., Nieto, J., Guivant, J., Stevens, M., Nebot, E.: Consistency of the EKF-SLAM Algorithm. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (2006)

  35. Dissanayake, G., Williams, S., Durrant-Whyte, H.F., Bailey, T.: Map management for efficient Simultaneous Localization and Mapping (SLAM). Auton. Robots 12, 267–286 (2002), Kluwer Academic Publishers

    Article  MATH  Google Scholar 

  36. Jensfelt, P., Kragic, D., Folkesson, J., Bjorkman, M.: A framework for vision based bearing only 3D SLAM. In: IEEE International Conference on Robotics and Automation (ICRA) (2006)

Download references

Author information

Authors and Affiliations

  1. Unit of Control, Polytechnic Military School, Algiers, Algeria

    Abdelkrim Nemra

  2. Sensors Group, Cranfield University, Cranfield, UK

    Abdelkrim Nemra & Nabil Aouf

Authors
  1. Abdelkrim Nemra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nabil Aouf
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nabil Aouf.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nemra, A., Aouf, N. Robust Airborne 3D Visual Simultaneous Localization and Mapping with Observability and Consistency Analysis. J Intell Robot Syst 55, 345–376 (2009). https://doi.org/10.1007/s10846-008-9306-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-008-9306-6

Keywords

Search

Navigation