Skip to main content
SpringerLink
Log in

A practical approach for EKF-SLAM in an indoor environment: fusing ultrasonic sensors and stereo camera

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

Improving the practical capability of SLAM requires effective sensor fusion to cope with the large uncertainties from the sensors and environment. Fusing ultrasonic and vision sensors possesses advantages of both economical efficiency and complementary cooperation. In particular, it can resolve the false data association and divergence problem of an ultrasonic sensor-only algorithm and overcome both the low frequency of SLAM update caused by the computational burden and the weakness to illumination changes of a vision sensor-only algorithm. In this paper, we propose a VR-SLAM (Vision and Range sensor-SLAM) algorithm to combine ultrasonic sensors and stereo camera very effectively. It consists of two schemes: (1) extracting robust point and line features from sonar data and (2) recognizing planar visual objects using a multi-scale Harris corner detector and its SIFT descriptor from a pre-constructed object database. We show that fusing these schemes through EKF-SLAM frameworks can achieve correct data association via the object recognition and high frequency update via the sonar features. The performance of the proposed algorithm was verified by experiments in various real indoor environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ahn, S., Choi, M., Choi, J., & Chung, W. K. (2006). Data association using visual object recognition for EKF-SLAM in home environment. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 2588–2594).

  • Barfoot, T. D. (2005). Online visual motion estimation using FastSLAM with SIFT features. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 579–585).

  • Bosse, M., Newman, P., Leonard, J., & Teller, S. (2004). SLAM in large-scale cyclic environments using the ATLAS framework. International Journal on Robotics and Research, 23(12), 1113–1139.

    Article  Google Scholar 

  • Choi, J., Ahn, S., & Chung, W. K. (2005). Robust sonar feature detection for the SLAM of mobile robot. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 3415–3420).

  • Choset, H., Nagatani, K., & Lazar, N. A. (2003). The arc-transversal median algorithm: A geometric approach to increasing ultrasonic sensor azimuth accuracy. IEEE Transactions on Robotics and Automation, 19(3), 513–523.

    Article  Google Scholar 

  • Davison, A. J. (2003). Real-time simultaneous localisation and mapping with a single camera. In Proc. of international conference on computer vision (pp. 1403–1410).

  • Dissanayake, M.W.M.G., Newman, P., Clark, S., Durrant-Whyte, H.F., & Csorba, M. (2001). A solution to the simultaneous localization and map building (SLAM) problem. IEEE Transactions on Robotics and Automation, 17(3), 229–241.

    Article  Google Scholar 

  • Elinas, P., Sim, R., & Little, J. J. (2006). σSLAM: Stereo vision SLAM using the Rao-Blackwellised particle filter and a novel mixture proposal distribution. In Proc. of IEEE international conference on robotics and automation (pp. 1564–1570).

  • Estrada, C., Neira, J., & Tardós, J.D. (2005). Hierarchical SLAM: Real-time accurate mapping of large environment. IEEE Transactions on Robotics, 21(4), 588–596.

    Article  Google Scholar 

  • Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with application to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.

    Article  MathSciNet  Google Scholar 

  • Folkesson, J., Jensfelt, P., & Christensen, H. I. (2005). Graphical SLAM using vision and the measurement subspace. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 325–330).

  • Guivant, J. E., & Nebot, E. M. (2001). Optimization of the simultaneous localization and map-building algorithms for real-time implementation. IEEE Transactions on Robotics and Automation, 17(3), 242–257.

    Article  Google Scholar 

  • Jeong, W., & Lee, K. M. (2005). CV-SLAM: A new ceiling vision-based SLAM technique. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 3195–3200).

  • Karlsson, N., Bernardo, E. D., Ostrowski, J., Goncalves, L., Pirjanian, P., & Munich, M. E. (2005). The vSLAM algorithm for robust localization and mapping. In Proc. of IEEE international conference on robotics and automation (pp. 24–29).

  • Leonard, J. J., & Durrant-Whyte, H. F. (1991). Mobile robot localization by tracking geometric beacons. IEEE Transactions on Robotics and Automation, 7(3), 376–382.

    Article  Google Scholar 

  • Lin, Z., Kim, S., & Kweon, I. S. (2005). Recognition-based indoor topological navigation using robust invariant features. In Proc. of IEEE/RSJ international conference on intelligent robots and systems (pp. 2309–2314).

  • Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    Article  Google Scholar 

  • Mikolajczyk, K., & Schmid, C. (2004). Scale and affine invariant interest point detectors. International Journal of Computer Vision, 60(1), 63–86.

    Article  Google Scholar 

  • Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10), 1615–1630.

    Article  Google Scholar 

  • Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2003). FastSLAM 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In Proc. of the sixteenth international joint conference on artificial intelligence (pp. 1151–1156).

  • Newman, P., & Ho, K. (2005). SLAM-Loop closing with visually salient features. In Proc. of IEEE international conference on robotics and automation (pp. 635–642).

  • Newman, P., Cole, D., & Ho, K. (2006). Outdoor SLAM using visual appearance and laser ranging. In Proc. of IEEE international conference on robotics and automation (pp. 1180–1187).

  • Ortin, D., Neira, J., & Montiel, J. M. M. (2003). Relocation using laser and vision. In Proc. of IEEE international conference on robotics and automation (pp. 1505–1510).

  • Se, S., Lowe, D. G., & Little, J. (2002). Mobile robot localization and mapping with uncertainty using scale-invariant visual landmarks. International Journal of Robotics Research, 21(8), 735–758.

    Article  Google Scholar 

  • Tardós, J. D., Neira, J., Newman, P. M., & Leonard, J. J. (2002). Robust mapping and localization in indoor environments using sonar data. International Journal of Robotics Research, 21(4), 311–330.

    Article  Google Scholar 

  • Wijk, O., & Christensen, H. I. (2000). Triangulation-based fusion of sonar data with application in robot tracking. IEEE Transactions on Robotics and Automation, 16(6), 740–752.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Robotics Lab., Department of Mechanical Engineering, Pohang University of Science & Technology (POSTECH), Pohang, Korea

    SungHwan Ahn, Jinwoo Choi & Wan Kyun Chung

  2. School of Electrical Engineering, Korea University, Seoul, Korea

    Nakju Lett Doh

Authors
  1. SungHwan Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinwoo Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nakju Lett Doh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wan Kyun Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to SungHwan Ahn.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ahn, S., Choi, J., Doh, N.L. et al. A practical approach for EKF-SLAM in an indoor environment: fusing ultrasonic sensors and stereo camera. Auton Robot 24, 315–335 (2008). https://doi.org/10.1007/s10514-007-9083-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-007-9083-2

Keywords

Search

Navigation