Skip to main content

Advertisement

Log in

Fuzzy ART-based place recognition for visual loop closure detection

  • Original Paper
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

An Erratum to this article was published on 22 February 2013

Abstract

The automatic place recognition problem is one of the key challenges in SLAM approaches for loop closure detection. Most of the appearance-based solutions to this problem share the idea of image feature extraction, memorization, and matching search. The weakness of these solutions is the storage and computational costs which increase drastically with the environment size. In this regard, the major constraints to overcome are the required visual information storage and the complexity of similarity computation. In this paper, a novel formulation is proposed that allows the computation time reduction while no visual information are stored and matched explicitly. The proposed solution relies on the incremental building of a bio-inspired visual memory using a Fuzzy ART network. This network considers the properties discovered in primate brain. The performance evaluation of the proposed method has been conducted using two datasets representing different large scale outdoor environments. The method has been compared with RatSLAM and FAB-MAP approaches and has demonstrated a decreased time and storage costs with broadly comparable precision recall performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Angeli A, Filliat D, Doncieux S, Meyer JA (2008) A fast and incremental method for loop-closure detection using bags of visual words. IEEE Trans Robot 24(5):1027–1037

    Article  Google Scholar 

  • Bailey T, Durrant-Whyte H (2006) Simultaneous localization and mapping (SLAM): part II. IEEE Robot Autom Mag 13(3):108–117

    Article  Google Scholar 

  • Bailey T, Neito J, Guivant J, Stevens M, Nebot E (2006) Consisteny of the EKF-SLAM algorithm. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 9–15 October, pp 3562–3568

  • Barrera A, Weitzenfeld A (2008) Biologically-inspired robot spatial cognition based on rat neurophysiological studies. J Autonom Robots 51(2):203–233

    Google Scholar 

  • Barry C, Lever C, Hayman R, Hartley T, Burton S, O’Keefe J, Jeffery K, Burgess N (2006) The boundary vector cell model of place cell firing and spatial memory. Rev Neurosci 17:71–97

    PubMed  Google Scholar 

  • Browning B (2000) Biologically plausible spatial navigation for a mobile robot. Ph.D. dissertation, Computer Science Electrical Engineering, University of Queensland, Brisbane, Australia

  • Burgess N (2008) Grid cells and theta as oscillatory interference: theory and predictions. J Hippocampus 18:1157–1174

    Article  Google Scholar 

  • Burgess N, Recce M, O’Keefe J (1994) A model of hippocampal function. Neural Netw 7:1065–1081

    Article  Google Scholar 

  • Burgess N, Donnet J, Jeffery K (1997) Robotics and neural simulation of the hippocampus and rat navigation. Philos Trans R Soc Lond B 352:1535–1543

    Article  CAS  Google Scholar 

  • Callmer J, Granström K, Nieto J, Ramos F (2008) Tree of words for visual loop closure detection in urban SLAM. Paper presented at Australasian Conference on Robotics & Automation (ACRA), Canberra, Australia, 3–5 December

  • Carpenter G, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115

    Article  Google Scholar 

  • Carpenter G, Grossberg S, Rosen D (1991) Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Netw 4:759–771

    Article  Google Scholar 

  • Cummins M, Newman P (2008) FAB-MAP: probabilistic localization and mapping in the space of appearance. Int J Robot Res 27:647–665

    Article  Google Scholar 

  • Cummins M, Newman P (2010) Accelerating FAB-MAP with concentration inequalities. IEEE Trans Robot 26(6):1042–1050

    Article  Google Scholar 

  • Cummins M, Newman P (2001) Appearance-only SLAM at large scale with FAB-MAP 2.0. Int J Robot Res 30(9):1100–1123

    Article  Google Scholar 

  • Cuperlier N, Quoy M, Gaussier P (2007) Neurobiologically inspired mobile robot navigation and planning. Front Neurorobot 1(3):1–15

    Google Scholar 

  • Durrant-Whyte H, Bailey T (2006) Simultaneous localization and mapping (SLAM): part I, the essential algorithms. IEEE Robot Autom Mag 13(2):99–110

    Article  Google Scholar 

  • Gaussier, P. Joulain, C. Zrehen, S. Banquet, J.P. Revel A (1997) Visual navigation in an open environment without map. In: IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS’97, Grenoble, France, September, pp. 545–550

  • Gaussier P, Revel A, Banquet J, Babeau P (2002) From view cells and place cells to cognitive map learning: processing stages of the hippocampal system. Biol Cybern 86:15–28

    Article  PubMed  CAS  Google Scholar 

  • Glover A, Maddern W, Milford M, Wyeth G (2010) FAB-MAP + RatSLAM: appearance-based SLAM for multiple times of day. In: IEEE International Conference on Robotics and Automation (ICRA), Anchorage, Alaska, 3–8 May, pp 3507–3512

  • Grisetti G, Stachniss C, Grzonka S, Burgard W (2007) A tree parameterization for efficient computing maximum likelihood maps using gradient descent. Paper presented at Robotics: Science and Systems Conference (RSS), Atlanta, GA, USA, 27–30 June

  • Grossberg S (1976) Adaptive pattern classification and universal recording, I: parallel development and coding of natural feature detectors. Biol Cybern 23:121–134

    Article  PubMed  CAS  Google Scholar 

  • Hafting T, Fyhn M, Molden S, Moser MB, Moser EI (2005) Microstructure of a spatial map in the entorhinal cortex. Nature 436:801– 806

    Article  PubMed  CAS  Google Scholar 

  • Ho K, Newman P (2007) Detecting loop closure with scene sequences. Int J Comput Vis 4:261–286

    Article  Google Scholar 

  • Jauffret A, Cuperlier N, Gaussier P (2011) Towards long range robot navigation. In: International workshop on bio-inspired robots, Nantes, France, 6–8 April

  • Kawewong A, Tongprasit N, Tangruamsub S, Hasegawa O (2011) Online and incremental appearance-based slam in highly dynamic environments. Int J Robot Res 30(1):33–55

    Article  Google Scholar 

  • Konolige K, Bowman J, Chen J, Mihelich P, Garage W (2010) View-based maps. Int J Robot Res 29(10):941–957

    Article  Google Scholar 

  • Kumar A, Tardif J, Anati R, Daniilidis K (2008) Experiments on visual loop closing using vocabulary trees. In: Computer Vision and Pattern Recognition Workshop, (CVPRW), Anchorage, AK, 23–28 June, pp 1–8

  • Lui WD, Jarvis R (2010) A pure vision-based approach to topological SLAM. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 18–22 October, pp 3784–3791

  • Milford M (2008) Robot navigation from nature, vol 41. Springer, Berlin

    Google Scholar 

  • Milford M, Wyeth G (2003) Hippocampal models for simultaneous localisation and mapping on an autonomous robot. Paper presented at the Australasian Conference on Robotics and Automation (ACRA), Brisbane, Australia, 1–3 December

  • Milford M, Wyeth G (2008) Mapping a suburb with a single camera using a biologically inspired SLAM system. IEEE Trans Robot 24:1038–1053

    Article  Google Scholar 

  • Milford M, Wyeth G (2011) Improving recall in appearance-based visual SLAM using visual expectation. Paper presented at the Australasian Conference on Robotics and Automation (ACRA), Brisbane, QLD, 7–9 December

  • Milford M, Wiles J, Wyeth G (2010) Solving navigational uncertainty using grid cells on robots. PLoS Comput Biol 6(11):e1000995

    Article  PubMed  Google Scholar 

  • Montemerlo M, Thrun S, Koller D, Wegbreit B (2002) FastSLAM: a factored solution to the simultaneous localization and mapping problem. In: Proceedings of AAAI national Conference on artificial intelligence, Edmonton, AB, Canada, pp 593–598

  • Montemerlo M, Thrun S, Koller D, Wegbreit B (2003) FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In: Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI), Acapulco, Mexico, 16–19 August, pp 1151–1156

  • Newman P, Ho K (2005) SLAM-loop closing with visually salient features. In: IEEE International Conference on Robotics and Automation (ICRA), Barcelona, Spain, 18–22 April, pp 635–642

  • Newman P, Cole D, Ho K (2006) Outdoor slam using visual appearance and laser ranging. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Orlando, Florida, USA, 15–19 May, pp 1180–1187

  • Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: Proceedings of the conference on computer vision and pattern recognition, vol 2, pp 2161–2168

  • O’Keefe J, Nadel L (1978) The hippocampus as a cognitive map. Oxford University Press, Oxford

  • Olson E (2008) Robust and efficient robotic mapping. Ph.D Thesis, MIT, Cambridge

  • Olson E, Leonard J, Teller S (2006) Fast iterative alignment of pose graphs with poor initial estimates. In: Proceedings of the IEEE International Conference on Robotics Automation (ICRA), Orlando, Florida, USA, 15–19 May, pp 2262–2269

  • Ramos F, Nieto J, Durrant-whyte H (2007) Recognising and modeling landmarks to close loops in outdoor SLAM. In: IEEE International Conference on Robotics and Automation (ICRA), Rome, Italy, 10–14 April, pp 2036–2041

  • Redish A (1997) Beyond the cognitive map. Ph.D. thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA

  • Rolls E (1999) Spatial view cells and the representation of place in the primate hippocampus. J Hippocampus 9:467–480

    Article  CAS  Google Scholar 

  • Sheynikhvich D (2007) Spatial navigation in geometric mazes: a computational model of rodent behavior. Ph.D thesis, EPFL, Lausanne

  • Sheynikhovich D, Chavarriaga R, Gerstner W (2009) Is there a geometric module for spatial orientation? Insights from a rodent navigation model. Psychol Rev 116:540–566

    Article  PubMed  Google Scholar 

  • Siagian C, Itti L (2009) Biologically inspired mobile robot vision localization. IEEE Trans Robot 25:861–873

    Article  Google Scholar 

  • Smith R, Self M, Cheeseman P (1987) A stochastic map for uncertain spatial relationships. In: International symposium on robotics research, Santa Cruz, California, USA, MIT press, Cambridge, pp 467–474

  • Sünderhauf N, Protzel P (2010) From neurons to robots: towards efficient biologically inspired filtering and SLAM. In: Advances in artificial intelligence, Lecture notes in computer science, Springer, New York, vol 6359, pp 341–348

  • Sünderhauf N, Protzel P (2011) BRIEF-Gist—closing the loop by simple means. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, California, USA, 25–30 September, pp 1234–1241

  • Sünderhauf N, Protzel P (2012) Towards a robust back-end for pose graph SLAM. In: Proceedings of the IEEE Internatuional Conference in Robotics Automation (ICRA), St. Paul, MN, USA, 14–18 May, pp 1254–1261

  • Thrun S, Burgard W, Fox D (2005) Probabilistic robotics. MIT press, Cambridge

  • Ulrich I, Nourbakhsh I (2000) Appearance-based place recognition for topological localization. In: IEEE Internatinal Conference on Robotics and Automation (ICRA), San Francisco, California, USA, 14–18 May, pp 1023–1029

  • Williams B, Cummins M, Neira J, Newman P, Reid I, Tardós J (2009) A comparison of loop closing techniques in monocular SLAM. Robot Autonom Syst 57:1188–1197

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karima Rebai.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rebai, K., Azouaoui, O. & Achour, N. Fuzzy ART-based place recognition for visual loop closure detection. Biol Cybern 107, 247–259 (2013). https://doi.org/10.1007/s00422-012-0539-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-012-0539-x

Keywords

Navigation