Skip to main content
SpringerLink
Log in

Haar invariant signatures and spatial recognition using omnidirectional visual information only

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

This paper describes a method for spatial representation, place recognition and qualitative self-localization in dynamic indoor environments, based on omnidirectional images. This is a difficult problem because of the perceptual ambiguity of the acquired images, and their weak robustness to noise, geometrical and photometric variations of real world scenes. The spatial representation is built up invariant signatures using Invariance Theory where we suggest to adapt Haar invariant integrals to the particular geometry and image transformations of catadioptric omnidirectional sensors. It follows that combining simple image features in a process of integration over visual transformations and robot motion, can build discriminant percepts about robot spatial locations. We further analyze the invariance properties of the signatures and the apparent relation between their similarity measures and metric distances. The invariance properties of the signatures can be adapted to infer a hierarchical process, from global room recognition to local and coarse robot localization.

The approach is validated in real world experiments and compared to some local and global state-of-the-art methods. The results demonstrate a very interesting performance of the proposed approach and show distinctive behaviors of global and local methods. The invariant signature method, while being very time and memory efficient, provides good separability results similarly to approaches based on local features.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Andreasson, H., Treptow, A., & Duckett, T. (2005). Localization for mobile robots using panoramic vision, local features and particle filter. In IEEE int. conf. on robotics and automation (pp. 3348–3353).

    Google Scholar 

  • Bogdanova, I., Vandergheynst, P., Antoine, J., Jacques, L., & Morvidone, M. (2005). Stereographic wavelet frames on the sphere. Applied and Computational Harmonic Analysis, 19(2), 223–252.

    Article  MathSciNet  MATH  Google Scholar 

  • Burkhardt, H., & Siggelkow, S. (2001). Invariant features in pattern recognition—fundamentals and applications. In C. Kotropoulos & I. Pitas (Eds.), Nonlinear model-based image/video processing and analysis (pp. 269–307). Wiley: New York.

    Google Scholar 

  • Charron, C. (2007). Constitution active de percepts spatiaux, application à la reconnaissance de lieux. Ph.D. thesis, Université de Picardie Jules Verne.

  • Charron, C., Labbani-Igibida, O., & Mouaddib, E. (2005). Qualitative localization using omnidirectional images and invariant features. In IEEE/RSJ int. conf. on intelligent robots and systems, Edmonton, Canada (pp. 3009–3014).

    Chapter  Google Scholar 

  • Charron, C., Labbani-Igbida, O., & Mouaddib, E. (2006). On building omnidirectional image signatures using Haar invariant features: application to the localization of robots. In Lecture notes in computer science: Vol. 3179. Advanced concepts for intelligent vision systems, Antwerp, Belgium (pp. 1099–1110). Berlin/Heidelberg: Springer.

    Chapter  Google Scholar 

  • Gaspar, J., Winters, N., & Santos-Victor, J. (2000). Vision-based navigation and environmental representations with an omnidirectional camera. IEEE Transactions on Robotics and Automation 16, 890–898.

    Article  Google Scholar 

  • Geyer, C., & Daniilidis, K. (2001). Catadioptric projective geometry. International Journal of Computer Vision, 45(3), 223–243.

    Article  MATH  Google Scholar 

  • Gonzalez, J., & Lacroix, S. (2002). Rover localization in natural environments by indexing panoramic images. In IEEE int. conf. on robotics and automation (pp. 1365–1370).

    Google Scholar 

  • Halawani, A., & Burkhardt, H. (2004). Image retrieval by local evaluation of nonlinear kernel functions around salient points. In Int. conf. on pattern recognition (Vol. 2, pp. 955–960).

    Google Scholar 

  • Halawani, A., & Burkhardt, H. (2005). On using histograms of local invariant features for image retrieval. In IAPR workshop on machine vision applications (pp. 538–541).

    Google Scholar 

  • Ishiguro, H., & Tsuji, S. (1996). Image-based memory of environment. In IEEE/RSJ int. conf. on intelligent robots and systems (Vol. 2, pp. 634–639).

    Google Scholar 

  • Ishikawa, M., Kawashima, S., & Homma, N. (1998). Memory-based location estimation and navigation using Bayesian estimation. In Int. conf. on neural information processing (Vol. 1, pp. 112–117). 1998.

    Google Scholar 

  • Jogan, M., & Leonardis, A. (2003). Robust localization using an omnidirectional appearance-based subspace model of environment. Robotics and Autonomous Systems, 45(1), 51–72.

    Article  Google Scholar 

  • Labbani-Igbida, O., Charron, C., & Mouaddib, E. (2006). Extraction of Haar integral features on omnidirectional images: supplication to local and global localization. In Lecture notes in computer science: Vol. 4174. Pattern Recognition, Berlin, Germany (pp. 334–343). Berlin/Heidelberg: Springer.

    Chapter  Google Scholar 

  • Leonardis, A., & Bischof, H. (2000). Robust recognition using eigenimages. Computer Vision and Image Understanding Special Issue on Robust Statistical Techniques in Image Understanding, 78(1), 99–118.

    Google Scholar 

  • Leprêtre, S., Gaussier, P., & Cocquerez, J. P. (2000). From navigation to object recognition. In Int. conf. on simulation of adaptive behavior, Paris, France.

    Google Scholar 

  • Lindeberg, T. (1994). Scale-space theory: A basic tool for analysing structures at different scales. Journal of Applied Statistics, 21(2), 224–270.

    Google Scholar 

  • Lowe, D. (1999). Object recognition from local scale-invariant features. In Int. conf. on computer vision (pp. 1150–1157).

    Google Scholar 

  • Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    Article  Google Scholar 

  • Maeda, S., Kuno, Y., & Shirai, Y. (1997). Active navigation vision based on eigenspace analysis. In Int. conf. on intelligent robots and systems, IEEE/RSJ, Grenoble, France (pp. 1018–1023). 1997.

    Google Scholar 

  • Menegatti, E., Maeda, T., & Ishiguro, H. (2004a). Image-based memory for robot navigation using properties of the omnidirectional images. Robotics and Autonomous Systems, 47(4), 251–267.

    Article  Google Scholar 

  • Menegatti, E., Zoccarato, M., Pagello, E., & Ishiguro, H. (2004b). Image-based Monte-Carlo localisation with omnidirectional images. Robotics and Autonomous Systems, 48(1), 17–30.

    Article  Google Scholar 

  • Murillo, A., Sagues, C., Guerrero, J., Goedeme, T., Tuytelaars, T., & Gool, L.V. (2007). From omnidirectional images to hierarchical localization. Robotics and Autonomous Systems, 55(5), 372–382.

    Article  Google Scholar 

  • Murillo, A., Campos, P., Kosecka, J., & Guerrero, J. (2010). Gist vocabularies in omnidirectional images for appearance based mapping and localization. In 10th IEEE workshop on omnidirectional vision, camera networks and non-classical cameras, (OMNIVIS), held with robotics, science and systems.

    Google Scholar 

  • Pajdla, T., & Hlavac, V. (1999). Zero phase representation of panoramic images for image based localization. In F. Solina, & A. Leonardis (Eds.), Lecture notes in computer science: Vol. 1689. 8-th int. conf. on computer analysis of images and patterns, Ljubljana, Slovenia (pp. 550–557). Berlin: Springer.

    Chapter  Google Scholar 

  • Puzicha, J., Buhmann, J., Rubner, Y., & Tomasi, C. (1999). Empirical evaluation of dissimilarity measures for color and texture. In IEEE int. conf. on computer vision (pp. 1165–1172).

    Google Scholar 

  • Ramisa, A., de Mantaras, R. L., Aldavert, D., & Toledo, R. (2007). Comparing combinations of feature regions for panoramic vslam. In 4th int. conf. on informatics in control, automation and robotics, Angers, France (pp. 292–297).

    Google Scholar 

  • Ramisa, A., Tapus, A., de Mantaras, R. L., & Toledo, R. (2008). Mobile robot localization using panoramic vision and combination of local feature region detectors. In IEEE int. conf. on robotics and automation, Pasadena, California (pp. 538–543).

    Chapter  Google Scholar 

  • Rubinstein-Salzedo, S. (2004). On the existence and uniqueness of invariant measures on locally compact groups (Expository paper). Berkeley: University of California.

    Google Scholar 

  • Scaramuzza, D., Criblez, N., Martinelli, A., & Siegwart, R. (2008). Field and service robotics, robust feature extraction and matching for omnidirectional images. Springer tracts in advanced robotics (Vol. 42, pp. 71–81). Berlin/Heidelberg: Springer.

    Google Scholar 

  • Schulz-Mirbach, H., Burkhardt, H., & Sigglekow, S. (1996). Using invariant features for content based data retrieval. In First NOBLESSE workshop on nonlinear methods in model-based image interpretation, Lausanne, Switzerland

    Google Scholar 

  • Sigglekow, S. (2002). Feature histograms for content-based image retrieval. Ph.D. thesis, Universität Freiburg im Breusgau.

  • Tamimi, H., Andreasson, H., Treptow, A., Duckett, T., & Zell, A. (2005). Localization of mobile robots with omnidirectional vision using particle filter and iterative sift. In European conf. on mobile robots, Ancona, Italy

    Google Scholar 

  • Tapus, A., & Siegwart, R. (2006). A cognitive modeling of space using fingerprints of places for mobile robot navigation. In IEEE int. conf. on robotics and automation, Orlando, USA (pp. 1188–1193).

    Google Scholar 

  • Ulrich, I., & Nourbakhsh, I. (2000). Appearance-based place recognition for topological localization. In Int. conf. on robotics and automation, San Francisco, CA (pp. 1023–1029). New York: IEEE Press.

    Google Scholar 

  • Vasudevan, S., Gachter, S., & Nguyen, V. Siegwart, R. (2007). Cognitive maps for mobile robots—an object based approach. Robotics and Autonomous Systems, 55(5), 359–371.

    Article  Google Scholar 

  • Weil, A. (1979). L’intégration dans les groupes topologiques et ses applications. Paris: Hermann.

    Google Scholar 

  • Wolf, J., Burgard, W., & Burkhardt, H. (2002). Using an image retrieval system for vision-based mobile robot localization. In M. Lew, N. Sebe, & J. Eakins (Eds.), Int. conf. on image and video retrieval (CIVR) (pp. 108–119). Berlin/Heidelberg: Springer.

    Chapter  Google Scholar 

  • Wolf, J., Burgard, W., & Burkhardt, H. (2005). Robust vision-based localization by combining an image retrieval system with Monte Carlo localization. IEEE Transactions on Robotics, 21(2), 208–216.

    Article  Google Scholar 

  • Zivkovic, Z., Booij, O., & Kröse, B. (2007). From images to rooms. Robotics and Autonomous Systems, 55(5), 411–418.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Model, Information and Systems Laboratory, University of Picardie Jules Verne, 33 rue Saint Leu, Amiens, 80000, France

    Ouiddad Labbani-Igbida, Cyril Charron & El Mustapha Mouaddib

Authors
  1. Ouiddad Labbani-Igbida
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cyril Charron
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. El Mustapha Mouaddib
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ouiddad Labbani-Igbida.

Additional information

This work was supported by Region of Picardie under the DIVA program.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Labbani-Igbida, O., Charron, C. & Mouaddib, E.M. Haar invariant signatures and spatial recognition using omnidirectional visual information only. Auton Robot 30, 333–349 (2011). https://doi.org/10.1007/s10514-011-9222-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-011-9222-7

Keywords

Search

Navigation