Abstract
In this paper we investigate the benefit of terrain classification for self-localization of a flying robot. The key idea is to use aerial images, which are already available from online databases such as GoogleMaps™, as reference map and to match images taken with a downward looking camera with this map. Using different terrain classes as features, we can make sure that our method is invariant to lighting/weather changes as well as seasonal variations or minor changes in the environment. A particle filter is used to register the query image with parts of the map. The proposed method has shown to work on image data from both simulated and real flights.
Andreas Masselli and Richard Hanten are with the Chair of Cognitive Systems, headed by Prof. Andreas Zell, at the Faculty of Science, University of Tuebingen.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Herbert Bay, Tinne Tuytelaars, and Luc J. Van Gool. Surf: Speeded up robust features. In Ales Leonardis, Horst Bischof, and Axel Pinz, editors, ECCV (1), volume 3951 of Lecture Notes in Computer Science, pages 404–417. Springer, 2006.
Sbastien Bosch, Simon Lacroix, and Fernando Caballero. Autonomous detection of safe landing areas for an uav from monocular images. In IROS, pages 5522–5527. IEEE, 2006.
Leo Breiman. Random forests. Machine Learning, 45(1):5–32, October 2001.
Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua. Brief: binary robust independent elementary features. In Proceedings of the 11th European conference on Computer vision: Part IV, ECCV’10, pages 778–792, Berlin, Heidelberg, 2010. Springer-Verlag.
A. Cesetti, E. Frontoni, A. Mancini, P. Zingaretti, and S. Longhi. A vision-based guidance system for uav navigation and safe landing using natural landmarks. J. Intell. Robotics Syst., 57(1–4):233–257, January 2010.
Andrea Cesetti, Emanuele Frontoni, Adriano Mancini, Andrea Ascani, Primo Zingaretti, and Sauro Longhi. A visual global positioning system for unmanned aerial vehicles used in photogrammetric applications. Journal of Intelligent and Robotic Systems, 61(1–4):157–168, 2011.
Sara Erhard, Karl Engelbert Wenzel, and Andreas Zell. Flyphone: Visual Self-Localisation Using a Mobile Phone as Onboard Image Processor on a Quadrocopter. Journal of Intelligent & Robotic Systems, 57:451–465, 2009.
Robert Hudjakov and Mart Tamre. Aerial imagery terrain classification for long-range autonomous navigation. In R. Küttner, editor, Proc. of the 7th International Conference of DAAAM Baltic Industrial Engineering, pages 530–535, Tallinn, April 2010. Tallinn Technical University Press.
Yasir Niaz Khan, Andreas Masselli, and Andreas Zell. Visual terrain classification by flying robots. In IEEE International Conference on Robotics and Automation (ICRA), pages 498–503, St. Paul, Minnesota, USA, May 2012.
Rainer Kümmerle, Bastian Steder, Christian Dornhege, Alexander Kleiner, Giorgio Grisetti, and Wolfram Burgard. Large scale graph-based slam using aerial images as prior information. Auton. Robots, 30(1):25–39, January 2011.
Dongjin Lee, Yeongju Kim, and Hyochoong Bang. Vision-based terrain referenced navigation for unmanned aerial vehicles using homography relationship. Journal of Intelligent and Robotic Systems, 69(1–4):489–497, 2013.
Xiaoming Li. A software scheme for uav’s safe landing area discovery. In Wei Deng, editor, AASRI Conference on Intelligent Systems and Control, volume 4, pages 230–235, 2013.
David G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91–110, November 2004.
Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. Orb: An efficient alternative to sift or surf. In International Conference on Computer Vision, Barcelona, 11/2011 2011.
B. Steder, G. Grisetti, C. Stachniss, and W. Burgard. Visual slam for flying vehicles. Trans. Rob., 24(5):1088–1093, October 2008.
S. Thrun, D. Fox, W. Burgard, and F. Dellaert. Robust monte carlo localization for mobile robots. Artificial Intelligence, 128(1–2):99–141, 2000.
Christoffer Valgren and Achim J. Lilienthal. Sift, surf & seasons: Appearance-based long-term localization in outdoor environments. Robot. Auton. Syst., 58(2):149–156, February 2010.
Acknowledgments
The authors thank Stefan Laible for his contributions and hints regarding terrain classification, Norbert Morgenstern for performing the outdoor flights, and Sebastian Buck for providing ground truth data.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Masselli, A., Hanten, R., Zell, A. (2016). Localization of Unmanned Aerial Vehicles Using Terrain Classification from Aerial Images. In: Menegatti, E., Michael, N., Berns, K., Yamaguchi, H. (eds) Intelligent Autonomous Systems 13. Advances in Intelligent Systems and Computing, vol 302. Springer, Cham. https://doi.org/10.1007/978-3-319-08338-4_60
Download citation
DOI: https://doi.org/10.1007/978-3-319-08338-4_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08337-7
Online ISBN: 978-3-319-08338-4
eBook Packages: EngineeringEngineering (R0)