Skip to main content
SpringerLink
Log in

Aerial-DEM geolocalization for GPS-denied UAS navigation

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

A Publisher Correction to this article was published on 27 February 2020

This article has been updated

Abstract

Accelerated by the proliferation of small, affordable, and lightweight electronically scanning radar systems as well as advances in Unmanned Aircraft System (UAS) technology, Geo-Registered Radar Returns data are becoming an incredible source for geolocalization in GPS-denied UAS navigation. Most existing approaches match aerial images to pre-stored Digital Elevation Models (DEMs) through 3D terrain reconstruction or GPU-based terrain rendering techniques. However, these reconstruction or rendering processes are themselves error-prone and time-consuming, which further decrease UAS navigation accuracy. In this work, we propose a novel geolocalization approach by directly matching aerial images to DEMs. Inspired by success of deep learning in face recognition/verification, we develop a triplet-ranking network to embed aerial images and DEMs into the same low-dimensional feature space, where matching Aerial-DEM are near one another and mismatched Aerial-DEM are far apart. To create large-scale training dataset, we design an efficient terrain generation approach using per-pixel displacement mapping technique. This approach augments aerial datasets by simulating visual appearances of terrain under different lighting conditions. Experiments are conducted to show the effectiveness of our deep network in finding matches between aerial images and DEMs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Change history

  • 27 February 2020

    The articles listed below were published in Issue January 2020, Issue 1, instead of Issue February 2020, Issues 1–2.

References

  1. Rodriguez, J.J., Aggarwal, J.K.: Matching aerial images to 3D terrain maps. IEEE Trans. Pattern Anal. Mach. Intell. 12(12), 1138–1149 (1990)

    Article  Google Scholar 

  2. Wang, T., Celik, K., Somani, A.K.: Characterization of mountain drainage patterns for GPS-denied UAS navigation augmentation. Comput. Vis. Appl. 27, 87–101 (2016)

    Google Scholar 

  3. Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: A unified embedding for face recognition and clustering. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2015)

  4. Wang, T., Sun, C., Lao, G.: Aerial-DEM geolocalization for GPS-denied UAS navigation. In: Proceedings of International Conference on Intelligent Control and Information Processing (2018)

  5. Horn, B.K.P., Bachman, B.L.: Using synthetic images to register real images with surface model. Graphics Image Process. 21, 914–924 (1978)

    Google Scholar 

  6. Chen, D.M., Baatz, G., Koser, K., Tasi, S.S., Vedantham, R., et al.: City-scale landmark identification on mobile devices. In: Proceedings of International Conference on Computer Vision and Pattern Recognition (2011)

  7. Li, Y., Snavely, N., Huttenlocher, D.P.: Location recognition using prioritized feature matching. In: Proceedings of European Conference on Computer Vision (2010)

  8. Zamir, A.R., Shah, M.: Accurate image localization based on google maps street view. In: Proceedings of European Conference on Computer Vision (2010)

  9. Bansal, M., Daniilidis, K.: Ultra-wide baseline facade matching for geo-localization. In: Proceedings of European Conference on Computer Vision (2012)

  10. Shan, Q., Wu, C., Curless, B.: Accurate geo-referenced by ground-to-aerial image matching. In: Proceedings of International Conference on 3D Vision (2014)

  11. Lin, T.Y., Cui, Y., Belongi, S., Hays, J.: Learning deep representations fro ground-to-aerial localization. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2015)

  12. Costea, D., Leordeanu, M.: Aerial image geolocalization from recognition and matching of roads and intersections, arXiv preprint arXiv:1605.08323 (2016)

  13. Wang, J., Song, Y., Leung, T., Rosenberg, C., Wang, J.: Learning fine-grained image similarity with deep ranking. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2014)

  14. Yu, Q., Liu, F., Song, Y., et al.: Sketch me that shoe. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2016)

  15. Krizhevsky, A., Sutskever, I., Hinton, G.: Image classification with deep convolutional neural networks. In: Proceedings of Neural Information Systems (2012)

  16. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: Overfeat: Integrated recognition, localization and detection using convolutional networks. In: Proceedings of International Conference on Learning Representations (2014)

  17. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2016)

  18. Szegedy, C., Ioffer, S., Vanhoucke, V.: Inception-v4, Inception-ResNet and the impact of residual connections on learning, arXiv preprint arXiv:1602.07261 (2016)

  19. Ritter, M.E.: An Introduction to Physical Geography and the Environment. Prentice Hall, Upper Saddle River (2006)

    Google Scholar 

  20. Farr, T.G., Rosen, P.A., Caro, E., et al.: The shuttle radar topography mission. Rev. Geophys. 45(2), 1–33 (2007)

    Article  Google Scholar 

  21. Szirmay-Kalos, L., Umenhoffer, T.: Displacement mapping on the GPU-state of the art. Comput. Graphics Forum 27(6), 1567–1592 (2006)

    Article  Google Scholar 

  22. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–1120 (2004)

    Article  Google Scholar 

  23. Dalal, N., Triggs, B.: Histogram of oriented gradients for human detection. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2004)

  24. Koch, G., Zemel, R., Salakutdinov, R.: Siamese neural networks for one-shot image recognition. In: Proceedings of ICML Deep Learning Workshop (2017)

Download references

Acknowledgements

The research of the first author is funded by National Science Funding of China under Grant 61803084. The research of the second author is funded by Phillip and Viginia Sproul Endowment at Iowa State University.

Author information

Authors and Affiliations

  1. Southeast University, Nanjing, China

    Teng Wang

  2. Iowa State University, Ames, USA

    Arun K. Somani

Authors
  1. Teng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arun K. Somani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Teng Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, T., Somani, A.K. Aerial-DEM geolocalization for GPS-denied UAS navigation. Machine Vision and Applications 31, 3 (2020). https://doi.org/10.1007/s00138-019-01052-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-019-01052-6

Keywords

Search

Navigation