Abstract
Due to increased potential applications of unmanned aerial vehicles over urban areas, algorithms for the safe landing of these devices have become more critical. One way to ensure a safe landing is to locate the ground plane regions of images captured by the device camera that are free of obstacles by deep semantic segmentation networks. In this paper, we study the performance of semantic segmentation networks trained for this purpose at a particular altitude and location. We show that a variation in altitude and location significantly decreases network performance. We then propose an approach to retrain the network using only a new set of images and without marking the ground regions in this novel training set. Our experiments show that we can convert a network’s operating range from low to high altitudes and vice versa by label-free retraining.



Similar content being viewed by others
Data availability
UAVid is available online at https://uavid.nl, SDrone is available at http://dronedataset.icg.tugraz.at, and the annotations used in this study are available at reasonable request from the first author.
References
Bouaiss, O., Mechgoug, R., Taleb-Ahmed, A.: Visual soft landing of an autonomous quadrotor on a moving pad using a combined fuzzy velocity control with model predictive control. Signal Image Video Process. 1–10 (2022)
Guérin, J., Delmas, K., Guiochet, J.: Certifying emergency landing for safe urban UAV. In: International Conference on Dependable Systems and Networks Workshops, pp. 55–62. IEEE (2021)
Alam, M.S., Oluoch, J.: A survey of safe landing zone detection techniques for autonomous unmanned aerial vehicles (UAVs). Expert Syst. Appl. 179, 115091 (2021)
Yang, T., Li, P., Zhang, H., Li, J., Li, Z.: Monocular vision SLAM-based UAV autonomous landing in emergencies and unknown environments. Electronics 7(5), 73 (2018)
Kinahan, J., Smeaton, A.F.: Image segmentation to identify safe landing zones for unmanned aerial vehicles. arXiv preprint arXiv:2111.14557 (2021)
Jain, J., Singh, A., Orlov, N., Huang, Z., Li, J., Walton, S., Shi, H.: SeMask: semantically masked transformers for semantic segmentation. arXiv:2112.12782 (2021)
Uzyıldırım, F.E., Özuysal, M.: Improving outdoor plane estimation without manual supervision. SIViP 16(2), 1–9 (2022)
Miangoleh, S.M.H., Dille, S., Mai, L., Paris, S., Aksoy, Y.: Boosting monocular depth estimation models to high-resolution via content-adaptive multi-resolution merging. In: Conference on Computer Vision and Pattern Recognition (2021)
Bosch, S., Lacroix, S., Caballero, F.: Autonomous detection of safe landing areas for an UAV from monocular images. In: International Conference on Intelligent Robots and Systems, pp. 5522–5527. IEEE (2006)
Garg, R., Yang, S., Scherer, S.: Monocular and stereo cues for landing zone evaluation for micro UAVs. arXiv preprint arXiv:1812.03539 (2018)
Rojas-Perez, L.O., Munguia-Silva, R., Martinez-Carranza, J.: Real-time landing zone detection for UAVs using single aerial images. In: International Micro Air Vehicle Competition and Conference, pp. 243–248 (2018)
Huang, Z., Wang, X., Wei, Y., Huang, L., Shi, H., Liu, W., Huang, T.S.: CCNet: Criss-cross attention for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. (Early Access) (2020). https://doi.org/10.1109/TPAMI.2020.3007032
Strudel, R., Garcia, R., Laptev, I., Schmid, C.: Segmenter: transformer for semantic segmentation. In: International Conference on Computer Vision, pp. 7262–7272 (2021)
Orhan, S., Bastanlar, Y.: Semantic segmentation of outdoor panoramic images. SIViP 16(3), 643–650 (2022)
Schönberger, J.L., Frahm, J.-M.: Structure-from-motion revisited. In: Conference on Computer Vision and Pattern Recognition (2016)
Schönberger, J.L., Zheng, E., Pollefeys, M., Frahm, J.-M.: Pixelwise view selection for unstructured multi-view stereo. In: European Conference on Computer Vision (2016)
Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: From contours to regions: an empirical evaluation. In: Conference on Computer Vision and Pattern Recognition, pp. 2294–2301. IEEE (2009)
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)
Mostegel, C., Maurer, M., Heran, N., Puerta, J.P., Fraundorfer, F.: Semantic Drone Dataset. http://dronedataset.icg.tugraz.at. Accessed 19 July 2022
Lyu, Y., Vosselman, G., Xia, G.-S., Yilmaz, A., Yang, M.Y.: UAVid: a semantic segmentation dataset for UAV imagery. J. Photogramm. Remote Sens. 165, 108–119 (2020)
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
All authors contributed to the conceptualization and design. FEU prepared the datasets, implemented the approach, and conducted the experiments. MÖ prepared the draft manuscript. All authors revised the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
No conflicts of interest.
Ethics approval
Not applicable.
Code availability
The code is available at reasonable request from the first author.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Uzyıldırım, F.E., Özuysal, M. Label-free retraining for improved ground plane segmentation. SIViP 17, 2465–2471 (2023). https://doi.org/10.1007/s11760-022-02463-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02463-1