Abstract
This paper presents a vision-based localization approach for Unmanned Aerial Vehicles (UAVs) flying at low altitude over forested areas. We address the task as a point cloud registration problem using local 3D features with the intention to exploit the shape and relative arrangement of the trees. We propose a 3D descriptor called SHOT-N which is an adaptation of the state-of-the-art SHOT 3D descriptor. SHOT-N leverages constraints in the extrinsic parameters of a gimballed, nadir-looking camera. Extensive experiments were performed with semi-simulated point cloud data based on real aerial images over four forested areas. SHOT-N is shown to outperform two state-of-the-art 3D descriptors in terms of the rate of successful registrations. The results suggest a high potential of the approach for aerial localization over forested areas.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Keystone software, http://spacemetric.com.
References
Aoki, Y., Goforth, H., Srivatsan, R.A., Lucey, S.: PointNetLK: robust & efficient point cloud registration using PointNet. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 7156–7165 (2019). https://doi.org/10.1109/CVPR.2019.00733
Bentley, J.L.: Multidimensional binary search trees used for associative searching. Commun. ACM 18(9), 509–517 (1975). https://doi.org/10.1145/361002.361007
Campos, C., Elvira, R., Rodriguez, J.J., Montiel, J.M., Tardos, J.D.: ORB-SLAM3: An accurate open-source library for visual, visual-inertial, and multimap SLAM. IEEE Trans. Rob. 37(6), 1874–1890 (2021). https://doi.org/10.1109/TRO.2021.3075644
Couturier, A., Akhloufi, M.A.: A review on absolute visual localization for UAV. Robot. Auton. Syst. 135, 103666 (2021). https://doi.org/10.1016/j.robot.2020.103666. https://doi.org/10.1016/j.robot.2020.103666
Dovis, F.: GNSS interference threats and countermeasures. Artech House Publishers, Norwood, MA, United States (2015)
Elbaz, G., Avraham, T., Fischer, A.: 3D point cloud registration for localization using a deep neural network auto-encoder. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, vol. 2017, pp. 2472–2481 (2017). https://doi.org/10.1109/CVPR.2017.265
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981). https://doi.org/10.1145/358669.358692
Grelsson, B., Felsberg, M., Isaksson, F.: Efficient 7D aerial pose estimation. In: 2013 IEEE Workshop on Robot Vision, WORV 2013, pp. 88–95 (2013). https://doi.org/10.1109/WORV.2013.6521919
Hemann, G., Singh, S., Kaess, M.: Long-range GPS-denied Aerial Inertial Navigation with LIDAR Localization. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (May), pp. 1659–1666 (2016). https://doi.org/10.1109/IROS.2016.7759267
Holz, D., Ichim, A.E., Tombari, F., Rusu, R.B., Behnke, S.: Registration with the point cloud library: a modular framework for aligning in 3-D. IEEE Robot. Autom. Mag. 22(4), 110–124 (2015). https://doi.org/10.1109/MRA.2015.2432331
Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. 4, 629–642 (1987)
Huang, X., Mei, G., Zhang, J., Abbas, R.: A comprehensive survey on point cloud registration, pp. 1–17 (2021). http://arxiv.org/abs/2103.02690
Jafarnia-Jahromi, A., Broumandan, A., Nielsen, J., Lachapelle, G.: GPS vulnerability to spoofing threats and a review of antispoofing techniques. Int. J. Navig. Observ. 2012, 127072 (2012). https://doi.org/10.1155/2012/127072
Khan, S.Z., Mohsin, M., Iqbal, W.: On GPS spoofing of aerial platforms: a review of threats, challenges, methodologies, and future research directions. PeerJ Computer Science 7, 1–35 (2021). https://doi.org/10.7717/PEERJ-CS.507
Patel, B., Barfoot, T.D., Schoellig, A.P.: Visual localization with google earth images for robust global pose estimation of UAVs. In: Proceedings - IEEE International Conference on Robotics and Automation, pp. 6491–6497 (2020). https://doi.org/10.1109/ICRA40945.2020.9196606
Petrelli, A., Di Stefano, L.: On the repeatability of the local reference frame for partial shape matching. Proceedings of the IEEE International Conference on Computer Vision, pp. 2244–2251 (2011). https://doi.org/10.1109/ICCV.2011.6126503
Qi, C.R., Su, H., Mo, K., Guibas, L.J.: PointNet: deep learning on point sets for 3D classification and segmentation. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 2017-Janua, pp. 77–85 (2017). https://doi.org/10.1109/CVPR.2017.16
Rusu, R.B.: Semantic 3D object maps for everyday manipulation in human living environments. Doctoral thesis, Technische Universität München (2009). https://doi.org/10.1007/s13218-010-0059-6
Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: IEEE International Conference on Robotics and Automation, pp. 3212–3217 (2009). https://doi.org/10.1109/robot.2009.5152473
Saiti, E., Theoharis, T.: An application independent review of multimodal 3D registration methods. Comput. Graph. (Pergamon) 91, 153–178 (2020). https://doi.org/10.1016/j.cag.2020.07.012
Salti, S., Tombari, F., Di Stefano, L.: SHOT: unique signatures of histograms for surface and texture description. Comput. Vis. Image Understanding 125, 251–264 (2014). https://doi.org/10.1016/j.cviu.2014.04.011
Sattler, T., et al.: Benchmarking 6DoF urban visual localization in changing conditions. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8601–8610 (2018). http://arxiv.org/abs/1707.09092
Tombari, F., Salti, S., Di Stefano, L.: Unique signatures of histograms for local surface description. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 356–369. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15558-1_26
Zhang, Z., Dai, Y., Sun, J.: Deep learning based point cloud registration: an overview. Virt. Real. Intell. Hardware 2(3), 222–246 (2020). https://doi.org/10.1016/j.vrih.2020.05.002
Acknowledgements
This work was carried out in the project “Autonomous Navigation Support from Real-Time Visual Mapping”, which was funded by Sweden’s National Strategic Innovation Programme for Aeronautics (Innovair) through Sweden’s Innovation Agency (Vinnova) (project nr. 2019-02746).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sabel, D., Westin, T., Maki, A. (2023). 3D Point Cloud Registration for GNSS-denied Aerial Localization over Forests. In: Gade, R., Felsberg, M., Kämäräinen, JK. (eds) Image Analysis. SCIA 2023. Lecture Notes in Computer Science, vol 13885. Springer, Cham. https://doi.org/10.1007/978-3-031-31435-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-31435-3_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31434-6
Online ISBN: 978-3-031-31435-3
eBook Packages: Computer ScienceComputer Science (R0)