Abstract
Image local feature extraction is extensively utilized in the field of photogrammetry where the spatial distribution of features is important in high-quality image matching, particularly in high-resolution unmanned aerial vehicle (UAV) image registration. Presently, the spatial distribution problems are considered in some local feature extraction methods, though these methods are designed for point descriptors. Line descriptors are more robust to repetitive patterns compared to point descriptors and have attracted extensive attention in recent years. Hence, a feature extraction method is designed in this paper for line descriptors based on the K-connected virtual line descriptors matching method. Using the four measures, the quality of local features is quantified, and a regular gridding strategy based on the quality of local features is applied in the feature selection procedure. The proposed feature extraction method was successfully applied to match various simulated and real UAV-based images. Based on the experimental results using real images, it is indicated that two evaluation criteria, namely the spatial distribution quality of features and the number of correct matches, are improved to at least 12% and 15%, respectively, for verifying the capability of the proposed method to enhance matching performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data and material
Data and material used during the study are available from authors by request.
References
Jiang, S., Jiang, W.: Efficient SfM for oblique UAV images: from match pair selection to geometrical verification. Remote Sens. 10, 1246 (2018)
Jiang, S., Jiang, W., Huang, W., Yang, L.: UAV-based oblique photogrammetry for outdoor data acquisition and offsite visual inspection of transmission line. Remote Sens. 9, 278 (2017)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)
Bay, H., Tuytelaars, T., Gool, L.V.: SURF: Speeded Up Robust Features. In: European Conference on Computer Vision (2006)
Deriche, R., Zhang, Z., Luong, Q.-T., Faugeras, O.: Robust recovery of the epipolar geometry for an uncalibrated stereo rig. In: Proceedings of the Third European Conference on Computer Vision, vol. 1, Stockholm, Sweden (2001)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. Assoc. Comp. 24, 381–395 (1981)
Li, J., Hu, Q., Ai, M.: 4FP-structure: a robust local region feature descriptor. Photogramm. Eng. Remote Sens. 83, 813–826 (2017)
Sattler, T., Leibe, B., Kobbelt, L.: SCRAMSAC: Improving RANSAC’s efficiency with a spatial consistency filter. Proceedings. 2090–2097 (2009)
Han, H., Zhu, Q., Du, Z., Zhang, Y., Ding, Y.: Reliable spatial relationship constrained feature point matching of oblique aerial images. Photogramm. Eng. Remote Sens. 81, 49–58 (2015)
Engin, T., Vincent, L., Pascal, F.: DAISY: an efficient dense descriptor applied to wide-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. 32, 815–830 (2010)
Leutenegger, S., Chli, M., Siegwart, R.Y.: BRISK: Binary robust invariant scalable keypoints. In: International Conference on Computer Vision (2011)
Zhe, L., Marlet, R.: Virtual line descriptor and semi-local graph matching method for reliable feature correspondence. In: British Machine Vision Conference (2012)
Li, J., Hu, Q., Ai, M., Zhong, R.: Robust feature matching via support-line voting and affine-invariant ratios. ISPRS J. Photogramm. Remote Sens. 132, 61–76 (2017)
Jiang, S., Jiang, W.: Reliable image matching via photometric and geometric constraints structured by Delaunay triangulation. ISPRS J. Photogramm. Remote Sens. 153, 1–20 (2019). https://doi.org/10.1016/j.isprsjprs.2019.04.006
Lingua, A., Marenchino, D., Nex, F.: Performance analysis of the SIFT operator for automatic feature extraction and matching in photogrammetric applications. Sensors 9, 3745–3766 (2009)
Song, R., Szymanski, J.: Well-distributed SIFT features. Electron. Lett. 45, 308–310 (2009)
Sedaghat, A., Mokhtarzade, M., Ebadi, H.: Uniform robust scale-invariant feature matching for optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 49, 4516–4527 (2011)
Sedaghat, A., Mohammadi, N.: Uniform competency-based local feature extraction for remote sensing images. ISPRS J. Photogramm. Remote Sens. 135, 142–157 (2018)
Hossein-Nejad, Z., Nasri, M.: RKEM: redundant keypoint elimination method in image registration. IET Image Proc. 11, 273–284 (2017)
Wang, B., Zhang, J., Lu, L., Huang, G., Zhao, Z.: A uniform SIFT-like algorithm for SAR image registration. IEEE Geosci. Remote Sens. Lett. 12, 1426–1430 (2015)
Kaehler, A., Bradski, G.: Learning Opencv 3: Computer Vision in C ++ with the Opencv Library. O’Reilly Media, Inc., Sebastopol (2016)
Funding
This research was funded by National Natural Science Foundation of China under Grant 41974215,and in part by the Fundamental Research Funds for Central Universities of the Central South University (2020zzts188).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Not applicable.
Code availability
Code are available from authors by request.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xing, L., Dai, W. A local feature extraction method for UAV-based image registration based on virtual line descriptors. SIViP 15, 705–713 (2021). https://doi.org/10.1007/s11760-020-01788-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-020-01788-z