Cited By
View all- Li ZJiang XMa SMa XLv ZDing HJi HSun Z(2024)Expediting the Convergence of Global Localization of UAVs through Forward-Facing Camera ObservationDrones10.3390/drones80703358:7(335)Online publication date: 19-Jul-2024
UAV Visual Localization Technology Based on Heterogenous Remote Sensing Image Matching
Pages 773 - 779
Abstract
At present, the positioning function of intelligent UAVs mainly uses GPS technology, and GPS signals are susceptible to environmental and electromagnetic interference factors. In this paper, we combine remote sensing image processing with image matching algorithms to propose a GPS-independent visual localization technique for UAVs. First, the VGG16 network is used as the feature extraction backbone network, and the backbone network is designed and optimized for the characteristics of heterogenous remote sensing images. Secondly, a feature point screening and matching strategy is constructed, by which common feature points between heterogeneous remote sensing images can be screened and used for feature matching. Finally, the remote sensing image containing geographic location information and the UAV aerial image are fed into the network for feature extraction and matching, and the transformation matrix between the aligned images is calculated by the successfully matched feature points, and the transformation matrix is used to complete the mapping from the aerial image to the satellite image, and finally the geographic location information of each pixel can be read from the mapped image to complete the localization.
References
[1]
LI Deren, LI Ming. Research Advance and Application Prospect of Unmanned Aerial Vehicle Remote Sensing System[J]. Geomatics and Information Science of Wuhan University, 2014, 39(5): 505-513.
[2]
LI Deren, GONG Jianya, SHAO Zhenfeng. From Digital Earth to Smart Earth[J]. Geomatics and Information Science of Wuhan University, 2010, 35(2): 127-132.
[3]
LI Deren. Development Prospect of Photogrammetry and Remote Sensing[J]. Geomatics and Information Science of Wuhan University, 2008, 33(12): 1211-1215.
[4]
Li Pingxiang. Matching Aerial Images with DEM[J]. Geomatics and Information Science of Wuhan University, 1995, 20(3): 202-207.
[5]
Shan M, Wang F, Lin F, Google map aided visual navigation for UAVs in GPS-denied environment[C]//In Proceedings of 2015 IEEE International Conference on Robotics and Biomimetics, December 6-9, 2019, Zhuhai, China, 2015: 114–119.
[6]
Conte G, Doherty P. Vision-based unmanned aerial vehicle navigation using geo-referenced information [J]. EURASIP Journal on Advances in Signal Processing, 2009, 2009(1): 1-18.
[7]
DeTone D, Malisiewicz T, Rabinovich A. Superpoint: Self-supervised interest point detection and description[C]//Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2018: 224-236.
[8]
Noh H, Araujo A, Sim J, Large-scale image retrieval with attentive deep local features[C]//Proceedings of the IEEE international conference on computer vision. 2017: 3456-3465.
[9]
Dusmanu M, Rocco I, Pajdla T, D2-net: A trainable cnn for joint description and detection of local features[C]//Proceedings of the ieee/cvf conference on computer vision and pattern recognition. 2019: 8092-8101.
[10]
Yi K M, Trulls E, Lepetit V, Lift: Learned invariant feature transform[C]//European conference on computer vision. Springer, Cham, 2016: 467-483.
[11]
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J]. Computer Science, 2014,1409 1556.
[12]
Lowe G. Sift-the scale invariant feature transform[J]. Int. J, 2004, 2(91-110): 2.
[13]
Muja M, Lowe D. Flann-fast library for approximate nearest neighbors user manual[J]. Computer Science Department, University of British Columbia, Vancouver, BC, Canada, 2009, 5.
[14]
Sebbah B, Alaoui O Y, Wahbi M, QGIS-Landsat Indices plugin (Q-LIP): Tool for environmental indices computing using Landsat data[J]. Environmental Modelling & Software, 2021, 137: 104972.
[15]
Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International journal of computer vision, 2004, 60(2): 91-110.
[16]
Barath D, Kukelova Z. Homography from two orientation-and scale-covariant features[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2019: 1091-1099.
Index Terms
- UAV Visual Localization Technology Based on Heterogenous Remote Sensing Image Matching
Recommendations
Research on Aircraft Whole day Location Technology Based on Aerial and Remote Sensing Image Matching
AIPR '23: Proceedings of the 2023 6th International Conference on Artificial Intelligence and Pattern RecognitionNowadays, aircraft positioning is mainly based on GNSS, but GNSS signal receiving equipment is difficult to ensure the stability and reliability of the positioning signal in the presence of obstruction or strong electromagnetic interference environments. ...
A Robust Feature Extraction Method for Heterogenous Remote Sensing Images Based on Feature Transfer
AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern RecognitionA robust feature extraction method based on feature transfer for heterogeneous remote sensing images is proposed to address the problem of insufficient generalization ability of traditional edge feature extraction methods applied to heterogeneous remote ...
Multi-exposure remote sensing image HDR synthesis technology based on spaceborne DSP
ITCC '21: Proceedings of the 2021 3rd International Conference on Information Technology and Computer CommunicationsSince traditional high dynamic range (HDR) imaging technology cannot be directly applied to satellites, in the field of remote sensing imaging, a technology for directly generating HDR remote sensing images on the satellite has been explored for a long ...
Comments
Information & Contributors
Information
Published In
September 2022
1221 pages
ISBN:9781450396899
DOI:10.1145/3573942
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 May 2023
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AIPR 2022
AIPR 2022: 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
September 23 - 25, 2022
Xiamen, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 41Total Downloads
- Downloads (Last 12 months)17
- Downloads (Last 6 weeks)2
Reflects downloads up to 01 Mar 2025
Other Metrics
Citations
Cited By
View all- Li ZJiang XMa SMa XLv ZDing HJi HSun Z(2024)Expediting the Convergence of Global Localization of UAVs through Forward-Facing Camera ObservationDrones10.3390/drones80703358:7(335)Online publication date: 19-Jul-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format