Abstract
Image registration is fundamental and crucial to remote sensing. However getting highly accurate registration performance automatically and fast for large-field images consistently is a challenge. As a work around to this problem, we propose a new image registration concept based on visual attention in this paper. This concept employs the advantages of feature-based or area-based methods to improve the precision and efficiency of image registration. The key concept of proposed integrated scheme is to make optimum use of the highly prominent details in the full scene by means of visual attention computational mechanism. To testify the validation, comparisons with other classical methods are carried out on real-world images. The experimental results show that the proposed method can effectively perform on multi-view/multi-temporal remote sensing images with outstanding precision and time saving performance.
概要
创新点
本文主要从提高遥感图像配准算法效率与准确率角度出发, 受到视觉注意计算模型启发, 提出了一种由粗到精的大视场遥感图像配准策略. 本策略包括基于显著感兴趣区域的粗匹配和局部互相关的精匹配两个过程. 创新点主要包括三个方面: 1) 改进的显著性区域特征提取及干扰区域剔除策略可有效、 快速地确定同名匹配特征区域; 2) 由匹配的同名区域, 为后续局部互相关匹配提出了一种初始变换参数提取策略; 3) 互相关优化搜索方法在经过粗匹配筛选的显著感兴趣区域进行, 有效地降低了迭代搜索过程的计算量, 提高算法效率. 实验结果表明, 本文所述方法在多视角、 多时段大视场同源遥感图像配准领域有较好的应用效果.
Similar content being viewed by others
References
Zitova B, Flusser J. Image registration methods: a survey. Image Vision Comput, 2003, 21: 977–1000
Chen T, Chen L, Su Y. A SAR image registration method based on pixel migration of edge-point feature. IEEE Geosci Remote Sens Lett, 2014, 11: 906–910
Hsieh Y C, McKeown Jr D M, Perlant F P. Performance evaluation of scene registration and stereo matching for artographic feature extraction. IEEE Trans Pattern Anal Mach Intell, 1992, 14: 214–238
Inglada J, Adragna F. Automatic multi-sensor image registration by edge matching using genetic algorithms. In: IEEE International Geoscience and Remote Sensing Symposium, 2001. 2313–2315
Ding M T, Jin Z, Tian Z, et al. Object registration for remote sensing images using robust kernel pattern vectors. Sci China Inf Sci, 2012, 55: 2611–2623
Qiu P, Liang Y. The improved algorithm of remote sensing image registration based on SIFT and Contourlet transform. In: 4th IEEE International Conference on Software Engineering and Service Science (ICSESS), 2013. 906–909
Wang L, Gao X, Fang Q. A novel mutual information-based similarity measure for 2D/3D registration in image guided intervention. In: International Conference on Orange Technologies, Tainan, 2013. 135–138
Pluim J P W, Maintz J B A, Viergever M A. Mutual-information-based registration of medical images: a survey. IEEE Trans Med Imag, 2003, 22: 986–1004
Chen H M, Arora M K, Varshney P K. Mutual information-based image registration for remote sensing data. Int J Remote Sens, 2003, 24: 3701–3706
Zhang K, Li X Z, Zhang J X. A robust point-matching algorithm for remote sensing image registration. IEEE Geosci Remote Sens Lett, 2014, 11: 469–473
Pluim J P W, Maintz J B A, Viergever M A. Mutual information matching in multiresolution contexts. Image Vision Comput, 2001, 19: 45–52
Kim K S, Lee J H, Ra J B. Robust multi-sensor image registration by enhancing statistical correlation. In: IEEE 8th International Conference on Information Fusion, 2005, 1: 380–386
Gong M, Zhao S, Jiao L, et al. A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information. IEEE Geosci Remote Sens, 2013, DOI: 10.1109/TGRS.2013.2281391
Feng J, Chen H, Bi F K, et al. Detection of oil spills in a complex scene of SAR imagery. Sci China Technol Sci, 2014, 57: 2204–2209
Weese J, Penney G P, et al. Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery. IEEE Trans Inf Technol Biomed, 1997, 1: 284–293
Liu Z Y, Zhou F G, et al. Multi-modal image registration by mutual information based on optimal region selection. In: International Conference on Information, Networking and Automation, 2010, 2: 249–253
Shao Z F, Tian Y J, Shen X L. BASI: a new index to extract built-up areas from high-resolution remote sensing images by visual attention model. Remote Sens Lett, 2014, 5: 305–314
Bi F K, Zhu B C, Gao L N, et al. A visual search inspired computational model for ship detection in optical satellite images. IEEE Geosci Remote Sens Lett, 2012, 9: 749–753
Achanta R, Hemami S, Estrada F, et al. Frequency-tuned salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009. 1597–1604
Walther D, Koch C. Modeling attention to salient proto-objects. Neural Netw, 2006, 19: 1395–1407
Hu M K. Visual pattern recognition by moment invariants. IRE Trans Inform Theory, 1962, 8: 179–187
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Feng, J., Ma, L., Bi, F. et al. A coarse-to-fine image registration method based on visual attention model. Sci. China Inf. Sci. 57, 1–10 (2014). https://doi.org/10.1007/s11432-014-5207-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-014-5207-4
Keywords
- remote sensing image registration
- visual attention
- similarity measure
- partial correlation
- coarse-to-fine process