Skip to main content
Log in

A coarse-to-fine image registration method based on visual attention model

一种基于视觉显著模型的快速图像配准方法

  • Research Paper
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

Image registration is fundamental and crucial to remote sensing. However getting highly accurate registration performance automatically and fast for large-field images consistently is a challenge. As a work around to this problem, we propose a new image registration concept based on visual attention in this paper. This concept employs the advantages of feature-based or area-based methods to improve the precision and efficiency of image registration. The key concept of proposed integrated scheme is to make optimum use of the highly prominent details in the full scene by means of visual attention computational mechanism. To testify the validation, comparisons with other classical methods are carried out on real-world images. The experimental results show that the proposed method can effectively perform on multi-view/multi-temporal remote sensing images with outstanding precision and time saving performance.

概要

创新点

本文主要从提高遥感图像配准算法效率与准确率角度出发, 受到视觉注意计算模型启发, 提出了一种由粗到精的大视场遥感图像配准策略. 本策略包括基于显著感兴趣区域的粗匹配和局部互相关的精匹配两个过程. 创新点主要包括三个方面: 1) 改进的显著性区域特征提取及干扰区域剔除策略可有效、 快速地确定同名匹配特征区域; 2) 由匹配的同名区域, 为后续局部互相关匹配提出了一种初始变换参数提取策略; 3) 互相关优化搜索方法在经过粗匹配筛选的显著感兴趣区域进行, 有效地降低了迭代搜索过程的计算量, 提高算法效率. 实验结果表明, 本文所述方法在多视角、 多时段大视场同源遥感图像配准领域有较好的应用效果.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Zitova B, Flusser J. Image registration methods: a survey. Image Vision Comput, 2003, 21: 977–1000

    Article  Google Scholar 

  2. Chen T, Chen L, Su Y. A SAR image registration method based on pixel migration of edge-point feature. IEEE Geosci Remote Sens Lett, 2014, 11: 906–910

    Article  Google Scholar 

  3. Hsieh Y C, McKeown Jr D M, Perlant F P. Performance evaluation of scene registration and stereo matching for artographic feature extraction. IEEE Trans Pattern Anal Mach Intell, 1992, 14: 214–238

    Article  Google Scholar 

  4. Inglada J, Adragna F. Automatic multi-sensor image registration by edge matching using genetic algorithms. In: IEEE International Geoscience and Remote Sensing Symposium, 2001. 2313–2315

    Google Scholar 

  5. Ding M T, Jin Z, Tian Z, et al. Object registration for remote sensing images using robust kernel pattern vectors. Sci China Inf Sci, 2012, 55: 2611–2623

    Article  MathSciNet  MATH  Google Scholar 

  6. Qiu P, Liang Y. The improved algorithm of remote sensing image registration based on SIFT and Contourlet transform. In: 4th IEEE International Conference on Software Engineering and Service Science (ICSESS), 2013. 906–909

    Google Scholar 

  7. Wang L, Gao X, Fang Q. A novel mutual information-based similarity measure for 2D/3D registration in image guided intervention. In: International Conference on Orange Technologies, Tainan, 2013. 135–138

    Google Scholar 

  8. Pluim J P W, Maintz J B A, Viergever M A. Mutual-information-based registration of medical images: a survey. IEEE Trans Med Imag, 2003, 22: 986–1004

    Article  Google Scholar 

  9. Chen H M, Arora M K, Varshney P K. Mutual information-based image registration for remote sensing data. Int J Remote Sens, 2003, 24: 3701–3706

    Article  Google Scholar 

  10. Zhang K, Li X Z, Zhang J X. A robust point-matching algorithm for remote sensing image registration. IEEE Geosci Remote Sens Lett, 2014, 11: 469–473

    Article  Google Scholar 

  11. Pluim J P W, Maintz J B A, Viergever M A. Mutual information matching in multiresolution contexts. Image Vision Comput, 2001, 19: 45–52

    Article  Google Scholar 

  12. Kim K S, Lee J H, Ra J B. Robust multi-sensor image registration by enhancing statistical correlation. In: IEEE 8th International Conference on Information Fusion, 2005, 1: 380–386

    Google Scholar 

  13. Gong M, Zhao S, Jiao L, et al. A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information. IEEE Geosci Remote Sens, 2013, DOI: 10.1109/TGRS.2013.2281391

    Google Scholar 

  14. Feng J, Chen H, Bi F K, et al. Detection of oil spills in a complex scene of SAR imagery. Sci China Technol Sci, 2014, 57: 2204–2209

    Article  Google Scholar 

  15. Weese J, Penney G P, et al. Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery. IEEE Trans Inf Technol Biomed, 1997, 1: 284–293

    Article  Google Scholar 

  16. Liu Z Y, Zhou F G, et al. Multi-modal image registration by mutual information based on optimal region selection. In: International Conference on Information, Networking and Automation, 2010, 2: 249–253

    Google Scholar 

  17. Shao Z F, Tian Y J, Shen X L. BASI: a new index to extract built-up areas from high-resolution remote sensing images by visual attention model. Remote Sens Lett, 2014, 5: 305–314

    Article  Google Scholar 

  18. Bi F K, Zhu B C, Gao L N, et al. A visual search inspired computational model for ship detection in optical satellite images. IEEE Geosci Remote Sens Lett, 2012, 9: 749–753

    Article  Google Scholar 

  19. Achanta R, Hemami S, Estrada F, et al. Frequency-tuned salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009. 1597–1604

    Google Scholar 

  20. Walther D, Koch C. Modeling attention to salient proto-objects. Neural Netw, 2006, 19: 1395–1407

    Article  MATH  Google Scholar 

  21. Hu M K. Visual pattern recognition by moment invariants. IRE Trans Inform Theory, 1962, 8: 179–187

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to FuKun Bi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Feng, J., Ma, L., Bi, F. et al. A coarse-to-fine image registration method based on visual attention model. Sci. China Inf. Sci. 57, 1–10 (2014). https://doi.org/10.1007/s11432-014-5207-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11432-014-5207-4

Keywords

关键词

Navigation