Skip to main content
SpringerLink
Log in

DESAC: differential evolution sample consensus algorithm for image registration

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Image registration is the process of matching and superimposing multiple images from heterogeneous sources, and it is widely used in areas such as image processing and computer vision. In point feature-based image registration, the RANdom SAmple Consensus (RANSAC) algorithm is commonly used to eliminate mis-matches and solve transform models. Traditional RANSAC tends to sample in sample space. Its discrete estimation of model parameters can lead to an inability to solve for the largest consensus set at large input sizes and low inlier ratio. RANSAC with sampling in parameter space is a novel and effective method, but it is less studied and still has many shortcomings. In this paper, a Differential Evolution SAmple Consensus (DESAC) algorithm based on sampling in parameter space is proposed, which represents the model as individuals and optimizes the model parameters by Differential Evolution (DE). First, for an adequate search of the parameter space, DESAC uses priori information for the first initialization and the resident initialization performed in the iteration. Second, to achieve a balance between exploration and exploitation, a mutation operator combining neighborhood optimal individuals and random individuals is proposed. Third, a novel selection operator is proposed in order to obtain individuals with high number of inliers and low inlier error. Finally, to reduce the verification overhead, a simplified pre-test step is applied before the full verification. Comparing with advanced RANSAC variants in real image dataset, the proposed method can robustly return consensus sets with very high number of inliers. Its average inlier error is lower and the transformation model is more accurate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Ma J, Ma Y, Li C (2019) Infrared and visible image fusion methods and applications: a survey. Inform Fusion 45:153–178

    Article  Google Scholar 

  2. Sun Y, Li Y, Yang Y, Yue H (2021) Differential evolution algorithm with population knowledge fusion strategy for image registration. Complex Intell Syst:1–16

  3. Sun D, Zhang S, Wang Y (2020) Improved feature point extraction and mismatch eliminating algorithm. Syst Sci Control Eng 8(1):11–21

    Article  Google Scholar 

  4. Chang HH, Wu GL, Chiang MH (2019) Remote sensing image registration based on modified SIFT and feature slope grouping. IEEE Geosci Remote Sens Lett 16(9):1363–1367

    Article  Google Scholar 

  5. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  6. Zhou QY, Park J, Koltun V (2016) Fast global registration. In European conference on computer vision (pp. 766-782). Springer, Cham.

  7. Yang, H., & Carlone, L. (2019). A polynomial-time solution for robust registration with extreme outlier rates. arXiv preprint arXiv:1903.08588

  8. Li J, Hu Q, Ai M (2020) Robust geometric model estimation based on scaled Welsch q-norm. IEEE Trans Geosci Remote Sens 58(8):5908–5921

    Article  Google Scholar 

  9. Raguram R, Chum O, Pollefeys M, Matas J, Frahm JM (2012) USAC: a universal framework for random sample consensus. IEEE Trans Pattern Anal Mach Intell 35(8):2022–2038

    Article  Google Scholar 

  10. Chum O, Matas J (2005) Matching with PROSAC-progressive sample consensus. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05) (Vol. 1, pp. 220-226). IEEE.

  11. Wu Y, Ma W, Gong M, Su L, Jiao L (2014) A novel point-matching algorithm based on fast sample consensus for image registration. IEEE Geosci Remote Sens Lett 12(1):43–47

    Article  Google Scholar 

  12. Jia S, Wang K, Li X, Xu T (2016) A novel improved probability-guided RANSAC algorithm for robot 3D map building. Journal of sensors, 2016.

  13. Barath D, Noskova J, Ivashechkin M, Matas J (2020) MAGSAC++, a fast, reliable and accurate robust estimator. In proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 1304-1312).

  14. Matas J, Chum O (2004) Randomized RANSAC with td, d test. Image Vis Comput 22(10):837–842

    Article  Google Scholar 

  15. Chen FX, Wang RS (2005) Fast RANSAC with preview model parameters evaluation. J Software 16(8):1431–1437

    Article  Google Scholar 

  16. Chum O, Matas J (2008) Optimal randomized RANSAC. IEEE Trans Pattern Anal Mach Intell 30(8):1472–1482

    Article  Google Scholar 

  17. Li J, Hu Q, Ai MJTPR (2017) Robust feature matching for geospatial images via an affine-invariant coordinate system. 32(159):317–331

  18. Rodehorst V, Hellwich O (2006) Genetic algorithm sample consensus (gasac)-a parallel strategy for robust parameter estimation. In 2006 conference on computer vision and pattern recognition workshop (CVPRW’06) (pp. 103-103). IEEE.

  19. Otte S, Schwanecke U, Zell A (2014) Antsac: a generic ransac variant using principles of ant colony algorithms. In 2014 22nd international conference on pattern recognition (pp. 3558-3563). IEEE.

  20. Shahbazi M, Sohn G, Théau J (2017) Evolutionary optimization for robust epipolar-geometry estimation and outlier detection. Algorithms 10(3):87

    Article  MathSciNet  MATH  Google Scholar 

  21. Shojaedini E, Majd M, Safabakhsh R (2019) Novel adaptive genetic algorithm sample consensus. Appl Soft Comput 77:635–642

    Article  Google Scholar 

  22. Wu Y, Miao Q, Ma W, Gong M, Wang S (2017) PSOSAC: particle swarm optimization sample consensus algorithm for remote sensing image registration. IEEE Geosci Remote Sens Lett 15(2):242–246

    Article  Google Scholar 

  23. Pant M, Zaheer H, Garcia-Hernandez L, Abraham A (2020) Differential evolution: a review of more than two decades of research. Eng Appl Artif Intell 90:103479

    Article  Google Scholar 

  24. Alahi A, Ortiz R, Vandergheynst P (2012) Freak: fast retina keypoint. In 2012 IEEE conference on computer vision and pattern recognition (pp. 510-517). IEEE.

  25. Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  26. Das S, Abraham A, Chakraborty UK, Konar A (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Trans Evol Comput 13(3):526–553

    Article  Google Scholar 

  27. Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Article  Google Scholar 

  28. Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In 2013 IEEE congress on evolutionary computation (pp. 71-78). IEEE.

  29. Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. In 2014 IEEE congress on evolutionary computation (CEC) (pp. 1658-1665). IEEE.

  30. Meng Z, Pan JS, Tseng KK (2019) PaDE: an enhanced differential evolution algorithm with novel control parameter adaptation schemes for numerical optimization. Knowl-Based Syst 168:80–99

    Article  Google Scholar 

  31. Sun G, Yang B, Yang Z, Xu G (2020) An adaptive differential evolution with combined strategy for global numerical optimization. Soft Comput 24(9):6277–6296

    Article  Google Scholar 

  32. Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Yuan HQ, Gu TL et al (2017) Dual-strategy differential evolution with affinity propagation clustering for multimodal optimization problems. IEEE Trans Evol Comput 22(6):894–908

    Article  Google Scholar 

  33. Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Wang H, Kwong S, Zhang J (2019) Automatic niching differential evolution with contour prediction approach for multimodal optimization problems. IEEE Trans Evol Comput 24(1):114–128

    Article  Google Scholar 

  34. Chen ZG, Zhan ZH, Wang H, Zhang J (2019) Distributed individuals for multiple peaks: a novel differential evolution for multimodal optimization problems. IEEE Trans Evol Comput 24(4):708–719

    Article  Google Scholar 

  35. Zhang YH, Gong YJ, Gao Y, Wang H, Zhang J (2019) Parameter-free Voronoi neighborhood for evolutionary multimodal optimization. IEEE Trans Evol Comput 24(2):335–349

    Article  Google Scholar 

  36. Fotouhi M, Hekmatian H, Kashani-Nezhad MA, Kasaei S (2019) SC-RANSAC: spatial consistency on RANSAC. Multimed Tools Appl 78(7):9429–9461

    Article  Google Scholar 

  37. Mikolajczyk K, Tuytelaars T, Schmid C, Zisserman A, Matas J, Schaffalitzky F et al (2005) A comparison of affine region detectors. Int J Comput Vis 65(1):43–72

    Article  Google Scholar 

  38. Barath D, Matas J (2018) Graph-cut RANSAC. In proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6733-6741).

Download references

Acknowledgments

This work was supported by National Natural Science Foundation of China (Grant No. 61763002 and 62072124), Guangxi Major Projects of Science and Technology (Grants No. 2020AA21077021), Foundation of Guangxi Experiment Center of Information Science (Grant No. KF1401).

Author information

Authors and Affiliations

  1. School of Computer and Electronics and Information, Guangxi University, Nanning, 530004, People’s Republic of China

    Yu Sun & FuXiang Wu

Authors
  1. Yu Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. FuXiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to FuXiang Wu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Y., Wu, F. DESAC: differential evolution sample consensus algorithm for image registration. Appl Intell 52, 15980–16003 (2022). https://doi.org/10.1007/s10489-022-03266-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03266-0

Keywords

Search

Navigation