Skip to main content
SpringerLink
Log in

Effective image registration model using optimized KAZE algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract 

The incompatible problem with velocity and accuracy has been restricting the application of the KAZE algorithm. In order to resolve this shortage, we propose the effective image registration model using the optimized KAZE algorithm. This effective image registration model consist of four stages. First of all, to reduce the input data of image registration, the original registration images are preprocessed by the fusion preprocessing method based on the average and the perceptual hashing algorithms. Second, to extract image features quickly, we utilize the FAST algorithm to extract image features instead of the local extremum based on the Hessian matrix and the Taylor principle. Third, in order to accelerate the velocity of image features matching, the compressed sensing principle is used to reduce the dimension of the image feature descriptors. Finally, the two-step strategy is adopted to ensure the accuracy of image registration, the step one is that the hybrid matching method based on the FLANN and the KNN algorithms is used to rough matching, and the step two is that adopt the RANSAC algorithm to further accurate matching. This paper utilizes two groups of the experiments to verify the effective model, the experiment results show that the effective model has velocity advantage compared with other current image registration methods, and also achieves the compatible with velocity and accuracy in the case of the highest matching score. This model provides an effective solution for the application of image registration, and also has great significance for the development of image registration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Soleimani M, Aghagolzadeh A, Ezoji M (2022) Symmetry-based representation for registration of multimodal images. Med Biol Eng Comput 60:1015–1032

    PubMed  Google Scholar 

  2. Li JS, Pan Y (2019) GPU-based parallel optimization for real-time scale-invariant feature transform in binocular visual registration. Pers Ubiquit Comput 23:465–474

    CAS  Google Scholar 

  3. Yao R, Sun JL, Zhou Y, Chen D (2016) Video stitching based on iterative hashing and dynamic seam-line with local context. Multimed Tools Appl 76(11):13615–13631

    Google Scholar 

  4. Lowe DG (1999) Object recognition from local scale-invariant features. Proceedings of the International Conference on Computer Vision 1140-1147

  5. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Google Scholar 

  6. Ke Y, Sukthankar R (2004) PCA-SIFT: A more distinctive representation for local image descriptors. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 411-417

  7. Bay H, Tuytelaars T, Gool LV (2006) SURF: Speeded up robust features. Proceedings of the European Conference on Computer Vision 404-417

  8. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: An efficient alternative to SIFT or SURF. IEEE International Conference on Computer Vision 2464-2471

  9. Alcantarilla PF, Bartoli A, Davison AJ (2012) KAZE features. European Conference on Computer Vision 214-227

  10. Weickert J, Bart M, Romeny H, Viergever MA (1998) Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans Image Process 7(3):398–410

    ADS  CAS  PubMed  Google Scholar 

  11. Weickert J, Grewenig S, Schroers C, Bruhn A (2015) Cyclic schemes for PDE-based image analysis. Int J Comput Vis 118(3):275–299

    MathSciNet  Google Scholar 

  12. Grewenig S, Weickert J, Bruhn A (2010) From box filtering to fast explicit diffusion. In Proceedings of the DAGM Symposium on Pattern Recognition 533-542

  13. Yang X, Cheng KT (2012) LDB: An ultra-fast feature for scalable augmented reality on mobile devices. IEEE International Symposium on Mixed and Augmented Reality 49-57

  14. Alcantarilla PF, Nuevo J, Bartoli A (2013) Fast explicit diffusion for accelerated features in nonlinear scale spaces. British Machine Vision Conference 1-11

  15. Ramkumar B, Laber R, Bojinov H, Hegde RS (2019) GPU acceleration of the KAZE image feature extraction algorithm. J Real-Time Image Proc 17:1169–1182

    Google Scholar 

  16. Ordóñez Á, Argüello F, Heras DB, Demir B (2020) GPU-accelerated registration of hyperspectral images using KAZE features. J Supercomput 76(12):9478–9492

    Google Scholar 

  17. Li D, Xu QN, Yu WN, Wang B (2020) SRP-AKAZE: An improved accelerated KAZE algorithm based on sparse random projection. IET Comput Vis 14(4):131–137

    Google Scholar 

  18. Bingham E, Mannila H (2001) Random projection in dimensionality reduction: applications to image and text data. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 245-250

  19. Liu CY, Xu JS, Wang F (2021) A review of keypoints’ detection and feature description in image registration. Scientific Programming 2021:8509164(1-25)

  20. Abbasi S, Tavakoli M, Boveiri HR, Shirazi MAM, Khayami R, Khorasani H, Javidan R, Mehdizadeh A (2022) Medical image registration using unsupervised deep neural network: A scoping literature review. Biomedical Signal Processing and Control 73:103444(1-11)

  21. Paul S, Pati UC (2021) A comprehensive review on remote sensing image registration. Int J Remote Sens 42(14):5396–5432

    Google Scholar 

  22. Rosten E, Porter R, Drummond T (2010) Faster and better: A machine learning approach to corner detection. IEEE Trans Pattern Anal Mach Intell 32(1):105–119

    PubMed  Google Scholar 

  23. Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. European Conference on Computer Vision 430-443

  24. Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306

    MathSciNet  Google Scholar 

  25. Muja M, Lowe DG (2009) Fast approximate nearest neighbors with automatic algorithm configuration. International Conference on Computer Vision Theory and Application 331-340

  26. Cover TM, Hart PE (2003) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Google Scholar 

  27. Fischler MA, Bolles RC (1981) Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun Assoc Comput Mach 24(6):381–395

    MathSciNet  Google Scholar 

  28. Haviana SFC, Kurniadi D (2016) Average hashing for perceptual image similarity in mobile phone application. J Telematics Inform 4(1):12–18

    Google Scholar 

  29. Tang ZJ, Huang ZQ, Yao H, Zhang XQ, Chen L, Yu CQ (2018) Perceptual image hashing with weighted DWT features for reduced-reference image quality assessment. Comput J 61(11):1695–1709

    Google Scholar 

  30. Chan KP, Fu AWC (1999) Efficient time series matching by wavelets. Proceedings International Conference on Data Engineering 126-133

  31. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698

    CAS  PubMed  Google Scholar 

  32. Kong FZ, Xiao X (2013) SIFT-MIC based matching location algorithm for wire bonding. International Conference on Multimedia Technology 1349-1355

  33. Trajkovic M, Hedley M (1998) Fast corner detection. Image Vis Comput 16(2):75–87

    Google Scholar 

  34. Zhu JG, Fan GH (2014) Algorithm of sub-pixel image registration based on Harris corner and SIFT descriptor. International Symposium on Advanced Optical Manufacturing and Testing Technologies: Optical Test and Measurement Technology and Equipment 9282:92822U(1-7)

  35. Harris C, Stephens M (1988) A combined corner and edge detector. Alvey Vision Conference 147-151

  36. Gong X, Yao F, Ma JY, Jiang JJ, Lu T, Zhang YD, Zhou HB (2022) Feature matching for remote-sensing image registration via neighborhood topological and affine consistency. Remote Sensing 14(11):2606 (1-21)

  37. Shao F, Liu ZX, An JB (2022) Feature matching based on minimum relative motion entropy for image registration. IEEE Trans Geosci Remote Sens 60(1):1–12

    Google Scholar 

  38. Chowdhary CL, Mouli PC (2013) Image registration with new system for ensemble of images of multi-sensor registration. World Appl Sci J 26(1):45–50

    Google Scholar 

  39. Reynolds DA (2009) Gaussian mixture models. Encyclopedia Biometr 741:659–663

    Google Scholar 

  40. Liu XP, Chen SL, Zhuo L, Li J, Huang KN (2018) Multi-sensor image registration by combining local self-similarity matching and mutual information. Front Earth Sci 12(4):779–790

    ADS  CAS  Google Scholar 

  41. Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1-8

  42. Viola P, Wells WMIII (1997) Alignment by maximization of mutual information. Int J Comput Vis 24(2):137–154

    Google Scholar 

  43. Boiman O, Irani M (2007) Detecting irregularities in images and in video. Int J Comput Vis 74(1):17–31

    Google Scholar 

  44. Shami TM, El-Saleh AA, Alswaitti M, Al-Tashi Q, Summakieh MA, Mirjalili S (2022) Particle swarm optimization: A comprehensive survey. IEEE Access 10:10031–10061

    Google Scholar 

  45. Li K, Zhang YS, Zhang ZC, Lai GL (2019) A coarse-to-fine registration strategy for multi-sensor images with large resolution differences. Remote Sensing 11(4):470(1-27)

  46. Socha K, Dorigo M (2008) Ant colony optimization for continuous domains. Eur J Oper Res 185(3):1155–1173

    MathSciNet  Google Scholar 

  47. Yu R, Lyu MH, Lu JH, Yang Y, Shen GC, Li F (2020) Spatial coordinates correction based on multi-sensor low-altitude remote sensing image registration for monitoring forest dynamics. IEEE Access 8:18483–18496

    Google Scholar 

  48. Yang W, Xu C, Mei LY, Yao YX, Liu C (2022) LPSO: Multi-source image matching considering the description of local phase sharpness orientation. IEEE Photonics J 14(1):1–9

    Google Scholar 

  49. Aguilera CA, Sappa AD, Toledo R (2015) LGHD: A feature descriptor for matching across non-linear intensity variations. IEEE International Conference on Image Processing 178-181

  50. Uǧurhan K (2020) Automated hemangioma detection using Otsu based binarized Kaze features. Multimed Tools Appl 79:24781–24793

    Google Scholar 

  51. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66

    Google Scholar 

  52. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 886-893.

  53. Sharma SK, Jain K (2020) Image stitching using AKAZE features. J Indian Soc Remote Sens 48(10):1389–1401

    Google Scholar 

  54. Choi S, Kim T, Yu W (2009) Performance evaluation of RANSAC family. British Machine Vision Conference 1-13

  55. Liu H, Xiao GF (2020) Remote sensing image registration based on improved KAZE and BRIEF descriptor. Int J Autom Comput 17(4):588–598

    Google Scholar 

  56. Calonder M, Lepetit V, Strecha C, Fua P (2010) BRIEF: Binary robust independent elementary features. Lect Notes Comput Sci 6314(1):778–792

    Google Scholar 

  57. Kazerouni IA, Dooly G, Toal D (2020) Underwater image enhancement and mosaicking system based on A-KAZE feature matching. Journal of Marine Science and Engineering 8(6):449(1-16)

  58. Tang ZJ, Luo ZH, Jiang LZ, Ma GQ (2021) A novel high precision mosaic method for sonar video sequence. Multimed Tools Appl 80(9):14429–14458

    Google Scholar 

  59. Chum O, Matas J (2005) Matching with PROSAC-progressive sample consensus. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 220-226

  60. Avola D, Bernardi M, Cinque L, Foresti GL, Pannone D, Petrioli C (2021) Forward-looking sonar image compression by integrating keypoint clustering and morphological skeleton. Multimed Tools Appl 80(2):1625–1639

    Google Scholar 

  61. Avola D, Bernardi M, Cinque L, Foresti GL, Massaroni C (2017) Adaptive bootstrapping management by keypoint clustering for background initialization. Pattern Recogn Lett 100:110–116

    ADS  Google Scholar 

  62. Saha PK, Borgefors G, Sanniti GB (2016) A survey on skeletonization algorithms and their applications. Pattern Recogn Lett 76(1):3–12

    ADS  Google Scholar 

  63. Celebi ME (2011) Improving the performance of k-means for color quantization. Image Vis Comput 29(4):260–271

    Google Scholar 

  64. Balammal S, Muthukkumar R, Seenivasagam V (2022) Enhancing scalability of image retrieval using visual fusion of feature descriptors. Intell Autom Soft Comput 31(3):1737–1752

    Google Scholar 

  65. Mohan NJ, Murugan R, Goel T, Roy P (2022) Fast and robust exudate detection in retinal fundus images using extreme learning machine autoencoders and modified KAZE features. J Digit Imaging 35(3):496–513

    PubMed  PubMed Central  Google Scholar 

  66. Pei LL, Zhang H, Yang B (2022) Improved Camshift object tracking algorithm in occluded scenes based on AKAZE and Kalman. Multimed Tools Appl 81(2):2145–2159

    PubMed  Google Scholar 

  67. Exner D, Bruns E, Kurz D, Grundhofer A (2010) Fast and robust CAMShift tracking. IEEE Comput Soc Conf Comput Vision Patt Recog Workshops:9–16

  68. Pourfard M, Hosseinian T, Saeidi R, Motamedi SA (2022) KAZE-SAR: SAR image registration using KAZE detector and modified SURF descriptor for tackling speckle noise. IEEE Trans Geosci Remote Sens 60(1):1–12

    Google Scholar 

  69. Smith SM, Brady JM (1997) SUSAN-A new approach to low level image processing. Int J Comput Vis 23(1):45–78

    Google Scholar 

  70. Li Y, Xu WS, Li W, Li A, Liu ZJ (2022) Research on hybrid intrusion detection method based on the ADASYN and ID3 algorithms. Math Biosci Eng 19(2):2030–2042

    PubMed  Google Scholar 

  71. Leutenegger S, Chli M, Siegwart RY (2011) BRISK: Binary robust invariant scalable keypoints. International Conference on Computer Vision 2548-2555

  72. Alahi A, Ortiz R, Vandergheynst P (2012) FREAK: Fast retina keypoint. IEEE Conference on Computer Vision and Pattern Recognition 510-517

  73. Guo R, Li SX, Cai RY, Sun XL (2019) Research on image matching algorithm based on improved SIFT UAV. Journal of Physics: Conference Series 1423(1):012028(1-5)

  74. Rubio-Ibañez P, Ruiz-Merino R, Domenech-Asensi G, Martínez-Álvarez JJ, Zapata-Pérez J, Díaz-Madrid JA, López-Alcantud JA (2018) An all-hardware implementation of the subpixel refinement stage in SIFT algorithm. Intl J Circuit Theory Appl 46(9):1690–1702

    Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China (No. 61903124, No. 51979085).

Author information

Authors and Affiliations

  1. College of Computer and Information, Hohai University, Nanjing, 211100, China

    Sheng Zhang, Jie Shen, Shengnan Zheng & Jingjing Tang

  2. School of Computer Engineering, Nanjing Institute of Technology, Nanjing, 211167, China

    Shengnan Zheng

Authors
  1. Sheng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengnan Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jingjing Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sheng Zhang.

Ethics declarations

Ethical approval

Not applicable.

Conflict of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The researchers had summarized the previous work done about the research works of image registration.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, S., Shen, J., Zheng, S. et al. Effective image registration model using optimized KAZE algorithm. Multimed Tools Appl 83, 33959–33984 (2024). https://doi.org/10.1007/s11042-023-16887-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16887-5

Keywords

Search

Navigation