Skip to main content
SpringerLink
Log in

Fusion algorithm of UAV infrared image and visible image registration

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

With the gradual advancement of image sensor technology and the gradual complexity of the application environment, single-source imaging sensors have been difficult to meet practical application requirements. Therefore, the registration and fusion techniques of infrared images and visible images are hot topics in recent years. This article aims to study the fusion of two images. Based on the traditional image fusion algorithm, the color space IHS transform and the lifting wavelet transform are combined according to the characteristics of infrared image and visible light image captured by the UAV imaging device. The experimental results show that the algorithm can not only retain the brightness information of the infrared target. Among them, some details of the visible light image are retained. In this paper, the four objective criteria of information entropy, standard deviation, image mean and average gradient are used to evaluate the fusion effect of the proposed algorithm. The obtained values are 7.285, 29.487, 122.2739, and 4.5678, respectively, which are higher than other algorithms. It can be seen that the algorithm proposed in this paper has important practical significance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Artola L, Hubert G, Gilar O (2015) Single event upset sensitivity of D-flip flop of infrared image sensors for low temperature applications down to 77 K. IEEE Trans Nucl Sci 62(6):1–1

    Article  Google Scholar 

  • Chu CH, Wu WC, Wang CC et al (2013) Friend recommendation for location-based mobile social networks. In: 2013 Seventh international conference on innovative mobile and internet services in ubiquitous computing (IMIS). IEEE, pp 365–370

  • Duan C, Wang X-G, Wang S (2015) Remote image fusion based on dual tree compactly supported shearlet transform. J Univ Electron Sci Technol China 44(1):43–49

    Google Scholar 

  • He F, Guo Y, Gao C (2018) Human segmentation of infrared image for mobile robot search. Multimed Tools Appl 77(9):10701–10714

    Article  Google Scholar 

  • Huang C (2021) Particle swarm optimization in image processing of power flow learning distribution. Discov Internet Things 1:12

    Article  Google Scholar 

  • Huang J, Le Z, Ma Y et al (2020) A generative adversarial network with adaptive constraints for multi-focus image fusion. Neural Comput Appl 32:15119–15129

    Article  Google Scholar 

  • Jalil B, Pascali MA, Leone GR et al (2019) Visible and infrared imaging based inspection of power installation. Pattern Recognit Image Anal 29(1):35–41

    Article  Google Scholar 

  • Lattanzi JP, Fein DA, Mcneeley SW et al (2015) Computed tomography-magnetic resonance image fusion: a clinical evaluation of an innovative approach for improved tumor localization in primary central nervous system lesions. Radiat Oncol Investig 5(4):195–205

    Article  Google Scholar 

  • Li Z, Mahapatra D, Tielbeek J et al (2016) Image registration based on autocorrelation of local structure. IEEE Trans Med Imaging 35(1):63–75

    Article  Google Scholar 

  • Madhuri R, Murty MR, Murthy J et al (2014) Cluster analysis on different data sets using K-modes and K-prototype algorithms. Springer, Berlin

    Book  Google Scholar 

  • Paquin D, Levy D, Xing L (2017) Hybrid multiscale landmark and deformable image registration. Math Biosci Eng 4(4):711–737

    MathSciNet  MATH  Google Scholar 

  • Park J-S, Hyun D-K, Hou J-U (2016) Detecting digital image forgery in near-infrared image of CCTV. Multimed Tools Appl 76(14):1–22

    Google Scholar 

  • Rajinikanth V, Satapathy SC, Dey N et al (2018) DWT-PCA image fusion technique to improve segmentation accuracy in brain tumor analysis

  • Wang X, Huang W, Ouyang J (2015) Real-time image registration of the multi-detectors mosaic imaging system. Chin Opt 8(2):211–219

    Article  Google Scholar 

  • Wang X, Shen Y, Zhou Z (2015) An image fusion algorithm based on lifting wavelet transform. J Image Graph 17(5):225–229

    Google Scholar 

  • Wang Z, Wang S, Zhu Y (2016) Review of image fusion based on pulse-coupled neural network. Arch Comput Methods Eng 23(4):659–671

    Article  MathSciNet  MATH  Google Scholar 

  • Xing L, Schreibmann E, Levy D (2017) Multiscale image registration. Math Biosci Eng (online) 3(2):389–418

    MathSciNet  MATH  Google Scholar 

  • Xu J-J (2015) Fast image registration method based on Harris and SIFT algorithm. Chin Opt 8(4):574–581

    Article  Google Scholar 

  • Yang X, Guo Y, Liu Y (2013) Bayesian-inference-based recommendation in online social networks. IEEE Trans Parallel Distrib Syst 24(4):642–651

    Article  Google Scholar 

  • Yuan B, Han L, Gu X et al (2021) Multi-deep features fusion for high-resolution remote sensing image scene classification. Neural Comput Appl 33:2047–2063

    Article  Google Scholar 

  • Yun H, Wu Z Wang G (2015) Enhancement of infrared image combined with histogram equalization and fuzzy set theory. J Comput Aided Des Comput Graph 27(8):1499–1509

    Google Scholar 

  • Zhang J (2019) Adaptive fusion algorithm of infrared visible light image based on compressed sensing coupling gradient descent. Guangxue Jishu/opt Tech 45(1):70–77

    Google Scholar 

  • Zhang J, Wang C, Ning Y et al (2013) LAFT-explorer: inferring, visualizing and predicting how your social network expands. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp. 1510–1513

  • Zhang Y, Li D, Zhang R et al (2020) Sparse features with fast guided filtering for medical image fusion. J Med Imag Health Inform 10(5):1195–1204

    Article  Google Scholar 

  • Zhao W, Lu H, Dong W (2018) Multisensor image fusion and enhancement in spectral total variation domain. IEEE Trans Multimed PP(99):1

    Google Scholar 

Download references

Acknowledgements

This work was supported by the State Key Laboratory of Metastable Materials Science and Technology, China (2018014), the Anhui University Provincial Natural Science Research Project, China (KJ2017B04), National Undergraduate Training Program for Innovation and Entrepreneurship (2020CXXL017).

Author information

Authors and Affiliations

  1. School of Mechanical and Electronic Engineering, Chuzhou University, Chuzhou, 239000, Anhui, China

    Yonghua Shi, Xishun Jiang & Shukun Li

Authors
  1. Yonghua Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xishun Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shukun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yonghua Shi.

Ethics declarations

Conflict of interest

There are no potential competing interests in our paper. And all authors have seen the manuscript and approved to submit to your journal. We confirm that the content of the manuscript has not been published or submitted for publication elsewhere.

Additional information

Communicated by Suresh Chandra Satapathy.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, Y., Jiang, X. & Li, S. Fusion algorithm of UAV infrared image and visible image registration. Soft Comput 27, 1061–1073 (2023). https://doi.org/10.1007/s00500-021-05918-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-021-05918-8

Keywords

Search

Navigation