Skip to main content
SpringerLink
Log in

Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter

  • Short Paper
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

The desire of infrared (IR) and visible (VIS) image fusion is to bring out an admixture image to augment the target information from IR image and to retain the texture details from VIS image. In this paper, we put forward a multi-scale multi-layer rolling guidance filter (MSML_RGF)-based IR and VIS image fusion. The fused image is the improved version of the source images with more significant features. Fundamentally, the IR and VIS source images are decomposed into three layers by the proposed algorithm namely micro-scale, macro-scale and base layers. Second, according to their characteristics, unique fusion rules are used to combine these three layers. Micro-scale layers are integrated by using phase congruency (PC)-based fusion rule, macro-scale layers are combined by absolute maximum based consistency verification fusion rule and the base layers are combined by weighted energy related fusion. At last, the fused image is acquired by summating the fused micro-scale, macro-scale and base layer outputs. Proposed method is evaluated both subjectively and objectively with comparisons to other five fusion methods on a publicly available database. The proposed method can well preserve the background and target information from both the source images visually and quantitatively without pseudo and blurred edges compared to the conventional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Egfin Nirmala D, Vignesh RK, Vaidehi V (2013) Multimodal image fusion in visual sensor networks. In: IEEE international conference on electronics, computing and communication technologies, pp 1–6

  2. Fang Y, Yamada K, Ninomiya Y, Horn B, Masaki I (2003) Comparison between infrared-image-based and visible-image-based approaches for pedestrian detection. In: IEEE IV intelligent vehicles symposium proceedings (Cat. No.03TH8683), Columbus, OH, USA, pp 505–510

  3. Bavirisetti D. P, Xiao G, Liu G (2017) Multi-sensor image fusion based on fourth order partial differential equations. In: Proceedings of IEEE 20th international conference on information fusion (fusion), pp 1–9

  4. Ma J, Ma Y, Li C (2019) Infrared and visible image fusion methods and applications: a survey. Inf Fusion 45:153–178

    Article  Google Scholar 

  5. Zhang Y, Zhang L, Bai X, Li Z (2017) Infrared and visual image fusion through infrared feature extraction and visual information preservation. Infrared Phys Technol 83:227–237

    Article  Google Scholar 

  6. Abhyankar M, Khaparde A, Deshmukh V (2016) Spatial domain decision-based image fusion using superimposition. In: IEEE/ACIS 15th international conference on computer and information science (ICIS), pp1–6

  7. Yuan Q, Zhang L, Shen H (2013) Regional spatially adaptive total variation super-resolution with spatial information filtering and clustering. IEEE Trans Image Process 22(6):2327–2342

    Article  MathSciNet  MATH  Google Scholar 

  8. Radhika V, Veera Swamy K, Srinivas Kumar S (2017) Image fusion algorithms using human visual system in transform domain. IOP Conf Ser Mater Sci Eng 225(1):1–13

    Google Scholar 

  9. Ashwanth B, Swamy KV (2020) Medical image fusion using transform techniques. In: 2020 5th International conference on devices, circuits and systems (ICDCS), pp 303–306

  10. Abhyankar M, Khaparde A, Deshmukh V (2016) Spatial domain decision based image fusion using superimposition. In: IEEE/ACIS 15th international conference on computer and information science (ICIS), pp 1–6

  11. Sappa AD, Carvajal JA, Aguilera CA, Oliveira M, Romero D, Vintimilla BX (2016) Wavelet-based visible and infrared image fusion: a comparative study. Sensors 16(6):861

    Article  Google Scholar 

  12. Vakaimalar E, Mala K, Suresh Babu R (2019) Multifocus image fusion scheme based on discrete cosine transform a spatial frequency. Multimedia Tools Appl 78:17573–17587

    Article  Google Scholar 

  13. Agrawal D, Karar V (2018) Generation of enhanced information image using curvelet transform-based image fusion for improving situation awareness of observer during surveillance. Int J Image Data Fusion 10(1):45–57

    Article  Google Scholar 

  14. Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106

    Article  Google Scholar 

  15. Li M, Dong Y (2013) Image fusion algorithm based on contrast pyramid and application. In: Proceedings of the 2013 international conference on mechatronic sciences, electric engineering and computer (MEC), pp 1342–1345

  16. Li MJ, Dong YB, Wang XL (2014) Image fusion algorithm based on gradient pyramid and its performance evaluation. Appl Mech Mater 525:715–718

    Article  Google Scholar 

  17. Yan L, Hao Q, Cao J, Saad R, Li K, Yan Z, Wu Z (2021) Infrared and visible image fusion via octave Gaussian pyramid framework. Sci Rep 11(1):1–12

    Google Scholar 

  18. Kaur H, Rani J (2015) Image fusion on digital images using Laplacian pyramid with DWT. In: Proceedings of 2015 third international conference on image information processing (ICIIP), pp 393–398

  19. Arivazhagan S, Prema G (2020) Infrared and visible image fusion using multi-scale NSCT and rolling-guidance filter. IET Image Process 14(16):4210–4219

    Article  Google Scholar 

  20. Munawwar Iqbal CM, Mohsin Riaz M, Iltaf N, Ghafoor A, Ahmad A (2019) Weighted image fusion using cross bilateral filter and non-subsampled contourlet transform. Multidimens Syst Signal Process 30:2199–2210

    Article  MATH  Google Scholar 

  21. Xing X, Liu C, Luo C, Xu T (2020) Infrared and visible image fusion based on nonlinear enhancement and NSST decomposition. EURASIP J Wirel Commun Netw 162:1–17

    Google Scholar 

  22. Li S, Kang X (2012) Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans Consum Electron 58(2):626–632

    Article  Google Scholar 

  23. Bhujle H (2016) Weighted-average fusion method for multiband images. In: International conference on signal processing and communications (SPCOM), pp 1–5

  24. Chandrajit Pal AC, Ghosh R (2015) A brief survey of recent edge-preserving smoothing algorithms on digital images. Procedia Comput Sci, pp 1–40. https://arxiv.org/abs/1503.07297

  25. Jiang Y, Wang M (2014) Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter. IET Image Process 8(3):183–190

    Article  Google Scholar 

  26. Bavirisetti DP, Xiao G, Zhao J, Zhang X, Wang P (2018) A new image and video fusion method based on cross bilateral filter. In: 21st international conference on information fusion (FUSION), pp 1–8

  27. Ch M, Riaz MM, Iltaf N, Ghafoor A, Ali SS (2020) A multifocus image fusion using highlevel DWT components and guided filter. Multimedia Tools Appl 79:12817–12828

    Article  Google Scholar 

  28. Zhang Y, Li D, Zhu WP (2020) Infrared and visible image fusion with hybrid image filtering. Math Probl Eng 2020:1–17

    MATH  Google Scholar 

  29. Zhang Q, Shen L, Xu L, Jia J (2014) Rolling guidance filter. In: Proceedings of the 13th European conference on computer vision (ECCV 2014), Zurich, Switzerland, pp 815–830

  30. Zhou Z, Wang B, Li S, Dong M (2016) Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters. Inf Fusion 30:15–26

    Article  Google Scholar 

  31. Tan W, Zhou H, Song J, Li H, Yu Y, Du J (2019) Infrared and visible image perceptive fusion through multi-level Gaussian curvature filtering image decomposition. Appl Opt 58(12):3064–3073

    Article  Google Scholar 

  32. Liu S, Zhang J, Chen J (2017) Multi-focus image fusion using Gaussian filter and dynamic programming. In: Asia-pacific signal and information processing annual summit and conference, pp 1182–1185

  33. Liu Y, Yang X, Zhang R, Albertini M, Celik T, Jeon G (2020) Entropy-based image fusion with joint sparse representation and rolling guidance filter. Entropy 22(1):1–22

    Article  Google Scholar 

  34. https://figshare.com/articles/TNO_Image_Fusion_Dataset/100802.

  35. Prajapatia P, Narmawalaa Z, Darjib P, Manthira Moorthib S, Ramakrishna R (2015) Evaluation of perceptual contrast and sharpness measures for meteorological satellite images. Procedia Comput Sci 57:17–24

    Article  Google Scholar 

  36. Li S, Kang X, Hu J (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875

    Article  Google Scholar 

  37. Zhan K, Yuange X, Wang H, Yufang M (2017) Fast filtering image fusion. J Electron Imaging 26(06):1–18

    Article  Google Scholar 

  38. Yu S, Chen X (2020) Infrared and visible image fusion based on a latent low-rank representation nested with multiscale geometric transform. IEEE Access 8:110214–110226

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ECE Department, Mepco Schlenk Engineering College, Sivakasi, India

    G. Prema & S. Arivazhagan

Authors
  1. G. Prema
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Arivazhagan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to G. Prema.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Prema, G., Arivazhagan, S. Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter. Pattern Anal Applic 25, 933–950 (2022). https://doi.org/10.1007/s10044-022-01073-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-022-01073-4

Keywords

Search

Navigation