Skip to main content
SpringerLink
Log in

Shearlet transform based technique for image fusion using median fusion rule

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image fusion is a challenging research area which is useful in various image processing applications. Image fusion integrates information from multiple source images into a single composite image for better visual quality and information content than any of its source images. In the present paper, we have proposed a new median based image fusion algorithm using nonsubsampled shearlet transform. Nonsubsampled shearlet transform is a powerful multiscale geometrical analysis (MGA) tool having rich mathematical structure, high directionality, anisotropy and shift-invariance features. Due to these features nonsubsampled shearlet transform can efficiently capture information of the source images in its coefficient sets. The coefficient sets of the source images are fused by using a new median based fusion rule. Median is an important statistical measurement, which is enriched with two outstanding properties that are edge preserving and robustness against noise. Hence, median based fusion rule increases the quality of fused image. The proposed fusion rule is simple and easy to understand. Strength of the proposed fusion method is verified visually as well as quantitatively by comparing it with different state of the art methods. We have performed experiments on three different types of images (medical, remote sensing and multifocus). Results of the experiments confirm that the proposed method outperform in comparison with other state-of-the-art fusion methods visually as well as quantitatively in terms of different quantitative performance measures such as entropy, standard deviation, edge strength, fusion factor, and running time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Abdipour M, Nooshyar M (2016) Multi-focus image fusion using sharpness criteria for visual sensor networks in wavelet domain. Comput Electr Eng 52:74–88

    Article  Google Scholar 

  2. Adelson EH, Anderson CH, Bergen JR, Burt PJ, Ogden JM (1984) Pyramid methods in image processing. RCA Engineer 29(6):33–41

    Google Scholar 

  3. Aymaz S, Kose C, Aymaz S (2020) Multi-focus image fusion for different datasets with super-resolution using gradient-based new fusion rule, Multimedia Tools and Applications, https://doi.org/10.1007/s11042-020-08670-7]https://doi.org/10.1007/s11042-020-08670-7].

  4. Bhatnagar G, Wu QMJ, Liu Z (2013) Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Transactions on Multimedia 15(5):1014–1024

    Article  Google Scholar 

  5. Blum RS, Liu Z (2005) Multi-sensor image fusion and its applications, CRC Press

  6. Borwonwatanadelok P, Rattanapitak W, Udomhunsakul S (2009) Multi-Focus Image Fusion based on Stationary Wavelet Transform and extended Spatial Frequency Measurement, in proceeding of International Conference on Electronic Computer Technology, pp. 77–81

  7. Candes E, Demanet L, Donoho D, Ying L (2006) Fast discrete curvelet transforms. Multiscale Modeling & Simulation Journal 5(3):861–899

    Article  MathSciNet  MATH  Google Scholar 

  8. Chaudhary V, Kumar V (2018) Block-based image fusion using multi-scale analysis to enhance depth of field and dynamic range. Signal Image and Video Processing 12:271–279

    Article  Google Scholar 

  9. Chen C, Geng P, Lu K (2015) Multifocus image fusion based on multiwavelet and DFB. Chemical Engineeing Transactions 46:277–283

    Google Scholar 

  10. Chibani Y (2006) Additive integration of SAR features into multispectral SPOT images by means of the à trous wavelet decomposition. ISPRS Journal of Photogrammetry & Remote Sensing 60(5):306–314

    Article  Google Scholar 

  11. Clevers JGPW, Milla RZ (2008) Multisensor and multiresolution image fusion using the linear mixing model, in: Image Fusion: Algorithms and Applications (Eds. T. Stathaki), Academic Press, pp. 67–84

  12. Cunha AL, Zhou J, Do MN (2006) The nonsubsampled Contourlet transform: theory, design and application. IEEE Transaction on Image Processing 15(10):3089–3101

    Article  Google Scholar 

  13. Daubechies I (1992) Ten lectures on wavelets, in SIAM: Philadelpia, PA

  14. Deng A, Wu J, Yang S (2011) An Image Fusion Algorithm Based on Discrete Wavelet Transform and Canny Operator, in proceeding of International Conference on Computer Eductaion, Simulation and Modeling (CESM 2011), pp. 32–38

  15. Deng A, Wu J, Yang S (2011) An image fusion algorithm based on discrete wavelet transform and Canny operator, in proceeding of International Conference on Advance Research on Computer Education, Simulation and Modeling, pp. 32–38

  16. Do MN, Vetterli M (2003) The finite Ridgelet transform for image representation. IEEE Trans Image Process 12(1):1–14

    Article  MathSciNet  MATH  Google Scholar 

  17. Do MN, Vetterli M (2003) Contourlets, In: Beyond Wavelets (Eds. J. Stoeckler, G.V. Welland), Academic Press, pp. 1–27

  18. Easley GR, Labate D, Lim W (2008) Sparse directional image representations using the discrete shearlet transform. Appl Comput Harmon Anal 25(1):25–46

    Article  MathSciNet  MATH  Google Scholar 

  19. Easley GR, Labate D, Colonna F (2009) Shearlet-based total variation diffusion for denoising. IEEE Trans Image Process 18(2):260–268

    Article  MathSciNet  MATH  Google Scholar 

  20. Fei Y, Wei G, Zongxi S (2017) Medical Image Fusion Based on Feature Extraction and Sparse Representation, International Journal of Biomedical Imaging, Vol. 2017, Article ID: 3020461

  21. Fernandes FCA, Spaendonck RLC, Burrus CS (2003) A new framework for complex wavelet transforms. IEEE Transaction on Signal Processing 51(7):1825–1837

    Article  MathSciNet  MATH  Google Scholar 

  22. Guorong G, Luping X, Dongzhu F (2013) Multi-focus image fusion based on nonsubsampled shearlet transform. IET Image Process 7(6):633–639

    Article  Google Scholar 

  23. He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on IHS and PCA. Procedia Engineering 7:280–285

    Article  Google Scholar 

  24. Hill P, Canagarajah N, Bull D (2002) Image fusion using complex wavelets’, in proceeding of 13th British Machine Vision Conference, pp. 487–496

  25. Jagalingam P, Hegde AV (2015) A review of quality metrics for fused image. Aquatic Procedia 4:133–142

    Article  Google Scholar 

  26. Jinju J, Santhi N, Ramar K, Bama BS (2019) Spatial frequency discrete wavelet transform image fusion technique for remote sensing applications. Engineering Science and Technology, an International Journal 22:715–726

    Article  Google Scholar 

  27. Khalegi B, Khamis A, Karray FO (2013) Multisensor data fusion: a review of the state-of-the-art. Information Fusion 14(1):28–44

    Article  Google Scholar 

  28. Labate D, Lim WQ, Kutyniok G, Weiss G (2005) Sparse multidimensional representation using shearlets, in proceeding wavelets XI, Vol. 5914, pp. 254–262

  29. Li S, Yang B (2008) Multifocus image fusion using region segmentation and spatial frequency. Image Vision and Computing 26(7):971–979

    Article  Google Scholar 

  30. Li X, Zhao J (2020) A novel multi-modal medical image fusion algorithm, Journal of Ambient Intelligence and Humanized Computing, https://doi.org/10.1007/s12652-020-02293-4].

  31. Li H, Manjunath BS, Mitra SK (1995) Multisensor image fusion using wavelet transform. Graphical Models and Image Processing 57(3):235–245

    Article  Google Scholar 

  32. Li S, Kwok JT, Wang Y (2002) Multifocus image fusion using artificial neural networks. Pattern Recogn Lett 23(8):985–997

    Article  MATH  Google Scholar 

  33. Li S, Li Z, Gong J (2010) Multivariate statistical analysis of measure for assessing the quality of image fusion, International Journal of Image and Data Fusion, Vol. 1, No. pp. 47–66

  34. Liu X, Xiao D (2019) Multimodality image fusion based on quantum wavelet transform and sum-modified-Laplacian rule. Int J Theor Phys 18:734–744

    Article  MathSciNet  MATH  Google Scholar 

  35. Liu Z, Blasch E, Xue Z, Zhao J, Laganiere R, Wu W (2012) Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study. IEEE Transaction on Pattern Analysis and Machine Intelligence 34(1):94–109

    Article  Google Scholar 

  36. Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Information Fusion 23:139–155

    Article  Google Scholar 

  37. Liu Y, Chen X, Peng H, Wang Z (2017) Multi-focus image fusion with a deep convolutional neural network. Information Fusion 36:191–207

    Article  Google Scholar 

  38. Ma J, Ma Y, Li C (2019) Infrared and visible image fusion methods and applications: a survey. Information Fusion 45:153–178

    Article  Google Scholar 

  39. Ma J, Liang P, Yu W, Chen C, Guo X, Wu J, Jiang J (2020) Infrared and visible image fusion via detail preserving adversarial learning. Information Fusion 54:85–98

    Article  Google Scholar 

  40. Miao Q, Shi C, Xu P, Yang M, Shi YB (2011) A noval algorithm of image fusion using shearlets. Opt Commun 284(6):1540–1547

    Article  Google Scholar 

  41. Moonon A, Hu J, Li S (2015) Remote sensing image fusion method based on nonsubsampled Shearlet transform and sparse representation, Sensing and Imaging, Article ID: 23. [DOI https://doi.org/10.1007/s11220-015-0125-0]

  42. Naidu VPS, Raol JR (2008) Pixel-level image fusion using wavelets and principal component analysis. Def Sci J 58(3):338–352

    Article  Google Scholar 

  43. Naji MA, Aghagolzadeh A, Ezoji M (2019) Ensemble of CNN for multi-focus image fusion. Information Fusion 51:201–214

    Article  Google Scholar 

  44. Nikolov SG, Hill PR, Bull DR, Canagarajah CN (2001) Wavelets for image fusion, in: Wavelets in Signal and Image Analysis, Computational Imaging and Vision Series (Eds. A. Petrosian, F. Meyer), Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 213–244

  45. Qiguang M, Cheng S, Weisheng L (2013) Image fusion based on shearlets, In: New Advances in Image Fusion (Eds. Q. Miao), pp. 113–133

  46. Rockinger O, Fechner T (1998) Pixel level fusion: the case of image sequences, in: Signal Processing, Sensor Fusion, and Target Tracking (SPIE), vol. 3374, pp. 378–388

  47. Romeny BMH (1996) Introduction to scale-space theory: Multiscale geometric image Analysis, in proceeding of 4th International Conference on Visualization in Biomedical Computing, pp. 1–25

  48. Shi W, Zhu CQ, Tian Y, Nichol J (2005) Wavelet based image fusion and quality assessment. Int J Appl Earth Obs Geoinf 6(3):241–251

    Google Scholar 

  49. Singh R, Khare A (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform– a multiresolution approach. Information Fusion 19:49–60

    Article  Google Scholar 

  50. Srivastava R, Khare A (2015) Multifocus noisy image fusion using Contourlet transform. The Imaging Science Journal 63(7):408–422

    Article  Google Scholar 

  51. Srivastava R, Khare A (2016) Threshold based image fusion in dual tree complex wavelet domain. International Journal of Image, Graphics and Signal Processing 8(10):64–74

    Article  Google Scholar 

  52. Srivastava R, Singh R, Khare A (2012) Image fusion based on nonsubsampled Contourlet transform, in proceeding of international conference on informatics, Electronics & Vision (IEEE/IAPR ICIEV12), Dhaka, Bangladesh pp 263-266

  53. Srivastava R, Prakash O, Khare A (2016) Local energy based multimodal medical image fusion in curvelet domain. IET Comput Vis 10(6):513–527

    Article  Google Scholar 

  54. Tian J, Chen L, Ma L, Yu W (2011) Multi-focus image fusion using a bilateral gradient-based sharpness criterion. Opt Commun 284(1):80–87

    Article  Google Scholar 

  55. Tian J, Chen L, Ma L, Yu W (2011) Multi-focus image fusion using a bilateral gradient-based sharpness criterion. Opt Commun 284:80–87

    Article  Google Scholar 

  56. Vetterli M, Herley C (1992) Wavelets and filter banks: theory and design. IEEE Trans Signal Process 40(9):2207–2232

    Article  MATH  Google Scholar 

  57. Vishwakarma A, Bhuyan MK, Iwahori Y (2018) Non-subsampled shearlet transform based image fusion using modified weighted saliency and local difference, Vo. 77, pp. 32013–32040

  58. Wang W, Chang F (2011) A multi-focus image fusion method based on Laplacian pyramid. J Comput 6(12):2559–2566

    Article  Google Scholar 

  59. Wang L, Li B, Tian L (2012) Multi-model medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients. Information Fusion 19(1):20–28

    Google Scholar 

  60. Wang K, Zheng M, Wei H, Qi G, Li Y (2020) Multi-Modality Medical Inage Fusion Using Convolutional Neural Network and Contrast Pyramid, Sensor, Vol. 2020, Article ID: 2169

  61. Yadav SP, Yadav S (2020) Image fusion using hybrid methods in multimodality medical images. Medical & Biological Engineering & Computing 58:669–697

    Article  Google Scholar 

  62. Yang Y, Park DS, Huang S, Rao N (2010) Medical image fusion via an effective wavelet-based approach, EURASIP journal on advances in signal processing, Vol 2010, Article ID: 579341

  63. Yang HY, Wang XY, Niu PP, Liu YC (2014) Image denoising using nonsubsampled shearlet transform and twin support vector machines. Neural Netw 57:152–165

    Article  Google Scholar 

  64. Yi S, Labate D, Easley GR, Krim H (2009) A shearlet approach to edge analysis and detection. IEEE Trans Image Process 18(5):929–941

    Article  MathSciNet  MATH  Google Scholar 

  65. Zheng Y (2009) Multi-scale fusion algorithm comparison: pyramid, DWT and iterative DWT, in proceeding of 12th International Conference on Information Fusion, pp. 1060–1067

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication, University of Allahabad, Prayagraj, India

    Ashish Khare & Richa Srivastava

  2. Dhirubhai Ambani Institute of Information and Communication Technology (DA-IICT), Gandhinagar, India

    Manish Khare

Authors
  1. Ashish Khare
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manish Khare
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richa Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ashish Khare.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khare, A., Khare, M. & Srivastava, R. Shearlet transform based technique for image fusion using median fusion rule. Multimed Tools Appl 80, 11491–11522 (2021). https://doi.org/10.1007/s11042-020-10184-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10184-1

Keywords

Search

Navigation