Skip to main content

Advertisement

Log in

Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected to be more informative for visual perception than any of the individual input images. The main objective of this paper is to improve the information, to preserve the edges and to enhance the quality of the fused image using cascaded principal component analysis (PCA) and shift invariant wavelet transforms.

Methods

A novel image fusion technique based on cascaded PCA and shift invariant wavelet transforms is proposed in this paper. PCA in spatial domain extracts relevant information from the large dataset based on eigenvalue decomposition, and the wavelet transform operating in the complex domain with shift invariant properties brings out more directional and phase details of the image. The significance of maximum fusion rule applied in dual-tree complex wavelet transform domain enhances the average information and morphological details.

Results

The input images of the human brain of two different modalities (MRI and CT) are collected from whole brain atlas data distributed by Harvard University. Both MRI and CT images are fused using cascaded PCA and shift invariant wavelet transform method. The proposed method is evaluated based on three main key factors, namely structure preservation, edge preservation, contrast preservation. The experimental results and comparison with other existing fusion methods show the superior performance of the proposed image fusion framework in terms of visual and quantitative evaluations.

Conclusion

In this paper, a complex wavelet-based image fusion has been discussed. The experimental results demonstrate that the proposed method enhances the directional features as well as fine edge details. Also, it reduces the redundant details, artifacts, distortions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Pappachan A, Dasarathy BV (2014) Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19

    Article  Google Scholar 

  2. Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Inf Fusion 23:139–155

    Article  Google Scholar 

  3. Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43(6):1391–1402

    Article  Google Scholar 

  4. Bhateja V, Patel H, Krishna A, Lay-Ekuakille A (2015) Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens J 15(12):6783–6790

    Article  Google Scholar 

  5. He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on HIS and PCA. Procedia Eng 7:280–285

    Article  Google Scholar 

  6. Bedi SS, Khandelwal R (2013) Contrast enhancement for PCA fusion of medical images. J Glob Res Comput Sci 4:25–29

    Google Scholar 

  7. Li S, Kang X, Fang L, Hu T, Yin H (2017) Pixel level image fusion: a survey of the state of the art. Inf Fusion 33:100–112

  8. Nandi D, Ashour AS, Samanta S, Chakraborty S, Salem MAM, Dey N (2015) Principal component analysis in medical image processing: a study. Int J Image Min 1(1):65–83

    Article  Google Scholar 

  9. Wan T, Zhu C, Qin Z (2013) Multifocus image fusion based on robust principal component analysis. Pattern Recognit Lett 34:1001–1008

    Article  Google Scholar 

  10. Suraj AA, Francis M, Kavya T, Nirmal TM (2014) Discrete wavelet transform based image fusion and denoising in FPGA. J Electr Syst Inf Technol 1:72–81

    Google Scholar 

  11. Singh R, Khare A (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform–a multiresolution approach. Inf Fusion 19:49–60

    Article  Google Scholar 

  12. Wei H, Viallon M, Delattre BMA, Moulin K, Yang F, Croisille P, Zhu Y (2015) Free breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet based image fusion. IEEE Trans Med Imaging 34(1):306–316

    Article  PubMed  Google Scholar 

  13. Prakash O, Srivastava R, Khare A (2013) Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule. In: Proceedings of 2013, IEEE international conference on information and communication technologies, pp 758–763

  14. Tu TM, Huang PS, Hung CL, Hung CP, Chang A (2004) A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1(4):309–312

  15. Ellmauthaler A, Pagliari CL, da Silva EAB (2013) Multiscale image fusion using the undecimated wavelet transform with spectral factorization and nonorthogonal filter banks. IEEE Trans Image Process 22(3):1005–1017

    Article  PubMed  Google Scholar 

  16. Nandeesh MD, Meenakshi M (2015) A novel technique of medical image fusion using stationary wavelet transform and principal component analysis. In: 2015 international conference on smart sensors and systems (IC-SSS), pp 1–5

  17. Harpreet K, Rachna R (2015) A combined approach using DWT & PCA on image fusion. Int J Adv Res Comput Commun Eng 4(9):294–296

    Google Scholar 

  18. Vijayarajan R, Muttan S (2015) Discrete wavelet transform based principal averaging fusion for medical images. Int J Electron Commun 69:896–902

  19. Pawar MM, Kulkarni NP (2014) Image resolution using multiwavelet transforms with interpolation technique. J Electr Electron Eng 9:9–13

    Google Scholar 

  20. Khare A, Tiwary US, Pedrycz W, Jeon M (2010) Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform. Imaging Sci J 58:340–358

    Article  Google Scholar 

  21. Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164

    Article  Google Scholar 

  22. Singh RR, Mishra R (2015) Benefits of dual tree complex wavelet transform over discrete wavelet transform for image fusion. Int J Innov Res Sci Technol 1(11):259–263

    Google Scholar 

  23. Chauhan RPS, Dwivedi R, Bhaga R (2013) Comparative analysis of discrete wavelet transform and complex wavelet transform for image fusion and denoising. Int J Eng Sci Invent 2(3):18–27

    Google Scholar 

  24. Chatterjee P, Ghoshal S, Biswas B, Chakrabarti A, Dey KN (2015) Medical image fusion using Daubechies complex wavelet and near set. In: Transactions on computational science XXV, Volume 9030 of the series lecture notes in computer science, pp 90–111

  25. Lu C, Chelikani S, Jaffray DA, Milosevic MF, Staib LH, Duncan JS (2012) Simultaneous non rigid registration, segmentation and tumor detection in MRI guided cervical cancer radiation therapy. IEEE Trans Med Imaging 31(6):1213–1227

    Article  PubMed  PubMed Central  Google Scholar 

  26. Alam F, Rahman SU, Ullah S, Gulati K (October 2017) Medical image registration in image guided surgery: issues, challenges and research opportunities. Biocybern Biomed Eng 38:71–89

  27. Zhang Y, Shi F, Wu G, Wang L, Yap PT, Shen D (2016) Consistent spatial–temporal longitudinal atlas construction for developing infant brains. IEEE Trans Med Imaging 35(12):2568–2577

    Article  PubMed  Google Scholar 

  28. Zhang Y, Shi F, Yap P-T, Shen D (2016) Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum Brain Mapp 37(6):2133–2150

    Article  PubMed  Google Scholar 

  29. Solanki CK, Patel NM (2011) Pixel based and wavelet based image fusion methods with their comparative study. In: National conference on recent trends in engineering & technology, pp 13–14

  30. Xydeas CS (2000) Petrovic: objective image fusion performance measure. Electron Lett 36:308–309

  31. Bhavana V, Krishnappa HK (2015) Multi-modality medical image fusion using discrete wavelet transform. Procedia Comput Sci 70:625–631

    Article  Google Scholar 

  32. Udhaya Suriya TS, Rangarajan P (2017) Brain tumor detection using discrete wavelet transform based medical image fusion. Biomed Res 2017:684–688

    Google Scholar 

  33. Sultana T, Dulal Hossain MD, Karam Newaz MD (2016) Analysis on SWT based image fusion techniques using intuitionistic fuzzy set operations. Int J Technol Enhanc Emerg Eng Res 4:16–19

    Google Scholar 

  34. Saravanan V, Babu G, Siva Kumar R, Monie EC (2016) Medical image fusion by PCA method and implementation on FPGA. Int J Emerg Trends Sci Technol 3(05):800–806. ISSN: 2348–9480

  35. Kuswaha L , Thakare VV (2017) A critical review on image fusion. Int J Innov Res Comput Commun Eng 5(5)

  36. Kaur D (2016) Image fusion using a hybrid technique (\(\text{ PCA }+\text{ SWT }\)). Int J Eng Comput Sci 5(02):15661–15667

    Article  Google Scholar 

  37. Hill P, Al-Mualla ME, Bull D (2017) Perceptual image fusion using wavelets. IEEE Trans Image Process 26(3):1076–1088

    Article  PubMed  Google Scholar 

  38. Bhandaril PK, Venkasteshappa, Raj CP (2016) An efficient method of image fusion using SWT and DTCWT. Int J Electron Commun Eng 9:29–37

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Reena Benjamin.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human and animal rights

For this type of study, formal consent is not required. This article does not contain any studies with human participants or animals performed by any of the authors. The article does not contain patient data.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Reena Benjamin, J., Jayasree, T. Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms. Int J CARS 13, 229–240 (2018). https://doi.org/10.1007/s11548-017-1692-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-017-1692-4

Keywords

Navigation