Abstract
Purpose
In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected to be more informative for visual perception than any of the individual input images. The main objective of this paper is to improve the information, to preserve the edges and to enhance the quality of the fused image using cascaded principal component analysis (PCA) and shift invariant wavelet transforms.
Methods
A novel image fusion technique based on cascaded PCA and shift invariant wavelet transforms is proposed in this paper. PCA in spatial domain extracts relevant information from the large dataset based on eigenvalue decomposition, and the wavelet transform operating in the complex domain with shift invariant properties brings out more directional and phase details of the image. The significance of maximum fusion rule applied in dual-tree complex wavelet transform domain enhances the average information and morphological details.
Results
The input images of the human brain of two different modalities (MRI and CT) are collected from whole brain atlas data distributed by Harvard University. Both MRI and CT images are fused using cascaded PCA and shift invariant wavelet transform method. The proposed method is evaluated based on three main key factors, namely structure preservation, edge preservation, contrast preservation. The experimental results and comparison with other existing fusion methods show the superior performance of the proposed image fusion framework in terms of visual and quantitative evaluations.
Conclusion
In this paper, a complex wavelet-based image fusion has been discussed. The experimental results demonstrate that the proposed method enhances the directional features as well as fine edge details. Also, it reduces the redundant details, artifacts, distortions.
Similar content being viewed by others
References
Pappachan A, Dasarathy BV (2014) Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19
Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Inf Fusion 23:139–155
Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43(6):1391–1402
Bhateja V, Patel H, Krishna A, Lay-Ekuakille A (2015) Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens J 15(12):6783–6790
He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on HIS and PCA. Procedia Eng 7:280–285
Bedi SS, Khandelwal R (2013) Contrast enhancement for PCA fusion of medical images. J Glob Res Comput Sci 4:25–29
Li S, Kang X, Fang L, Hu T, Yin H (2017) Pixel level image fusion: a survey of the state of the art. Inf Fusion 33:100–112
Nandi D, Ashour AS, Samanta S, Chakraborty S, Salem MAM, Dey N (2015) Principal component analysis in medical image processing: a study. Int J Image Min 1(1):65–83
Wan T, Zhu C, Qin Z (2013) Multifocus image fusion based on robust principal component analysis. Pattern Recognit Lett 34:1001–1008
Suraj AA, Francis M, Kavya T, Nirmal TM (2014) Discrete wavelet transform based image fusion and denoising in FPGA. J Electr Syst Inf Technol 1:72–81
Singh R, Khare A (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform–a multiresolution approach. Inf Fusion 19:49–60
Wei H, Viallon M, Delattre BMA, Moulin K, Yang F, Croisille P, Zhu Y (2015) Free breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet based image fusion. IEEE Trans Med Imaging 34(1):306–316
Prakash O, Srivastava R, Khare A (2013) Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule. In: Proceedings of 2013, IEEE international conference on information and communication technologies, pp 758–763
Tu TM, Huang PS, Hung CL, Hung CP, Chang A (2004) A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1(4):309–312
Ellmauthaler A, Pagliari CL, da Silva EAB (2013) Multiscale image fusion using the undecimated wavelet transform with spectral factorization and nonorthogonal filter banks. IEEE Trans Image Process 22(3):1005–1017
Nandeesh MD, Meenakshi M (2015) A novel technique of medical image fusion using stationary wavelet transform and principal component analysis. In: 2015 international conference on smart sensors and systems (IC-SSS), pp 1–5
Harpreet K, Rachna R (2015) A combined approach using DWT & PCA on image fusion. Int J Adv Res Comput Commun Eng 4(9):294–296
Vijayarajan R, Muttan S (2015) Discrete wavelet transform based principal averaging fusion for medical images. Int J Electron Commun 69:896–902
Pawar MM, Kulkarni NP (2014) Image resolution using multiwavelet transforms with interpolation technique. J Electr Electron Eng 9:9–13
Khare A, Tiwary US, Pedrycz W, Jeon M (2010) Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform. Imaging Sci J 58:340–358
Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164
Singh RR, Mishra R (2015) Benefits of dual tree complex wavelet transform over discrete wavelet transform for image fusion. Int J Innov Res Sci Technol 1(11):259–263
Chauhan RPS, Dwivedi R, Bhaga R (2013) Comparative analysis of discrete wavelet transform and complex wavelet transform for image fusion and denoising. Int J Eng Sci Invent 2(3):18–27
Chatterjee P, Ghoshal S, Biswas B, Chakrabarti A, Dey KN (2015) Medical image fusion using Daubechies complex wavelet and near set. In: Transactions on computational science XXV, Volume 9030 of the series lecture notes in computer science, pp 90–111
Lu C, Chelikani S, Jaffray DA, Milosevic MF, Staib LH, Duncan JS (2012) Simultaneous non rigid registration, segmentation and tumor detection in MRI guided cervical cancer radiation therapy. IEEE Trans Med Imaging 31(6):1213–1227
Alam F, Rahman SU, Ullah S, Gulati K (October 2017) Medical image registration in image guided surgery: issues, challenges and research opportunities. Biocybern Biomed Eng 38:71–89
Zhang Y, Shi F, Wu G, Wang L, Yap PT, Shen D (2016) Consistent spatial–temporal longitudinal atlas construction for developing infant brains. IEEE Trans Med Imaging 35(12):2568–2577
Zhang Y, Shi F, Yap P-T, Shen D (2016) Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum Brain Mapp 37(6):2133–2150
Solanki CK, Patel NM (2011) Pixel based and wavelet based image fusion methods with their comparative study. In: National conference on recent trends in engineering & technology, pp 13–14
Xydeas CS (2000) Petrovic: objective image fusion performance measure. Electron Lett 36:308–309
Bhavana V, Krishnappa HK (2015) Multi-modality medical image fusion using discrete wavelet transform. Procedia Comput Sci 70:625–631
Udhaya Suriya TS, Rangarajan P (2017) Brain tumor detection using discrete wavelet transform based medical image fusion. Biomed Res 2017:684–688
Sultana T, Dulal Hossain MD, Karam Newaz MD (2016) Analysis on SWT based image fusion techniques using intuitionistic fuzzy set operations. Int J Technol Enhanc Emerg Eng Res 4:16–19
Saravanan V, Babu G, Siva Kumar R, Monie EC (2016) Medical image fusion by PCA method and implementation on FPGA. Int J Emerg Trends Sci Technol 3(05):800–806. ISSN: 2348–9480
Kuswaha L , Thakare VV (2017) A critical review on image fusion. Int J Innov Res Comput Commun Eng 5(5)
Kaur D (2016) Image fusion using a hybrid technique (\(\text{ PCA }+\text{ SWT }\)). Int J Eng Comput Sci 5(02):15661–15667
Hill P, Al-Mualla ME, Bull D (2017) Perceptual image fusion using wavelets. IEEE Trans Image Process 26(3):1076–1088
Bhandaril PK, Venkasteshappa, Raj CP (2016) An efficient method of image fusion using SWT and DTCWT. Int J Electron Commun Eng 9:29–37
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Human and animal rights
For this type of study, formal consent is not required. This article does not contain any studies with human participants or animals performed by any of the authors. The article does not contain patient data.
Rights and permissions
About this article
Cite this article
Reena Benjamin, J., Jayasree, T. Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms. Int J CARS 13, 229–240 (2018). https://doi.org/10.1007/s11548-017-1692-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-017-1692-4