Skip to main content

Advertisement

SpringerLink
Log in

PET–MRI image fusion using adaptive filter based on spectral and spatial discrepancy

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Recently, medical imaging equipment has undergone major developments. They play an important role in healthcare industry since they provide visual interpretation of human organs. Magnetic resonance imaging (MRI) and positron emission tomography (PET) are two well-known technologies which capture the structural and functional characteristics of the body organs, respectively. Fusing such functional and structural information can help physicians to better understand the normal and abnormal behaviors of tissues and organs. The contribution of this paper is twofold. First, an adaptive filter-based image fusion method is proposed to integrate information of MRI and PET images. Second, the notion of spatial discrepancy is added to the conventional spectral discrepancy and both discrepancy criteria are used for optimizing the filter parameters. The proposed image fusion technique is tested on seven publicly available brain image datasets including two cases of Alzheimer’s disease, normal coronal, normal sagittal, normal axial, grade II astrocytoma, and grade IV astrocytoma provided by Harvard University. The proposed method is compared with other biomedical image fusion approaches in both quantitative and visual manners. The results show that the proposed image fusion technique provides better performance in improving spectral and structural characteristics of the original images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Aiazzi, B., Baronti, S., Lotti, F., Selva, M.: A comparison between global and context-adaptive pansharpening of multispectral images. IEEE Geosci. Remote Sens. Lett. 6(2), 302–306 (2009)

    Article  Google Scholar 

  2. Al-Wassai, F.A., Kalyankar, N., Al-Zuky, A.A.: The IHS transformations based image fusion. arXiv preprint arXiv:11074396 (2011)

  3. Amini, N., Fatemizadeh, E., Behnam, H.: MRI and PET image fusion by using curvelet transform. J. Adv. Comput. Res. 5(4), 23–30 (2014)

    Google Scholar 

  4. Amini, N., Fatemizadeh, E., Behnam, H.: MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules. J. Med. Eng. Technol. 38(4), 211–219 (2014)

    Article  Google Scholar 

  5. Angle, H., Ste-Croix, C., Kittel, E.: Review of fusion systems and contributing technologies for SIHS. Contract 519(836), 5911 (2007)

    Google Scholar 

  6. Bhatnagar, G., Wu, Q.J., Liu, Z.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimed. 15(5), 1014–1024 (2013)

    Article  Google Scholar 

  7. Bushberg, J.T., Boone, J.M.: The Essential Physics of Medical Imaging. Lippincott Williams & Wilkins, Philadelphia (2011)

    Google Scholar 

  8. Daneshvar, S., Ghassemian, H.: MRI and PET images fusion based on human retina model. J. Zhejiang Univ. Sci. A 8(10), 1624–1632 (2007)

    Article  MATH  Google Scholar 

  9. Daneshvar, S., Ghassemian, H.: MRI and PET image fusion by combining IHS and retina-inspired models. Inf. Fusion 11(2), 114–123 (2010)

    Article  Google Scholar 

  10. Deshmukh, M., Bhosale, U.: Image fusion and image quality assessment of fused images. Int. J. Image Process. 4(5), 484 (2010)

    Google Scholar 

  11. Dou, W., Chen, Y.H.: Image fusion method of high-pass modulation including interband correlations. J. Infrared. Millim. Waves 29(2), 140–144 (2010)

    Article  Google Scholar 

  12. Huang, S.G., et al.: Wavelet for image fusion. National Taiwan University, Graduate Institute of Communication Engineering and Department of Electrical Engineering (2010)

  13. James, A.P., Dasarathy, B.V.: Medical image fusion: a survey of the state of the art. Inf. Fusion 19, 4–19 (2014)

    Article  Google Scholar 

  14. Krishn, A., Bhateja, V., Himanshi, S.A.: Medical image fusion using combination of PCA and wavelet analysis. In: Advances in Computing, Communications and Informatics (ICACCI, 2014 International Conference, pp. 986–991. https://doi.org/10.1109/ICACCI.2014.6968636 (2014)

  15. Kumar, B.S.: Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform. SIViP 7(6), 1125–1143 (2013)

    Article  Google Scholar 

  16. Kumar, T.S., Arivazhagan, S., Ganesan, L.: A modified statistical approach for image fusion using wavelet transform. SIViP 3(2), 137–144 (2009)

    Article  Google Scholar 

  17. Lakshmi, S., Sankaranarayanan, D.V., et al.: A study of edge detection techniques for segmentation computing approaches. IJCA Special Issue on Computer Aided Soft Computing Techniques for Imaging and Biomedical Applications CASCT, pp. 35–40 (2010)

  18. Lillo-Saavedra, M., Gonzalo, C., Arquero, A., Martinez, E.: Fusion of multispectral and panchromatic satellite sensor imagery based on tailored filtering in the fourier domain. Int. J. Remote Sens. 26(6), 1263–1268 (2005)

    Article  Google Scholar 

  19. Liu, X., Mei, W., Du, H., Bei, J.: A novel image fusion algorithm based on nonsubsampled shearlet transform and morphological component analysis. SIViP 10(5), 959–966 (2016)

    Article  Google Scholar 

  20. Mule, M.B., Padmavathi, N.: Basic medical image fusion methods. Int. J. Adv. Res. Comput. Eng. Technol. 4(3), 10 (2015)

    Google Scholar 

  21. Pietrzyk, U.: Registration of MRI and PET Images for Clinical Applications. CRC, Boca Raton, FL (2001)

    Book  Google Scholar 

  22. Ramandeep, R.K.: Review on different aspects of image fusion for medical imaging. Int. J. Sci. Res. 3(5), 1887–1889 (2014)

    Google Scholar 

  23. Shah, P., Merchant, S.N., Desai, U.B.: Multifocus and multispectral image fusion based on pixel significance using multiresolution decomposition. SIViP 7(1), 95–109 (2013)

    Article  Google Scholar 

  24. Shahdoosti, H.R.: MS and PAN image fusion by combining brovey and wavelet methods. In: International Conference on Information Technology, Computer and Communication (arXiv preprint arXiv:170101996) (2017)

  25. Shahdoosti, H.R., Ghassemian, H.: Fusion of MS and PAN images preserving spectral quality. Geosci. Remote Sens. Lett. IEEE 12(3), 611–615 (2015)

    Article  Google Scholar 

  26. Sharma, K., Sharma, M.: Image fusion based on image decomposition using self-fractional Fourier functions. SIViP 8(7), 1335–1344 (2014)

    Article  Google Scholar 

  27. Shreyamsha, K.B.: Image fusion based on pixel significance using cross bilateral filter. SIViP 9(5), 1193–1204 (2015)

    Article  Google Scholar 

  28. Tu, T.M., Huang, P., Hung, C.L., Chang, C.P.: A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci. Remote Sens. Lett. 1, 309–312 (2004)

    Article  Google Scholar 

  29. Xu, Z.: Medical image fusion using multi-level local extrema. Inf. Fusion 19, 38–48 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical and Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Arash Saboori

  2. The University of Texas at Dallas, Richardson, TX, 75080, USA

    Javad Birjandtalab

Authors
  1. Arash Saboori
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Javad Birjandtalab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arash Saboori.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saboori, A., Birjandtalab, J. PET–MRI image fusion using adaptive filter based on spectral and spatial discrepancy. SIViP 13, 135–143 (2019). https://doi.org/10.1007/s11760-018-1338-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-018-1338-1

Keywords

Search

Navigation