Skip to main content

Advertisement

SpringerLink
Log in

Medical image fusion based on saliency and adaptive similarity judgment

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Information regarding single-modality medical images remains limited at present. Therefore, the details of relevant organizations cannot be reflected by such information and misdiagnosis may result in the clinical setting. A novel image fusion method based on nonsubsampled contourlet transform (NSCT) and visual saliency is presented for multimode medical images to solve the aforementioned problem and improve the effect of fused images. In this method, an image is initially decomposed via NSCT to obtain low- and high-frequency coefficients and derive the Achanta (AC) saliency map of the image. Subsequently, the similarity of low- and high-frequency subbands is calculated using the standard deviation and energy of a region. Similarity is determined through an adaptive threshold. Meanwhile, the saliency map is utilized to guide the fusion of high- and low-frequency coefficients, with emphasis on the visual salient target area of the source image. Lastly, inverse NSCT is used to reconstruct the fused image. The proposed algorithm can effectively improve the quality of multimodal medical image fusion and increase complementary information among different modalities as demonstrated by the experimental results. This algorithm is superior to existing medical image fusion algorithms and more in accord with human visual characters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Zhang F, Yoo Y, Mong K et al (2007) Non linear diffusion in Laplacian pyramid domain for ultrasonic speckle reduction. IEEE Trans Med Imaging 26(2):200–211

    Article  Google Scholar 

  2. Li S, Kang X, Fang L (2017) Pixel-level image fusion: a survey of the state of the art. Inform Fusion 33:100–112

    Article  Google Scholar 

  3. Yin H (2015) Sparse representation with learned multiscale dictionary for image fusion. Neurocomputing 148(19):600–610

    Article  Google Scholar 

  4. Xiao B, Wang K, Bi X, Li W, Han J (2018) 2D-LBP: an enhanced local binary feature for texture image classification, IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/TCSVT.2018.2869841

  5. Cai K, Yang RQ, Li LH et al (2016) Tetralogy of Fallot cardiac function evaluation and intelligent diagnosis based on dual-source computed tomography cardiac images. Artif Organs 5(40):459–469

    Article  Google Scholar 

  6. Cai K, Yang RQ, Yue HW et al (2017) Dynamic updating atlas for heart segmentation with a nonlinear field-based model. Int J Med Rob Comput Assisted Surg 3(13):e1785

    Article  Google Scholar 

  7. Burt P, Adelson E (1983) The Laplacian pyramid as a compact image code. IEEE Trans Comput 31(4):532–540

    Google Scholar 

  8. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  9. Cai W, Chen S, Zhang D (2007) Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation. Pattern Recogn 40(3):835–838

    Article  Google Scholar 

  10. Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8

  11. Cunha A, Jianping Z, Do M (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE Trans Image Process, Publ IEEE Signal Process Soc 15(10):3089–3101

    Article  Google Scholar 

  12. Achanta R, Hemami S, Estrada F (2009) Frequency-tuned salient region detection. Proceedings of the Computer Vision and Pattern Recognition, Los Alamitos: IEEE Computer Society Press, pp.1597-1604

  13. Wei X, Lin H, Yu Y, Yang L (2017) Low-resource cross-domain product review sentiment classification based on a CNN with an auxiliary large-scale corpus. Algorithms 10(3):81–90

    Article  Google Scholar 

  14. Cai K, Yang RQ, Li LH et al (2015) A semi-automatic coronary artery segmentation framework using mechanical simulation. Journal Med Syst 10(39):65–74

    Google Scholar 

  15. Cai K, Yang RQ, Chen HZ et al (2017) A framework combining window width-level adjustment and Gaussian filter-based multi-resolution for automatic whole heart segmentation. Neurocomputing 1(220):138–150

    Article  Google Scholar 

  16. Liu Y, Wang Z (2014) Simultaneous image fusion and denoising with adaptive sparse representation. IET Image Process 9(5):347–357

    Article  Google Scholar 

  17. Wei W, Song H, Li W, Shen P, Vasilakos A (2017) Gradient-driven parking navigation using a continuous information potential field based on wireless sensor network. Inf Sci 408(2):100–114

    Article  Google Scholar 

  18. Kim M, Han DK (2016) Joint patch clustering-based dictionary learning for multimodal image fusion. Inform Fusion 27:198–214

    Article  Google Scholar 

  19. Chen H, Qiao H, Xu L, Feng Q, Cai K (2019) A fuzzy optimization strategy for the implementation of RBF LSSVR model in Vis-NIR analysis of pomelo maturity. IEEE Trans Ind Inf:1. https://doi.org/10.1109/TII.2019.2933582

  20. Song HB, He DJ, Gong L (2014) Crops image fusion in different light conditions based on contourlet transform. Trans Chinese Soc Agric Eng 30(11):173–179

    Google Scholar 

  21. Huang Z, Tang J, Shan G, Ni J, Chen Y, Wang C (2019) An efficient passenger-hunting recommendation framework with multi-task deep learning. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2019.2901759

  22. Cai ZS, Chen MS (2015) Study on multi-focus image fusion method based on wavelet transfrom. Laser Optoelectron Prog 52:091003

    Article  Google Scholar 

  23. Hu XL, Pan DW, Lu HM (2012) Image fusion based on the second generation curvelet transform and feature product. Microelectron Comput 29(11):126–129

    Google Scholar 

  24. Huang ZY, He JN (2017) A novel image fusion algorithm based on NSCT and regional features. J Fuzhou Univ 45(1):80–90

    Google Scholar 

  25. Li S, Fang L, Yin H (2012) Multitemporal image change detection using a detail-enhancing approach with nonsubsampled contourlet transform. IEEE Geosci Remote Sens Lett 9(5):836–840

    Article  Google Scholar 

  26. Dai WZ, Pan SW, Li JF (2017) Medical image fusion algorithm based on human visual characteristics and adaptive PCNN. J Optoelectron Laser 7:808–816

    Google Scholar 

  27. Su J, Li B, Wang YZ (2016) Infrared image enhancement based on PCNN segmentation and fuzzy set theory. Acta Opt Sin 36(9):0910001

    Article  Google Scholar 

  28. Palmedo H, Bucerius J, Joe A (2006) Integrated PET /CT in differentiated thyroid cancer: diagnostic accuracy and impact on patient management. J Nucl Med 47(4):616–624

    Google Scholar 

  29. Zhang M, Zhang D, Goerlandt F, Yan X, Kujala P (2019) Use of HFACS and fault tree model for collision risk factors analysis of icebreaker assistance in ice-covered waters. Saf Sci 111:128–143

    Article  Google Scholar 

  30. Wei W, Fan X, Song H, Fan X, Yang J (2016) Imperfect information dynamic Stackelberg game based resource allocation using hidden Markov for cloud computing. IEEE Trans Serv Comput 11(1):78–89

    Article  Google Scholar 

Download references

Funding

This work was supported by the China Postdoctoral Science Foundation (No.2018T110880, No. 2017M620375) and Guangdong Provincial Science and Technology Program (No. 2017A040405056).

Author information

Authors and Affiliations

  1. College of Automation, Zhongkai University of Agriculture and Engineering, Guangzhou, 510225, China

    Wei Li, Keqiang Wang & Ken Cai

Authors
  1. Wei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Keqiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ken Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ken Cai.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, W., Wang, K. & Cai, K. Medical image fusion based on saliency and adaptive similarity judgment. Pers Ubiquit Comput 27, 2019–2025 (2023). https://doi.org/10.1007/s00779-019-01317-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-019-01317-x

Keywords

Search

Navigation