Skip to main content

Advertisement

SpringerLink
Log in

GA-based multiresolution fusion of segmented brain images using PD-, T1- and T2-weighted MR modalities

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Medical image fusion has been used to derive the useful complimentary information from multimodality imaging. The proposed methodology introduces fusion approach for robust and automatic extraction of information from segmented images of different modalities. This fusion strategy is implemented in multiresolution domain using wavelet transform- and genetic algorithm-based search technique to extract maximum complementary information. The analysis of input images at multiple resolutions is able to extract more fine details and improves the quality of the composite fused image. The proposed approaches are also independent of any manual marking or knowledge of fiducial points and start the fusion procedure automatically. The performance of fusion scheme implemented on segmented brain images has been evaluated computing mutual information as similarity measuring matrix. Prior to fusion process, images are being segmented using different segmentation techniques like fuzzy C-mean and Markov random field models. Experimental results show that Gibbs- and ICM-based segmentation approaches related to Markov random field perform over the fuzzy C-mean and which are being used prior to GA-based fusion process for MR T1, MR T2 and MR PD images of section of human brain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Barra V, Boire J-Y (2001) A general framework for the fusion of anatomical and functional medical images. NeuroImage 13(3):410–424

    Article  Google Scholar 

  2. Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sensing 43(6):1391–1402

    Article  Google Scholar 

  3. Garg S, Kiran KU, Mohan R, Tiwary US (2005) Multilevel medical image fusion using segmented image by level set evolution with region competition. In: Proceedings of 27th IEEE engineering in medicine and biology conference (EMBC-05), Shanghai, China, September 1–4, 2005

  4. Guihong Q, Dali Z, Pingfan Y (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9:184–190

    Article  Google Scholar 

  5. Dutta Majumder D, Bhattacharya M (1998) Soft computing methods for uncertainty management in multimodal image registration and fusion problems. In: International conference of information sciences JCIS-98, North Carolina, Duke University, USA, October 1998

  6. Dutta Majumder D, Bhattacharya M (2000) Cybernetic approach to medical technology: application to cancer screening and other diagnostics, millennium volume of kybernetes. Int J Syst Cybernet 29(7/8):871–895 (MCB publications, Emerald, UK)

    Google Scholar 

  7. Bloch I (1996) Information combination operators for data fusion: a comparative review with classification. IEEE Trans Syst Man Cybernet Part A Syst Humans 26(1):52–67

    Google Scholar 

  8. Chanussot J, Mauris G, Lambert P (1999) Fuzzy fusion techniques for linear features detection in multitemporal SAR images. IEEE Trans Geosci Remote Sensing 37(3):1292–1305

    Google Scholar 

  9. Zhu Y-M, Cochoff SM (2006) An object-oriented framework for medical image registration, fusion, and visualization. Comput Methods Programs Biomed 82(3):258–267

    Article  Google Scholar 

  10. Petrovic VS, Xydeas CS (2004) Gradient-based multiresolution image fusion. IEEE Trans Image Process 13(2):228–237

    Article  Google Scholar 

  11. Redondo R, Sroubek F, Fischer S, Cristobal G (2009) Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique. Inform Fusion 10(2):163–171

    Article  Google Scholar 

  12. Li S, Yang B (2008) Multifocus image fusion using region segmentation and spatial frequency. Image Vis Comput 26(7):971–979

    Article  Google Scholar 

  13. Dutta Majumder D, Bhattacharya M (1998) Multimodal data fusion for alzheimer’s patients using dempster-shafer theory of evidence. In: 3rd Asian fuzzy systems symposium 1998, Korea, Proceedings, pp 713–719

  14. Leahy R, Yan X (1991) Incorporation of anatomical MR data for improved functional imaging with PET. In: Colchester ACF, Hawkes DJ (eds) information processing in medical imaging. Springer, New York, pp 105–120

  15. Hurn MA, Mardia KV (1996) Bayesian fused classification of medical images. IEEE Trans Med Imaging 15:850–858

    Article  Google Scholar 

  16. Garvey TD, Lowrance JD, Fischler MA (1981) An inference technique for integrating knowledge from disparate sources. In: Proceedings of 7th international conference on artificial intelligence. Vancouver, BC, Canada, pp 319–325

  17. Le H`egarat-Mascle S, Bloch I, Vidal-Madjar D (1997) Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing. IEEE Trans Geosci Remote Sensing 35:1018–1031

  18. Bruzzone L, Fern’andez Prieto D, Serpico SB (1999) A neural-statistical approach to multitemporal and multisource remote-sensing image classification. IEEE Trans Geosci Remote Sensing 37(3):1350–1359

  19. Li M, Cai W, Tan Z (2006) A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn Lett 27(16):1948–1956

    Article  Google Scholar 

  20. Pradhan PS, King RL, Younan NH, Holcomb DW (2006) Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion. IEEE Trans Geosci Remote Sensing 44(12):3674–3686

    Article  Google Scholar 

  21. Acerbi-Junior FW, Clevers JGPW, Schaepman ME (2006) The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna. Int J Appl Earth Observ Geoinform 8(4):278–288

    Article  Google Scholar 

  22. Pajares G, Cruz JMDL (2004) A wavelet-based image fusion tutorial. Pattern Recogn 37(9):1855–1872

    Article  Google Scholar 

  23. Ray LA, Adhami RR (2006) Dual tree discrete wavelet transform with application to image fusion. In: Southeastern symposium on system theory, pp 430–433

  24. Qu G, Zhang D, Yan P (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9(4):184–190

    Google Scholar 

  25. Zheng YF, Essock EA, Hansen BC, Haun AM (2007) A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inform Fusion 8(2):177–192

    Article  Google Scholar 

  26. Mitianoudis N, Stathaki T (2007) Pixel-based and region-based image fusion schemes using ICA bases. Inform Fusion 8(2):131–142

    Article  Google Scholar 

  27. Piella G (2003) A general framework for multiresolution image fusion: from pixels to regions. Inform Fusion 4(4):259–280

    Article  Google Scholar 

  28. Pham DL, Xu C, Prince JL (2000) Current methods in medical image segmentation. Ann Rev Biomed Eng 2:315–338

    Article  Google Scholar 

  29. Banerjee S, Mukherjee DP, Dutta Majumder D (1999) Fuzzy c-means approach to tissue classification in multimodal medical imaging. Inform Sci 115:261–279

    Google Scholar 

  30. Fenster A, Chiu B (2005) Evaluation of segmentation algorithms for medical imaging. In: Proceedings of the 2005 IEEE engineering in medicine and biology 27th annual conference Shanghai, China, September 1–4, p 244

  31. Zhang YJ (1996) A survey on evaluation methods for image segmentation. Pattern Recogn 29:1335–1346

    Google Scholar 

  32. Weszka JS, Rosenfeld A (1978) Threshold evaluation techniques. IEEE Trans Syst Man Cybernet SMC-8:622–629

    Google Scholar 

  33. Levine MD, Nazif A (1985) Dynamic measurement of computer generated image segmentations. IEEE Trans Pattern Anal Mach Intell PAMI-7(2):155–164

    Google Scholar 

  34. Sahoo PK, Soltani S, Wong AKC, Chen YC (1988) A survey of thresholding techniques. CVGIP 41:233–260

    Google Scholar 

  35. Cardenes R, Warfield S, Macías E, Ruiz-Alzola J (2003) High performance supervised and unsupervised MRI brain segmentation. In: Proceedings of the neuroimaging workshop, Eurocast, pp 57–60

  36. Cardenes R, Warfield S, Macías E, Santana J, Ruiz-Alzola J (2003) An efficient algorithm for multiple esclerosis lesion segmentation from brain MRI. Computer aided system theory-EUROCAST 2809, pp 542–551

  37. Bland M (1995) An introduction to medical statistics. Oxford University Press, Oxford, pp 542–551

  38. Zar JH (1984) Biostatistical analysis, 2nd edn. Prentice Hall Inc., Englewood Cliffs

  39. Chalana V, Kim Y (1997) A methodology for evaluation of boundary detection algorithms on medical images. IEEE Trans Med Imaging 16(5):642–652

    Google Scholar 

  40. Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21:720–733

    Google Scholar 

  41. Dunn JC (1974) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57

    MathSciNet  Google Scholar 

  42. Bezdek JC, Keller JM, Krishnapuram R, Pal NR (1999) Fuzzy models and algorithms for pattern recognition and image processing, 3rd edn. Springer, New York, pp 368–369

  43. Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 1:45–57

    Google Scholar 

  44. Besag J (1986) On the statistical analysis of dirty images. R Stat Soc B 48:259–302

    Google Scholar 

  45. Geman S, Geman D (1984) Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6:721–741

    Article  MATH  Google Scholar 

  46. Wu J, Feng G (2009) Intrusion detection based on simulated annealing and fuzzy c-means clustering. In: International conference on multimedia information networking and security, pp 382–385

  47. Burt PJ (1984) The pyramid as structure for efficient computation. In: Rosenfeld A (ed) Multiresolution image processing and analysis, vol. 5. Springer, Berlin, pp 6–35

  48. Toet A (1992) Multiscale contrast enhancement with application to image fusion. Opt Eng 31(5):1026–1031

    Google Scholar 

  49. Uner MK, Ramac LC, Varshney PK (1997) Concealed weapon detection: an image fusion approach. In: Proceedings of SPIE, vol 2942, pp 123–132

  50. Wilson TA, Rogers SK, Myers LR (1995) Perceptual-based hyperspectral image fusion using multiresolution analysis. Opt Eng 34(11):3154–3164

    Google Scholar 

  51. Das A, Bhattacharya M (2011) Affine based registration of CT and MR modality images of human brain using multiresolution approaches: comparative study on genetic algorithm and particle swarm optimization. Neural Comput Appl 20(2):223–237 (Springer, London)

    Google Scholar 

  52. Butz T, Thiran J-P (2001) Affine registration with feature space mutual information. In: Niessen WJ, Viergever MA (eds) Medical image computing and computer-assisted intervention, vol 2208 of lecture notes in computer science. Springer, Berlin, pp 549–556

  53. Bhattacharya M, Dutta Majumder D (2000) Registration of CT and MR images of Alzheimer’s patient: a shape theoretic approach. Pattern Recog Lett 21(6–7):531–548

    Google Scholar 

  54. Hill DLG et al (1993) Registration of MR and CT images for skull base surgery using point like anatomical features. Brit J Radiol 64:1030–1035

    Google Scholar 

Download references

Acknowledgment

Authors gratefully acknowledge the help rendered by National Brain Research Centre, Gurgaon, India.

Author information

Authors and Affiliations

  1. Information Communication Technology, Indian Institute of Information Technology and Management, Morena Link Road, Gwalior, 474010, India

    Mahua Bhattacharya & M. Chandana

  2. Institute of Radio Physics and Electronics, University of Calcutta, 92 A.P.C. Road, Kolkata, 700009, India

    Arpita Das

Authors
  1. Mahua Bhattacharya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arpita Das
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Chandana
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mahua Bhattacharya.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bhattacharya, M., Das, A. & Chandana, M. GA-based multiresolution fusion of segmented brain images using PD-, T1- and T2-weighted MR modalities. Neural Comput & Applic 21, 1433–1447 (2012). https://doi.org/10.1007/s00521-011-0730-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0730-3

Keywords

Search

Navigation