Skip to main content
Log in

Global U-net with amalgamation of inception model and improved kernel variation for MRI brain image segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this work, we propound the Global Inception U-Nets, that consist of suppled non-local accretion blocks, that could be used in clinical image segmentation especially for MRI segmentation of brain tumour images. The non-local accretion blocks can be positioned in U-Net as image size-conservation blocks along with the down-sampling and up-sampling layers. The fundamental research in this work involved use of the inception model to assort brain images. We have also used variant sized filters. The idea behind using these types of filters, was that the variant sized filters helps the neural network become sturdy towards the change in the scale. We start by drawing out deep activation features. This is applied on the overall image as well as on the image patches of distinct scales. The image in the encoder side is filtered in parallel by multi sized kernels. The output from every single filter undergoes batch normalisation (BN) and the outputs are summed up with a Maxout unit. This approach shrinks the spatial information of the outputs and introduces competition among the kernels. Then activations of image patches are brought together by using extra Maxpool operation with the convolution layer and after convolution layer too. Thus, we get a contemporary image representation by merging both the Maxpool and inception model activations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Aboelenein NM, Songhao P, Koubaa A, Noor A, Afifi A (2020) Httu-net: Hybrid two track u-net for automatic brain tumor segmentation. IEEE Access

  2. Alfano B, Ciampi M, De Pietro G (2007) A wavelet-based algorithm for multimodal medical image fusion. In: International conference on semantic and digital media technologies, Springer, pp 117–120

  3. Alom MZ, Yakopcic C, Taha TM, Asari VK (2018) Nuclei segmentation with recurrent residual convolutional neural networks based u-net (r2u-net). In: NAECON 2018-IEEE national aerospace and electronics conference, IEEE, pp 228–233

  4. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495

    Article  Google Scholar 

  5. Chang J-R, Chen Y-S (2015) Batch-normalized maxout network in network. arXiv:1511.02583

  6. Chavan S, Pawar A, Talbar S (2017) Multimodality medical image fusion using rotated wavelet transform. Advances in Intelligent Systems Research 137:627–635

    Google Scholar 

  7. Croisille P, Yang F, Moulin K Free-breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet

  8. Erdem F, Avdan U (2020) Comparison of different u-net models for building extraction from high-resolution aerial imagery. International Journal of Environment and Geoinformatics 7(3):221–227

    Article  Google Scholar 

  9. Gai D, Shen X, Cheng H, Chen H (2019) Medical image fusion via pcnn based on edge preservation and improved sparse representation in nsst domain. IEEE Access 7:85413–85429

    Article  Google Scholar 

  10. Goceri E Challenges and recent solutions for image segmentation in the era of deep learning. In: 2019 Ninth international conference on image processing theory, Tools and Applications (IPTA)

  11. Goodfellow I, Warde-Farley D, Mirza M, Courville A, Bengio Y (2013) Maxout networks. In: International conference on machine learning, PMLR, pp 1319–1327

  12. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  13. Hesamian MH, Jia W, He X, Kennedy P (2019) Deep learning techniques for medical image segmentation: Achievements and challenges. J Digit Imaging 32(4):582–596

    Article  Google Scholar 

  14. Hu Y, Wen G, Luo M, Dai D, Ma J, Yu Z (2018) Competitive inner-imaging squeeze and excitation for residual network. arXiv:1807.08920

  15. Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167

  16. Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv:1412.6980

  17. Kumar NN, Prasad TJ, Prasad KS Linear weighted nonsubsampled contourlet transform fusion using principal component analysis

  18. Liu X, Mei W, Du H (2018) Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter. Med Biol Eng Comput 56(9):1565–1578

    Article  Google Scholar 

  19. Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. Proc icml 30(1):3

    Google Scholar 

  20. Manessi F, Rozza A, Bianco S, Napoletano P, Schettini R (2018) Automated pruning for deep neural network compression. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 657–664

  21. Moeskops P, de Bresser J, Kuijf HJ, Mendrik AM, Biessels GJ, Pluim JP, Išgum I (2018) Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in mri. NeuroImage: Clinical 17:251–262

    Article  Google Scholar 

  22. Nair RR, Singh T (2021) Mamif: Multimodal adaptive medical image fusion based on b-spline registration and non-subsampled shearlet transform. Multimed Tools Appl 80(12):19079–19105

    Article  Google Scholar 

  23. Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in mri images. IEEE Trans Med Imaging 35(5):1240–1251

    Article  Google Scholar 

  24. Prasad S, et al. (2020) Dual stage bayesian network with dual-tree complex wavelet transformation for image denoising. Journal of Engineering Research, 8(1)

  25. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, Springer, pp 234–241

  26. Tong K, Wu Y, Zhou F (2020) Recent advances in small object detection based on deep learning: A review. Image and Vision Computing, pp 103910

  27. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008

  28. Wang Z, Zou N, Shen D, Ji S (2020) Non-local u-nets for biomedical image segmentation. In: AAAI, pp 6315–6322

  29. Yadav SP (2020) Fusion of medical images in wavelet domain: a hybrid implementation. Comput Model Eng Sci 122(1):303–321

    Google Scholar 

  30. Yadav SP, Yadav S (2019) Fusion of medical images using a wavelet methodology: A survey. IEIE Trans Smart Process Comput 8(4):265–271

    Article  Google Scholar 

  31. Yadav SP, Yadav S (2020) Image fusion using hybrid methods in multimodality medical images. Medical & Biological Engineering & Computing 58(4):669–687

    Article  Google Scholar 

  32. Yogalakshmi G, Rani BS (2020) A review on the techniques of brain tumor: Segmentation, feature extraction and classification. In: 2020 11th international conference on computing, communication and networking technologies (ICCCNT), IEEE, pp 1–6

  33. Zhang S, Huang F, Liu B, Li G, Chen Y, Chen Y, Zhou B, Wu D (2021) A multi-modal image fusion framework based on guided filter and sparse representation. Opt Lasers Eng 137:106354

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Annu Mishra.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mishra, A., Gupta, P. & Tewari, P. Global U-net with amalgamation of inception model and improved kernel variation for MRI brain image segmentation. Multimed Tools Appl 81, 23339–23354 (2022). https://doi.org/10.1007/s11042-022-12094-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12094-w

Keywords

Navigation