Abstract
In this work, we propound the Global Inception U-Nets, that consist of suppled non-local accretion blocks, that could be used in clinical image segmentation especially for MRI segmentation of brain tumour images. The non-local accretion blocks can be positioned in U-Net as image size-conservation blocks along with the down-sampling and up-sampling layers. The fundamental research in this work involved use of the inception model to assort brain images. We have also used variant sized filters. The idea behind using these types of filters, was that the variant sized filters helps the neural network become sturdy towards the change in the scale. We start by drawing out deep activation features. This is applied on the overall image as well as on the image patches of distinct scales. The image in the encoder side is filtered in parallel by multi sized kernels. The output from every single filter undergoes batch normalisation (BN) and the outputs are summed up with a Maxout unit. This approach shrinks the spatial information of the outputs and introduces competition among the kernels. Then activations of image patches are brought together by using extra Maxpool operation with the convolution layer and after convolution layer too. Thus, we get a contemporary image representation by merging both the Maxpool and inception model activations.
Similar content being viewed by others
References
Aboelenein NM, Songhao P, Koubaa A, Noor A, Afifi A (2020) Httu-net: Hybrid two track u-net for automatic brain tumor segmentation. IEEE Access
Alfano B, Ciampi M, De Pietro G (2007) A wavelet-based algorithm for multimodal medical image fusion. In: International conference on semantic and digital media technologies, Springer, pp 117–120
Alom MZ, Yakopcic C, Taha TM, Asari VK (2018) Nuclei segmentation with recurrent residual convolutional neural networks based u-net (r2u-net). In: NAECON 2018-IEEE national aerospace and electronics conference, IEEE, pp 228–233
Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495
Chang J-R, Chen Y-S (2015) Batch-normalized maxout network in network. arXiv:1511.02583
Chavan S, Pawar A, Talbar S (2017) Multimodality medical image fusion using rotated wavelet transform. Advances in Intelligent Systems Research 137:627–635
Croisille P, Yang F, Moulin K Free-breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet
Erdem F, Avdan U (2020) Comparison of different u-net models for building extraction from high-resolution aerial imagery. International Journal of Environment and Geoinformatics 7(3):221–227
Gai D, Shen X, Cheng H, Chen H (2019) Medical image fusion via pcnn based on edge preservation and improved sparse representation in nsst domain. IEEE Access 7:85413–85429
Goceri E Challenges and recent solutions for image segmentation in the era of deep learning. In: 2019 Ninth international conference on image processing theory, Tools and Applications (IPTA)
Goodfellow I, Warde-Farley D, Mirza M, Courville A, Bengio Y (2013) Maxout networks. In: International conference on machine learning, PMLR, pp 1319–1327
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Hesamian MH, Jia W, He X, Kennedy P (2019) Deep learning techniques for medical image segmentation: Achievements and challenges. J Digit Imaging 32(4):582–596
Hu Y, Wen G, Luo M, Dai D, Ma J, Yu Z (2018) Competitive inner-imaging squeeze and excitation for residual network. arXiv:1807.08920
Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167
Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv:1412.6980
Kumar NN, Prasad TJ, Prasad KS Linear weighted nonsubsampled contourlet transform fusion using principal component analysis
Liu X, Mei W, Du H (2018) Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter. Med Biol Eng Comput 56(9):1565–1578
Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. Proc icml 30(1):3
Manessi F, Rozza A, Bianco S, Napoletano P, Schettini R (2018) Automated pruning for deep neural network compression. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 657–664
Moeskops P, de Bresser J, Kuijf HJ, Mendrik AM, Biessels GJ, Pluim JP, Išgum I (2018) Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in mri. NeuroImage: Clinical 17:251–262
Nair RR, Singh T (2021) Mamif: Multimodal adaptive medical image fusion based on b-spline registration and non-subsampled shearlet transform. Multimed Tools Appl 80(12):19079–19105
Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in mri images. IEEE Trans Med Imaging 35(5):1240–1251
Prasad S, et al. (2020) Dual stage bayesian network with dual-tree complex wavelet transformation for image denoising. Journal of Engineering Research, 8(1)
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, Springer, pp 234–241
Tong K, Wu Y, Zhou F (2020) Recent advances in small object detection based on deep learning: A review. Image and Vision Computing, pp 103910
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008
Wang Z, Zou N, Shen D, Ji S (2020) Non-local u-nets for biomedical image segmentation. In: AAAI, pp 6315–6322
Yadav SP (2020) Fusion of medical images in wavelet domain: a hybrid implementation. Comput Model Eng Sci 122(1):303–321
Yadav SP, Yadav S (2019) Fusion of medical images using a wavelet methodology: A survey. IEIE Trans Smart Process Comput 8(4):265–271
Yadav SP, Yadav S (2020) Image fusion using hybrid methods in multimodality medical images. Medical & Biological Engineering & Computing 58(4):669–687
Yogalakshmi G, Rani BS (2020) A review on the techniques of brain tumor: Segmentation, feature extraction and classification. In: 2020 11th international conference on computing, communication and networking technologies (ICCCNT), IEEE, pp 1–6
Zhang S, Huang F, Liu B, Li G, Chen Y, Chen Y, Zhou B, Wu D (2021) A multi-modal image fusion framework based on guided filter and sparse representation. Opt Lasers Eng 137:106354
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mishra, A., Gupta, P. & Tewari, P. Global U-net with amalgamation of inception model and improved kernel variation for MRI brain image segmentation. Multimed Tools Appl 81, 23339–23354 (2022). https://doi.org/10.1007/s11042-022-12094-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12094-w