Skip to main content
SpringerLink
Log in

Brain tumor segmentation by auxiliary classifier generative adversarial network

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Recently, great progress has been achieved in the building of automatic segmentation and classification systems for use in medical applications utilizing machine learning techniques. These systems have been used to analyze medical images. However, the performance of some of these systems typically decreases when utilizing fresh data. This may be because different data were used for training, which may be because of changes in protocols or imaging equipment, or it may be because of a combination of these factors. In the field of medical imaging, one of the most difficult and important goals is to produce an image that is really medical yet is otherwise wholly distinct from the original images. The fake images that are produced as a consequence boost diagnostic accuracy and make it possible to identify more data, both with the help of computers and in the training of medical professionals. These issues are mostly brought on by low-contrast MR images, particularly in the anatomical regions of the brain, as well as shifts in sequence. Within the scope of this study, we investigate the possibility of producing multiple-sequence MR images by the application of auxiliary classifier-generating adversarial networks (ACGANs). In addition to that, a brand new approach to in-depth learning for tumor segmentation in MR images is provided. In the beginning, a deep neural network is trained to function as a discriminator in GAN data sets consisting of magnetic resonance (MR) images in order to extract the features and also learn the structure of the MR images in their annular layers. After that, the layers that are already fully connected are removed, and the entire deep network is instructed in segmentation for the purpose of diagnosing tumors. The proposed AC-GAN method provides an overall accuracy of 94% on the BraTs2019 database using Adam optimization with a batch size of 30.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data availability

The data that support the findings of this study are openly available in MICCAI 2019 BraTS at https://www.med.upenn.edu/cbica/brats2019/data.html.

References

  1. Liu, J., Pan, Y., Li, M., Chen, Z., Tang, L., Lu, C., Wang, J.: Applications of deep learning to MRI images: A survey. Big Data Mining Anal. 1(1), 1 (2018). https://doi.org/10.26599/BDMA.2018.9020001

    Article  Google Scholar 

  2. Louis, D.N., Perry, A., Reifenberger, G., Von Deimling, A., Figarella-Branger, D., Cavenee, W.K., Ohgaki, H., Wiestler, O.D., Kleihues, P., Ellison, D.W., The 2016 world health organization classification of tumors of the central nervous system: A summary. ActaNeuropathol. 131 (6) (2016) 803–820, https://doi.org/10.1007/s00401-016-1545-1.

  3. Havaei, M., Davy, A., Wardefarley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.M., Larochelle, H.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)

    Article  Google Scholar 

  4. Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2481–2495 (2017)

    Article  Google Scholar 

  5. Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., Pal, C.: The importance of skip connections in biomedical image segmentation, in: Deep Learning and Data Labeling for Medical Applications, Springer, (2016), pp. 179—187.

  6. Yang, X., Xu, Z., Luo, J., Towards perceptual image dehazing by physics-based disentanglement and adversarial training, The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18) (2018).

  7. Goodfellow, I., Pouget-Abadie, J., Mirza M., et al.: Generative adversarial nets. In: Advances in neural information processing systems, (2014) pp. 2672–2680.

  8. Tahir, B., Iqbal, S., Khan, M.U.G., Saba, T., Mehmood, Z., Anjum, A., Mahmood, T.: Feature enhancement framework for brain tumor segmentation and classification. Microsc. Res. Tech. 82(6), 803–811 (2019). https://doi.org/10.1002/jemt.23224

    Article  Google Scholar 

  9. Chang, H., Lu, J., Yu, F., Finkelstein, A.., Pairedcyclegan: asymmetric style transfer for applying and removing makeup, 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018).

  10. Engin, D., Genc, A., Kemal Ekenel, H. Cycle-dehaze: Enhanced cyclegan for single image dehazing, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2018) 825–833.

  11. Guluzade, J., Kalejahi, B.K., Danishvar, S.: Brain tumor segmentation methods based on MRI images: Review paper Khazar. J. Sci. Technol. (2021). https://doi.org/10.5782/2520-6133.2021.5.2.49

    Article  Google Scholar 

  12. Zhu, J.-Y., Park, T., Isola, P., Efros, A.A. Unpaired image-to-image translation using cycle-consistent adversarial networks, IEEE International Conference on Computer Vision (2017).

  13. Rezaei, M., Harmuth, K., Gierke, W., Kellermeier, T., Fischer, M., Yang, H., Meinel, C., A conditional adversarial network for semantic segmentation of brain tumor, in: International MICCAI Brainlesion Workshop, Springer, (2017), pp. 241–252.

  14. Yosinski, J., Clune,J., Bengio, Y., and Lipson, H., How transferable are features in deep neural networks? CoRR, vol. abs/1411.1792, 2014. [Online]. Available: http://arxiv.org/abs/1411.1792.

  15. Ioffe S., and Szegedy, C., Batch normalization: Accelerating deep network training by reducing internal covariate shift, arXiv preprint arXiv:1502.03167, (2015).

  16. Salimans T., and Kingma, D.P., Weight normalization: A simple reparameterization to accelerate training of deep neural networks, in Adv. Neural Inf. Proc. Syst., (2016), pp. 901– 909.

  17. Wu, J., Zhang, C., Xue, T., Freeman, B., and Tenenbaum, J. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling, in Adv. Neural Inf. Proc. Syst., (2016), pp. 82–90.

  18. Havaei, M., Davy, A., Warde-Farley, D., et al.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)

    Article  Google Scholar 

  19. Havaei, M., Guizard, N., Chapados, N., Bengio, Y.: Hemis: Hetero-modal image segmentation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., et al. (eds.) Medical image computing and computer-assisted intervention—MICCAI 2016, pp. 469–477. Springer International Publishing, Cham (2016)

    Google Scholar 

  20. Kamnitsas, K., Ledig, C., Newcombe, V.F., et al.: Efficient multi-scale 3d cnn with fully connected crf for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78 (2017)

    Article  Google Scholar 

  21. Ranjbarzadeh, R., BagherianKasgari, A., JafarzadehGhoushchi, S., et al.: Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images. Sci Rep 11, 10930 (2021). https://doi.org/10.1038/s41598-021-90428-8

    Article  Google Scholar 

  22. Mukherkjee, D., Saha, P., Kaplun, D., Sinitca, A., Sarkar, R.: Brain tumor image generation using an aggregation of GAN models with style transfer. Sci. Rep. 12(1), 9141 (2022). https://doi.org/10.1038/s41598-022-12646-y.PMID:35650252;PMCID:PMC9160042

    Article  Google Scholar 

  23. Neelima, G., Chigurukota, D.R., BalajeeMaram, B., Girirajan, B.: Optimal DeepMRSeg based tumor segmentation with GAN for brain tumor classification. Biomed. Sign. Proc. Control (2022). https://doi.org/10.1016/j.bspc.2022.103537

    Article  Google Scholar 

  24. Dhaniya, R.D., Umamaheswari, K.M. Brain tumor identification and classification of MRI images using data augmented support vector machine. Cogn. Neurodyn. (2022), 1–11.

  25. Han, C., Rundo, L., Murao, K., Noguchi, T., Shimahara, Y., Milacski, Z.Á., Koshino, S., Sala, E., Nakayama, H., Satoh, S.I.: MADGAN: Unsupervised medical anomaly detection GAN using multiple adjacent brain MRI slice reconstruction. BMC Bioinform. 22, 1–20 (2021)

    Article  Google Scholar 

  26. Deepak, S.; Ameer, P.M. MSG-GAN based synthesis of brain mri with meningioma for data augmentation. In Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India, 2–4 July 2020; IEEE: Piscataway, NJ, USA, (2020); pp. 1–6.

  27. Cirillo, M.D., Abramian, D., Eklund, A. (2021). Vox2Vox: 3D-GAN for brain tumour segmentation. In: Crimi, A., Bakas, S. (eds) Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2020. Lecture Notes in Computer Science(), vol 12658. Springer, Cham. https://doi.org/10.1007/978-3-030-72084-1_25.

  28. Li, Y., Chen, Y., Shi, Y.: Brain tumor segmentation using 3D generative adversarial networks. Int. J. Pattern Recognit. Artif. Intell. 35, 2157002 (2021)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Biomedical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran

    Behnam Kiani Kalejahi & Saeed Meshgini

  2. Department of Electronic and Computer Engineering, Brunel University, London, UK

    Sebelan Danishvar

Authors
  1. Behnam Kiani Kalejahi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saeed Meshgini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sebelan Danishvar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

BKK: Designed and conducted the research study, analyzed the data, and wrote the manuscript. Dr.SM: Assisted with the research design and data analysis, and contributed to writing the manuscript. Dr.SD: Provided resources for the study, and reviewed and edited the manuscript. All authors have reviewed and approved the final version of the manuscript and agree with the content and conclusions presented."

Corresponding author

Correspondence to Behnam Kiani Kalejahi.

Ethics declarations

Conflict of interest

The Title of manuscript: “Brain Tumor Segmentation by Auxiliary Classifier Generative Adversarial Network.” It is declared that all co-authors have confirmed the contents of the manuscript and there is no financial interest to report.

Ethical approval

Considering that the “Brain Tumor Segmentation by Auxiliary Classifier Generative Adversarial Network” is an observational study, so it does not need to have ethical approval.

Informed consent

Considering that the “Brain Tumor Segmentation by Auxiliary Classifier Generative Adversarial Network” is an observational study, so it does not need to have informed consent.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kiani Kalejahi, B., Meshgini, S. & Danishvar, S. Brain tumor segmentation by auxiliary classifier generative adversarial network. SIViP 17, 3339–3345 (2023). https://doi.org/10.1007/s11760-023-02555-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02555-6

Keywords

Search

Navigation