Skip to main content
SpringerLink
Log in

Automatic Head-and-Neck Tumor Segmentation in MRI via an End-to-End Adversarial Network

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Among head-and-neck tumors, nasopharyngeal carcinoma (NPC) is the most common type which accounts for high mortality. In the clinical treatment of NPC, magnetic resonance imaging (MRI) has been the primacy method to assess the local and intracranial infiltration of NPC. Due to the time-consuming and labor-intensive nature of NPC in MRI segmentation process, it is desirable to design an accurate and automatic tumor segmentation method. In light of this, we propose a novel end-to-end adversarial network, named as Dense-SegNet based Generative Adversarial Networks (DS-GANs), for NPC segmentation. First, to solve the problem of edge blurring of NPC in MRI images, we propose a hybrid U-shape architecture which integrates the advantages of SegNet and U-net, and the hybrid architecture is named as SU-net. Second, enlightened by the great success of densely connected convolutional networks, we introduce the dense blocks structure to replace the convolution and deconvolution blocks in the proposed SU-net, thus minimizing the number of training parameters while achieving higher performance. The improved composite architecture is referred as DSU-net and employed as the generator network. Third, the traditional adversarial network outputting a single true/false may not match our tumor segmentation task, we introduce a multiscale adversarial network to distinguish both global and local features between the segmented result and the ground truth. Finally, we propose to use a hybrid loss function that utilizes both the multiscale adversarial loss and the Dice loss to train the entire network for better segmentation performance. The effectiveness of the proposed method is evaluated through an in-house NPC dataset of MRI images and better segmentation results are obtained compared with the state-of-the-art segmentation methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Lo KW, To KF, Huang DP (2004) Focus on nasopharyngeal carcinoma. Cancer Cell 5(5):423–428

    Article  Google Scholar 

  2. Chang ET, Liu Z, Hildesheim A, Liu Q, Ye W (2017) Active and passive smoking and risk of nasopharyngeal carcinoma: a population-based case-control study in southern china. Am J Epidemiol 185(12):1–9

    Article  Google Scholar 

  3. Mornet S, Vasseur S, Grasset F, Duguet E (2004) Magnetic nanoparticle design for medical diagnosis and therapy. J Mater Chem 14(14):2161–2175

    Article  Google Scholar 

  4. Zu C, Wang Z, Zhang D, Liang P, Shi Y, Shen D, Wu G (2017) Robust multi-atlas label propagation by deep sparse representation. Pattern Recogn 63:511–517

    Article  Google Scholar 

  5. Peng PJ, Lv BJ, Wang ZH, Liao H, Liu YM, Lin Z et al (2017) Multi-institutional prospective study of nedaplatin plus s-1 chemotherapy in recurrent and metastatic nasopharyngeal carcinoma patients after failure of platinum-containing regimens. Ther Adv Med Oncol 9(2):68–74

    Article  Google Scholar 

  6. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for scene segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495

    Article  Google Scholar 

  7. Huang YH, Feng QJ (2018) Segmentation of brain tumor on magnetic resonance images using 3d full-convolutional densely connected convolutional networks. J South Med Univ 38(6):661–668

    Google Scholar 

  8. Gubern-Merida A, Kallenberg M, Mann RM, Marti R, Karssemeijer N (2015) Breast segmentation and density estimation in breast MRI: a fully automatic framework. IEEE J Biomed Health Inform 19(1):349–357

    Article  Google Scholar 

  9. Marsousi M, Plataniotis K, Stergiopoulos S (2017) An automated approach for kidney segmentation in three-dimensional ultrasound images. IEEE J Biomed Health Inform 21:1079–1094

    Article  Google Scholar 

  10. Roy S, He Q, Sweeney E, Carass A, Reich DS, Prince JL, Pham DL (2015) Subject-specific sparse dictionary learning for atlas-based brain MRI segmentation. IEEE J Biomed Health Inform 19(5):1598–1609

    Article  Google Scholar 

  11. Song Y, He L, Zhou F, Chen S, Ni D, Lei B, Wang T (2017) Segmentation, splitting, and classification of overlapping bacteria in microscope images for automatic bacterial vaginosis diagnosis. IEEE J Biomed Health Inform 21:1095–1104

    Article  Google Scholar 

  12. Zhou J, Tian Q, Chong V, Xiong W, Huang W, Wang Z (2011) Segmentation of skull base tumors from MRI using a hybrid support vector machine-based method. In: International workshop on machine learning in medical imaging, pp 134–141

  13. Huang W, Chan KL, Zhou J (2013) Region-based nasopharyngeal carcinoma lesion segmentation from MRI using clustering- and classification-based methods with learning. J Digit Imaging 26(3):472–482

    Article  Google Scholar 

  14. Geng Q, Zhou Z, Cao X (2018) Survey of recent progress in semantic image segmentation with CNNs. Sci China 61(05):107–124

    MathSciNet  Google Scholar 

  15. Zhang Z, Pang Y (2020) CGNet: cross-guidance network for semantic segmentation. Sci China Inf Sci 63(2):1–16

    Article  Google Scholar 

  16. Wang K, Zhan B, Zu C, Wu X, Zhou J, Zhou L, Wang Y (2022) Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning. Med Image Anal 79:102447

    Article  Google Scholar 

  17. Tang P, Yang P, Nie D, Wu X, Zhou J, Wang Y (2022) Unified medical image segmentation by learning from uncertainty in an end-to-end manner. Knowl-Based Syst 241:108215

    Article  Google Scholar 

  18. Hu L, Li J, Peng X, Xiao J, Zhan B, Zu C, Wang Y (2022) Semi-supervised NPC segmentation with uncertainty and attention guided consistency. Knowl-Based Syst 239:108021

    Article  Google Scholar 

  19. Sun Y, Yang H, Zhou J, Wang Y (2022) ISSMF: integrated semantic and spatial information of multi-level features for automatic segmentation in prenatal ultrasound images. Artif Intell Med 125:102254

    Article  Google Scholar 

  20. Wang K, Wang Y, Zhan B, Yang Y, Zu C, Wu X, Zhou L (2022) An efficient semisupervised framework with multitask and curriculum learning for medical image segmentation. Int J Neural Syst 32(9):2250043

    Article  Google Scholar 

  21. Jiang H, Ma H, Qian W, Gao M, Li Y (2017) An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Informat 22(4):1227–1237

    Article  Google Scholar 

  22. Lekadir K, Galimzianova A, Betriu À, del Mar Vila M, Igual L, Rubin DL et al (2017) A Convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J Biomed Health Informat 21(1):48–55

    Article  Google Scholar 

  23. Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK et al (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78

    Article  Google Scholar 

  24. Milletari F, Ahmadi SA, Kroll C, Plate A, Rozanski V, Maiostre J et al (2017) Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound. Comput Vis Image Understand 164:92–102

    Article  Google Scholar 

  25. Cha KH, Hadjiiski L, Samala RK, Chan HP, Caoili EM, Cohan RH (2016) Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. Med Phys 43(4):1882–1896

    Article  Google Scholar 

  26. Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer

  27. Milletari F, Navab N, Ahmadi SA (2016). V-net: fully convolutional neural networks for volumetric medical image segmentation. In: 3D Vision (3DV), 2016 4th international conference on (pp. 565–571). IEEE

  28. Kuo M, Xinyuan C, Ye Z, Tao Z, Jianrong D, Junlin Y et al (2017) Deep deconvolutional neural network for target segmentation of nasopharyngeal cancer in planning computed tomography images. Front Oncol 7:315

    Article  Google Scholar 

  29. Wang Y, Zhao L, Song Z, Wang M (2018). Organ at risk segmentation in head and neck CT images by using a two-stage segmentation framework based on 3d u-net. IEEE Access.

  30. Gao Z et al (2020) Privileged modality distillation for vessel border detection in intracoronary imaging. IEEE Trans Med Imaging 39(5):1524–1534. https://doi.org/10.1109/TMI.2019.2952939

    Article  MathSciNet  Google Scholar 

  31. Eelbode T, Bertels J, Berman M et al (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or Jaccard index. IEEE Trans Med Imaging 39(11):3679–3690

    Article  Google Scholar 

  32. Oksuz I, Clough JR, Ruijsink B et al (2020) Deep learning based detection and correction of cardiac mr motion artefacts during reconstruction for high-quality segmentation. IEEE Trans Med Imaging 39(12):4001–4010

    Article  Google Scholar 

  33. Ma Z, Wu X, Sun S, et al (2018) A discriminative learning based approach for automated nasopharyngeal carcinoma segmentation leveraging multi-modality similarity metric learning. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE.

  34. Goodfellow IJ, Pouget-Abadie J, Mirza M, Bing X, Warde-Farley D, Ozair S, et al (2014) Generative adversarial nets. In: International conference on neural information processing systems

  35. Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552

    Article  Google Scholar 

  36. Bodla N, Hua G, Chellappa R (2018) Semi-supervised FusedGAN for conditional image generation.

  37. Zhang B, Ouyang F, Gu D, Dong Y, Lu Z, Mo X et al (2017) Advanced nasopharyngeal carcinoma: pre-treatment prediction of progression based on multi-parametric MRI radiomics. Oncotarget 8(42):72457–72465

    Article  Google Scholar 

  38. Vardhana M, Arunkumar N, Lasrado S, Abdulhay E, Ramirez-Gonzalez G (2018) Convolutional neural network for bio-medical image segmentation with hardware acceleration. Cognit Syst Res 50(AUG):10–14

    Article  Google Scholar 

  39. Bi L, Kim J, Kumar A, Fulham M, Feng D (2017) Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation. Vis Comp 33(6–8):1061–1071

    Article  Google Scholar 

  40. Creswell A, White T, Dumoulin V, Arulkumaran K, Sengupta B, Bharath AA (2017) Generative adversarial networks: an overview. IEEE Signal Process Mag 35(1):53–65

    Article  Google Scholar 

  41. Wang KF, Gou C, Duan YJ, Lin YL, Wang FY (2017) Generative adversarial networks: the state of the art and beyond. Zidonghua Xuebao/Acta Automatica Sinica 43(3):321–332

    Google Scholar 

  42. Xue Y, Xu T, Zhang H et al (2018) SegAN: adversarial network with multi-scale L1 loss for medical image segmentation. Neuroinform 16:383–392

    Article  Google Scholar 

  43. Tang XL, Du YM, Liu YW, Li JX, Ma YW (2018) Image recognition with conditional deep convolutional generative adversarial networks. Zidonghua Xuebao/Acta Automatica Sinica 44(5):855–864

    Google Scholar 

  44. Yuan Y, Qin W, Guo X, Buyyounouski M, Hancock S, Han B, Xing L (2019) Prostate segmentation with encoder-decoder densely connected convolutional network (Ed-Densenet). In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 434–437. IEEE

  45. Ghamisi P, Yokoya N (2018) Img2dsm: height simulation from single imagery using conditional generative adversarial net. IEEE Geosci Remote Sens Lett 15(5):794–798

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by National Natural Science Foundation of China (NSFC 62071314), Sichuan Science and Technology Program 2023YFG0263, 2023NSFSC0497, and Opening Foundation of Agile and Intelligent Computing Key Laboratory of Sichuan Province.

Author information

Authors and Affiliations

  1. School of Computer Science, Sichuan University, Chengdu, China

    PinLi Yang, JiLiu Zhou & Yan Wang

  2. Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China

    XingChen Peng

  3. Department of Radiation Oncology, Cancer Center, West China Hospital, Sichuan University, Chengdu, China

    JiangHong Xiao

  4. School of Computer Science, Chengdu University of Information Technology, Chengdu, China

    Xi Wu

Authors
  1. PinLi Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. XingChen Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. JiangHong Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xi Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. JiLiu Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yan Wang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, P., Peng, X., Xiao, J. et al. Automatic Head-and-Neck Tumor Segmentation in MRI via an End-to-End Adversarial Network. Neural Process Lett 55, 9931–9948 (2023). https://doi.org/10.1007/s11063-023-11232-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-023-11232-1

Keywords

Search

Navigation