Skip to main content

MTD-GAN: Multi-task Discriminator Based Generative Adversarial Networks for Low-Dose CT Denoising

  • Conference paper
  • First Online:
Machine Learning for Medical Image Reconstruction (MLMIR 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13587))

Abstract

Radiation dose reduction of computed tomography (CT) is an important research topic due to the potential risk of X-rays. However, low-dose CT (LDCT) images inevitably have a noise that can compromise diagnoses. Recently, although various deep learning algorithms were applied for LDCT denoising, there are still some issues including over-smoothness and visually awkwardness for radiologists. In this paper, we propose a multi-task discriminator based generative adversarial network (MTD-GAN) simultaneously conducting three vision tasks (classification, segmentation, and reconstruction) in a discriminator. To stabilize GAN training, we introduce two novel loss functions termed non-difference suppression (NDS) loss and reconstruction consistency (RC) loss. Furthermore, we take a fast Fourier transform with convolution block (FFT-Conv Block) in the generator to make use of both high- and low-frequency features. Our model has been evaluated by pixel-space and feature-space based metrics in the head and neck LDCT denoising task, and results show outperformance quantitatively and qualitatively than the state-of-the-art denoising methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Brenner, D.J., Hall, E.J.: Computed tomography—an increasing source of radiation exposure. N. Engl. J. Med. 357, 2277–2284 (2007)

    Article  Google Scholar 

  2. de Gonzalez, A.B., Darby, S.: Risk of cancer from diagnostic X-rays: estimates for the UK and 14 other countries. Lancet 363, 345–351 (2004)

    Article  Google Scholar 

  3. Valentin, J.: International commission on radiological protection. In: The 2007 Recommendations of the International Commission on Radiological Protection, vol. 103, pp. 2–4. Annals of the ICRP, ICRP Publication (2007)

    Google Scholar 

  4. Wang, H., Wu, X., Huang, Z., Xing, E.P.: High-frequency component helps explain the generalization of convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8684–8694 (2020)

    Google Scholar 

  5. Chen, H., et al.: Low-dose CT with a residual encoder-decoder convolutional neural network. IEEE Trans. Med. Imaging 36, 2524–2535 (2017)

    Article  Google Scholar 

  6. Goodfellow, I., et al.: Generative adversarial nets. Adv. Neural Inform. Process. Syst. 27, (2014)

    Google Scholar 

  7. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)

    Article  Google Scholar 

  8. Liang, T., Jin, Y., Li, Y., Wang, T.: EDCNN: Edge enhancement-based densely connected network with compound loss for low-dose CT denoising. In: 2020 15th IEEE International Conference on Signal Processing (ICSP), pp. 193–198. IEEE (2020)

    Google Scholar 

  9. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., Yang, M.-H.: Restormer: efficient transformer for high-resolution image restoration. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5728–5739 (20220)

    Google Scholar 

  10. Wang, D., Fan, F., Wu, Z., Liu, R., Wang, F., Yu, H.: CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising. arXiv preprint arXiv:2202.13517 (2022)

  11. Yang, Q., et al.: Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans. Med. Imaging 37, 1348–1357 (2018)

    Article  Google Scholar 

  12. Shan, H., et al.: Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction. Nat. Mach. Intell. 1, 269–276 (2019)

    Article  Google Scholar 

  13. Schonfeld, E., Schiele, B., Khoreva, A.: A u-net based discriminator for generative adversarial networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8207–8216 (2020)

    Google Scholar 

  14. Huang, Z., Zhang, J., Zhang, Y., Shan, H.: DU-GAN: generative adversarial networks with dual-domain U-Net-based discriminators for low-dose CT denoising. IEEE Trans. Instrum. Meas. 71, 1–12 (2021)

    Google Scholar 

  15. Lin, C.H., Chang, C.-C., Chen, Y.-S., Juan, D.-C., Wei, W., Chen, H.-T.: COCO-GAN: generation by parts via conditional coordinating. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4512–4521 (2020)

    Google Scholar 

  16. Zhang, H., Goodfellow, I., Metaxas, D., Odena, A.: Self-attention generative adversarial networks. In: International Conference on Machine Learning, pp. 7354–7363. PMLR (2019)

    Google Scholar 

  17. Vandenhende, S., Georgoulis, S., Van Gansbeke, W., Proesmans, M., Dai, D., Van Gool, L.: Multi-task learning for dense prediction tasks: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44 (2021)

    Google Scholar 

  18. Hang, R., Zhou, F., Liu, Q., Ghamisi, P.: Classification of hyperspectral images via multitask generative adversarial networks. IEEE Trans. Geosci. Remote Sens. 59, 1424–1436 (2020)

    Article  Google Scholar 

  19. Rad, M.S., et al.: Benefiting from multitask learning to improve single image super-resolution. Neurocomputing 398, 304–313 (2020)

    Article  Google Scholar 

  20. Liu, M.-Y., et al.: Few-shot unsupervised image-to-image translation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10551–10560 (2019)

    Google Scholar 

  21. Cha, J., Chun, S., Lee, G., Lee, B., Kim, S., Lee, H.: Few-shot compositional font generation with dual memory. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, JM. (eds.) European Conference on Computer Vision. LNIP, vol. 12364, pp. 735–751. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58529-7_43

  22. Wan, W., Lee, H.J.: Generative adversarial multi-task learning for face sketch synthesis and recognition. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 4065–4069. IEEE (2019)

    Google Scholar 

  23. Liu, Y., Wang, Z., Jin, H., Wassell, I.: Multi-task adversarial network for disentangled feature learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3743–3751 (2018)

    Google Scholar 

  24. Kyung, S., et al.: Improved performance and robustness of multi-task representation learning with consistency loss between pretexts for intracranial hemorrhage identification in head CT. Med. Image Anal. 81, 102489 (2022)

    Google Scholar 

  25. Miyato, T., Kataoka, T., Koyama, M., Yoshida, Y.: Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 (2018)

  26. Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., Paul Smolley, S.: Least squares generative adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2794–2802 (2016)

    Google Scholar 

  27. Zhang, H., Zhang, Z., Odena, A., Lee, H.: Consistency regularization for generative adversarial networks. arXiv preprint arXiv:1910.12027 (2019)

  28. Katznelson, Y.: An introduction to Harmonic Analysis. Cambridge University Press (2004)

    Google Scholar 

  29. Chi, L., Jiang, B., Mu, Y.: Fast fourier convolution. Adv. Neural. Inf. Process. Syst. 33, 4479–4488 (2020)

    Google Scholar 

  30. Zamir, S.W., et al.: Multi-stage progressive image restoration. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14821–14831 (2021)

    Google Scholar 

  31. Kramer, M., et al.: Computed tomography angiography of carotid arteries and vertebrobasilar system: a simulation study for radiation dose reduction. Medicine 94 (2015)

    Google Scholar 

  32. Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., Finn, C.: Gradient surgery for multi-task learning. Adv. Neural. Inf. Process. Syst. 33, 5824–5836 (2020)

    Google Scholar 

  33. Sajjadi, M.S., Scholkopf, B., Hirsch, M.: Enhancenet: single image super-resolution through automated texture synthesis. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4491–4500 (2017)

    Google Scholar 

  34. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Hochreiter, S.: Gans trained by a two time-scale update rule converge to a local nash equilibrium. Adv. Neural Inform. Process. Syst. 30 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Namkug Kim .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 396 kb)

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kyung, S., Won, J., Pak, S., Hong, Gs., Kim, N. (2022). MTD-GAN: Multi-task Discriminator Based Generative Adversarial Networks for Low-Dose CT Denoising. In: Haq, N., Johnson, P., Maier, A., Qin, C., Würfl, T., Yoo, J. (eds) Machine Learning for Medical Image Reconstruction. MLMIR 2022. Lecture Notes in Computer Science, vol 13587. Springer, Cham. https://doi.org/10.1007/978-3-031-17247-2_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-17247-2_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-17246-5

  • Online ISBN: 978-3-031-17247-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics