Abstract
CT image quality is heavily reliant on radiation dose, which causes a trade-off between radiation dose and image quality that affects the subsequent image-based diagnostic performance. However, high radiation can be harmful to both patients and operators. Several (deep learning-based) approaches have been attempted to denoise low dose images. However, those approaches require access to large training sets, specifically the full dose CT images for reference, which can often be difficult to obtain. Self-supervised learning is an emerging alternative for lowering the reference data requirement facilitating unsupervised learning. Currently available self-supervised CT denoising works are either dependent on foreign domains or pretexts that are not very task-relevant. To tackle the aforementioned challenges, we propose a novel self-supervised learning approach, namely Self-Supervised Window-Leveling for Image DeNoising (SSWL-IDN), leveraging an innovative, task-relevant, simple, yet effective surrogate—prediction of the window-leveled equivalent. SSWL-IDN leverages residual learning and a hybrid loss combining perceptual loss and MSE, all incorporated in a VAE framework. Our extensive (in- and cross-domain) experimentation demonstrates the effectiveness of SSWL-IDN in aggressive denoising of CT (abdomen and chest) images acquired at 5% dose level only (Code available at https://github.com/ayaanzhaque/SSWL-IDN).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
For chest scans, the 5% dose level is simulated from routine and 10% dose level scans available in the Mayo data library.
References
Ataei, S., Alirezaie, J., Babyn, P.: Cascaded convolutional neural networks with perceptual loss for low dose CT denoising. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–5. IEEE (2020)
Biswas, B., Ghosh, S.K., Ghosh, A.: DVAE: deep variational auto-encoders for denoising retinal fundus image. In: Bhattacharyya, S., Konar, D., Platos, J., Kar, C., Sharma, K. (eds.) Hybrid Machine Intelligence for Medical Image Analysis. SCI, vol. 841, pp. 257–273. Springer, Singapore (2020). https://doi.org/10.1007/978-981-13-8930-6_10
Brenner, D.J., Hall, E.J.: Computed tomography - an increasing source of radiation exposure. N. Engl. J. Med. 357(22), 2277–2284 (2007). https://doi.org/10.1056/NEJMra072149. pMID: 18046031
Chen, B., Duan, X., Yu, Z., Leng, S., Yu, L., McCollough, C.: Development and validation of an open data format for CT projection data. Med. Phys. 42(12), 6964–6972 (2015)
Chen, H., et al.: Low-dose CT with a residual encoder-decoder convolutional neural network. IEEE Trans. Med. Imaging 36(12), 2524–2535 (2017). https://doi.org/10.1109/TMI.2017.2715284
Chen, H., Zhang, Y., Zhang, W., Liao, P., Li, K., Zhou, J., Wang, G.: Low-dose CT denoising with convolutional neural network. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 143–146. IEEE (2017b)
Diwakar, M., Kumar, M.: A review on CT image noise and its denoising. Biomed. Signal Process. Control 42, 73–88 (2018)
Gholizadeh-Ansari, M., Alirezaie, J., Babyn, P.: Deep learning for low-dose CT denoising using perceptual loss and edge detection layer. J. Digit. Imaging, 1–12 (2019)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Im Im, D., Ahn, S., Memisevic, R., Bengio, Y.: Denoising criterion for variational auto-encoding framework. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31 (2017)
Kingma, D.P., Salimans, T., Jozefowicz, R., Chen, X., Sutskever, I., Welling, M.: Improving variational inference with inverse autoregressive flow. arXiv preprint arXiv:1606.04934 (2016)
Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)
Krull, A., Buchholz, T.O., Jug, F.: Noise2Void-learning denoising from single noisy images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2129–2137 (2019)
Laine, S., Karras, T., Lehtinen, J., Aila, T.: High-quality self-supervised deep image denoising. In: Advances in Neural Information Processing Systems, vol. 32, pp. 6970–6980 (2019)
Ma, Y., Wei, B., Feng, P., He, P., Guo, X., Wang, G.: Low-dose CT image denoising using a generative adversarial network with a hybrid loss function for noise learning. IEEE Access 8, 67519–67529 (2020)
Quan, Y., Chen, M., Pang, T., Ji, H.: Self2Self with dropout: learning self-supervised denoising from single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020
de Sa, V.R.: Learning classification with unlabeled data. In: Advances in Neural Information Processing Systems, pp. 112–119. Citeseer (1994)
Wu, D., Ren, H., Li, Q.: Self-supervised dynamic CT perfusion image denoising with deep neural networks. IEEE Trans. Radiat. Plasma Med. Sci. (2020)
Xie, Y., Wang, Z., Ji, S.: Noise2Same: optimizing a self-supervised bound for image denoising. In: Advances in Neural Information Processing Systems, vol. 33 (2020)
Xu, J., et al.: Noisy-As-Clean: learning self-supervised denoising from corrupted image. IEEE Trans. Image Process. 29, 9316–9329 (2020)
Yang, Q., et al.: Low-dose CT image denoising using a generative adversarial network with wasserstein distance and perceptual loss. IEEE Trans. Med. Imaging 37(6), 1348–1357 (2018). http://dx.doi.org/10.1109/TMI.2018.2827462
Yi, X., Babyn, P.: Sharpness-aware low-dose CT denoising using conditional generative adversarial network. J. Digital Imaging 31(5), 655–669 (2018)
Yu, L., Shiung, M., Jondal, D., McCollough, C.H.: Development and validation of a practical lower-dose-simulation tool for optimizing computed tomography scan protocols. J. Comput. Assist. Tomogr. 36(4), 477–487 (2012)
Yuan, N., Zhou, J., Qi, J.: Half2Half: deep neural network based CT image denoising without independent reference data. Phys. Med. Biol. 65(21), 215020 (2020)
Yue, Z., Yong, H., Zhao, Q., Zhang, L., Meng, D.: Variational denoising network: Toward blind noise modeling and removal. In: The Thirty-third Annual Conference on Neural Information Processing Systems (2019)
Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)
Zhang, R., Isola, P., Efros, A.A., Shechtman, E., Wang, O.: The unreasonable effectiveness of deep features as a perceptual metric. In: CVPR (2018)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Haque, A., Wang, A., Imran, AAZ. (2021). Window-Level Is a Strong Denoising Surrogate. In: Lian, C., Cao, X., Rekik, I., Xu, X., Yan, P. (eds) Machine Learning in Medical Imaging. MLMI 2021. Lecture Notes in Computer Science(), vol 12966. Springer, Cham. https://doi.org/10.1007/978-3-030-87589-3_47
Download citation
DOI: https://doi.org/10.1007/978-3-030-87589-3_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87588-6
Online ISBN: 978-3-030-87589-3
eBook Packages: Computer ScienceComputer Science (R0)
