Abstract
Deep-learning-based tomographic imaging is an important application of artificial intelligence and a new frontier of machine learning. Deep learning has been widely used in computer vision and image analysis, which deal with existing images, improve these images, and produce features from them. Since 2016, deep learning techniques have been actively researched for tomographic imaging, especially in the context of biomedicine, with impressive results and great potential. Tomographic reconstruction produces images of multi-dimensional structures from externally measured ‘encoded’ data in the form of various tomographic transforms (integrals, harmonics, echoes and so on). In this Review, we provide a general background, highlight representative results with an emphasis on medical imaging, and discuss key issues that need to be addressed in this emerging field. In particular, tomographic imaging is an integral part of modern medicine, and will play a key role in personalized, preventive and precision medicine and make it intelligent, inexpensive and indiscriminate.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$119.00 per year
only $9.92 per issue
Buy this article
- Purchase on SpringerLink
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Barrett, H., Myers, K., Hoeschen, C., Kupinski, M. & Little, M. Task-based measures of image quality and their relation to radiation dose and patient risk. Phys. Med. Biol. 60, R1 (2015).
Floyd, C. An artificial neural network for SPECT image reconstruction. IEEE Trans. Med. Imaging 10, 485–487 (1991).
Yan, H. & Mao, J. Data truncation artifact reduction in MR imaging using a multilayer neural network. IEEE Trans. Med. Imaging 12, 73–77 (1993).
Wang, G. A perspective on deep imaging. IEEE Access 4, 8914–8924 (2016).
Wang, G., Ye, J. C., Mueller, K. & Fessler, J. A. Image reconstruction is a new frontier of machine learning. IEEE Trans. Med. Imaging 37, 1289–1296 (2018).
McCann, M. T., Jin, K. H. & Unser, M. Convolutional neural networks for inverse problems in imaging: a review. IEEE Signal Process. Mag. 34, 85–95 (2017).
Ravishankar, S., Ye, J. C. & Fessler, J. A. Image reconstruction: from sparsity to data-adaptive methods and machine learning. Proc. IEEE 108, 86–109 (2019).
Sahiner, B. et al. Deep learning in medical imaging and radiation therapy. Med. Phys. 46, e1–e36 (2019).
Gong, K., Berg, E., Cherry, S. R. & Qi, J. Machine learning in PET: from photon detection to quantitative image reconstruction. Proc. IEEE 108, 51–68 (2019).
Nuyts, J., De Man, B., Fessler, J. A., Zbijewski, W. & Beekman, F. J. Modelling the physics in the iterative reconstruction for transmission computed tomography. Phys. Med. Biol. 58, R63 (2013).
Hebert, T. & Leahy, R. A generalized EM algorithm for 3-D bayesian reconstruction from Poisson data using Gibbs priors. IEEE Trans. Med. Imagine 8, 194–202 (1989).
Zaidi, H., Ruest, T., Schoenahl, F. & Montandon, M.-L. Comparative assessment of statistical brain MR image segmentation algorithms and their impact on partial volume correction in PET. Neuroimage 32, 1591–1607 (2006).
Hounsfield, G. N. Computerized transverse axial scanning (tomography): part 1. Description of system. Br. J. Radiol. 46, 1016–1022 (1973).
Shepp, L. A. & Logan, B. F. The Fourier reconstruction of a head section. IEEE Trans. Nucl. Sci. 21, 21–43 (1974).
Kang, E., Min, J. & Ye, J. C. A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction. Med. Phys. 44, e360–e375 (2017).
Chen, H. et al. Low-dose CT via convolutional neural network. Biomed. Opt. Express 8, 679–694 (2017).
Shan, H. et al. Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction. Nat. Mach. Intell. 1, 269–276 (2019).
Sodickson, D. K. & Manning, W. J. Simultaneous acquisition of spatial harmonics (SMASH): fast imaging with radiofrequency coil arrays. Magn. Reson. Med. 38, 591–603 (1997).
Pruessmann, K. P., Weiger, M., Scheidegger, M. B. & Boesiger, P. Sense: sensitivity encoding for fast MRI. Magn. Reson. Med. 42, 952–962 (1999).
Griswold, M. A. et al. Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn. Reson. Med. 47, 1202–1210 (2002).
Lustig, M., Donoho, D. & Pauly, J. M. Sparse MRI: the application of compressed sensing for rapid MR imaging. Magn. Reson. Med. 58, 1182–1195 (2007).
Brada, R. et al. Towards motion-robust MRI – autonomous motion timing and correction during MR scanning using multi-coil data and a deep-learning neural network. In Proc. ISMRM Twenty Seventh Annual Meeting (ISMRM, 2019).
Hammernik, K. et al. Learning a variational network for reconstruction of accelerated MRI data. Magn. Reson. Med. 79, 3055–3071 (2018).
Kwon, K., Kim, D. & Park, H. A parallel MR imaging method using multilayer perceptron. Med. Phys. 44, 6209–6224 (2017).
Sun, J., Li, H. & Xu, Z. Deep ADMM-Net for compressive sensing MRI. In Advances in Neural Information Processing Systems 10–18 (NeurIPS, 2016).
Wang, S. et al. Accelerating magnetic resonance imaging via deep learning. In 2016 IEEE 13th Int. Symp. Biomedical Imaging 514–517 (IEEE, 2016).
Defrise, M. et al. Exact and approximate rebinning algorithms for 3-D PET data. IEEE Trans. Med. Imaging 16, 145–158 (1997).
Fink, M. Time reversal of ultrasonic fields. I. Basic principles. IEEE Trans. Ultrason. Ferroelec. Freq. Control 39, 555–566 (1992).
Jin, K. H., McCann, M. T., Froustey, E. & Unser, M. Deep convolutional neural network for inverse problems in imaging. IEEE Trans. Image Process. 26, 4509–4522 (2017).
Lee, D., Yoo, J., Tak, S. & Ye, J. Deep residual learning for accelerated MRI using magnitude and phase networks. IEEE Trans. Biomed. Eng. 65, 1985–1995 (2018).
Gong, K., Catana, C., Qi, J. & Li, Q. PET image reconstruction using deep image prior. IEEE Trans. Med. Imaging 38, 1655–1665 (2018).
Qian, H., Rui, X. & Ahn, S. Deep learning models for PET scatter estimations. In 2017 IEEE Nuclear Science Symp. Medical Imaging Conf. 1–5 (IEEE, 2017).
Rust, M. J., Bates, M. & Zhuang, X. Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy STORM. Nat. Methods 3, 793–796 (2006).
Hess, S. T., Girirajan, T. P. & Mason, M. D. Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. Biophys. J. 91, 4258 (2006).
Betzig, E. et al. Imaging intracellular fluorescent proteins at nanometer resolution. Science 313, 1642–1645 (2006).
Nehme, E., Weiss, L. E., Michaeli, T. & Shechtman, Y. DeepSTORM: super-resolution single-molecule microscopy by deep learning. Optica 5, 458–464 (2018).
Rivenson, Y. et al. Deep learning microscopy. Optica 4, 1437–1443 (2017).
Liu, T. et al. Deep learning-based super-resolution in coherent imaging systems. Sci. Rep. 9, 3926 (2019).
Rivenson, Y., Zhang, Y., Günaydın, H., Teng, D. & Ozcan, A. Phase recovery and holographic image reconstruction using deep learning in neural networks. Light Sci. Appl. 7, 17141 (2018).
Li, S., Deng, M., Lee, J., Sinha, A. & Barbastathis, G. Imaging through glass diffusers using densely connected convolutional networks. Optica 5, 803–813 (2018).
Sun, Y., Xia, Z. & Kamilov, U. S. Efficient and accurate inversion of multiple scattering with deep learning. Opt. Express 26, 14678–14688 (2018).
Lyu, M. et al. Deep-learning-based ghost imaging. Sci. Rep. 7, 17865 (2017).
Rivenson, Y. et al. Deep learning enhanced mobile-phone microscopy. ACS Photon. 5, 2354–2364 (2018).
Xu, M. & Wang, L. V. Photoacoustic imaging in biomedicine. Rev. Sci. Instrum. 77, 041101 (2006).
Zhou, Z. et al. High spatial–temporal resolution reconstruction of plane-wave ultrasound images with a multichannel multiscale convolutional neural network. IEEE Trans. Ultrason. Ferroelec. Freq. Control 65, 1983–1996 (2018).
Antholzer, S., Haltmeier, M. & Schwab, J. Deep learning for photoacoustic tomography from sparse data. Inverse Prob. Sci. Eng. 27, 987–1005 (2019).
Davoudi, N., Deán-Ben, X. L. & Razansky, D. Deep learning optoacoustic tomography with sparse data. Nat. Mach. Intell. 1, 453–460 (2019).
Wolterink, J. M., Leiner, T., Viergever, M. A. & Išgum, I. Generative adversarial networks for noise reduction in low-dose CT. IEEE Trans. Med. Imaging 36, 2536–2545 (2017).
Yang, G. et al. DAGAN: deep de-aliasing generative adversarial networks for fast compressed sensing MRI reconstruction. IEEE Trans. Med. Imaging 37, 1310–1321 (2017).
Bubba, T. A. et al. Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography. Inverse Prob. 35, 064002 (2019).
Kutyniok, G. & Labate, D. Shearlets: Multiscale Analysis for Multivariate Data (Springer, 2012).
Zhang, Y. & Yu, H. Convolutional neural network based metal artifact reduction in X-ray computed tomography. IEEE Trans. Med. Imaging 37, 1370–1381 (2018).
Schlemper, J., Caballero, J., Hajnal, J. V., Price, A. N. & Rueckert, D. A deep cascade of convolutional neural networks for dynamic MR image reconstruction. IEEE Trans. Med. Imaging 37, 491–503 (2018).
Vishnevskiy, V., Walheim, J. & Kozerke, S. Deep variational network for rapid 4D flow MRI reconstruction. Nat. Mach. Intell. 2, 228–235 (2020).
Eo, T. et al. KIKI-net: cross-domain convolutional neural networks for reconstructing undersampled magnetic resonance images. Magn. Reson. Med. 80, 2188–2201 (2018).
Qin, C. et al. Convolutional recurrent neural networks for dynamic mr image reconstruction. IEEE Trans. Med. Imaging 38, 280–290 (2018).
Vishnevskiy, V., Sanabria, S. J. & Goksel, O. Image reconstruction via variational network for real-time hand-held sound-speed imaging. In International Workshop on Machine Learning for Medical Image Reconstruction (eds Knoll, F. et al.) 120–128 (Springer, 2018).
Adler, J. & Öktem, O. Learned primal-dual reconstruction. IEEE Trans. Med. Imaging 37, 1322–1332 (2018).
Gupta, H., Jin, K. H., Nguyen, H. Q., McCann, M. T. & Unser, M. CNN-based projected gradient descent for consistent CT image reconstruction. IEEE Trans. Med. Imaging 37, 1440–1453 (2018).
Chen, H. et al. LEARN: Learned experts’ assessment-based reconstruction network for sparse-data CT. IEEE Trans. Med. Imaging 37, 1333–1347 (2018).
Cheng, L., Ahn, S., Ross, S. G., Qian, H. & De Man, B. Accelerated iterative image reconstruction using a deep learning based leapfrogging strategy. In Int. Conf. Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine 715–720 (Fully 3D, 2017).
Chun, I. Y., Huang, Z., Lim, H. & Fessler, J. Momentum-net: fast and convergent iterative neural network for inverse problems. IEEE Trans. Pattern Anal. Mach. Intell. https://doi.org/10.1109/TPAMI.2020.3012955 (2020).
Aggarwal, H. K., Mani, M. P. & Jacob, M. MoDL: model-based deep learning architecture for inverse problems. IEEE Trans. Med. Imaging 38, 394–405 (2018).
Hauptmann, A. et al. Model-based learning for accelerated, limited-view 3-D photoacoustic tomography. IEEE Trans. Med. Imaging 37, 1382–1393 (2018).
Biswas, S., Aggarwal, H. K. & Jacob, M. Dynamic MRI using model-based deep learning and SToRM priors: MoDL-SToRM. Magn. Res. Med. 82, 485–494 (2019).
Lyu, Q., Shan, H., Xie, Y., Li, D. & Wang, G. Cine cardiac MRI motion artifact reduction using a recurrent neural network. Preprint at https://arxiv.org/abs/2006.12700 (2020).
Gong, K. et al. Iterative PET image reconstruction using convolutional neural network representation. IEEE Trans. Med. Imaging 38, 675–685 (2018).
Wu, D., Kim, K., El Fakhri, G. & Li, Q. Iterative low-dose CT reconstruction with priors trained by artificial neural network. IEEE Trans. Med. Imaging 36, 2479–2486 (2017).
Lim, H., Chun, I. Y., Fessler, J. & Dewaraja, Y. Improved low count quantitative SPECT reconstruction with a trained deep learning based regularizer. J. Nucl. Med. 60, 42 (2019).
Gao, Y. et al. A feasibility study of extracting tissue textures from a previous full-dose CT database as prior knowledge for Bayesian reconstruction of current low-dose CT images. IEEE Trans. Med. Imaging 38, 1981–1992 (2019).
Buzzard, G. T., Chan, S. H., Sreehari, S. & Bouman, C. A. Plug-and-play unplugged: optimization-free reconstruction using consensus equilibrium. SIAM J. Imaging Sci. 11, 2001–2020 (2018).
Liu, J. et al. RARE: Image reconstruction using deep priors learned without ground truth. IEEE J. Selected Topics Signal Process. 14, 1088–1099 (2020).
Wu, Z. et al. SIMBA: Scalable inversion in optical tomography using deep denoising priors. IEEE J. Selected Topics Signal Process. 14, 1163–1175 (2020).
Ulyanov, D., Vedaldi, A. & Lempitsky, V. Deep image prior. In Proc. IEEE Conf. Computer Vision and Pattern Recognition 9446–9454 (IEEE, 2018).
Jin, K. H., Gupta, H., Yerly, J., Stuber, M. & Unser, M. Time-dependent deep image prior for dynamic MRI. Preprint at https://arxiv.org/abs/1910.01684 (2019).
Zhu, B., Liu, J. Z., Cauley, S. F., Rosen, B. R. & Rosen, M. S. Image reconstruction by domain-transform manifold learning. Nature 555, 487–492 (2018).
Ye, D. H., Buzzard, G. T., Ruby, M. & Bouman, C. A. Deep back projection for sparse-view CT reconstruction. In 2018 IEEE Global Conf. Signal and Information Processing (IEEE, 2018).
Li, Y., Li, K., Zhang, C., Montoya, J. & Chen, G.-H. Learning to reconstruct computed tomography images directly from sinogram data under a variety of data acquisition conditions. IEEE Trans. Med. Imaging 38, 2469–2481 (2019).
Fu, L. & De Man, B. A hierarchical approach to deep learning and its application to tomographic reconstruction. In 15th Int. Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine 1107202 (International Society for Optics and Photonics, 2019).
Whiteley, W., Luk, W. K. & Gregor, J. DirectPET: full-size neural network PET reconstruction from sinogram data. J. Med. Imaging 7, 032503 (2020).
Häggström, I., Schmidtlein, C. R., Campanella, G. & Fuchs, T. J. DeepPET: a deep encoder–decoder network for directly solving the PET image reconstruction inverse problem. Med. Image Anal. 54, 253–262 (2019).
Würfl, T. et al. Deep learning computed tomography: learning projection-domain weights from image domain in limited angle problems. IEEE Trans. Med. Imaging 37, 1454–1463 (2018).
Han, Y. & Ye, J. C. One network to solve all ROIs: deep learning CT for any ROI using differentiated backprojection. Med. Phys. 46, e855–e872 (2019).
Han, Y., Kim, J. & Ye, J. C. Differentiated backprojection domain deep learning for conebeam artifact removal. IEEE Trans. Med. Imaging 39, 3571–3582 (2020).
Claus, B. E., Jin, Y., Gjesteby, L. A., Wang, G. & De Man, B. Metal-artifact reduction using deep-learning based sinogram completion: initial results. In Proc. 14th Int. Meeting Fully Three-Dimensional Image Reconstruction Radiology Nuclear Medicine 631–634 (Fully 3D, 2017).
Ghani, M. U. & Karl, W. C. Fast enhanced CT metal artifact reduction using data domain deep learning. IEEE Trans. Comput. Imaging 6, 181–193 (2019).
De Man, Q. et al. A two-dimensional feasibility study of deep learning-based feature detection and characterization directly from CT sinograms. Med. Phys. 46, e790–e800 (2019).
Han, Y., Sunwoo, L. & Ye, J. C. k-space deep learning for accelerated MRI. IEEE Trans. Med. Imaging 39, 377–386 (2019).
Lee, J., Han, Y., Ryu, J.-K., Park, J.-Y. & Ye, J. C. k-space deep learning for reference-free EPI ghost correction. Magn. Reson. Med. 82, 2299–2313 (2019).
Akçakaya, M., Moeller, S., Weingärtner, S. & Uğurbil, K. Scan-specific robust artificial-neural-networks for k-space interpolation (RAKI) reconstruction: database-free deep learning for fast imaging. Magn. Res. Med. 81, 439–453 (2019).
Pramanik, A., Aggarwal, H. & Jacob, M. Deep generalization of structured low-rank algorithms (Deep-SLR). IEEE Trans. Med. Imaging https://doi.org/10.1109/TMI.2020.3014581 (2020).
Luchies, A. C. & Byram, B. C. Deep neural networks for ultrasound beamforming. IEEE Trans. Med. Imaging 37, 2010–2021 (2018).
Gasse, M. et al. High-quality plane wave compounding using convolutional neural networks. IEEE Trans. Ultrason. Ferroelec. Freq. Control 64, 1637–1639 (2017).
Khan, S., Huh, J. & Ye, J. C. Adaptive and compressive beamforming using deep learning for medical ultrasound. IEEE Trans. Ultrason. Ferroelec. Freq. Control 67, 1558–1572 (2020).
Luijten, B. et al. Deep learning for fast adaptive beamforming. In 2019 IEEE Int. Conf. Acoustics, Speech and Signal Processing 1333–1337 (IEEE, 2019).
Yoon, Y. H., Khan, S., Huh, J. & Ye, J. C. Efficient B-mode ultrasound image reconstruction from sub-sampled RF data using deep learning. IEEE Trans. Med. Imaging 38, 325–336 (2018).
Kang, E., Koo, H. J., Yang, D. H., Seo, J. B. & Ye, J. C. Cycle-consistent adversarial denoising network for multiphase coronary CT angiography. Med. Phys. 46, 550–562 (2019).
Zhu, J.-Y., Park, T., Isola, P. & Efros, A. A. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proc. IEEE Int. Conf. Computer Vision 2223–2232 (IEEE, 2017).
Nguyen, T., Xue, Y., Li, Y., Tian, L. & Nehmetallah, G. Deep learning approach for Fourier ptychography microscopy. Opt. Express 26, 26470–26484 (2018).
Lee, S., Han, S., Salama, P., Dunn, K. W. & Delp, E. J. Three dimensional blind image deconvolution for fluorescence microscopy using generative adversarial networks. In 2019 IEEE 16th Int. Symp. Biomedical Imaging 538–542 (IEEE, 2019).
Villani, C. Optimal Transport: Old and New Vol. 338 (Springer, 2008).
Lim, S., Lee, S.-E., Chang, S. & Ye, J. C. CycleGAN with a blur kernel for deconvolution microscopy: Optimal transport geometry. IEEE Trans. Comput. Imaging 6, 1127–1138 (2020).
Li, M., Shan, H., Pryshchep, S., Lopez, M. M. & Wang, G. Deep adversarial network for super stimulated emission depletion imaging. J. Nanophoton. 14, 016009 (2020).
Liu, F., Jang, H., Kijowski, R., Bradshaw, T. & McMillan, A. B. Deep learning MR imaging–based attenuation correction for PET/MR imaging. Radiology 286, 676–684 (2018).
Hwang, D. et al. Improving the accuracy of simultaneously reconstructed activity and attenuation maps using deep learning. J. Nucl. Med. 59, 1624–1629 (2018).
Dar, S. U. et al. Image synthesis in multi-contrast MRI with conditional generative adversarial networks. IEEE Trans. Med. Imaging 38, 2375–2388 (2019).
Lee, D., Moon, W.-J. & Ye, J. C. Assessing the importance of magnetic resonance contrasts using collaborative generative adversarial networks. Nat. Mach. Intell. 2, 34–42 (2020).
Lehtinen, J. et al. Noise2Noise: learning image restoration without clean data. In Int. Conf. Machine Learning 2965–2974 (PMLR, 2018).
Yaman, B. et al. Self-supervised physics-based deep learning MRI reconstruction without fully-sampled data. In 2020 IEEE 17th Int. Symp. Biomedical Imaging 921–925 (IEEE, 2020).
Wu, D., Ren, H. & Li, Q. Self-supervised dynamic CT perfusion image denoising with deep neural networks. IEEE Trans. Radiation Plasma Med. Sci. https://doi.org/10.1109/TRPMS.2020.2996566 (2020).
Wu, D., Gong, K., Kim, K., Li, X. & Li, Q. Consensus neural network for medical imaging denoising with only noisy training samples. In Int. Conf. Medical Image Computing and Computer-Assisted Intervention 741–749 (Springer, 2019).
Donoho, D. L. Compressed sensing. IEEE Trans. Inform. Theory 52, 1289–1306 (2006).
Ye, J. C., Han, Y. & Cha, E. Deep convolutional framelets: a general deep learning framework for inverse problems. SIAM J. Imaging Sci. 11, 991–1048 (2018).
Ye, J. C. & Sung, W. K. Understanding geometry of encoder-decoder CNNs. In Proc. 36th Int. Conf. Machine Learning Vol. 97 (eds Chaudhuri, K. & Salakhutdinov, R.) 7064–7073 (PMLR, 2019).
NIH Image Database (NIH, 2020); https://www.nihlibrary.nih.gov/resources/subject-guides/web-search-thinking-beyond-google/images
McCollough, C. H. et al. Low-dose CT for the detection and classification of metastatic liver lesions: results of the 2016 low dose CT grand challenge. Med. Phys. 44, e339–e352 (2017).
Gaillard, F. & Murphy, A. Imaging data sets (artificial intelligence). Radiopaedia https://radiopaedia.org/articles/imaging-data-sets-artificial-intelligence?lang=us (2020).
Xu, X. G., Taranenko, V., Zhang, J. & Shi, C. A boundary-representation method for designing whole-body radiation dosimetry models: pregnant females at the ends of three gestational periods—RPI-P3, -P6 and -P9. Phys. Med. Biol. 52, 7023 (2007).
Segars, W. P., Sturgeon, G., Mendonca, S., Grimes, J. & Tsui, B. M. 4D XCAT phantom for multimodality imaging research. Med. Phys. 37, 4902–4915 (2010).
Krishna, A. & Mueller, K. Medical CT image generation with style. In 15th Int. Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine 1107234 (International Society for Optics and Photonics, 2019).
De Man, B. et al. CatSim: a new computer assisted tomography simulation environment. In Medical Imaging 2007: Physics of Medical Imaging Vol. 6510 65102G (International Society for Optics and Photonics, 2007).
Jia, X., Yan, H., Cerviño, L., Folkerts, M. & Jiang, S. B. A GPU tool for efficient, accurate, and realistic simulation of cone beam CT projections. Med. Phys. 39, 7368–7378 (2012).
Abadi, E. et al. DukeSim: a realistic, rapid, and scanner-specific simulation framework in computed tomography. IEEE Trans. Med. Imaging 38, 1457–1465 (2018).
De Man, B. et al. XCIST (X-ray-based Cancer Imaging Simulation Toolkit): a new open-source project (ITCR grant). In Institute for Mathematics and its Applications Workshop on Computational Imaging (IMA, 2019).
Sharma, D. et al. In silico imaging tools from the VICTRE clinical trial. Med. Phys. 46, 3924–3928 (2019).
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C. & Wermter, S. Continual lifelong learning with neural networks: a review. Neural Netw. 113, 54–71 (2019).
Konečný, J. et al. Federated learning: Strategies for improving communication efficiency. Preprint at https://arxiv.org/abs/1610.05492 (2016).
McMahan, H. B. et al. Communication-efficient learning of deep networks from decentralized data. Preprint at https://arxiv.org/abs/1602.05629 (2016).
Krull, A., Buchholz, T.-O. & Jug, F. Noise2Void-learning denoising from single noisy images. In Proc. IEEE Conf. Computer Vision and Pattern Recognition 2129–2137 (IEEE, 2019.
Liao, H., Lin, W.-A., Zhou, S. K. & Luo, J. ADN: artifact disentanglement network for unsupervised metal artifact reduction. IEEE Trans. Med. Imaging 39, 634–643 (2019).
Locatello, F. et al. Challenging common assumptions in the unsupervised learning of disentangled representations. In Int. Conf. Machine Learning 4114–4124 (PMLR, 2019).
Gjesteby, L., Xi, Y., Kalra, M. K., Yang, Q. & Wang, G. Hybrid imaging system for simultaneous spiral MR and X-ray (MRX) scans. IEEE Access 5, 1050–1061 (2016).
Dineley, J. Tackling the silent crisis in cancer care. Lindau Nobel Laureate Meetings https://www.lindau-nobel.org/blog-tackling-the-silent-crisis-in-cancer-care-with-innovation/ (2018).
Antun, V., Renna, F., Poon, C., Adcock, B. & Hansen, A. C. On instabilities of deep learning in image reconstruction and the potential costs of AI. Proc. Natl Acad. Sci. USA https://doi.org/10.1073/pnas.1907377117 (2020).
Ozdag, M. Adversarial attacks and defenses against deep neural networks: a survey. Procedia Comp. Sci. 140, 152–161 (2018).
Wu, W. et al. Stabilizing deep tomographic reconstruction networks. Preprint at https://arxiv.org/abs/2008.01846 (2020).
Park, S. H. & Han, K. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286, 800–809 (2018).
Arrieta, A. B. et al. Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inform. Fusion 58, 82–115 (2020).
Fan, F., Xiong, J. & Wang, G. On interpretability of artificial neural networks. Preprint at https://arxiv.org/abs/2001.02522 (2020).
Geis, J. R. et al. Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement. Radiology 293, 436–440 (2019).
Awad, E. et al. The Moral Machine experiment. Nature 563, 59–64 (2018).
Wang, G., Zhang, Y., Ye, X. & Mou, X. Machine Learning for Tomographic Imaging (IOP, 2019).
Poirot, M. G. et al. Physics-informed deep learning for dual-energy computed tomography image processing. Sci. Rep. 9, 17709 (2019).
Kang, E., Chang, W., Yoo, J. & Ye, J. C. Deep convolutional framelet denosing for low-dose CT via wavelet residual network. IEEE Trans. Med. Imaging 37, 1358–1369 (2018).
Ouyang, J., Chen, K. T., Gong, E., Pauly, J., Zaharchuk, G. & Ultra-low-dose, P. E. T. reconstruction using generative adversarial network with feature matching and task-specific perceptual loss. Med. Phys. 46, 3555–3564 (2019).
Chen, K. T. et al. Ultra-low-dose 18F-florbetaben amyloid PET imaging using deep learning with multi-contrast MRI inputs. Radiology 290, 649–656 (2019).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, G., Ye, J.C. & De Man, B. Deep learning for tomographic image reconstruction. Nat Mach Intell 2, 737–748 (2020). https://doi.org/10.1038/s42256-020-00273-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s42256-020-00273-z
This article is cited by
-
Transforming traffic accident investigations: a virtual-real-fusion framework for intelligent 3D traffic accident reconstruction
Complex & Intelligent Systems (2025)
-
Noise suppression in photon-counting computed tomography using unsupervised Poisson flow generative models
Visual Computing for Industry, Biomedicine, and Art (2024)
-
The digitalization of emergency department triage: the perspectives of health professionals and patients
BMC Health Services Research (2024)
-
Real space iterative reconstruction for vector tomography (RESIRE-V)
Scientific Reports (2024)
-
Obtaining parallax-free X-ray powder diffraction computed tomography data with a self-supervised neural network
npj Computational Materials (2024)