Abstract
Generating dual-energy subtraction (DES) soft-tissue images from chest radiographs (also called bone suppression) is an important task, as it improves the detection rates for lung nodules. Previous studies focus on generating DES-like soft-tissue images from CXRs through machine/deep learning techniques. However, they usually require tedious image processing steps for bone segmentation/delineation or ignore anatomical structure information (e.g., edges of ribs and clavicles) in CXRs. In this work, we propose a bone Edge-guided Generative Adversarial Network (EGAN) to generate DES-like soft-tissue images from conventional CXRs, which does not require human intervention and can explicitly use anatomical structure information of bones in CXRs. Specifically, the edges of ribs and clavicles in an input CXR were first detected by a trained fully convolutional network. Then, the edge probability map, as well as the original CXR image, are fed into a GAN model to generate the DES-like soft-tissue image, where the detected edge information is used as the prior knowledge to directly and specifically guide the image generation process. Experimental results on 504 subjects (each equipped with a CXR, a DES bone image, and a DES soft-tissue image) demonstrate that EGAN can produce DES-like soft-tissue images with high-quality and high-resolution, compared with classic deep learning methods. We further apply the trained EGAN to CXRs acquired by different types of X-ray machines in the public JSRT and NIH ChestXray 14 datasets, and our method can also produce visually appealing DES-like soft-tissue images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Horváth, Á., Orbán, G.G., Horváth, Á., Horváth, G.: An X-ray CAD system with ribcage suppression for improved detection of lung lesions. Periodica Polytechnica Electr. Eng. 57(1), 19 (2013)
von Berg, J., et al.: A novel bone suppression method that improves lung nodule detection. Int. J. Comput. Assist. Radiol. Surg. 11(4), 641–655 (2015). https://doi.org/10.1007/s11548-015-1278-y
Baltruschat, I.M., et al.: When does bone suppression and lung field segmentation improve chest X-ray disease classification? ISB I, 1362–1366 (2019)
Zarshenas, A., Liu, J., Forti, P., Suzuki, K.: Separation of bones from soft tissue in chest radiographs: anatomy-specific orientation-frequency-specific deep neural network convolution. Med. Phys. 46(5), 2232–2242 (2019)
Hogeweg, L., Sánchez, C.I., van Ginneken, B.: Suppression of translucent elongated structures: applications in chest radiography. IEEE Trans. Med. Imaging 32(11), 2099–2113 (2013)
Lee, J.S., Wang, J.W., Wu, H.H., Yuan, M.Z.: A nonparametric-based rib suppression method for chest radiographs. Comput. Math. Appl. 64(5), 1390–1399 (2012)
Rasheed, T., Ahmed, B., Khan, M.A., Bettayeb, M., Lee, S., Kim, T.S.: RiB suppression in frontal chest radiographs: a blind source separation approach. In: International Symposium on Signal Processing and its Applications, pp. 1–4 (2007)
Loog, M., van Ginneken, B., Schilham, A.M.: Filter learning: application to suppression of bony structures from chest radiographs. Med. Image Anal. 10(6), 826–840 (2006)
Chen, S., Suzuki, K.: Separation of bones from chest radiographs by means of anatomically specific multiple massive-training ANNs combined with total variation minimization smoothing. IEEE Trans. Med. Imaging 33(2), 246–257 (2013)
Yang, W., et al.: Cascade of multi-scale convolutional neural networks for bone suppression of chest radiographs in gradient domain. Med. Image Anal. 35, 421–433 (2017)
Zhou, B., Lin, X., Eck, B., Hou, J., Wilson, D.: Generation of virtual dual energy images from standard single-shot radiographs using multi-scale and conditional adversarial network. In: ACCV, pp. 298–313 (2018)
Oh, D.Y., Yun, I.D.: Learning bone suppression from dual energy chest X-rays using adversarial networks. arXiv preprint arXiv:1811.02628 (2018)
Eslami, M., Tabarestani, S., Albarqouni, S., Adeli, E., Navab, N., Adjouadi, M.: Image-to-images translation for multi-task organ segmentation and bone suppression in chest X-ray radiography. arXiv preprint arXiv:1906.10089 (2019)
Agrawal, A., Raskar, R., Chellappa, R.: Edge suppression by gradient field transformation using cross-projection tensors. In: CVPR, pp. 2301–2308 (2006)
Jégou, S., Drozdzal, M., Vazquez, D., Romero, A., Bengio, Y.: The one hundred layers tiramisu: fully convolutional DenseNets for semantic segmentation. In: CVPR Workshops, pp. 11–19 (2017)
Pan, Y., Liu, M., Lian, C., Zhou, T., Xia, Y., Shen, D.: Synthesizing missing PET from MRI with cycle-consistent generative adversarial networks for Alzheimer’s disease diagnosis. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. Synthesizing missing PET from MRI with cycle-consistent generative adversarial networks for Alzheimer’s disease diagnosis, vol. 11072, pp. 455–463. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00931-1_52
He, K., Zhang, X., Ren, S., Sun, J.: Identity mappings in deep residual networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 630–645. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_38
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: CVPR, pp. 1125–1134 (2017)
Shiraishi, J., et al.: Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules. Am. J. Roentgenol. 174(1), 71–74 (2000)
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.: ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: CVPR, pp. 3462–3471 (2017)
Acknowledgements
Y. Liu, Y. Xi and W. Yang were partially supported by the National Natural Science Foundation of China (No. 81771916) and the Guangdong Provincial Key Laboratory of Medical Image Processing (No. 2014B-030301042). A part of this work was finished when Y. Liu was visiting the University of North Carolina at Chapel Hill.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, Y., Liu, M., Xi, Y., Qin, G., Shen, D., Yang, W. (2020). Generating Dual-Energy Subtraction Soft-Tissue Images from Chest Radiographs via Bone Edge-Guided GAN. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12262. Springer, Cham. https://doi.org/10.1007/978-3-030-59713-9_65
Download citation
DOI: https://doi.org/10.1007/978-3-030-59713-9_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59712-2
Online ISBN: 978-3-030-59713-9
eBook Packages: Computer ScienceComputer Science (R0)
