Guangrui Liang
ABSTRACT
In recent years, with the development of computer science and technology, computer aided diagnosis (CAD) systems have played important role in clinical practice. Using deep learning technology, existing CAD systems can predict whether CT images contain lung nodule automatically. However, for the precise segmentation of lung nodule and nodule boundary, further diagnosis by doctors is required. The current widely used segmentation networks still have segmentation uncertainty in the lung nodules boundary, which will interfere the accuracy of segmentation results. To solve this problem, this paper propose a UAA-UNet (Uncertainty Analysis Based Attention UNet) based on the uncertainty analysis of edge regions. The network structure is divided into two stages. In the first stage, the initial segmentation map of the lung nodule is obtained, and the second stage focuses on the uncertainty region of the initial segmentation map. By learning the features of the uncertainty region, the uncertainty is reduced and the segmentation accuracy is improved. The second stage includes two modules, the uncertainty attention module and the uncertainty elimination module. In uncertainty attention module, the entropy map of the initial segmentation map of the lung nodule is input into the network as attention information to improve the network's ability to understand uncertainty. In uncertainty elimination module, by using EWCE (entropy map weighted cross entropy loss function), the entropy map of the prediction result is fed back to the network as a weight factor to further improve the network's learning ability of the uncertain region. We selected lung nodule slices from 1012 patients in the Lung Image Database Consortium (LIDC) to validate the feasibility and effectiveness of the proposed method. The experiment result shows that, in the lung nodule segmentation task, by leveraging uncertainty analysis, the network achieves significant improvements over the baseline network.
- Center M, Siegel R, Jemal A. Global cancer facts & figures. Atlanta: American Cancer Society, 2011, 3: 1-52.Google Scholar
- Wanqing Chen PhD, MD, Rongshou Zheng MPH, Peter D. Baade PhD, Siwei Zhang BMedSc, Hongmei Zeng PhD, MD, Freddie Bray PhD, Ahmedin Jemal DVM, PhD, Xue Qin Yu PhD, MPH, Jie He MD. Cancer statistics in China, 2015. CA: a cancer journal for clinicians, 2016, 66(2): 115-132.Google Scholar
- David R.Baldwin. Prediction of risk of lung cancer in populations and in pulmonary nodules: significant progress to drive changes in paradigms. Lung Cancer, 2015, 89(1): 1-3.Google ScholarCross Ref
- Gabriel I. Barbash, M.D., M.P.H., and Sherry A. Glied, Ph.D. New technology and health care costs–the case of robot-assisted surgery. The New England journal of medicine, 2010, 363(8): 701.Google Scholar
- Joao Rodrigo Ferreirada Silva Sousa, Aristofanes Correa Silva, Anselmo Cardosode Paiva, Rodolfo Acatauassu Nunes. Methodology for automatic detection of lung nodules in computerized tomography images. Computer methods and programs in biomedicine, 2010, 98(1): 1-14.Google Scholar
- Shanhui Sun, Christian Bauer, Reinhard Beichel. Automated 3-D segmentation of lungs with lung cancer in CT data using a novel robust active shape model approach. IEEE transactions on medical imaging, 2011, 31(2): 449-460.Google Scholar
- Jinsa Kuruvilla, K.Gunavathi. "Lung cancer classification using neural networks for CT images." Computer methods and programs in biomedicine 113.1 (2014): 202-209.Google Scholar
- Messay, T., Hardie, R. C., & Tuinstra, T. R. (2015). Segmentation of pulmonary nodules in computed tomography using a regression neural network approach and its application to the lung image database consortium and image database resource initiative dataset. Medical image analysis, 22(1), 48-62.Google Scholar
- Mohsen Keshani, Zohreh Azimifar, Farshad Tajeripour, Reza Boostani. Lung nodule segmentation and recognition using SVM classifier and active contour modeling: A complete intelligent system. Computers in biology and medicine, 2013, 43(4): 287-300.Google Scholar
- Shelhamer Evan, Long Jonathan, Darrell Trevor. Fully convolutional networks for semantic segmentation. IEEE transactions on pattern analysis and machine intelligence, 2016, 39(4): 640-651.Google Scholar
- LiangChieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, Alan L. Yuille. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE transactions on pattern analysis and machine intelligence, 2017, 40(4): 834-848.Google Scholar
- Shuo Wang, Mu Zhou, Zaiyi Liu, Zhenyu Liu, Dongsheng Gu, Yali Zang, Di Dong, Olivier Gevaert, Jie Tian. Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation. Medical image analysis, 2017, 40: 172-183.Google Scholar
- Sihang Chen, Yifan Wang. Pulmonary nodule segmentation in computed tomography with an encoder-decoder architecture. In 2019 10th International Conference on Information Technology in Medicine and Education (ITME) (pp. 157-162). IEEE.Google Scholar
- M Liu, J Dong, X Dong, H Yu, L Qi. Segmentation of lung nodule in CT images based on mask R-CNN//2018 9th International Conference on Awareness Science and Technology (iCAST). IEEE, 2018: 1-6.Google Scholar
- [online] Available:https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDRI.Google Scholar
- Rafael Wiemker, Martin Bergtholdt, Ekta Dharaiya, Sven Kabus, Michael C. Lee. Agreement of CAD features with expert observer ratings for characterization of pulmonary nodules in CT using the LIDC-IDRI database//Medical Imaging 2009: Computer-Aided Diagnosis. International Society for Optics and Photonics, 2009, 7260: 72600H.Google Scholar
- Wook-Jin Choi, Tae-Sun Choi. Automated pulmonary nodule detection system in computed tomography images: A hierarchical block classification approach. Entropy, 2013, 15(2): 507-523.Google ScholarCross Ref
- Qiang Li,Shusuke Sone,Kunio Doi. Selective enhancement filters for nodules, vessels, and airway walls in two‐and three‐dimensional CT scans. Medical physics, 2003, 30(8): 2040-2051.Google Scholar
- Tomokazu Oda, Mitsuru Kubo, Yoshiki Kawata, Noboru Niki, Kenji Eguchi, Hironobu Ohmatsu, Ryutaro Kakinuma, Masahiro Kaneko, Masahiko Kusumoto, Noriyuki Moriyama, Kiyoshi Mori, Hiroyuki Nishiyama. Detection algorithm of lung cancer candidate nodules on multislice CT images//Medical Imaging 2002: Image Processing. International Society for Optics and Photonics, 2002, 4684: 1354-1361.Google Scholar
- Ezhil E.Nithila, S.S.Kumar. Automatic detection of solitary pulmonary nodules using swarm intelligence optimized neural networks on CT images. Engineering science and technology, an international journal, 2017, 20(3): 1192-1202.Google Scholar
- O Ronneberger, P Fischer, T Brox. (2015, October). U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234-241). Springer, Cham.Google ScholarCross Ref
- O Oktay, J Schlemper, L L Folgoc, M Lee, M Heinrich, K Misawa, K Mori, S McDonagh, N Y Hammerla, B Kainz, B Glocker, D Rueckert. (2018). Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999.Google Scholar
- Xiao Xiao, Shen Lian, Zhiming Luo, Shaozi Li. Weighted res-unet for high-quality retina vessel segmentation//2018 9th international conference on information technology in medicine and education (ITME). IEEE, 2018: 327-331.Google Scholar
- Md Zahangir Alom, Mahmudul Hasan, Chris Yakopcic, Tarek M. Taha, Vijayan K. Asari. Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv preprint arXiv:1802.06955, 2018.Google Scholar
- Sijing Cai, Yunxian Tian, Harvey Lui, Haishan Zeng, Yi Wu, Guannan Chen. Dense-UNet: a novel multiphoton in vivo cellular image segmentation model based on a convolutional neural network. Quantitative imaging in medicine and surgery, 2020, 10(6): 1275.Google Scholar
Index Terms
- Uncertainty Analysis Based Attention Network for Lung Nodule Segmentation from CT Images
Recommendations
Deep neural network pulmonary nodule segmentation methods for CT images: Literature review and experimental comparisons
AbstractAutomatic and accurate segmentation of pulmonary nodules in CT images can help physicians perform more accurate quantitative analysis, diagnose diseases, and improve patient survival. In recent years, with the development of deep learning ...
Highlights- Categorizes current lung nodule segmentation issues and summarizes solutions.
- Evaluated segmentation model performance in different datasets.
- Comprehensive assessment of the characteristics attributes of pulmonary nodules.
- Open ...
Deep Learning-Based Lung Nodule Segmentation and 3D Reconstruction Algorithm for CT Images
Artificial Intelligence Security and PrivacyAbstractIn recent years, deep learning techniques have been widely applied in the field of medical image processing, particularly in the segmentation of pulmonary nodules, which has garnered increasing attention from researchers. The segmentation of ...
An Automated Lung Nodule Segmentation Method Based On Nodule Detection Network and Region Growing
MMAsia '19: Proceedings of the 1st ACM International Conference on Multimedia in AsiaSegmentation of a specific organ or tissue plays an important role in medical image analysis with the rapid development of clinical decision support systems. With medical imaging equipments, segmenting the lung nodules in the images is able to help ...
Comments