Abstract
Purpose
Accurate lung cancer diagnosis is crucial to select the best course of action for treating the patient. From a simple chest CT volume, it is necessary to identify whether the cancer has spread to nearby lymph nodes or not. It is equally important to know precisely where each malignant lymph node is with respect to the surrounding anatomical structures and the airways. In this paper, we introduce a new data-set containing annotations of fifteen different anatomical structures in the mediastinal area, including lymph nodes of varying sizes. We present a 2D pipeline for semantic segmentation and instance detection of anatomical structures and potentially malignant lymph nodes in the mediastinal area.
Methods
We propose a 2D pipeline combining the strengths of U-Net for pixel-wise segmentation using a loss function dealing with data imbalance and Mask R-CNN providing instance detection and improved pixel-wise segmentation within bounding boxes. A final stage performs pixel-wise labels refinement and 3D instance detection using a tracking approach along the slicing dimension. Detected instances are represented by a 3D pixel-wise mask, bounding volume, and centroid position.
Results
We validated our approach following a fivefold cross-validation over our new data-set of fifteen lung cancer patients. For the semantic segmentation task, we reach an average Dice score of 76% over all fifteen anatomical structures. For the lymph node instance detection task, we reach 75% recall for 9 false positives per patient, with an average centroid position estimation error of 3 mm in each dimension.
Conclusion
Fusing 2D networks’ results increases pixel-wise segmentation results while enabling good instance detection. Better leveraging of the 3D information and station mapping for the detected lymph nodes are the next steps.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Falk S, Williams C (2010) Lung cancer-the facts, 3rd edn, chap 1. Oxford University Press, pp 3–4. ISBN 978-0-19-956933-5
Schwartz L, Bogaerts J, Ford R, Shankar L, Therasse P, Gwyther S, Eisenhauer EA (2009) Evaluation of lymph nodes with RECIST 1.1. Eur J Cancer 45(2):261–267
El-Sherief AH, Lau CT, Wu CC, Drake RL, Abbott GF, Rice TW (2014) International association for the study of lung cancer (IASLC) lymph node map: radiologic review with CT illustration. Radiographics 34(6):1680–1691
Sorger H, Hofstad EF, Amundsen T, Lang T, Bakeng JBL, Leira HO (2017) A multimodal image guiding system for navigated ultrasound bronchoscopy (EBUS): a human feasibility study. PLoS ONE 12(2):e0171841
Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5 D representation for lymph node detection using random sets of deep convolutional neural network observations. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 520–527
Liu J, Zhao J, Hoffman J, Yao J, Zhang W, Turkbey EB, Wang S, Kim C, Summers RM (2014) Mediastinal lymph node detection on thoracic CT scans using spatial prior from multi-atlas label fusion. In: Medical imaging 2014: computer-aided diagnosis. International society for optics and photonics, vol 9035, p 90350M
Liu J, Hoffman J, Zhao J, Yao J, Lu L, Kim L, Turkbey EB, Summers RM (2016) Mediastinal lymph node detection and station mapping on chest CT using spatial priors and random forest. Med Phys 43(7):4362–4374
Nogues I, Lu L, Wang X, Roth H, Bertasius G, Lay N, Shi J, Tsehay Y, Summers RM (2016) Automatic lymph node cluster segmentation using holistically-nested neural networks and structured optimization in CT images. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 388–397
Oda H, Bhatia KK, Oda M, Kitasaka T, Iwano S, Homma H, Takabatake H, Mori M, Natori H, Schnabel J A, Mori K (2017) Hessian-assisted supervoxel: structure-oriented voxel clustering and application to mediastinal lymph node detection from CT volumes. In: Medical imaging 2017: computer-aided diagnosis. International society for optics and photonics, vol 10134, p 101341D
Oda H, Roth HR, Bhatia KK, Oda M, Kitasaka T, Iwano S, Homma H, Takabatake H, Mori M, Natori H, Schnabel J A, Mori K (2018) Dense volumetric detection and segmentation of mediastinal lymph nodes in chest CT images. In: Medical imaging 2018: computer-aided diagnosis . International society for optics and photonics, vol 10575, p 1057502
Reynisson PJ, Scali M, Smistad E, Hofstad EF, Leira HO, Lindseth F, Hernas TAN, Amundsen T, Sorger H, Lang T (2015) Airway segmentation and centerline extraction from thoracic CT comparison of a new method to state of the art commercialized methods. PLoS ONE 10(12):e0144282
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241
He K, Gkioxari G, Dollr P, Girshick R (2017) Mask r-cnn. In: 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770-778
Funding
This work has received funding from the Center for Innovative Ultrasound Solutions, a Norwegian Research Council appointed center for research-based innovation (SFI), Project Grant 237887.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Bouget, D., Jørgensen, A., Kiss, G. et al. Semantic segmentation and detection of mediastinal lymph nodes and anatomical structures in CT data for lung cancer staging. Int J CARS 14, 977–986 (2019). https://doi.org/10.1007/s11548-019-01948-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-019-01948-8