Skip to main content

Advertisement

Log in

An improved supervoxel 3D region growing method based on PET/CT multimodal data for segmentation and reconstruction of GGNs

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Among the various types of lung nodules, ground glass nodules (GGNs) are difficult to segment accurately due to complex morphological characteristics. Moreover, GGNs are associated with a higher malignancy probability. Three-dimensional (3D) segmentation and reconstruction techniques can help physicians intuitively elucidate the relationship between lung nodules and their surrounding tissues. We propose an improved supervoxel 3D region growing approach based on positron emission tomography/computed tomography (PET/CT) multimodal data for the segmentation and reconstruction of GGNs. First, the seed point is automatically located with PET information and a 3D mask is generated. Then, a fuzzy connectivity (FC) map is generated based on the 3D mask, and an improved supervoxel 3D region growing is utilized on a fuzzy connectivity map under the constraints of the 3D mask. Finally, 3D GGNs segmentation and reconstruction results are obtained. Qualitative and quantitative comparisons between our proposed method and other region growing methods shows great superiority of our proposed method, with the Jaccard similarity coefficient between our proposed method and physician manual segmentation reaching 95.61%; the average processing time is 16.38 s. Experimental results show that our proposed supervoxel-based 3D region growing method is very promising for assisting physicians in diagnosis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282

    Google Scholar 

  2. Al-Ayyoub M, AlZu’bi S, Jararweh Y, Shehab M, Gupta B (2018) Accelerating 3D medical volume segmentation using GPUs. Multimed Tools Appl 77(4):4939–4958

    Google Scholar 

  3. AlZu’bi S, Jararweh Y, Al-Zoubi H, Elbes M, Kanan T, Gupta B (2018) Multi-orientation geometric medical volumes segmentation using 3d multiresolution analysis. Multimed Tools Appl:1–26

  4. Aokage K et al (2017) Limited resection for early-stage non-small cell lung cancer as function-preserving radical surgery: a review. Jpn J Clin Oncol 47(1):7–11

    Google Scholar 

  5. Badura P, Pietka E (2014) Soft computing approach to 3D lung nodule segmentation in CT. Comput Biol Med 53:230–243

    Google Scholar 

  6. Bellotti R et al (2007) A CAD system for nodule detection in low-dose lung CTs based on region growing and a new active contour model. Med Phys 34(12):4901–4910

    Google Scholar 

  7. Cascio D, Magro R, Fauci F, Iacomi M, Raso G (2012) Automatic detection of lung nodules in CT datasets based on stable 3D mass–spring models. Comput Biol Med 42(11):1098–1109

    Google Scholar 

  8. Chang H, Zhuang A, Valentino D, Chu W (2009) Performance measure characterization for evaluating neuroimage segmentation algorithms. Neuroimage 47(1):122–135

    Google Scholar 

  9. Charbonnier J et al (2018) Automatic segmentation of the solid core and enclosed vessels in subsolid pulmonary nodules. Sci Rep 8(1):646

    Google Scholar 

  10. Conze P, Noblet V, Rousseau F, Heitz F, De Blasi V, Memeo R, Pessaux P (2017) Scale-adaptive supervoxel-based random forests for liver tumor segmentation in dynamic contrast-enhanced CT scans. Int J Comput Assist Radiol Surg 12(2):223–233

    Google Scholar 

  11. Cui Q, Qiang Z, Zhao J, Qiang Y, Liao X (2017) A 3D Segmentation Method for Pulmonary Nodule Image Sequences based on Supervoxels and Multimodal Data. International Journal of Performability Engineering 13(5):682

    Google Scholar 

  12. del Fresno M, Vénere M, Clausse A (2009) A combined region growing and deformable model method for extraction of closed surfaces in 3D CT and MRI scans. Comput Med Imaging Graph 33(5):369–376

    Google Scholar 

  13. Diciotti S, Picozzi G, Falchini M, Mascalchi M, Villari N, Valli G (2008) 3-D segmentation algorithm of small lung nodules in spiral CT images. IEEE Trans Inf Technol Biomed 12(1):7–19

    Google Scholar 

  14. Fabbri R, Costa L, Torelli J, Bruno O (2008) 2D Euclidean distance transform algorithms: A comparative survey. ACM Computing Surveys (CSUR) 40(1):2

    Google Scholar 

  15. Feng Y, Hao P, Zhang P, Liu X, Wu F, Wang H (2019) Supervoxel based weakly-supervised multi-level 3D CNNs for lung nodule detection and segmentation. Journal of Ambient Intelligence and Humanized Computing:1–11

  16. Fu G, Lu H, Tan J, Kim H, Zhu X, Lu J (2018) Segmentation of Spinal Canal Region in CT Images using 3D Region Growing Technique. In 2018 International Conference on Information and Communication Technology Robotics (ICT-ROBOT) (pp. 1-4). IEEE.

  17. Gonzalez R et al (2002) Digital Image Processing, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 2002:125-134;534-536

  18. Hansell D et al (2008) Fleischner Society: glossary of terms for thoracic imaging. Radiology 246(3):697–722

    Google Scholar 

  19. Harati V, Khayati R, Farzan A (2011) Fully automated tumor segmentation based on improved fuzzy connectedness algorithm in brain MR images. Comput Biol Med 41(7):483–492

    Google Scholar 

  20. Huang S, Liu X, Han G, Zhao X, Zhao Y, Zhou C (2018) 3D GGO candidate extraction in lung CT images using multilevel thresholding on supervoxels. In Medical Imaging 2018: Computer-Aided Diagnosis (Vol. 10575, p. 1057533). International Society for Optics and Photonics.

  21. Hüllebrand M, Hennemuth A, Messroghli D, Kühne T, Friman O (2011) Semi-automatic 4D fuzzy connectedness segmentation of heart ventricles in cine MRI. In Bildverarbeitung für die Medizin 2011 (pp. 3-7). Springer, Berlin, Heidelberg.

    Google Scholar 

  22. Hussein S et al (2016) Automatic segmentation and quantification of white and brown adipose tissues from PET/CT scans. IEEE Trans Med Imaging 36(3):734–744

    Google Scholar 

  23. Irving B, Cifor A, Papież B, Franklin J, Anderson E, Brady M, Schnabel J (2014) Automated colorectal tumour segmentation in DCE-MRI using supervoxel neighbourhood contrast characteristics. In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 609-616). Springer, Cham.

    Google Scholar 

  24. Jacobs C et al (2015) Solid, part-solid, or non-solid?: classification of pulmonary nodules in low-dose chest computed tomography by a computer-aided diagnosis system. Investig Radiol 50(3):168–173

    Google Scholar 

  25. Jiang Y (2017) Research on Supervoxel Based Region Growing Segmentation for Point Cloud Data. Xidian University, Xi’an

    Google Scholar 

  26. Jung J, Hong H, Goo J (2018) Ground-glass nodule segmentation in chest CT images using asymmetric multi-phase deformable model and pulmonary vessel removal. Comput Biol Med 92:128–138

    Google Scholar 

  27. Kadkhodaei M et al (2016) Automatic segmentation of multimodal brain tumor images based on classification of super-voxels. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 5945-5948). IEEE.

  28. Kim Y, Lee S, Park C, Kim K (2016) Evaluation of semi-automatic segmentation methods for persistent ground glass nodules on thin-section CT scans. Healthcare Informatics Research 22(4):305–315

    Google Scholar 

  29. Li Q, Li F, Doi K (2008) Computerized detection of lung nodules in thin-section CT images by use of selective enhancement filters and an automated rule-based classifier. Acad Radiol 15(2):165–175

    Google Scholar 

  30. Li S, Liu X, Yang A, Pang K, Zhou C, Zhao X, Zhao Y (2013) A novel approach of computer-aided detection of focal ground-glass opacity in 2D lung CT images. In Medical Imaging 2013: Computer-Aided Diagnosis, 8670:86702W-86702W-6.

  31. Lian C, Ruan S, Denœux T, Li H, Vera P (2018) Joint tumor segmentation in PET-CT images using co-clustering and fusion based on belief functions. IEEE Trans Image Process 28(2):755–766

    MathSciNet  MATH  Google Scholar 

  32. Liu H et al (2018) A fast weak-supervised pulmonary nodule segmentation method based on modified self-adaptive FCM algorithm. Soft Comput 22(12):3983–3995

    Google Scholar 

  33. LloréNs R, Naranjo V, LóPez F, AlcañIz M (2012) Jaw tissues segmentation in dental 3D CT images using fuzzy-connectedness and morphological processing. Comput Methods Prog Biomed 108(2):832–843

    Google Scholar 

  34. Lu H et al (2018) Extraction of GGO Candidate Regions on Thoracic CT Images using SuperVoxel-Based Graph Cuts for Healthcare Systems. Mobile Networks and Applications 23(6):1669–1679

    Google Scholar 

  35. Mercieca S, Belderbos J, van Loon J, Gilhuijs K, Julyan P, van Herk M (2018) Comparison of SUVmax and SUVpeak based segmentation to determine primary lung tumour volume on FDG PET-CT correlated with pathology data. Radiother Oncol 129(2):227–233

    Google Scholar 

  36. Mukhopadhyay S (2016) A segmentation framework of pulmonary nodules in lung CT images. J Digit Imaging 29(1):86–103

    MathSciNet  Google Scholar 

  37. Piert M et al (2018) Accuracy of tumor segmentation from multi-parametric prostate MRI and 18 F-choline PET/CT for focal prostate cancer therapy applications. EJNMMI Res 8(1):23

    Google Scholar 

  38. Qi Y et al. (2008). Semi-automatic segmentation of liver tumors from CT scans using Bayesian rule-based 3D region growing. In MICCAI workshop (Vol. 41, No. 43, p. 201).

  39. Revol-Muller C, Peyrin F, Carrillon Y, Odet C (2002) Automated 3D region growing algorithm based on an assessment function. Pattern Recogn Lett 23(1–3):137–150

    MATH  Google Scholar 

  40. Rose J, Revol-Muller C, Langlois J, Janier M, Odet C (2008) 3D region growing integrating adaptive shape prior. In 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (pp. 967-970). IEEE.

  41. Saha P, Udupa J (2001) Fuzzy connected object delineation: axiomatic path strength definition and the case of multiple seeds. Comput Vis Image Underst 83(3):275–295

    MATH  Google Scholar 

  42. Siegel R, Naishadham D, Jemal A (2013) Cancer statistics, 2013. CA Cancer J Clin 63(1):11–30

    Google Scholar 

  43. Sun M, Hu R, Yu H, Zhao B, Ren H (2015) Intracranial hemorrhage detection by 3D voxel segmentation on brain CT images. In 2015 International Conference on Wireless Communications & Signal Processing (WCSP) (pp. 1-5). IEEE.

  44. Sun X, Zhang H, Duan H (2006) 3D computerized segmentation of lung volume with computed tomography. Acad Radiol 13(6):670–677

    Google Scholar 

  45. Tian Z, Liu L, Fei B. (2015). A supervoxel-based segmentation method for prostate MR images. In Medical Imaging 2015: Image Processing (Vol. 9413, p. 941318). International Society for Optics and Photonics.

  46. Tong Y et al (2017). Interactive iterative relative fuzzy connectedness lung segmentation on thoracic 4D dynamic MR images. In Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging (Vol. 10137, p. 1013723). International Society for Optics and Photonics.

  47. Tu X et al (2017) Automatic categorization and scoring of solid, part-solid and non-solid pulmonary nodules in CT images with convolutional neural network. Sci Rep 7(1):8533

    Google Scholar 

  48. Udupa J, Samarasekera S (1996) Fuzzy connectedness and object definition: theory, algorithms, and applications in image segmentation. Graphical models and image processing 58(3):246–261

    Google Scholar 

  49. Wang H, Yushkevich P (2013). Multi-atlas segmentation without registration: A supervoxel-based approach. In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 535–542). Springer, Berlin, Heidelberg.

    Google Scholar 

  50. Werner M, Parker J, Kolodny G, English J, Palmer M (2009) Respiratory gating enhances imaging of pulmonary nodules and measurement of tracer uptake in FDG PET/CT. Am J Roentgenol 193(6):1640–1645

    Google Scholar 

  51. Wu W, Zhou Z, Wu S, Zhang Y (2016) Automatic liver segmentation on volumetric CT images using supervoxel-based graph cuts. Computational and mathematical methods in medicine, 1–14

    MathSciNet  MATH  Google Scholar 

  52. Xi T, Schreurs R, Heerink W, Berge S, Maal T (2014) A novel region-growing based semi-automatic segmentation protocol for three-dimensional condylar reconstruction using cone beam computed tomography (CBCT). PLoS One 9(11):e111126

    Google Scholar 

  53. Xie Y, Zhang J, Xia Y, Fulham M, Zhang Y (2018) Fusing texture, shape and deep model-learned information at decision level for automated classification of lung nodules on chest CT. Information Fusion 42:102–110

    Google Scholar 

  54. Xu W, Yu S, Ma Y, Liu C, Xin J (2017) Effect of different segmentation algorithms on metabolic tumor volume measured on 18F-FDG PET/CT of cervical primary squamous cell carcinoma. Nucl Med Commun 38(3):259

    Google Scholar 

  55. Yang J (2017) Solitary Lung nodules Detection based on Hybird Imaging. Taiyuan University of Technology, Taiyuan

    Google Scholar 

  56. Yau H, Lin Y, Tsou L, Lee C (2008) An adaptive region growing method to segment inferior alveolar nerve canal from 3D medical images for dental implant surgery. Computer-Aided Design and Applications 5(5):743–752

    Google Scholar 

  57. Zhang W et al (2017) A segmentation method for lung nodule image sequences based on superpixels and density-based spatial clustering of applications with noise. PLoS One 12(9):e0184290

    Google Scholar 

  58. Zhao J, Qiang W, Ji G, Zhou X (2018) 3D reconstruction of pulmonary nodules in PET-CT image sequences based on a novel 3D region growing method combined with ACO. International Journal of Bio-Inspired Computation 11(1):54–59

    Google Scholar 

  59. Zhu S, Xia X, Zhang Q, Belloulata K (2007). An image segmentation algorithm in image processing based on threshold segmentation. In 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System (pp. 673-678). IEEE.

Download references

Acknowledgements

This research was funded in part by National Natural Science Foundation of China, grant number 61872261, in part by the open funding project of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University (Grant No. VRLAB2018B07) and in part by Research Project Supported by Shanxi Natural Science Foundation (201801D121139).

Author information

Authors and Affiliations

Authors

Contributions

writing—review and editing Q.Y and D.Y.; methodology Y.W. and C.Q; software W.J., validation Z.Z.; formal analysis, W.S.

Corresponding author

Correspondence to Yan Qiang.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dong, Y., Yang, W., Wang, J. et al. An improved supervoxel 3D region growing method based on PET/CT multimodal data for segmentation and reconstruction of GGNs. Multimed Tools Appl 79, 2309–2338 (2020). https://doi.org/10.1007/s11042-019-08250-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-08250-4

Keywords

Navigation