Skip to main content

Deep Learning Based Automatic Segmentation of Pathological Kidney in CT: Local Versus Global Image Context

  • Chapter
  • First Online:
Book cover Deep Learning and Convolutional Neural Networks for Medical Image Computing

Abstract

Chronic kidney disease affects one of every ten adults in USA (over 20 million). Computed tomography (CT) is a widely used imaging modality for kidney disease diagnosis and quantification. However, automatic pathological kidney segmentation is still a challenging task due to large variations in contrast phase, scanning range, pathology, and position in the abdomen, etc. Methods based on global image context (e.g., atlas- or regression-based approaches) do not work well. In this work, we propose to combine deep learning and marginal space learning (MSL), both using local context, for robust kidney detection and segmentation. Here, deep learning is exploited to roughly estimate the kidney center. Instead of performing a whole axial slice classification (i.e., whether it contains a kidney), we detect local image patches containing a kidney. The detected patches are aggregated to generate an estimate of the kidney center. Afterwards, we apply MSL to further refine the pose estimate by constraining the position search to a neighborhood around the initial center. The kidney is then segmented using a discriminative active shape model. The proposed method has been trained on 370 CT scans and tested on 78 unseen cases. It achieves a mean segmentation error of 2.6 and 1.7 mm for the left and right kidney, respectively. Furthermore, it eliminates all gross failures (i.e., segmentation is totally off) in a direct application of MSL.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Center for Disease Control and Prevention (2014) National chronic kidney disease fact sheet. http://www.cdc.gov/diabetes/pubs/pdf/kidney_factsheet.pdf

  2. Yuh BI, Cohan RH (1999) Different phases of renal enhancement: role in detecting and characterizing renal masses during helical CT. Am J Roentgenol 173(3):747–755

    Article  Google Scholar 

  3. Yang G, Gu J, Chen Y, Liu W, Tang L, Shu H, Toumoulin C (2014) Automatic kidney segmentation in CT images based on multi-atlas image registration. In: Proceedings of the international conference on IEEE engineering in medicine and biology society, pp 5538–5541

    Google Scholar 

  4. Criminisi A, Shotton J, Robertson D, Konukoglu E (2011) Regression forests for efficient anatomy detection and localization in CT studies. In: Proceedings of the international conference on medical image computing and computer assisted intervention, pp 106–117

    Google Scholar 

  5. Cuingnet R, Prevost R, Lesage D, Cohen LD, Mory B, Ardon R (2012) Automatic detection and segmentation of kidneys in 3D CT images using random forests. In: Proceedings of the international conference on medical image computing and computer assisted intervention, pp 66–74

    Google Scholar 

  6. Lay N, Birkbeck N, Zhang J, Zhou SK (2013) Rapid multi-organ segmentation using context integration and discriminative models. In: Proceedings of the information processing in medical imaging, pp 450–462

    Google Scholar 

  7. Zheng Y, Barbu A, Georgescu B, Scheuering M, Comaniciu D (2008) Four-chamber heart modeling and automatic segmentation for 3D cardiac CT volumes using marginal space learning and steerable features. IEEE Trans Med Imaging 27(11):1668–1681

    Article  Google Scholar 

  8. Zheng Y, Comaniciu D (2014) Marginal space learning for medical image analysis – efficient detection and segmentation of anatomical structures. Springer, Berlin

    Book  MATH  Google Scholar 

  9. Thong W, Kadoury S, Piche N, Pal CJ (2015) Convolutional networks for kidney segmentation in contrast-enhanced CT scans. In: Proceedings of workshop on deep learning in medical image analysis, pp 1–8

    Google Scholar 

  10. Yan Z, Zhan Y, Peng Z, Liao S, Shinagawa Y, Metaxas DN, Zhou XS (2015) Bodypart recognition using multi-stage deep learning. In: Proceedings of the information processing in medical imaging, pp 449–461

    Google Scholar 

  11. Zheng Y, Liu D, Georgescu B, Nguyen H, Comaniciu D (2015) 3D deep learning for efficient and robust landmark detection in volumetric data. In: Proceedings of the international conference on medical image computing and computer assisted intervention, pp 565–572

    Google Scholar 

  12. Liu F, Yang L (2015) A novel cell detection method using deep convolutional neural network and maximum-weight independent set. In: Proceedings of the international conference on medical image computing and computer assisted intervention, pp 349–357

    Google Scholar 

  13. Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In: Proceedings of the international conference on medical image computing and computer assisted intervention, pp 520–527

    Google Scholar 

  14. Carneiro G, Nascimento JC, Freitas A (2012) The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans Image Process 21(3):968–982

    Article  MathSciNet  Google Scholar 

  15. Ghesu FC, Krubasik E, Georgescu B, Singh V, Zheng Y, Hornegger J, Comaniciu D (2016) Marginal space deep learning: efficient architecture for volumetric image parsing. IEEE Trans Med Imaging 35:1217

    Google Scholar 

  16. Cheng X, Zhang L, Zheng Y (2016) Deep similarity learning for multimodal medical images. Comput Methods Biomech Biomed Eng Imaging Vis

    Google Scholar 

  17. Miao S, Wang ZJ, Zheng Y, Liao R (2016) Real-time 2D/3D registration via CNN regression. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 1–4

    Google Scholar 

  18. Zheng Y, Doermann D (2005) Handwriting matching and its application to handwriting synthesis. In: International conference on document analysis and recognition, pp 1520–5263

    Google Scholar 

  19. Zheng Y (2015) Cross-modality medical image detection and segmentation by transfer learning of shape priors. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 424–427

    Google Scholar 

  20. Bookstein F (1989) Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans Pattern Anal Mach Intell 11(6):567–585

    Article  MATH  Google Scholar 

  21. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. arXiv:1408.5093

  22. Seifert S, Barbu A, Zhou K, Liu D, Feulner J, Huber M, Suehling M, Cavallaro A, Comaniciuc D (2009) Hierarchical parsing and semantic navigation of full body CT data. In: Proceedings of SPIE medical imaging, pp 1–8

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yefeng Zheng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Zheng, Y., Liu, D., Georgescu, B., Xu, D., Comaniciu, D. (2017). Deep Learning Based Automatic Segmentation of Pathological Kidney in CT: Local Versus Global Image Context. In: Lu, L., Zheng, Y., Carneiro, G., Yang, L. (eds) Deep Learning and Convolutional Neural Networks for Medical Image Computing. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-42999-1_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42999-1_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42998-4

  • Online ISBN: 978-3-319-42999-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics