Abstract
Analyses of polyp images play an important role in an early detection of colorectal cancer. An automated polyp segmentation is seen as one of the methods that could improve the accuracy of the colonoscopic examination. The paper describes evaluation study of a segmentation method developed for the Endoscopic Vision Gastrointestinal Image ANAlysis – (GIANA) polyp segmentation sub-challenges. The proposed polyp segmentation algorithm is based on a fully convolutional network (FCN) model. The paper describes cross-validation results on the training GIANA dataset. Various tests have been evaluated, including network configuration, effects of data augmentation, and performance of the method as a function of polyp characteristics. The proposed method delivers state-of-the-art results. It secured the first place for the image segmentation tasks at the 2017 GIANA challenge and the second place for the SD images at the 2018 GIANA challenge.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
It is envisaged that supplementary results of the ongoing research on polyp segmentation will be gradually made available at: https://github.com/ybguo1/Polyp-Segmentation.
References
Zhang, Y., Matuszewski, B.J., Shark, L.K., Moore, C.J.: Medical image segmentation using new hybrid level-set method. In: 15th International Conference BioMedical Visualization: Information Visualization in Medical and Biomedical Informatics, pp. 71–76. IEEE (2008)
Zhang, Y., Matuszewski, B.J.: Multiphase active contour segmentation constrained by evolving medial axes. In: 16th IEEE International Conference on Image Processing, pp. 2993–2996. IEEE (2009)
Guo, Y., Matuszewski, B.J.: GIANA polyp segmentation with fully convolutional dilation neural networks. In: Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: GIANA, ISBN 978-989-758-354-4, pp. 632-641 (2019). https://doi.org/10.5220/0007698806320641
Hwang, S., Oh, J., Tavanapong, W., Wong, J., De Groen, P.C.: Polyp detection in colonoscopy video using elliptical shape feature. In: IEEE International Conference on Image Processing, vol. 2, pp. II–465. IEEE (2007)
Gross, S., et al.: Polyp segmentation in NBI colonoscopy. In: Meinzer, H.P., Deserno, T.M., Handels, H., Tolxdorff, T. (eds.) Bildverarbeitung für die Medizin 2009, pp. 252–256. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-540-93860-6_51
Breier, M., Gross, S., Behrens, A., Stehle, T., Aach, T.: Active contours for localizing polyps in colonoscopic NBI image data. In: Medical Imaging 2011: Computer- Aided Diagnosis, vol. 7963, p. 79632 M. International Society for Optics and Photonics (2011)
Breier, M., Gross, S., Behrens, A.: Chan-Vese segmentation of polyps in colono-scopic image data. In: Proceedings of the 15th International Student Conference on Electrical Engineering POSTER, vol. 2011 (2011)
Bernal, J., Sánchez, J., Vilarino, F.: Towards automatic polyp detection with a polyp appearance model. Pattern Recogn. 45(9), 3166–3182 (2012)
Bernal, J., Sánchez, J., Vilarino, F.: Impact of image preprocessing methods on polyp localization in colonoscopy frames. In: 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 7350–7354. IEEE (2013)
Bernal, J., Sánchez, F.J., Fernández-esparrach, G., Gil, D., Rodríguez, C., Vi-larino, F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput. Med. Imaging Graph. 43, 99–111 (2015)
Bernal, J., et al.: Comparative validation of polyp detection methods in video colonoscopy: results from the MICCAI 2015 endoscopic vision challenge. IEEE Trans. Med. Imaging 36(6), 1231–1249 (2017)
Tajbakhsh, N., Gurudu, S.R., Liang, J.: A Classification-Enhanced Vote Accumulation Scheme for Detecting Colonic Polyps. In: Yoshida, H., Warfield, S., Vannier, M.W. (eds.) ABD-MICCAI 2013. LNCS, vol. 8198, pp. 53–62. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41083-3_7
Tajbakhsh, N., Chi, C., Gurudu, S.R., Liang, J.: Automatic polyp detection from learned boundaries. In: IEEE 11th International Symposium on Biomedical Imaging, pp. 97–100. IEEE (2014)
Tajbakhsh, N., Gurudu, Suryakanth R., Liang, J.: Automatic Polyp Detection Using Global Geometric Constraints and Local Intensity Variation Patterns. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 179–187. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10470-6_23
Karkanis, S.A., Iakovidis, D.K., Maroulis, D.E., Karras, D.A., Tzivras, M.: Computer-aided tumor detection in endoscopic video using color wavelet features. IEEE Trans. Inf Technol. Biomed. 7(3), 141–152 (2003)
Iakovidis, D.K., Maroulis, D.E., Karkanis, S.A., Brokos, A.: A comparative study of texture features for the discrimination of gastric polyps in endoscopic video. In: 18th IEEE Symposium on Computer-Based Medical Systems (CBMS) (2005). https://doi.org/10.1109/cbms.2005.6
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Ribeiro, E., Uhl, A., Hafner, M.: Colonic polyp classification with convolutional neural networks. In: IEEE 29th International Symposium on Computer-Based Medical Systems, pp. 253–258. IEEE (2016)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, Alejandro F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Vázquez, D., et al.: A benchmark for endoluminal scene segmentation of colonoscopy images. J. Healthc. Eng. 2017 (2017)
Zhang, L., Dolwani, S., Ye, X.: Automated Polyp Segmentation in Colonoscopy Frames Using Fully Convolutional Neural Network and Textons. In: Valdés Hernández, M., González-Castro, V. (eds.) MIUA 2017. CCIS, vol. 723, pp. 707–717. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60964-5_62
Li, Q., et al.: Colorectal polyp segmentation using a fully convolutional neural network. In: 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, pp. 1–5. IEEE (2017)
Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122 (2015)
Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)
Peng, C., Zhang, X., Yu, G., Luo, G., Sun, J.: Large kernel matters–improve semantic segmentation by global convolutional network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4353–4361 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Chen, L.C., Papandreou, G., Schroff, F. and Adam, H.: Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587 (2017)
GIANA Challenge page, https://endovissub2017-giana.grand-challenge.org/polypsegmentation/. Accessed 02 Mar 2019
Must Know Tips/Tricks in Deep Neural Networks, http://lamda.nju.edu.cn/weixs/project/CNNTricks/CNNTricks.html. Accessed 02 Mar 2019
Acknowledgements
The authors would like to acknowledge the organizers of the Gastrointestinal Image ANAlysis – (GIANA) challenges for providing video colonoscopy polyp images.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Guo, Y., Matuszewski, B.J. (2020). Polyp Segmentation with Fully Convolutional Deep Dilation Neural Network. In: Zheng, Y., Williams, B., Chen, K. (eds) Medical Image Understanding and Analysis. MIUA 2019. Communications in Computer and Information Science, vol 1065. Springer, Cham. https://doi.org/10.1007/978-3-030-39343-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-39343-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39342-7
Online ISBN: 978-3-030-39343-4
eBook Packages: Computer ScienceComputer Science (R0)