Abstract
Wireless capsule endoscopy (WCE) is a promising technology for the investigation of gastrointestinal (GI) tracts. Long WCE video pose a challenge before the field experts and therefore automatic identification of anomalous video frames and localization of anomalies is an important research problem. Various segmentation models based on deep learning techniques for object localization have been suggested for different type of applications including biomedical applications. Recently, some researchers have applied these methods for the analysis of WCE images. In this paper four popular deep learning-based segmentation models UNet, SegNet, PSPNet, and Fully Convolutional Network (FCN) are analyzed for their suitability in localization of anomaly. Popular CNN architectures like VGG16, MobileNet, and ResNet50 are used as the base architecture to create the segmentation models. In this work two well known polyp datasets namely ETIS-Larib and CVC-ClinicDB are considered. The outcomes show that UNet and SegNet developed using MobileNetV1 architecture are performing relatively better than other architectures. Mean IoU of 0.910 and 0.883 is achieved using MobileNet-UNet whereas using MobileNet-SegNet it reaches 0.894 and 0.885 on CVC-ClinicDB and ETIS-Larib datasets respectively.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Akbari, M., et al.: Polyp segmentation in colonoscopy images using fully convolutional network. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 69–72. IEEE (2018)
Ameling, S., Wirth, S., Paulus, D., Lacey, G., Vilarino, F.: Texture-based polyp detection in colonoscopy. In: Bildverarbeitung für die Medizin 2009, pp. 346–350. Springer, Heidelberg (2009)
Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Banik, D., Bhattacharjee, D., Nasipuri, M.: A multi-scale patch-based deep learning system for polyp segmentation. In: Chaki, R., Cortesi, A., Saeed, K., Chaki, N. (eds.) Advanced Computing and Systems for Security. AISC, vol. 1136, pp. 109–119. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-2930-6_9
Banik, D., Roy, K., Bhattacharjee, D., Nasipuri, M., Krejcar, O.: Polyp-net: a multimodel fusion network for polyp segmentation. IEEE Trans. Instrum. Meas. 70, 1–12 (2020)
Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., Vilariño, F.: Wm-dova maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians. Computerized Medical Imaging and Graphics 43, 99–111 (2015)
Bernal, J., Sánchez, J., Vilariño, F.: A region segmentation method for colonoscopy images using a model of polyp appearance. In: Vitrià, J., Sanches, J.M., Hernández, M. (eds.) IbPRIA 2011. LNCS, vol. 6669, pp. 134–142. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21257-4_17
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. corr abs/1512.03385 (2015) (2015)
Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
Hwang, S., Oh, J., Tavanapong, W., Wong, J., De Groen, P.C.: Automatic polyp region segmentation for colonoscopy images using watershed algorithm and ellipse segmentation. In: Medical Imaging 2007: Computer-Aided Diagnosis. vol. 6514, p. 65141D. International Society for Optics and Photonics (2007)
Jain, S., Seal, A., Ojha, A., Krejcar, O., Bureš, J., Tachecí, I., Yazidi, A.: Detection of abnormality in wireless capsule endoscopy images using fractal features. Comput. Biol. Med. 127, 104094 (2020)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Prasath, V.S., Kawanaka, H.: Vascularization features for polyp localization in capsule endoscopy. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 1740–1742. IEEE (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Sasmal, P., Iwahori, Y., Bhuyan, M., Kasugai, K.: Active contour segmentation of polyps in capsule endoscopic images. In: 2018 International Conference on Signals and Systems (ICSigSys), pp. 201–204. IEEE (2018)
Shin, Y., Qadir, H.A., Aabakken, L., Bergsland, J., Balasingham, I.: Automatic colon polyp detection using region based deep CNN and post learning approaches. IEEE Access 6, 40950–40962 (2018)
Shin, Y., Qadir, H.A., Balasingham, I.: Abnormal colon polyp image synthesis using conditional adversarial networks for improved detection performance. IEEE Access 6, 56007–56017 (2018)
Silva, J., Histace, A., Romain, O., Dray, X., Granado, B.: Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer. Int. J. Comput. Assist. Radiol. Surg. 9(2), 283–293 (2014)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Tajbakhsh, N., Gurudu, S.R., Liang, J.: Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans. Med. Imaging 35(2), 630–644 (2015)
Yu, L., Chen, H., Dou, Q., Qin, J., Heng, P.A.: Integrating online and offline three-dimensional deep learning for automated polyp detection in colonoscopy videos. IEEE J. Biomed. Health Inform. 21(1), 65–75 (2016)
Yuan, Y., Meng, M.Q.H.: Deep learning for polyp recognition in wireless capsule endoscopy images. Med. Phys. 44(4), 1379–1389 (2017)
Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2881–2890 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jain, S., Seal, A., Ojha, A. (2022). Localization of Polyps in WCE Images Using Deep Learning Segmentation Methods: A Comparative Study. In: Raman, B., Murala, S., Chowdhury, A., Dhall, A., Goyal, P. (eds) Computer Vision and Image Processing. CVIP 2021. Communications in Computer and Information Science, vol 1567. Springer, Cham. https://doi.org/10.1007/978-3-031-11346-8_46
Download citation
DOI: https://doi.org/10.1007/978-3-031-11346-8_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-11345-1
Online ISBN: 978-3-031-11346-8
eBook Packages: Computer ScienceComputer Science (R0)