Ishita Paul
ABSTRACT
Colorectal polyps, which are associated with colorectal cancer, can be detected using a colonoscopy. Using the data from colonoscopy images to segment polyps is crucial in medical practice because it provides critical data for identification and surgery. However, precise segmentation of polyps is difficult due to the following factors: the polyp-bordering mucosa boundary is not sharp, and polyps of the same type differ in texture, size, and color. We propose to use the DeepLabV3+ architecture for image segmentation for medical purposes by examining its segmentation results on colonoscopy images from the datasets Kvasir and CVC-ClinicDB. DeepLabV3+ generates an F1-score of 0.865 for CVC-ClinicDB on an NVIDIA A100 class Cloud-Based GPU. The model is divided into the following parts: an encoder that performs separable convolution on the input map and a decoder that up-samples the data provided by the encoder using transpose convolution. Our approach significantly enhances segmentation accuracy and offers a number of benefits with respect to generality and real-time segmentation efficiency, according to evaluations done quantitatively and qualitatively on the two datasets.
- Deepak Bhaskar Acharya and Huaming Zhang. 2020. Community Detection Clustering via Gumbel Softmax. SN Computer Science 1, 5 (2020), 262.Google Scholar
Digital Library
- Deepak Bhaskar Acharya and Huaming Zhang. 2020. Feature Selection and Extraction for Graph Neural Networks. In Proceedings of the 2020 ACM Southeast Conference. 252--255.Google ScholarDigital Library
- Deepak Bhaskar Acharya and Huaming Zhang. 2021. Data Points Clustering via Gumbel Softmax. SN Computer Science 2, 4 (2021), 311.Google ScholarDigital Library
- Mojtaba Akbari, Majid Mohrekesh, Ebrahim Nasr-Esfahani, SM Reza Soroushmehr, Nader Karimi, Shadrokh Samavi, and Kayvan Najarian. 2018. Polyp Segmentation in Colonoscopy Images using Fully Convolutional Network. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 69--72.Google ScholarCross Ref
- Jorge Bernal, Javier Sánchez, and Fernando Vilarino. 2012. Towards Automatic Polyp Detection with a Polyp Appearance Model. Pattern Recognition 45, 9 (2012), 3166--3182.Google ScholarDigital Library
- Divya Bhaskaracharya, Rajesh Parameshwaran Nair, Prakashini K, Girish R Menon, Paul Litvak, Pitchaiah Mandava, Deepu Vijayasenan, and Sumam David S. 2021. A More Generalizable DNN based Automatic Segmentation of Brain Tumors from Multimodal Low-Resolution 2D MRI. In 2021 IEEE 18th India Council International Conference (INDICON). IEEE, 1--5.Google Scholar
- Patrick Brandao, Evangelos Mazomenos, Gastone Ciuti, Renato Caliò, Federico Bianchi, Arianna Menciassi, Paolo Dario, Anastasios Koulaouzidis, Alberto Arezzo, and Danail Stoyanov. 2017. Fully Convolutional Neural Networks for Polyp Segmentation in Colonoscopy. In Medical Imaging 2017: Computer-Aided Diagnosis, Vol. 10134. SPIE, 101--107.Google Scholar
- Freddie Bray, Jacques Ferlay, Isabelle Soerjomataram, Rebecca L Siegel, Lindsey A Torre, and Ahmedin Jemal. 2018. Global Cancer Statistics 2018: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA: a cancer journal for clinicians 68, 6 (2018), 394--424.Google Scholar
- Liang-Chieh Chen, Yi Yang, Jiang Wang, Wei Xu, and Alan L Yuille. 2016. Attention to Scale: Scale-Aware Semantic Image Segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3640--3649.Google ScholarCross Ref
- Liang-Chieh Chen and Y Zhu. 2018. Semantic Image Segmentation with Deeplab in Tensorflow. Google AI Blog (2018).Google Scholar
- Miguel T Coimbra and JP Silva Cunha. 2006. MPEG-7 Visual Descriptors---Contributions for Automated Feature Extraction in Capsule Endoscopy. IEEE transactions on circuits and systems for video technology 16, 5 (2006), 628--637.Google ScholarDigital Library
- Deng-Ping Fan, Ge-Peng Ji, Tao Zhou, Geng Chen, Huazhu Fu, Jianbing Shen, and Ling Shao. 2020. PraNet: Parallel Reverse Attention Network for Polyp Segmentation. In International conference on medical image computing and computer-assisted intervention. Springer, 263--273.Google Scholar
- Yuqi Fang, Cheng Chen, Yixuan Yuan, and Kai-yu Tong. 2019. Selective Feature Aggregation Network with Area-boundary Constraints for Polyp segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 302--310.Google ScholarDigital Library
- Jun Fu, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. Dual Attention Network for Scene Segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3146--3154.Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE transactions on pattern analysis and machine intelligence 37, 9 (2015), 1904--1916.Google ScholarDigital Library
- Sae Hwang, JungHwan Oh, Wallapak Tavanapong, Johnny Wong, and Piet C De Groen. 2007. Polyp Detection in Colonoscopy Video using Elliptical Shape Feature. In 2007 IEEE International Conference on Image Processing, Vol. 2. IEEE, II--465.Google ScholarCross Ref
- Debesh Jha, Pia H Smedsrud, Dag Johansen, Thomas de Lange, Håvard D Johansen, Pål Halvorsen, and Michael A Riegler. 2021. A Comprehensive Study on Colorectal Polyp Segmentation with ResUNet++, Conditional Random Field and Test-Time Augmentation. IEEE journal of biomedical and health informatics 25, 6 (2021), 2029--2040.Google Scholar
- Stavros A Karkanis, Dimitrios K Iakovidis, Dimitrios E Maroulis, Dimitris A. Karras, and M Tzivras. 2003. Computer-Aided Tumor Detection in Endoscopic Video using Color Wavelet Features. IEEE transactions on information technology in biomedicine 7, 3 (2003), 141--152.Google ScholarDigital Library
- Nam Hee Kim, Yoon Suk Jung, Woo Shin Jeong, Hyo-Joon Yang, Soo-Kyung Park, Kyuyong Choi, and Dong Il Park. 2017. Miss Rate of Colorectal Neoplastic Polyps and Risk Factors for Missed Polyps in Consecutive Colonoscopies. Intestinal research 15, 3 (2017), 411.Google Scholar
- Nicolas Boutry Le Duy Huynh. 2020. A U-Net++ with Pre-trained Efficient-net Backbone for Segmentation of Diseases and Artifacts in Endoscopy Images and Videos. In CEUR Workshop Proceedings, Vol. 2595. 13--17.Google Scholar
- Takahisa Matsuda, Akiko Ono, Masau Sekiguchi, Takahiro Fujii, and Yutaka Saito. 2017. Advances in Image Enhancement in Colonoscopy for Detection of Adenomas. Nature Reviews Gastroenterology & Hepatology 14, 5 (2017), 305--314.Google ScholarCross Ref
- Subhashree Mohapatra, Tripti Swarnkar, and Jayashankar Das. 2021. Deep Convolutional Neural Network in Medical Image Processing. In Handbook of deep learning in biomedical engineering. Elsevier, 25--60.Google Scholar
- Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional Networks for Biomedical Image Segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234--241.Google Scholar
- Kashif Shaheed, Aihua Mao, Imran Qureshi, Munish Kumar, Sumaira Hussain, Inam Ullah, and Xingming Zhang. 2022. DS-CNN: A Pre-trained Xception Model based on Depth-wise Separable Convolutional Neural Network for Finger Vein Recognition. Expert Systems with Applications 191 (2022), 116288.Google ScholarDigital Library
- Krishnan Shankar M, Yang Wen-jin, Chan Kap Luk, and Kumar Senthil. 1998. Intestinal Abnormality Detection from Endoscopic Images. In Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol. 20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No. 98CH36286), Vol. 2. IEEE, 895--898.Google ScholarCross Ref
- Lequan Yu, Hao Chen, Qi Dou, Jing Qin, and Pheng Ann Heng. 2016. Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos. IEEE journal of biomedical and health informatics 21, 1 (2016), 65--75.Google Scholar
- Lei Zhang, Sunil Dolwani, and Xujiong Ye. 2017. Automated Polyp Segmentation in Colonoscopy Frames using Fully Convolutional Neural Network and Textons. In Annual Conference on Medical Image Understanding and Analysis. Springer, 707--717.Google ScholarCross Ref
- Zongwei Zhou, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh, and Jianming Liang. 2018. Unet++: A Nested U-Net Architecture for Medical Image Segmentation. In Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, 3--11.Google ScholarDigital Library
Index Terms
- DCNN-based Polyps Segmentation using Colonoscopy images
Recommendations
Detection of Colorectal Polyps Based on Deep Learning
ICBBT '21: Proceedings of the 2021 13th International Conference on Bioinformatics and Biomedical TechnologyColorectal polyps are usually a sign of early precancerous lesions of colorectal cancer. Colorectal polyp screening is of great significance for the early detection and prevention of colorectal cancer. CT images can provide an important basis for the ...
Improved classification of colorectal polyps on histopathological images with ensemble learning and stain normalization
Highlights- Different from the previous studies which make polyp classification on HI, in this study, various stain normalization techniques are combined with an ...
AbstractBackground and Objective: Early detection of colon adenomatous polyps is critically important because correct detection of it significantly reduces the potential of developing colon cancers in the future. The key ...
Deep Learning for Detection of Colonic Polyps from Computed Tomography Colonoscopy Images Combined with Colonoscopy
The objective of this study was to investigate the diagnosis of colonic polyps (CP) through the computed tomography (CT) images combined with colonoscopy based on Fourier central slice theorem algorithm. In this study, 86 patients with CP admitted to ...
Comments