Abstract
The accurate gland segmentation from digitized H&E (hematoxylin and eosin) histology images with a wide range of histologic grades of cancer is quite challenging. The methodologies proposed in recent researches have performed well in segmenting glands from benign subjects but have not given satisfactory results when segmenting glands from malignant cases. The methodology proposed in this paper is based on the symmetric encoder-decoder network which works remarkably well in detecting and segmenting glands in the case of malignant subjects and overall. The proposed pipelines harness the power of multilevel CNN architecture to capture contextual information and concatenation of features from skip connections with upsampled feature maps to improve the localization accuracy thereby improving the precise segmentation accuracy. The raw predicted map is further refined using morphological operators as a post-processing tool. The method is trained and evaluated on the Warwick-QU dataset. The final segmentation results have been compared with the performance of top-performing teams of gland challenge (GlaS) MICCI 2015 along with the recent researches. The final predicted segmentation maps have achieved the F1 score of 0.81 for gland detection, object dice score of 0.82 for segmentation, and Hausdorff distance of 84.18 for gland shape similarity which is akin to or higher than the existing models for the malignant subject. The model has done affably well on the overall dataset too.
Similar content being viewed by others
References
Chen H, Qi X, Yu L, Dou Q, Qin J, Heng PA (2017) DCAN: deep contour-aware networks for object instance segmentation from histology images. Med Image Anal 36:135–146. https://doi.org/10.1016/j.media.2016.11.004
Chen H, Qi X, Yu L, Heng PA (2016) DCAN: deep contour-aware networks for accurate gland segmentation, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition IEEE Computer Society, pp 2487–2496 https://doi.org/10.1109/CVPR.2016.273
Gour M, Jain S, Agrawal R (2020) DeepRNNetSeg: deep residual neural network for nuclei segmentation on breast cancer histopathological images, in: Communications in Computer and Information Science pp 243–253 https://doi.org/10.1007/978-981-15-4018-9_23
Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B (2009) Histopathological image analysis: a review. IEEE Rev Biomed Eng 2:147–171. https://doi.org/10.1109/RBME.2009.2034865
Hu Z, Tang J, Wang Z, Zhang K, Zhang L, Sun Q (2018) Deep learning for image-based cancer detection and diagnosis − a survey. Pattern Recognition 83:134–149. https://doi.org/10.1016/j.patcog.2018.05.014
Ker J, Wang L, Rao J, Lim T (2017) Deep learning applications in medical image analysis. IEEE Access 6:9375–9379. https://doi.org/10.1109/ACCESS.2017.2788044
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88. https://doi.org/10.1016/j.media.2017.07.005
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp 3431–3440
Naylor P, Laé M, Reyal F, Walter T (2019) Segmentation of nuclei in histopathology images by deep regression of the distance map. IEEE Transactions Med Imag. https://doi.org/10.1109/TMI.2018.2865709
Rastogi P, Singh V, Yadav M (2018) Deep learning and big datatechnologies in medical image analysis, in: PDGC 2018 - 2018 5th International Conference on Parallel, Distributed and Grid Computing pp 60–63 https://doi.org/10.1109/PDGC.2018.8745750
Rezaei S, Emami A, Zarrabi H, Rafiei S, Najarian K, Karimi N, Samavi S, Reza Soroushmehr SM (2019) Gland segmentation in histopathology images using deep networks and handcrafted features, in: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) pp 1031–1034 https://doi.org/10.1109/EMBC.2019.8856776
Rezaei S, Emami A, Karimi N, Samavi S (2020) Gland segmentation in histopathological images by deep neural network, in: 2020 25th International Computer Conference, Computer Society of Iran (CSICC) pp 1–5 https://doi.org/10.1109/CSICC49403.2020.9050084
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention – MICCAI 2015. Springer, Cham, pp 234–241
Sirinukunwattana K, Snead DRJ, Rajpoot NM (2015) A stochastic polygons model for glandular structures in colon histology images. IEEE Transactions Med Imag 34:2366–2378. https://doi.org/10.1109/TMI.2015.2433900
Sirinukunwattana K, Pluim JPW, Chen H, Qi X, Heng PA, Guo YB, Wang LY, Matuszewski BJ, Bruni E, Sanchez U, Böhm A, Ronneberger O, Cheikh BB, Racoceanu D, Kainz P, Pfeiffer M, Urschler M, Snead DRJ, Rajpoot NM (2017) Gland segmentation in colon histology images: the glas challenge contest. Med Image Anal 35:489–502. https://doi.org/10.1016/j.media.2016.08.008
Tang J, Li J, Xu X (2018) Segnet-based gland segmentation from colon cancer histology images. Proceedings - 2018 33rd Youth Academic Annual Conference of Chinese Association of Automation, YAC 2018 1078–1082 https://doi.org/10.1109/YAC.2018.8406531
Xu Y, Li Y, Wang Y, Liu M, Fan Y, Lai M, Chang EIC (2017) Gland instance segmentation using deep multichannel neural networks. IEEE Transactions Biomed Eng 64:2901–2912. https://doi.org/10.1109/TBME.2017.2686418
Zhou Y, Onder OF, Dou Q, Tsougenis E, Chen H, Heng P-A (2019) CIA-Net: robust nuclei instance segmentation with contour-aware information aggregation. In: Chung ACS, Gee JC, Yushkevich PA, Bao S (eds) Information processing in medical imaging. Springer, Cham, pp 682–693
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study's conception and design. Material preparation, data collection, and analysis were performed by Priyanka Rastogi. The first draft of the manuscript was written by Priyanka Rastogi and all authors commented on previous versions of the manuscript. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Ethical approval
The article does not contain any studies with human participants or animals performed by any of the authors.
Data availability
The datasets used in conducting the study are available on the link https://warwick.ac.uk/fac/cross_fac/tia/data/glascontest/download while submitting the manuscript.
Code availability
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rastogi, P., Khanna, K. & Singh, V. Gland segmentation in colorectal cancer histopathological images using U-net inspired convolutional network. Neural Comput & Applic 34, 5383–5395 (2022). https://doi.org/10.1007/s00521-021-06687-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-021-06687-z