Skip to main content
SpringerLink
Log in

Multi-task learning for gland segmentation

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Morphology of glands is used by pathologist to evaluate the malignancy degree of adenocarcinomas which is a common type of cancer. Automatic analysis of histopathology images is important for a scalable and objective diagnosis, and segmentation of glands is a key step in this process. In this paper, we propose a method to accurately separate the gland instances from each other. We formulate the gland segmentation as a multi-task learning problem and generate the segmentation maps for the gland objects, contours and touching boundaries simultaneously. Our method uses the advantage of end-to-end learning and can be adapted to different base networks. To evaluate the proposed method, we use the benchmark “MICCAI 2015 Gland Segmentation in Colon Histology Images Challenge” dataset. On base networks DeepLabV3+ and U-Net, we show the success of the proposed multi-task model over single-task models. Comparisons with the reported results of the challenge and the results of other state-of-the-art studies support the advantages of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer assisted intervention, (2015)

  2. Fu, H., Qiu, G., Shu, J., Ilyas, M.: A novel polar space random field model for the detection of glandular structures. IEEE Trans. Med. Imaging 33, 764–776 (2014)

    Article  Google Scholar 

  3. Chen, L., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation, arXiv preprint arXiv:1706.05587,2017

  4. Chen, L., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision(2018)

  5. Chen, L., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Pattern Anal. Mach. Intell. 40, 834–848 (2018)

    Article  Google Scholar 

  6. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (2016)

  7. Wang, P., Hu, X., Li, Y., Liu, Q., Zhu, X.: Automatic cell nuclei segmentation and classification of breast cancer histopathology images. Signal Process. 122, 1–13 (2016)

    Article  Google Scholar 

  8. Wan, T., Cao, J., Chen, J., Qin, Z.: Automated grading of breast cancer histopathology using cascaded ensemble with combination of multi-level image features. Neurocomputing 229, 34–44 (2017)

    Article  Google Scholar 

  9. Sharma, H., Zerbe, N., Heim, D., Wienert, S., Behrens, H., Hellwich, O., Hufnagl, P.: A Multi-resolution Approach for Combining Visual Information using Nuclei Segmentation and Classification in Histopathological Images., VISAPP, 3, (2015)

  10. Edulapuram, R., Stanley, R J., Long, L R., Antani, S., Thoma, G., Zuna, R., Stoecker, W., Hagerty, J.: Nuclei Segmentation using a Level Set Active Contour Method and Spatial Fuzzy C-means Clustering., VISIGRAPP, 4, (2017)

  11. Isola, P., Zhu, J., Zhou, T., Efros, A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, (2017)

  12. Husham, A., Hazim Alkawaz, M., Saba, T., Rehman, A., Saleh Alghamdi, J.: Automated nuclei segmentation of malignant using level sets. Microscopy Research and Technique 79, 993–997 (2016)

    Article  Google Scholar 

  13. Gunduz-Demir, C., Kandemir, M., Tosun, A., Sokmensuer, C.: Automatic segmentation of colon glands using object-graphs. Medical Image Analysis 14, 1–12 (2010)

    Article  Google Scholar 

  14. Kainz, P., Pfeiffer, M., Urschler, M.: Segmentation and classification of colon glands with deep convolutional neural networks and total variation regularization. Peer J. 5, e3874 (2017)

    Article  Google Scholar 

  15. Chen, H., Qi, X., Yu, L., Dou, Q., Qin, J., Heng, P.: DCAN: deep contour-aware networks for object instance segmentation from histology images. Med. Image Anal. 36, 135–146 (2017)

    Article  Google Scholar 

  16. Sirinukunwattana, K., Snead, D., Rajpoot, N.: A stochastic polygons model for glandular structures in colon histology images. IEEE Trans. Med. Imaging 34, 2366–2378 (2015)

    Article  Google Scholar 

  17. Yang, L., Zhang, Y., Chen, J., Zhang, S., Chen, D.: Suggestive annotation: A deep active learning framework for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, (2017)

  18. Xu, Y., Li, Y., Wang, Y., Liu, M., Fan, Y., Lai, M., Eric, I., Chang, C.: Gland instance segmentation using deep multichannel neural networks. IEEE Trans. Biomed. Eng. 64, 12 (2017)

    Google Scholar 

  19. Sirinukunwattana, K., Pluim, J., Chen, H., Qi, X., Heng, P., Guo, Y., Wang, L., Matuszewski, B., Bruni, E., Sanchez, U.: Gland segmentation in colon histology images: the glas challenge contest. Med. Image Anal. 35, 489–502 (2017)

    Article  Google Scholar 

  20. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (2015)

  21. Graham, S., Epstein, D., Rajpoot, N.: Rota-Net: rotation equivariant network for simultaneous gland and lumen segmentation in colon histology images. In: European Congress on Digital Pathology (2019)

  22. Yan, Z., Yang, X., Cheng, K.: A deep model with shape-preserving loss for gland instance segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention (2018)

  23. Qu, H., Yan, Z., Riedlinger, G., De, S., Metaxas, D.: Improving nuclei/gland instance segmentation in histopathology images by full resolution neural network and spatial constrained loss. In: International conference on medical image computing and computer-assisted intervention (2019)

  24. Yan, Z., Yang, X., Cheng, K.: Enabling a single deep learning model for accurate gland instance segmentation: a shape-aware adversarial learning framework. IEEE Trans. Med. Imaging 39, 6 (2020)

    Article  Google Scholar 

  25. Yan, M., Li, H., Kang, B., Feng, J., Kang, Y., Zhang, T., Yang, L., Cui, L.: s3 Net: trained on a small sample segmentation network for biomedical image analysis. In: 2019 IEEE International Conference on Bioinformatics and Biomedicine (2019)

  26. Cohen, T., Welling, M.: Group equivariant convolutional networks. In: International conference on machine learning (2016)

  27. Binder, T., Tantaoui, E.M., Pati, P., Catena, R., Set-Aghayan, A., Gabrani, M.: Multi-organ gland segmentation using deep learning. Front. Med. 6, 173 (2019)

  28. Paul, A., Mukherjee, D.P.: Gland segmentation from histology images using informative morphological scale space. In: International Conference on Image Processing (2016)

  29. Naqvi, S.F.H., Ayubi, S., Nasim, A., Zafar, Z.: Automated gland segmentation leading to cancer detection for colorectal biopsy images. In: Future of Information and Communication Conference (2019)

  30. Wang, L., Zhou, Y., Matuszewski, B.: A new hybrid method for gland segmentation in histology images. In: International Conference on Computer Analysis of Images and Patterns (2019)

  31. Zhang, K., Fu, J., Hua, L., Zhang, P., Shao, Y., Xu, S., Zhou, H., Chen, L., Wang, J.: Multiple morphological constraints-based complex gland segmentation in colorectal cancer pathology image analysis. Complexity (2020)

  32. Xie, Y., Lu, H., Zhang, J., Shen, C., Xia, Y.: Deep segmentation-emendation model for gland instance segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention (2019)

  33. Bienias, L., Guillamón, J., Nielsen, L., Alstrøm, T.: Insights into the behaviour of multi-task deep neural networks for medical image segmentation. In: IEEE 29th international workshop on machine learning for signal processing (2019)

  34. Silva-Rodríguez, J., Payá-Bosch, E., García, G., Colomer, A., Naranjo, V.: Prostate gland segmentation in histology images via residual and multi-resolution U-NET. In: International Conference on Intelligent Data Engineering and Automated Learning (2020)

  35. Ding, H., Pan, Z., Cen, Q., Li, Y., Chen, S.: Multi-scale fully convolutional network for gland segmentation using three-class classification. Neurocomputing 380, 150–161 (2020)

    Article  Google Scholar 

  36. Yan, C., Cai, C., Xie, J., Fu, Y., Shuai, H., Fan, X., Xu, J.: Prior consistent CNN with multi-task learning for colon image classification (2019)

  37. Wang, L., Zhen, H., Fang, X., Wan, S., Ding, W., Guo, Y.: A unified two-parallel-branch deep neural network for joint gland contour and segmentation learning. Future Generat. Comput. Syst. 100, 316–324 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This study has been partially supported by Science Academy’s Young Scientist Awards Program (BAGEP)

Author information

Authors and Affiliations

  1. Graduate School of Science and Engineering, Hacettepe University, Beytepe, Ankara, Turkey

    Iman Rezazadeh & Pinar Duygulu

Authors
  1. Iman Rezazadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pinar Duygulu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Iman Rezazadeh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rezazadeh, I., Duygulu, P. Multi-task learning for gland segmentation. SIViP 17, 1–9 (2023). https://doi.org/10.1007/s11760-022-02197-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02197-0

Keywords

Search

Navigation