skip to main content
10.1145/3373509.3373579acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

Improving Histopathological Image Segmentation and Classification using Graph Convolution Network

Authors Info & Claims
Published:25 March 2020Publication History

ABSTRACT

In this paper, we present a system for segmentation and classification of breast cancer ROI images by integrating the idea of hierarchical processing of segmentation and classification tasks. The system is composed of a segmentation module and a GCN module, where the GCN module is designed to improve the performance of the classification result. The segmentation module is used to obtain the segmentation masks of the image patches of the ROI image, which are spliced to generate the segmenion result of the ROI image. The GCN module is used to capture the spatial and semantic dependencies among image patches of the ROI image, by constructing the graph using the segmentation masks of the image patches. Based on the learned features by the GCN module, the classification result of the ROI image can be obtained. Experimental results on the grand challenge on BreAst Cancer Histology images (BACH) 2018 dataset [17] show that, the proposed segmentation and classification method outperforms the winner of BACH 2018 significantly, which demonstrates the effectiveness of the proposed method.

References

  1. Ahmed Fakhry, Tao Zeng, Shuiwang Ji: Residual Deconvolutional Networks for Brain Electron Microscopy Image Segmentation. IEEE Trans. Med. Imaging 36(2): 447--456 (2017)Google ScholarGoogle ScholarCross RefCross Ref
  2. Richard E. Fine: Diagnostic Techniques. B. C. Decker, Inc., Ontario, 2nd edn. (2006)Google ScholarGoogle Scholar
  3. Anant Madabhushi, George Lee: Image Analysis and Machine Learning in Digital Pathology: Challenges and Opportunities. Medical Image Analysis 33: 170--175 (2016)Google ScholarGoogle ScholarCross RefCross Ref
  4. Joann G Elmore, Gary M Longton, Patricia A Carney, Berta M Geller, Tracy Onega, Anna N A Tosteson, Heidi D Nelson, Margaret S Pepe, Kimberly H Allison, Stuart J Schnitt, Frances P O'Malley, Donald L Weaver: Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA (2015)Google ScholarGoogle Scholar
  5. Dinggang Shen, Guorong Wu, and Heung-Il Suk, Deep Learning in Medical Image Analysis, Annual Review of Biomedical Engineering 19: 221--248 (2017).Google ScholarGoogle Scholar
  6. Christoph Haarburger, Michael Baumgartner, Mirjam Broeckmann, Hannah Schneider, Simone Schwabing, Christiane Kuhl, Dorit Merhof: Multi Scale Curriculum CNN for Context-Aware Breast MRI Malignancy Classification. MICCAI (2019)Google ScholarGoogle Scholar
  7. William Lotter, Greg Sorensen, David Cox: A Multi-Scale CNN and Curriculum Learning Strategy for Mammogram Classification. MICCAI (2017)Google ScholarGoogle Scholar
  8. Mohammad Hossein Askari Hemmat, Sina Honari, Lucas Rouhier, Christian S. Perone, Julien Cohen-Adad, Yvon Savaria, Jean-Pierre David: U-Net Fixed-Point Quantization for Medical Image Segmentation. ISBI (2019)Google ScholarGoogle Scholar
  9. Jonathan Long, Evan Shelhamer, Trevor Darrell: Fully Convolutional Networks for Semantic Segmentation. CVPR 2015: 3431--3440.Google ScholarGoogle Scholar
  10. Ruoyu Li, Jiawen Yao, Xinliang Zhu, Yeqing Li, Junzhou Huang: Graph CNN for Survival Analysis on Whole Slide Pathological Images. MICCAI (2018)Google ScholarGoogle Scholar
  11. Zhao-Min Chen, Xiu-Shen Wei, Peng Wang, Yanwen Guo: Multi-Label Image Recognition with Graph Convolutional Networks. CVPR (2019)Google ScholarGoogle Scholar
  12. Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia: Pyramid Scene Parsing Network. CVPR (2017)Google ScholarGoogle Scholar
  13. Sachin Mehta, Mohammad Rastegari, Anat Caspi, Linda Shapiro, Hannaneh Hajishirzi: ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation. ECCV (2018)Google ScholarGoogle Scholar
  14. Sachin Mehta, Mohammad Rastegari, Linda Shapiro, Hannaneh Hajishirzi: ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network. arXiv:1811.11431Google ScholarGoogle Scholar
  15. Olaf Ronneberger, Philipp Fischer, Thomas Brox: U-Net: Convolutional Networks for Biomedical Image Segmentation. MICCAI (2015)Google ScholarGoogle Scholar
  16. Sachin Mehta, Ezgi Mercan, Jamen Bartlett, Donald Weave, Joann G Elmore, Linda Shapiro: Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images. MICCAI (2018)Google ScholarGoogle Scholar
  17. Guilherme Aresta, Teresa Araújo, Scotty Kwok, Sai Saketh Chennamsetty, Mohammed Safwan, et al.: BACH: grand challenge on breast cancer histology images. MIA (2019)Google ScholarGoogle Scholar
  18. Scotty Kwok: Multiclass Classification of Breast Cancer in Whole-Slide Images. Lecture Notes in Computer Science, volume 10882. doi:10.1007/978-3-319-93000-8_106.Google ScholarGoogle Scholar
  19. Sai Saketh Chennamsetty, Mohammed Safwan, Varghese Alex: Classification of Breast Cancer Histology Image using Ensemble of Pre-trained Neural Networks. Image Analysis and Recognition. doi:10.1007/978-3-319-93000-8-91.Google ScholarGoogle Scholar
  20. Bahram Marami, Marcel Prastawa, Monica Chan, Michael Donovan, Gerardo Fernandez, Jack Zeineh:Ensemble Network for Region Identification in Breast Histopathology Slides. Image Analysis and Recognition. doi:10.1007/978-3-319-93000-8_98.Google ScholarGoogle Scholar
  21. Nadia Brancati, Maria Frucci, Daniel Riccio: Multi-classification of Breast Cancer Histology Images by Using a Fine-Tuning Strategy LNCS, volume 10882.doi:10.1007/978-3-319-93000-8_87.Google ScholarGoogle Scholar

Index Terms

  1. Improving Histopathological Image Segmentation and Classification using Graph Convolution Network

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          ICCPR '19: Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition
          October 2019
          522 pages
          ISBN:9781450376570
          DOI:10.1145/3373509

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 25 March 2020

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader