Abstract
The fine-grained classification or grading of breast cancer pathological images is of great value in clinical application. However, the manual feature extraction methods not only require professional knowledge, but also the cost of feature extraction is high, especially the high quality features. In this paper, we devise an improved deep convolution neural network model to achieve accurate fine-grained classification or grading of breast cancer pathological images. Meanwhile, we use online data augmentation and transfer learning strategy to avoid model overfitting. According to the issue that small inter-class variance and large intra-class variance exist in breast cancer pathological images, multi-class recognition task and verification task of image pair are combined in the representation learning process; in addition, the prior knowledge (different subclasses with relatively large distance and small distance between the same subclass) are embedded in the process of feature extraction. At the same time, the prior information that pathological images with different magnification belong to the same subclass will be embedded in the feature extraction process, which will lead to less sensitive with image magnification. Experimental results on two different pathological image datasets show that the performance of our method is better than that of state-of-the-arts, with good robustness and generalization ability.
Xipeng Pan, Lingqiao Li—Authors contributed equally.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Stewart, B., Wild, C.P.: World Cancer Report 2014. International Agency for Research on Cancer, World Health Organization (2014)
Han, Z., Wei, B., Zheng, Y., Yin, Y., Li, K. Li, S.: Breast cancer multi-classification from histopathological images with structured deep learning model. Sci. Rep. 7(1) (2017). https://doi.org/10.1038/s41598-017-04075-z
Dimitropoulos, K., Barmpoutis, P., Zioga, C., Kamas, A., Patsiaoura, K., Grammalidis, N.: Grading of Invasive Breast Carcinoma through Grassmannian VLAD encoding. PLoS ONE 12(9), e0185110 (2017)
Janowczyk, A., Madabhushi, A.: Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases. J. Pathol. Inform. 7, 29 (2016)
Gupta, V., Singh, A., Sharma, K., et al.: Automated classification for breast cancer histopathology images: is stain normalization important? In: Computer Assisted and Robotic Endoscopy and Clinical Image-Based Procedures (2017)
Gupta, V., Bhavsar, A.: Breast cancer histopathological image classification: is magnification important? In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 769–776. Honolulu, HI (2017)
Spanhol, F.A., Oliveira, L.S., Petitjean, C., Heutte, L.: Breast cancer histopathological image classification using convolutional neural networks. In: 2016 International Joint Conference on Neural Networks, pp. 2560–2567, Vancouver, BC, Canada (2016)
Spanhol, F.A., Oliveira, L.S., Petitjean, C., et al.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2016)
Gupta, V., Bhavsar, A.: An integrated multi-scale model for breast cancer histopathological image classification with joint colour-texture features. In: Computer Analysis of Images and Patterns: 17th International Conference, CAIP, Ystad, Sweden (2017)
Wei, B., Han, Z., He, X., Yin, Y.: Deep learning model based breast cancer bistro pathological image classification. In: 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA) (2017)
Song, Y., Zou, J., Chang, H., et al.: Adapting fisher vectors for histopathology image classification. In: International Symposium on Biomedical Imaging, pp. 600–603. IEEE Press (2017)
Song, Y., Chang, H., Huang, H., Cai, W.: Supervised Intra-embedding of fisher vectors for histopathology image classification. In: Descoteaux M., Maier-Hein L., Franz A., Jannin P., Collins D., Duchesne S. (eds.) Medical Image Computing and Computer-Assisted Intervention—MICCAI 2017. Lecture Notes in Computer Science, vol. 10435. Springer, Cham (2017)
Chollet, F.: Xception: Deep Learning with Depthwise Separable Convolutions (2016). arXiv:1610.02357
Sun, Y., Chen, Y., Wang, X., et al.: Deep learning face representation by joint identification-verification. In: International Conference on Neural Information Processing Systems, pp. 1988–1996. MIT Press (2014)
Lu, H., Li, Y., Chen, M.: Brain Intelligence: Go Beyond Artificial Intelligence (2017)
Lu, H., Li, B., Zhu, J.: Wound intensity correction and segmentation with convolutional neural networks. J. Concurr. Comput. Pract. Exp. (2016)
Lu, H., Li, Y., Uemura, T.: FDCNet: filtering deep convolutional network for marine organism classification. J. Multimed. Tools Appl. 1–14 (2017)
Acknowledgements
The authors would like to thank Spanhol et al. [8], and Dimitropoulos et al. [3] for publishing the datasets. We would like to express our gratitude to anonymous reviewers and editor for helpful comments. This research was supported in part by the National Natural Science Foundation of China (Grant Nos. 21365008, 61462018, 61762026 and 61562013), and Natural Science Foundation of Guangxi Province (No. 2017GXNSFDA198025 and 2017GXNSFAA198278).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Pan, X. et al. (2020). Multi-task Deep Learning for Fine-Grained Classification/Grading in Breast Cancer Histopathological Images. In: Lu, H. (eds) Cognitive Internet of Things: Frameworks, Tools and Applications. ISAIR 2018. Studies in Computational Intelligence, vol 810. Springer, Cham. https://doi.org/10.1007/978-3-030-04946-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-04946-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04945-4
Online ISBN: 978-3-030-04946-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)