Abstract
Breast cancer has the highest prevalence in women globally. The classification of breast cancer histopathological images has always been a hot spot of clinical concern. In Computer-Aided Diagnosis (CAD), traditional models mostly use a single network to extract features, which has significant limitations. Besides, many networks are trained and optimized on patient-level datasets, ignoring the lower-level labels. This paper proposes a deep ensemble model based on image-level labels for the binary classification of benign and malignant breast histopathological images. First, the BreakHis dataset is randomly divided into training, validation and test sets. Then, data augmentation techniques are used to balance the number of benign and malignant samples. Thirdly, VGG-16, Xception, Resnet-50, Densenet-201 are selected as the base classifiers resulting from their complementarity. Finally, with accuracy as the ensemble weight, an accuracy of 98.90% is achieved. In order to verify the capabilities of our method, the latest Transformer and Multilayer Perception (MLP) models have been experimentally compared on the same dataset. Our model wins with a 5–20% advantage, emphasizing the ensemble model’s far-reaching significance in classification tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anda, J.: Histopathology image classification using an ensemble of deep learning models. Sensors 20 (2020)
Das, K., Karri, S., Roy, A., et al.: Classifying histopathology whole-slides using fusion of decisions from deep convolutional network on a collection of random multi-views at multi-magnification. In: Proceedings of ISBI 2017, pp. 1024–1027 (2017)
Graham, B., El-Nouby, A., Touvron, H., et al.: Levit: a vision transformer in convnet’s clothing for faster inference. In: Proceedings of ICCV 2021, pp. 12,259–12,269 (2021)
Gurcan, M., Boucheron, L., Can, A., et al.: Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2, 147–171 (2009)
Hadad, O., Ran, B., Ben-Ari, R., et al.: Ensemble learning (2009)
He, K., Zhang, X., Ren, S., et al.: Deep residual learning for image recognition. In: Proceedings of CVPR 2016, pp. 770–778 (2016)
Hu, C., Sun, X., Yuan, Z., et al.: Classification of breast cancer histopathological image with deep residual learning. Int. J. Imaging Syst. Technol. 31, 1583–1594 (2021)
Huang, G., Liu, Z., Van Der Maaten, L., et al.: Densely connected convolutional networks. In: Proceedings of CVPR 2017, pp. 4700–4708 (2017)
Kassani, S., Kassani, P., Wesolowski, M., et al.: Classification of histopathological biopsy images using ensemble of deep learning networks (2019)
Kolesnikov, A., Dosovitskiy, A., Weissenborn, D., et al.: An image is worth 16x16 words: Transformers for image recognition at scale (2021)
Li, J., Zhang, J., Sun, Q., et al.: Breast cancer histopathological image classification based on deep second-order pooling network, pp. 1–7 (2020)
Liu, H., Dai, Z., So, D., et al.: Pay attention to mlps. Adv. Neural. Inf. Process. Syst. 34, 9204–9215 (2021)
Matos, D., J., A., B.J., Oliveira, L., et al.: Histopathologic image processing: a review. arXiv: 1904.07900 (2019)
Petushi, S., Garcia, F., Haber, M., et al.: Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer. BMC Med. Imaging 6(1), 1–11 (2006)
Rahaman, M., Li, C., Yao, Y., et al.: Identification of covid-19 samples from chest x-ray images using deep learning: a comparison of transfer learning approaches. J. Xray Sci. Technol. 28(5), 821–839 (2020)
Ribani, R., Marengoni, M.: A survey of transfer learning for convolutional neural networks. In: Proceedings of SIBGRAPI 2019, pp. 47–57 (2019)
Schuster, M., Paliwal, K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673–2681 (1997)
Senousy, Z., Abdelsamea, M., Gaber, M., et al.: Mcua: multi-level context and uncertainty aware dynamic deep ensemble for breast cancer histology image classification. IEEE Transactions on Biomedical Engineering, pp. 1–1 (2021)
Senousy, Z., Abdelsamea, M., Mostafa Mohamed, M., et al.: 3e-net: Entropy-based elastic ensemble of deep convolutional neural networks for grading of invasive breast carcinoma histopathological microscopic images. Entropy 23, 620 (2021)
Shukla, K., Tiwari, A., Sharma, S., er al.: Classification of histopathological images of breast cancerous and non cancerous cells based on morphological features. Biomed. Pharmacol. J. 10(1), 353–366 (2017)
Siegel, R., Miller, K., Fuchs, H., et al.: Cancer statistics, 2021. CA: A Cancer J. Clin. 71(1), 7–33 (2021)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2014)
Spanhol, F., Oliveira, L., Petitjean, C., et al.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2015)
Srinivas, A., Lin, T., Parmar, N., et al.: Bottleneck transformers for visual recognition, pp. 16,519–16,529 (2021)
Szegedy, C., Liu, W., Jia, Y., et al.: Going deeper with convolutions, pp. 1–9 (2015)
Tolstikhin, I., Houlsby, N., Kolesnikov, A., et al.: Mlp-mixer: an all-mlp architecture for vision. In: Advances in Neural Information Processing Systems, vol. 34 (2021)
Touvron, H., Bojanowski, P., Caron, M., et al.: Resmlp: Feedforward networks for image classification with data-efficient training. arXiv: 2105.03404 (2021)
Touvron, H., Cord, M., Douze, M., et al.: Training data-efficient image transformers & distillation through attention, pp. 10,347–10,357 (2021)
Touvron, H., Cord, M., Sablayrolles, A., et al.: Going deeper with image transformers. In: Proceedings of ICCV 2021, pp. 32–42 (2021)
Xu, W., Xu, Y., Chang, T., et al.: Co-scale conv-attentional image transformers. In: Proceedings of ICCV 2021, pp. 9981–9990 (2021)
Yan, R., Ren, F., Wang, Z., et al.: Breast cancer histopathological image classification using a hybrid deep neural network. Methods 173, 52–60 (2020)
Yang, Z., Ran, L., Zhang, S., et al.: Ems-net: ensemble of multiscale convolutional neural networks for classification of breast cancer histology images. Neurocomputing 366, 46–53 (2019)
Yuan, L., Chen, Y., Wang, T., et al.: Tokens-to-token vit: training vision transformers from scratch on imagenet. In: Proceedings of ICCV 2021, pp. 558–567 (2021)
Zhou, X., Li, C., Rahaman, M., et al.: A comprehensive review for breast histopathology image analysis using classical and deep neural networks. IEEE Access 8, 90931–90956 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, Y. et al. (2022). Image Classification in Breast Histopathology Using Transfer and Ensemble Learning. In: Pietka, E., Badura, P., Kawa, J., Wieclawek, W. (eds) Information Technology in Biomedicine. ITIB 2022. Advances in Intelligent Systems and Computing, vol 1429. Springer, Cham. https://doi.org/10.1007/978-3-031-09135-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-09135-3_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-09134-6
Online ISBN: 978-3-031-09135-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)