Abstract
The quality of classification is crucial in medical applications. Especially when it comes to confirm that the patient does not have a malignant tumor. An example of such an application is a binary classification of breast tumor malignancy based on histopathological images. This paper explains the most popular attention mechanism in convolution neural networks as follows. Convolutional Block Attention Module, Attention Augmented Convolution, and Attention Guided Convolutional Neural Networks. Four neural networks are built and compared. Each is evaluated in the classification problem of histopathological images of breast cancer. On the basis of the results, it is clear that some attentional neural networks can outperform standard convolutional networks in the classification of breast cancer. In our investigation, the convolution networks reached an accuracy level of 90% and an AUC-ROC of 95.9%. It is worse compared to the Convolutional Block Attention Module Network (accuracy 90.7%, AUC-ROC 96.9%) and the Attention-Guided Convolutional Network (accuracy 91.2%, AUC-ROC 96.6%). Attention-augmented convolution remains behind the standard convolutional network, achieving 88.9% accuracy and 94.8% AUC-ROC. The Attention-Guided Convolution Network was the best network of all four. We also compared precision, NPV, sensitivity, specificity, and \(F_{1}\)-score. We came to the conclusion that the Convolutional Block Attention Module network has the highest NPV (90.8%) and sensitivity (96.2%), while the Attention-Guided Convolutional Neural Network scored the highest in precision (92.4%) and specificity (82.9%).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
How common is breast cancer? ACS (2020). https://www.cancer.org/cancer/breast-cancer/about/how-common-is-breast-cancer.html
Ba, J.L., Kiros, J.R., Hinton, G.E.: Layer normalization (2016)
Bello, I., Zoph, B., Vaswani, A., Shlens, J., Le, Q.V.: Attention augmented convolutional networks (2019)
Beykikhoshk, A., Quinn, T.P. Lee, S.C., Tran, T., Venkatesh, S.: DeepTRIAGE: interpretable and individualised biomarker scores using attention mechanism for the classification of breast cancer sub-types (2019)
Chen, D., Qian, G., Pan, Q.: Breast cancer classification with electronic medical records using hierarchical attention bidirectional networks. In: IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 983–988 (2018)
Cheng, J., Dong, L., Lapata, M.: Long short-term memory-networks for machine reading (2016)
Cruz-Roa, A.: Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks. In: Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 9041 (2014)
Deng, J., Ma, Y., Li, D., Zhao, J., Liu, Y., Zhang, H.: Classification of breast density categories based on self-attention neural networks. In: Computer Methods and Programs in Biomedicine, vol. 193 (2020)
El Hage Chehade, H., Headon, H., Tokhy, O., Heeney, J., Kasem, A., Mokbel, K.: Is sentinel lymph node biopsy a viable alternative to complete axillary dissection following neoadjuvant chemotherapy in women with node positive breast cancer at diagnosis? An updated meta-analysis involving 3398 patients. Am. J. Surg. 2021 (2016)
Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position (1980)
Gao, S.: Hierarchical attention networks for information extraction from cancer pathology reports. J. Am. Med. Inf. Assoc. JAMIA 25 (2017)
Guan, Q., Huang, Y., Zhong, Z., Zheng, Z., Zheng, L., Yang, Y.: Diagnose like a radiologist: attention guided convolutional neural network for thorax disease classification (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015)
Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks (2016)
Janowczyk, A., Madabhushi, A.: Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases. J. Pathol. Inf. 7 (2016)
Kang, X., Liu, X., Nie, X., Xi, X., Yin, Y.: Attention model enhanced network for classification of breast cancer image (2020)
LeCun, Y., Haffner, P., Bottou, L., Bengio, Y.: Object recognition with gradient based learning (1999)
Lei, H., Liu, S., Elazab, A., Lei, B.: Attention-guided multi-branch convolutional neural network for mitosis detection from histopathological images. IEEE J. Biomed. Health Inf. (2020)
Li, S., Dong, M., Du, G., Mu, X.: Attention dense-u-net for automatic breast mass segmentation in digital mammogram. IEEE Access 7, 59037–59047 (2019)
Liang, Y., Yang, J., Quan, X., Zhang, H.: Metastatic breast cancer recognition in histopathology images using convolutional neural network with attention mechanism. In: Chinese Automation Congress (CAC) 2019, pp. 2922–2926 (2019)
Luo, L.: Deep angular embedding and feature correlation attention for breast MRI cancer analysis (2019)
Luz, D.-S., Lima, T.-J., Silva, R.-R., Magalhães, D.-M., Araujo, F.-H.: Automatic detection metastasis in breast histopathological images based on ensemble learning and color adjustment. Biomed. Sig. Process. Control (2022)
van der Noordaa, M.: Major reduction in axillary lymph node dissections after neoadjuvant systemic therapy for node-positive breast cancer by combining PET/CT and the MARI procedure. Ann. Surg. Oncol. 25 (2018)
Sanyal, R., Jethanandani, M., Sarkar, R.: DAN: breast cancer classification from high-resolution histology images using Deep Attention Network. In: Sharma, M.K., Dhaka, V.S., Perumal, T., Dey, N., Tavares, J.M.R.S. (eds.) Innovations in Computational Intelligence and Computer Vision. AISC, vol. 1189, pp. 319–326. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-6067-5_35
Spanhol, F. de Oliveira, L.S., Petitjean, C., Heutte, L.: A dataset for breast cancer histopathological image classification (2015)
Tharwat, A.: Classification assessment methods: a detailed tutorial (2018)
Toğaçar, M., Özkurt, K., Ergen, B., Cömert, Z.: BreastNet: a novel convolutional neural network model through histopathological images for the diagnosis of breast cancer. Physica A 545 (2019)
Vaswani, A.: Attention is all you need (2017)
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., Lang, K.: Phoneme recognition using time-delay neural networks (1989)
Wang, J., Liu, Q., Xie, H., Yang, Z., Zhou, H.: Boosted EfficientNet: detection of lymph node metastases in breast cancer using convolutional neural network (2020)
Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_1
Xu, B., et al.: Attention by selection: a deep selective attention approach to breast cancer classification. IEEE Trans. Med. Imaging 39, 1930–1941 (2020)
Xu, K.: Show, attend and tell: neural image caption generation with visual attention (2015)
Xuan, P., Sheng, N., Zhang, T., Liu, Y., Guo, Y.: CNNDLP: a method based on convolutional autoencoder and convolutional neural network with adjacent edge attention for predicting lncRNA-disease associations. Int. J. Mol. Sci. 20, 42–60 (2019)
Yang, H., Kim, J., Kim, H., Adhikari, S.P.: Guided soft attention network for classification of breast cancer histopathology images. IEEE Trans. Med. Imaging 39, 1306–1315 (2020)
Yang, Y., Fasching, P.A., Tresp, V.: Modeling progression free survival in breast cancer with tensorized recurrent neural networks and accelerated failure time models. In: Proceedings of Machine Learning Research vol. 68, pp. 164–176 (2017)
Yao, H., Zhang, X., Zhou, X., Liu, S.: Parallel structure deep neural network using CNN and RNN with an attention mechanism for breast cancer histology image classification. Cancers 11 (2019)
Zagoruyko, S., Komodakis, N.: Paying more attention to attention: improving the performance of convolutional neural networks via attention transfer (2016)
Zeiler, M., Fergus, R.: Visualizing and understanding convolutional neural networks (2013)
Zhong, Y., et al.: Dilated and soft attention-guided convolutional neural network for breast cancer histology images classification. Microscopy Res. Tech. 85, 4 (2022)
Li, R., Wang, S., Wang, Z.: Breast cancer X-ray image staging: based on efficient net with multi-scale fusion and cbam attention. J. Phys. Conf. Ser. (2021)
Songsaeng, C., Pradaranon, V., Chaichulee, S.: Multi-scale convolutional neural networks for classification of digital mammograms with breast calcifications. IEEE Access (2021)
Zou, Y., Zhang, J., Huang, S., Liu, B.: Breast cancer histopathological image classification using attention high-order deep network. Int. J. Imaging Syst. Technol. (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ziąber, M., Przystalski, K., Białas, P., Rudnicki, W., Łuczyńska, E. (2023). Comparison of Attention Mechanism in Convolutional Neural Networks for Binary Classification of Breast Cancer Histopathological Images. In: Arai, K. (eds) Advances in Information and Communication. FICC 2023. Lecture Notes in Networks and Systems, vol 651. Springer, Cham. https://doi.org/10.1007/978-3-031-28076-4_51
Download citation
DOI: https://doi.org/10.1007/978-3-031-28076-4_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28075-7
Online ISBN: 978-3-031-28076-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)