Abstract
This paper proposes an ensemble deep learning system for the early detection of breast cancer. Unlike traditional ensemble learning that processes the whole image, the proposed system processes only the Suspected Nodule Regions (SNRs), extracted using an optimal dynamic thresholding method, where the threshold varies corresponding to the details of each input image. The SNRs affords better performance and offer the ability to detect small size nodules. The ensemble is composed of four transfer learning Convolutional Neural Networks (CNNs) (i.e., AlexNet, ResNet-50, ResNet-101, and DenseNet-201). A binary Support Vector Machine (SVM) follows each CNN model to provide either a malignant or a benign score. To obtain the final system decision, the first-order momentum is derived over the four binary outputs of the ensemble CNNs and the final decision is guided by the four CNNs’ training accuracies. The proposed ensemble fusion scheme, tested on Region of Interest (ROI) images, using the public digital medical images Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM), achieves an accuracy of 94% to distinguish between Malignant (M) and Benign (B) classes and of 95% to distinguish between Malignant Mass (MM) and Benign Mass (BM) nodules. Comparison with related methods on the same data confirms the accuracy and advantages of the proposed ensemble system.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Alizadehsani R, Roshanzamir M, Hussain S, Khosravi A, Koohestani A, Zangooei MH, Abdar M, Beykikhoshk A, Shoeibi A, Zare A, et al. (2021) Handling of uncertainty in medical data using machine learning and probability theory techniques: a review of 30 years (1991–2020). Ann Oper Res 1–42. https://doi.org/10.1007/s10479-021-04006-2
Altaf F, Islam SM, Akhtar N, Janjua NK (2019) Going deep in medical image analysis: Concepts, methods, challenges, and future directions. IEEE Access 7:99540–99572
Ansar W, Shahid AR, Raza B, Dar AH (2020) Breast cancer detection and localization using mobilenet based transfer learning for mammograms. In: International symposium on intelligent computing systems. Springer, pp 11–21
Bennett K, Demiriz A (1998) Semi-supervised support vector machines. Adv Neural Inf Process Syst 11:368–374
Bowyer K, Kopans D, Kegelmeyer W, Moore R, Sallam M, Chang K, Woods K (1996) The digital database for screening mammography. In: 3rd international workshop on digital mammography, vol 58, p 27
Castro E, Cardoso JS, Pereira JC (2018) Elastic deformations for data augmentation in breast cancer mass detection. In: 2018 IEEE EMBS international conference on biomedical and health informatics (BHI). IEEE, pp 230–234
Chan HP, Samala RK, Hadjiiski LM, Zhou C (2020) Deep learning in medical image analysis. In: Deep learning in medical image analysis. Springer, pp 3–21
Chen Y, Zhang Q, Wu Y, Liu B, Wang M, Lin Y (2018) Fine-tuning resnet for breast cancer classification from mammography. In: The international conference on healthcare science and engineering. Springer, pp 83–96
Deepa S, Subbiah BV (2013) Efficient ROI segmentation of digital mammogram images using Otsu’s N thresholding method. Natl J Adv Comput Manag 4(1)
DeSantis CE, Ma J, Gaudet MM, Newman LA, Miller KD, Goding Sauer A, Jemal A, Siegel RL (2019) Breast cancer statistics, 2019. CA Cancer J Clin 69(6):438–451
Gunn SR (1998) Support vector machines for classification and regression. ISIS Techn Rep 14(1):5–16
Hekal AA, Elnakib A, Moustafa HED (2021) Automated early breast cancer detection and classification system. Signal, Image Video Process 15:1–9
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
Huang XL, Ma X, Hu F (2018) Machine learning and intelligent communications. Mob Netw Appl 23(1):68–70
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
Lameski P, Zdravevski E, Mingov R, Kulakov A (2015) SVM parameter tuning with grid search and its impact on reduction of model over-fitting. In: Rough sets, fuzzy sets, data mining, and granular computing. Springer, pp 464–474
Lee RS, Gimenez F, Hoogi A, Rubin D (2016) Curated breast imaging subset of DDSM. Cancer Imaging Arch 8:2016
Lévy D, Jain A (2016) Breast mass classification from mammograms using deep convolutional neural networks. arXiv preprint arXiv:1612.00542
Li H, Zhuang S, Da Li, Zhao J, Ma Y (2019) Benign and malignant classification of mammogram images based on deep learning. Biomed Signal Process Control 51:347–354
Matheus BRN, Schiabel H (2011) Online mammographic images database for development and comparison of cad schemes. J Digit Imaging 24(3):500–506
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66
Patil RS, Biradar N (2020) Automated mammogram breast cancer detection using the optimized combination of convolutional and recurrent neural network. Evolut Intell 14:1–16
Pisner DA, Schnyer DM (2020) Support vector machine. In: Machine learning. Elsevier, pp 101–121
Ragab DA, Sharkas M, Marshall S, Ren J (2019) Breast cancer detection using deep convolutional neural networks and support vector machines. PeerJ 7:e6201
Suzuki S, Zhang X, Homma N, Ichiji K, Sugita N, Kawasumi Y, Ishibashi T, Yoshizawa M (2016) Mass detection using deep convolutional neural network for mammographic computer-aided diagnosis. In: 2016 55th annual conference of the society of instrument and control engineers of Japan (SICE). IEEE, pp 1382–1386
Swetha T, Bindu CH (2015) Detection of breast cancer with hybrid image segmentation and Otsu’s thresholding. In: 2015 international conference on computing and network communications (CoCoNet). IEEE, pp 565–570
Tsochatzidis L, Costaridou L, Pratikakis I (2019) Deep learning for breast cancer diagnosis from mammograms-a comparative study. J Imaging 5(3):37
WHO (2020) Breast cancer. https://www.who.int/cancer/prevention/diagnosis-screening/breast-cancer/en/. Accessed 7 Nov 2020
Wu P, Li H, Zeng N, Li F (2022) FMD-Yolo: an efficient face mask detection method for COVID-19 prevention and control in public. Image Vis Comput 117:104341
Xi P, Shu C, Goubran R (2018) Abnormality detection in mammography using deep convolutional neural networks. In: 2018 IEEE international symposium on medical measurements and applications (MeMeA). IEEE, pp 1–6
Yi D, Sawyer RL, Cohn III D, Dunnmon J, Lam C, Xiao X, Rubin D (2017) Optimizing and visualizing deep learning for benign/malignant classification in breast tumors. arXiv preprint arXiv:1705.06362
Zeng N, Wang Z, Zineddin B, Li Y, Du M, Xiao L, Liu X, Young T (2014) Image-based quantitative analysis of gold immunochromatographic strip via cellular neural network approach. IEEE Trans Med Imaging 33(5):1129–1136
Zeng N, Li H, Peng Y (2021) A new deep belief network-based multi-task learning for diagnosis of Alzheimer’s disease. Neural Comput Appl 1–12. https://doi.org/10.1007/s00521-021-06149-6
Zhu W, Zeng N, Wang N (2010) Sensitivity, specificity, accuracy, associated confidence interval and roc analysis with practical SAS implementations. NESUG Proc: Health Care Life Sci, Baltimore, Maryland 19:67
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hekal, A.A., Moustafa, H.ED. & Elnakib, A. Ensemble deep learning system for early breast cancer detection. Evol. Intel. 16, 1045–1054 (2023). https://doi.org/10.1007/s12065-022-00719-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12065-022-00719-w