Convolutional Neural Networks based classification of breast ultrasonography images by hybrid method with respect to benign, malignant, and normal using mRMR

https://doi.org/10.1016/j.compbiomed.2021.104407Get rights and content

Highlights

  • Breast cancer ultrasound images were diagnosed and classified with the proposed hybrid model.

  • In this study, features obtained from Alexnet, Mobilenet, and Resnet50 architectures were concatenated. (It has been observed that the hybrid feature extraction structure yielded better results).

  • The accuracy rate of the hybrid model is 95.6%.

Abstract

Early diagnosis of breast lesions and differentiation of malignant lesions from benign lesions are important for the prognosis of breast cancer. In the diagnosis of this disease ultrasound is an extremely important radiological imaging method because it enables biopsy as well as lesion characterization. Since ultrasonographic diagnosis depends on the expert, the knowledge level and experience of the user is very important. In addition, the contribution of computer aided systems is quite high, as these systems can reduce the workload of radiologists and reinforce their knowledge and experience when considered together with a dense patient population in hospital conditions. In this paper, a hybrid based CNN system is developed for diagnosing breast cancer lesions with respect to benign, malignant and normal. Alexnet, MobilenetV2, and Resnet50 models are used as the base for the Hybrid structure. The features of these models used are obtained and concatenated separately. Thus, the number of features used are increased. Later, the most valuable of these features are selected by the mRMR (Minimum Redundancy Maximum Relevance) feature selection method and classified with machine learning classifiers such as SVM, KNN. The highest rate is obtained in the SVM classifier with 95.6% in accuracy.

Introduction

Breast lesions are three-dimensional space-occupying lesions of the breast. Benign and malignant breast lesions consist of many diseases with very different radiological features. Breast cancer is the most common type of cancer in women and ranks second in cancer-related deaths after lung cancer [1]. Therefore, early diagnosis of breast lesions and differentiation of malignant lesions from benign lesions are extremely important for the prognosis of patients [2]. The main radiological methods used in imaging breast lesions are mammography, ultrasonography, and magnetic resonance imaging. Mammography is soft tissue radiography that allows the breast to be viewed. Breast ultrasonography is a nonionizing and noninvasive imaging method in which sound waves are used. It is an extremely important imaging method in distinguishing solid-cystic breast lesions and characterizing solid lesions. It provides important information about the vascularity of the lesions with Doppler ultrasonography. It also guides the biopsy of breast lesions. Recently, with the use of high-frequency ultrasonography probes with advanced technologies, even small breast lesions can be seen in ultrasonography. In addition, since the mammography of patients with dense breasts is not sufficiently diagnostic, ultrasonography is used in these patients in order not to overlook the lesion and to diagnose it at an early stage [3]. Ultrasonography is preferred especially in young patients to prevent radiation exposure of the breast. In addition to being inexpensive, easily accessible, reproducible, and not containing ionizing radiation, breast ultrasonography has important advantages [4]. Our aim in this study is to classify benign, malignant, and normal breast lesions by using deep learning methods in ultrasonographic images. With the developing technology, deep learning architectures are becoming popular day by day [5].

In this study, three different CNN models such as Alexnet, Resnet50, and MobilenetV2 are used for concatenating features. Later, the features taken from these architectures are classified with various classifiers. Finally, in the proposed model, features from Alexnet, Resnet50, and MobilenetV2 are concatenated. The mRMR feature selection method is used to reduce the size of these concatenated features and to save time and cost. The best features obtained with mRMR have been classified in various classifiers such as SVM, KNN which are very popular machine learning classifiers. According to the results we obtained in this study, it shows that computer-aided systems can be used more frequently in medical application [6].

There are articles on breast cancer classification in the literature. Kwon et al. proposed an automatic breast ultrasound system for breast cancer evaluation. Here, two different imaging techniques have been used to compare their diagnostic performances. 136 asymptomatic women were used in the study. It was observed that the sensitivity and specifity values were similar in both imaging techniques. In this study, the specifity values of 97.7% in the 2-VST method and 95.2% in the 3-VST method were obtained [7].

Sun et al. conducted a classification procedure using 2395 breast ultrasound images of 479 breast cancer patients. In the CNN model they used, they worked with two classes of images, benign and malignant. His AUC value in his studies is 95%. They also stated that the CNN model they used was Densenet201 [8].

Zhang et al. stated that they collected ultrasound images from 2 hospitals in their study. They stated that there were 2822, 707, 210 images, respectively, in the data set they obtained, and these images were used both in training the model and testing the model. In this study, the accuracy value they obtained was 92.86. They used deep learning architectures in their study [9].

Kim et al. focused on the ABUS method in their work on automatic breast ultrasound scanning for dense breasts. They shared the use of this method and the results they obtained in ultrasound images. It was seen that different sensitivity and specifity values were obtained here [10].

Masud et al. classified breast cancer ultrasound images in their study. Here they combined 2 different data sets. They used pre-trained CNN models in their work. They divided the data in the data set into 3 classes with the CNN model they proposed. These classes are malignant, benign, and normal. In the model they recommend, the accuracy value is 100% and the AUC value is 1 [11].

In their study, Zhang et al. analysed four pre-trained CNN models in a dataset of ultrasound images. They achieved the highest AUC of 0.90 among these pre-trained models [12].

Moon et al. aimed to diagnose breast cancer using ultrasound images in their study. They used 2 different data sets in their studies. Using the image fusion method, they brought together different CNN methods. They stated that they achieved an accuracy of 91.10% in their first dataset and 94.62% in their second dataset [13].

Kim et al. Proposed a deep learning-based method using breast ultrasound images in their study. Different performance criteria were calculated in this study. The AUC value was found to be 89% [14].

Moon et al. used ultrasound images for the diagnosis of breast cancer in their study. The difference between the proposed method and the traditional method is that they used 3-D Convolutional Neural Networks architectures. They have calculated different performance metrics in these studies they have done. The accuracy rate they achieved in their study was 96.7% [15].

Breast cancer ultrasound images are classified and presented to the expert in this study. It will be easier for the expert to interpret these images and individual mistakes will be avoided. In addition, thanks to computer-aided systems, the workload of experts will be reduced. This system offers the possibility to use it for pre-diagnosis in non-specialist places. The roughly hybrid model is presented in Fig. 1.

Breast cancer is getting more common day by day. Interpretation of each patient's data by the specialist can cause problems in terms of time and cost. Computer-aided systems can be used in the diagnosis process to prevent errors that may occur in traditional methods. A CNN-based hybrid model has been proposed to diagnose and classify breast cancer images, especially in images. An accuracy rate of 95.6% was achieved with the proposed hybrid model. When the obtained results are compared with the studies in the literature, it has been observed that the proposed hybrid method reaches a higher accuracy value. It has been followed that the developed hybrid model can successfully classify breast cancer ultrasound images.

In the first section of the paper, general information is given, and the relevant literature has been examined. The purpose of the paper is mentioned in the 1.2. contribution. In chapter two, the data set used is examined, then the structure of the developed hybrid architecture is detailed. In chapter three, the results and details of the study are given, the performance criteria used in CNN models are also examined, and the performance criteria of the proposed hybrid model are evaluated. Chapter four is discussion and final chapter is conclusion.

Section snippets

Background

In this section, the data set used, data augmentation techniques, used models and the proposed method are examined.

Experimental results

This study was implemented in Matlab 2019b environment. While 80% of the images in the data set were used for train operation, 20% of them were used for testing. The training parameters of the CNN methods used in the paper are given in Table 1. It is not possible for CNN models to process all data in the data set simultaneously with normal computers in terms of time and memory. To solve this problem, it is necessary to divide the data sets into small pieces. In this way, giving data to models

Discussion

Breast imaging is used in the evaluation of breast lesions in cases such as painful breasts and the presence of a palpable mass. Ultrasonography is an indispensable method for imaging the breast. It is also used as a complement to mammography and magnetic resonance imaging. Mammography is preferred primarily in the evaluation of breast lesions in elderly women. On the other hand, ultrasonography is the preferred imaging method, especially in young patients, to avoid the radiation risk of

Conclusion

The need to save time and money and increase efficiency cannot be denied due to the busy patient population and workload in hospitals today. For all these reasons, the use of deep learning methods in the evaluation of medical images attracts a great deal of attention. It is thought that deep learning methods will have an important place in detecting and classifying the presence of lesions in breast ultrasound. With the proposed hybrid method in the paper, an accuracy rate of 95.6% was achieved.

Declaration of competing interest

There is no conflict of interest in this study. Also, the environment and animals were not harmed.

Acknowledgements

Authors thank owners of the database: https://europepmc.org/article/pmc/pmc6906728#sec1 [16] for sharing their data.

References (44)

  • R.L. Siegel et al.

    Cancer statistics

    CA A Cancer J. Clin.

    (2018)
  • H.D. Cheng et al.

    Automated breast cancer detection and classification using ultrasound images: a survey

    Pattern Recogn.

    (2010)
  • N. Ohuchi et al.

    Sensitivity and specificity of mammography and adjunctive ultrasonography to screen for breast cancer in the Japan Strategic Anti-cancer Randomized Trial (J-START): a randomised controlled trial

    Lancet

    (2016)
  • A. Kornecki

    Current status of breast ultrasound

    Can. Assoc. Radiol. J.

    (2011)
  • H. Chen et al.

    The rise of deep learning in drug discovery

    Drug Discov. Today

    (2018)
  • V. Sree et al.

    A novel machine learning framework for automated detection of arrhythmias in ECG segments

    J. Ambient. Intell. human. Compute.

    (2021)
  • B.R. Kwon et al.

    Automated breast ultrasound system for breast cancer evaluation: diagnostic performance of the two-view scan technique in women with small breasts

    Korean J. Radiol.

    (2020)
  • Q. Sun et al.

    Deep learning vs. radiomics for predicting axillary lymph node metastasis of breast cancer using ultrasound images: don't forget the peritumoral region

    Front. Oncol.

    (2020)
  • Xianyu Zhang

    Evaluating the accuracy of breast cancer and molecular subtype diagnosis by ultrasound image deep learning model

    Front. Oncol.

    (2021)
  • S.H. Kim et al.

    Automated breast ultrasound screening for dense breasts

    Korean J. Radiol.

    (2020)
  • M. Masud et al.

    Convolutional neural network-based models for diagnosis of breast cancer

    (2020)
  • H. Zhang et al.

    Diagnostic efficiency of the breast ultrasound computer-aided prediction model based on convolutional neural network in breast cancer

    J. Digit. Imag.

    (2020)
  • W.K. Moon et al.

    Computer-aided diagnosis of breast ultrasound images using ensemble learning from convolutional neural networks

    Comput. Methods Progr. Biomed.

    (2020)
  • S.Y. Kim et al.

    Deep learning-based computer-aided diagnosis in screening breast ultrasound to reduce false-positive diagnoses

    Sci. Rep.

    (2021)
  • W.K. Moon et al.

    Computer-aided tumor detection in automated breast ultrasound using a 3-D convolutional neural network

    Comput. Methods Progr. Biomed.

    (2020)
  • W. Al-Dhabyani et al.

    Dataset of breast ultrasound images

    Data in Brief

    (2020 Feb)
  • A. Gudigar

    Local preserving class separation framework to identify gestational diabetes mellitus mother using ultrasound fetal cardiac image

  • T.H. Pham et al.

    Development of breast papillary index for differentiation of benign and malignant lesions using ultrasound images

    J Ambient. Intell. Human. Comput.

    (2021)
  • X. Yan et al.

    Intelligent fault diagnosis of rotating machinery using improved multiscale dispersion entropy and mRMR feature selection

    Knowl. Base Syst.

    (2019)
  • H. Peng et al.

    Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

    IEEE Trans. Pattern Anal. Mach. Intell.

    (2005)
  • Shu Lih Oh

    Classification of heart sound signals using a novel deep wave net model

    Comput. Methods Progr. Biomed.

    (2020)
  • Xinle Wang

    Celiac disease diagnosis from videocapsule endoscopy images with residual learning and deep feature extraction

    Comput. Methods Progr. Biomed.

    (2020)
  • Cited by (74)

    • Breast cancer diagnosis: A systematic review

      2024, Biocybernetics and Biomedical Engineering
    View all citing articles on Scopus
    View full text