Abstract
Computer-aided diagnoses are playing a remarkable role in analyzing the MRI images and thus assist the radiologist. The brain tumor is one of the most common and incursive diseases, leading to a very short life expectancy in their highest grade. Early detection of the brain tumor and its proper diagnosis may increase the survival rate of a patient. This paper has developed an intelligent system based on the fusion of histogram of oriented gradient and deep CNN-based neural features from MRI in the identification of tumors. This research has performed Principle Component Analysis as a feature optimization technique to attain more intuitive features from the fused feature vector. A machine learning-based ensemble classifier based on bagging and boosting known as Bootstrap Aggregation is then used on the optimized fusion vector to detect the tumor. An extensive experiment is performed using four types of MRI sequences T1, T2, T1c, and Flair from two publicly available datasets BRATS 2013 and BRATS 2015. This fusion-based method gives a satisfactory performance with a detection accuracy of 98.79% using a fivefold cross-validation technique.
Similar content being viewed by others
Data availability
The datasets used in the paper are publicly available. Proper acknowledgments with citation guidelines are maintained for the use of these datasets.
References
American Brain Tumor Association (2020) Available online: https://www.abta.org/. Accessed 16 Jun 2020
Banerjee S, Mitra S, Masulli F, Rovetta S (2018) Brain tumor detection and classification from multi-sequence MRI: study using ConvNets. In: International MICCAI brainlesion workshop, pp 170–179
Tiwari A, Srivastava S, Pant M (2020) Brain tumor segmentation and classification from magnetic resonance images: review of selected methods from 2014 to 2019. Pattern Recognit Lett 131:244–260
Zhou C, Chen S, Ding C, Tao D (2018) Learning contextual and attentive information for brain tumor segmentation. In: International MICCAI brainlesion workshop, pp 497–507
Laukamp KR et al (2019) Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI. Eur Radiol 29(1):124–132. https://doi.org/10.1007/s00330-018-5595-8
Abbasi S, Tajeripour F (2017) Detection of brain tumor in 3D MRI images using local binary patterns and histogram orientation gradient. Neurocomputing 219:526–535
Tandel GS et al (2019) A review on a deep learning perspective in brain cancer classification. Cancers 11(1):111
Chahal PK, Pandey S, Goel S (2020) A survey on brain tumor detection techniques for MR images. Multimed Tools Appl 79:21771–21814. https://doi.org/10.1007/s11042-020-08898-32020
Gordillo N, Montseny E, Sobrevilla P (2013) State of the art survey on MRI brain tumor segmentation. Magn Reson Imaging 31(8):1426–1438
Mohsen H, El-Dahshan E-SA, El-Horbaty E-SM, Salem A-BM (2018) Classification using deep learning neural networks for brain tumors. Future Comput Inform J 3(1):68–71
Seetha J, Raja SS (2018) Brain tumor classification using convolutional neural networks. Biomed Pharmacol J 11(3):1457
Chaplot S, Patnaik LM, Jagannathan NR (2006) Classification of magnetic resonance brain images using wavelets as input to support vector machine and neural network. Biomed Signal Process Control 1(1):86–92
Amin SE, Megeed MA (2012) Brain tumor diagnosis systems based on artificial neural networks and segmentation using MRI. In: 2012 8th international conference on informatics and systems (INFOS), p MM-119
Saba T, Mohamed AS, El-Affendi M, Amin J, Sharif M (2020) Brain tumor detection using fusion of hand crafted and deep learning features. Cogn Syst Res 59:221–230
Zhang YD, Wu L, Wang S (2011) Magnetic resonance brain image classification by an improved artificial bee colony algorithm. Prog Electromagn Res 116:65–79
Bhagwat K, More D, Shinde S, Daga A, Tornekar R (2013) Comparative study of brain tumor detection using K-means, fuzzy C means and hierarchical clustering algorithms. Int J Sci Eng Res 2:626–632
Yasmin M, Sharif M, Masood S, Raza M, Mohsin S (2012) Brain image enhancement—a survey. World Appl Sci J 17(9):1192–1204
Salem N, Malik H, Shams A (2019) Medical image enhancement based on histogram algorithms. Proc Comput Sci 163:300–311
Madhukumar S, Santhiyakumari N (2015) Evaluation of k-means and fuzzy C-means segmentation on MR images of brain. Egypt J Radiol Nucl Med 46(2):475–479
Alam MS, Rahman MM, Hossain MA, Islam MK, Ahmed KM, Ahmed KT, Singh BC, Miah MS (2019) Automatic human brain tumor detection in MRI image using template-based K means and improved fuzzy C means clustering algorithm. Big Data Cogn Comput 3(2):27
Aslam A, Khan E, Beg MS (2015) Improved edge detection algorithm for brain tumor segmentation. Proc Comput Sci 58:430–437
Dam E, Loog M, Letteboer M (2004) Integrating automatic and interactive brain tumor segmentation. In: Proceedings of the 17th international conference on pattern recognition (ICPR 2004). IEEE, pp 790–793
Kaus MR, Warfield SK, Nabavi A, Black PM, Jolesz FA, Kikinis R (2001) Automated segmentation of MR images of brain tumors. Radiology 218:586–591
Meier R, Bauer S, Slotboom J, Wiest R, Reyes M (2013) A hybrid model for multimodal brain tumor segmentation. Multimodal Brain Tumor Segmentation 31:31–37
Menze BH et al (2014) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024
Pinto A, Pereira S, Rasteiro D, Silva CA (2018) Hierarchical brain tumour segmentation using extremely randomized trees. Pattern Recognit 82:105–117
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 886–893
Sarwinda D, Bustamam A (2018) 3D-HOG features-based classification using MRI images to early diagnosis of Alzheimer’s disease. In: 2018 IEEE/ACIS 17th international conference on computer and information science (ICIS), pp 457–462
Visual Geometry Group—University of Oxford (2020) Available online: https://www.robots.ox.ac.uk/~vgg/research/very_deep/. Accessed 16 Jun 2020
Nandi D, Ashour AS, Samanta S, Chakraborty S, Salem MA, Dey N (2015) Principal component analysis in medical image processing: a study. Int J Image Min 1(1):65–86
Peng H, Long F, Ding C (2005) Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238
Rokach L (2010) Ensemble-based classifiers. Artif Intell Rev 33(1–2):1–39
El-Melegy MT, Abo El-Magd KM, Ali SA, Hussain KF, Mahdy YB (2019) Ensemble of multiple classifiers for automatic multimodal brain tumor segmentation. In: 2019 international conference on innovative trends in computer engineering (ITCE), Aswan, Egypt, pp 58–63. https://doi.org/10.1109/itce.2019.8646431
Wang Z, Xiao H, He W, Wen F, Yuan K (2013) Real-time SIFT-based object recognition system. In: 2013 IEEE international conference on mechatronics and automation, pp 1361–1366
Weninger L, Rippel O, Koppers S, Merhof D (2018) Segmentation of brain tumors and patient survival prediction: methods for the BRATS 2018 challenge. In: International MICCAI brainlesion workshop, pp 3–12
Ari A, Hanbay D (2018) Deep learning based brain tumor classification and detection system. Turk J Electr Eng Comput Sci 26:2275–2286
Suter Y, Jungo A, Rebsamen M, Knecht U, Herrmann E, Wiest R, Reyes M (2018) Deep learning versus classical regression for brain tumor patient survival prediction. In: International MICCAI brainlesion workshop. Springer, pp 429–440
Li Y, Shen L (2017) Deep learning based multimodal brain tumor diagnosis. In: International MICCAI brainlesion workshop. Springer, pp 149–158
Nie D, Zhang H, Adeli E, Liu L, Shen D (2016) 3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 212–220
Chato L, Latifi S (2017) Machine learning and deep learning techniques to predict overall survival of brain tumor patients using MRI images. In: International conference on bioinformatics and bioengineering (BIBE). IEEE, pp 9–14
Amarapur B (2020) Computer-aided diagnosis applied to MRI images of brain tumor using cognition based modified level set and optimized ANN classifier. Multimed Tools Appl 79:3571–3599
Acknowledgements
We are very grateful to Dr. Md. Farhan Matin, Associate Professor, Department of Radiology and Imaging, Uttara Adhunik Medical College & Hospital, Dhaka, Bangladesh for his valuable suggestions.
Funding
No funding was received for this research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships. Therefore, there are no competing interests.
Human and animal rights
This article does not contain any studies with animals and human performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mostafiz, R., Uddin, M.S., Alam, NA. et al. MRI-based brain tumor detection using the fusion of histogram oriented gradients and neural features. Evol. Intel. 14, 1075–1087 (2021). https://doi.org/10.1007/s12065-020-00550-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12065-020-00550-1