Skip to main content

Advertisement

SpringerLink
Log in

PFP-HOG: Pyramid and Fixed-Size Patch-Based HOG Technique for Automated Brain Abnormality Classification with MRI

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Detecting neurological abnormalities such as brain tumors and Alzheimer’s disease (AD) using magnetic resonance imaging (MRI) images is an important research topic in the literature. Numerous machine learning models have been used to detect brain abnormalities accurately. This study addresses the problem of detecting neurological abnormalities in MRI. The motivation behind this problem lies in the need for accurate and efficient methods to assist neurologists in the diagnosis of these disorders. In addition, many deep learning techniques have been applied to MRI to develop accurate brain abnormality detection models, but these networks have high time complexity. Hence, a novel hand-modeled feature-based learning network is presented to reduce the time complexity and obtain high classification performance. The model proposed in this work uses a new feature generation architecture named pyramid and fixed-size patch (PFP). The main aim of the proposed PFP structure is to attain high classification performance using essential feature extractors with both multilevel and local features. Furthermore, the PFP feature extractor generates low- and high-level features using a handcrafted extractor. To obtain the high discriminative feature extraction ability of the PFP, we have used histogram-oriented gradients (HOG); hence, it is named PFP-HOG. Furthermore, the iterative Chi2 (IChi2) is utilized to choose the clinically significant features. Finally, the k-nearest neighbors (kNN) with tenfold cross-validation is used for automated classification. Four MRI neurological databases (AD dataset, brain tumor dataset 1, brain tumor dataset 2, and merged dataset) have been utilized to develop our model. PFP-HOG and IChi2-based models attained 100%, 94.98%, 98.19%, and 97.80% using the AD dataset, brain tumor dataset1, brain tumor dataset 2, and merged brain MRI dataset, respectively. These findings not only provide an accurate and robust classification of various neurological disorders using MRI but also hold the potential to assist neurologists in validating manual MRI brain abnormality screening.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data Availability

The data used in this study were downloaded from https://www.kaggle.com/tourist55/alzheimers-dataset-4-class-of-images, https://www.kaggle.com/sartajbhuvaji/brain-tumor-classification-mri, and https://wiki.cancerimagingarchive.net/.

References

  1. Mesin L: Biomedical Image Processing and Classification. Electronics 10(1):66, 2021. https://doi.org/10.3390/electronics10010066

  2. Smith-Bindman R, et al.: Trends in use of medical imaging in US health care systems and in Ontario, Canada, 2000-2016. Jama 322:843-856, 2019

    PubMed  PubMed Central  Google Scholar 

  3. Malik M, Jaffar MA, Naqvi MR: Comparison of Brain Tumor Detection in MRI Images Using Straightforward Image Processing Techniques and Deep Learning Techniques. Proc. 2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA): City

  4. Schobert IT, Savic LJ: Current Trends in Non-Invasive Imaging of Interactions in the Liver Tumor Microenvironment Mediated by Tumor Metabolism. Cancers 13:3645, 2021

    CAS  PubMed  PubMed Central  Google Scholar 

  5. Sternberg SR: Biomedical image processing. Computer 16:22-34, 1983

    Google Scholar 

  6. Jin D, et al.: Artificial Intelligence in Medicine Technical Basis and Clinical Applications, Chapter 14 - Artificial intelligence in radiology, p 265–289, 2021. https://doi.org/10.1016/B978-0-12-821259-2.00014-4

  7. Razmjooy N, et al.: Computer-aided diagnosis of skin cancer: A review. Current medical imaging 16:781-793, 2020

    PubMed  Google Scholar 

  8. Talo M, Yildirim O, Baloglu UB, Aydin G, Acharya UR: Convolutional neural networks for multi-class brain disease detection using MRI images. Computerized Medical Imaging and Graphics 78:101673, 2019

    PubMed  Google Scholar 

  9. Gudigar A, Raghavendra U, Hegde A, Kalyani M, Ciaccio EJ, Acharya UR: Brain pathology identification using computer aided diagnostic tool: A systematic review. Computer methods and programs in biomedicine 187:105205, 2020

    PubMed  Google Scholar 

  10. Haq EU, Huang J, Kang L, Haq HU, Zhan T: Image-based state-of-the-art techniques for the identification and classification of brain diseases: a review. Medical & Biological Engineering & Computing:1–18, 2020

  11. Lin W, et al.: Bidirectional Mapping of Brain MRI and PET With 3D Reversible GAN for the Diagnosis of Alzheimer’s Disease. Frontiers in Neuroscience 15:357, 2021

    Google Scholar 

  12. Fernandes SL, Tanik UJ, Rajinikanth V, Karthik KA: A reliable framework for accurate brain image examination and treatment planning based on early diagnosis support for clinicians. Neural Computing and Applications 32:15897-15908, 2020

    Google Scholar 

  13. Tandel GS, Balestrieri A, Jujaray T, Khanna NN, Saba L, Suri JS: Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm. Computers in Biology and Medicine 122:103804, 2020

    PubMed  Google Scholar 

  14. Zhao X, Ang CKE, Acharya UR, Cheong KH: Application of Artificial Intelligence techniques for the detection of Alzheimer’s disease using structural MRI images. Biocybernetics and Biomedical Engineering, 2021

  15. Saba T, Mohamed AS, El-Affendi M, Amin J, Sharif M: Brain tumor detection using fusion of hand crafted and deep learning features. Cognitive Systems Research 59:221-230, 2020

    Google Scholar 

  16. Rauschecker AM, et al.: Artificial intelligence system approaching neuroradiologist-level differential diagnosis accuracy at brain MRI. Radiology 295:626-637, 2020

    PubMed  Google Scholar 

  17. Dosovitskiy A, et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:201011929, 2020

  18. Tolstikhin I, et al.: MLP-Mixer: An all-MLP Architecture for Vision. arXiv preprint arXiv:210501601, 2021

  19. Bahadure NB, Ray AK, Thethi HP: Image analysis for MRI based brain tumor detection and feature extraction using biologically inspired BWT and SVM. International journal of biomedical imaging 2017, 2017

  20. Lahmiri S: Glioma detection based on multi-fractal features of segmented brain MRI by particle swarm optimization techniques. Biomedical Signal Processing and Control 31:148-155, 2017

    Google Scholar 

  21. Gudigar A, Raghavendra U, Ciaccio EJ, Arunkumar N, Abdulhay E, Acharya UR: Automated categorization of multi-class brain abnormalities using decomposition techniques with MRI images: a comparative study. IEEE Access 7:28498-28509, 2019

    Google Scholar 

  22. Ahmed S, et al.: Ensembles of patch-based classifiers for diagnosis of Alzheimer diseases. IEEE Access 7:73373-73383, 2019

    Google Scholar 

  23. Nayak DR, Dash R, Majhi B, Acharya UR: Application of fast curvelet Tsallis entropy and kernel random vector functional link network for automated detection of multiclass brain abnormalities. Computerized Medical Imaging and Graphics 77:101656, 2019

    PubMed  Google Scholar 

  24. Talo M, Baloglu UB, Yıldırım Ö, Acharya UR: Application of deep transfer learning for automated brain abnormality classification using MR images. Cognitive Systems Research 54:176-188, 2019

    Google Scholar 

  25. Gudigar A, Raghavendra U, San TR, Ciaccio EJ, Acharya UR: Application of multiresolution analysis for automated detection of brain abnormality using MR images: A comparative study. Future Generation Computer Systems 90:359-367, 2019

    Google Scholar 

  26. Acharya UR, et al.: Automated detection of Alzheimer’s disease using brain MRI images–a study with various feature extraction techniques. Journal of Medical Systems 43:1-14, 2019

    Google Scholar 

  27. Koh JEW, et al.: Automated detection of Alzheimer's disease using bi-directional empirical model decomposition. Pattern Recognition Letters 135:106-113, 2020

    Google Scholar 

  28. Mehmood A, Maqsood M, Bashir M, Shuyuan Y: A deep siamese convolution neural network for multi-class classification of alzheimer disease. Brain sciences 10:84, 2020

    PubMed  PubMed Central  Google Scholar 

  29. Ghassemi N, Shoeibi A, Rouhani M: Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images. Biomedical Signal Processing and Control 57:101678, 2020

    Google Scholar 

  30. Afshar P, Mohammadi A, Plataniotis KN: BayesCap: A Bayesian Approach to Brain Tumor Classification Using Capsule Networks. IEEE Signal Processing Letters 27:2024-2028, 2020

    Google Scholar 

  31. Poyraz AK, Dogan S, Akbal E, Tuncer T: Automated brain disease classification using exemplar deep features. Biomedical Signal Processing and Control 73:103448, 2022

    Google Scholar 

  32. El-Latif AAA, Chelloug SA, Alabdulhafith M, Hammad M: Accurate Detection of Alzheimer’s Disease Using Lightweight Deep Learning Model on MRI Data. Diagnostics 13:1216, 2023

    PubMed  PubMed Central  Google Scholar 

  33. Muezzinoglu T, et al.: PatchResNet: Multiple Patch Division–Based Deep Feature Fusion Framework for Brain Tumor Classification Using MRI Images. Journal of Digital Imaging:1–15, 2023

  34. Gupta RK, Bharti S, Kunhare N, Sahu Y, Pathik N: Brain tumor detection and classification using cycle generative adversarial networks. Interdisciplinary Sciences: Computational Life Sciences 14:485-502, 2022

    PubMed  Google Scholar 

  35. Dalal N, Triggs B: Histograms of oriented gradients for human detection. Proc. 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05): City

  36. Tuncer T, Dogan S, Subasi A: A new fractal pattern feature generation function based emotion recognition method using EEG. Chaos, Solitons & Fractals 144:110671, 2021

    Google Scholar 

  37. Silva DJ, Amaral JS, Amaral VS: Broad multi-parameter dimensioning of magnetocaloric systems using statistical learning classifiers. Frontiers in Energy Research 8:121, 2020

    Google Scholar 

  38. Dubey S: Alzheimer’s Dataset (4 Class of Images). Kaggle, Dec, 2019. https://www.kaggle.com/datasets/tourist55/alzheimers-dataset-4-class-of-images

  39. Kang J, Gwak J: Deep Learning-Based Brain Tumor Classification in MRI images using Ensemble of Deep Features. Journal of the Korea Society of Computer and Information 26:37-44, 2021

    Google Scholar 

  40. Brain Tumor Classification (MRI). Available at https://www.kaggle.com/sartajbhuvaji/brain-tumor-classification-mri/discussion.

  41. Scarpace L, et al.: Radiology data from the cancer genome atlas glioblastoma multiforme [TCGA-GBM] collection. The Cancer Imaging Archive 11:1, 2016

    Google Scholar 

  42. Clark K, et al.: The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. Journal of digital imaging 26:1045-1057, 2013

    PubMed  PubMed Central  Google Scholar 

  43. Pedano N, et al.: Radiology data from the cancer genome atlas low grade glioma [TCGA-LGG] collection. The Cancer Imaging Archive 2, 2016

  44. Nagabushanam P, Thomas George S, Radha S: EEG signal classification using LSTM and improved neural network algorithms. Soft Computing 24:9981-10003, 2020

    Google Scholar 

  45. Goutte C, Gaussier E: A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. Proc. European conference on information retrieval: City

  46. Khodatars M, et al.: Deep learning for neuroimaging-based diagnosis and rehabilitation of autism spectrum disorder: a review. Computers in Biology and Medicine 139:104949, 2021

    PubMed  Google Scholar 

  47. Puspaningrum EY, Wahid RR, Amaliyah RP: Alzheimer’s Disease Stage Classification using Deep Convolutional Neural Networks on Oversampled Imbalance Data. Proc. 2020 6th Information Technology International Seminar (ITIS): City

  48. Acharya H, Mehta R, Singh DK: Alzheimer Disease Classification Using Transfer Learning. Proc. 2021 5th International Conference on Computing Methodologies and Communication (ICCMC): City

  49. Fu’adah Y, Wijayanto I, Pratiwi N, Taliningsih F, Rizal S, Pramudito M: Automated Classification of Alzheimer’s Disease Based on MRI Image Processing using Convolutional Neural Network (CNN) with AlexNet Architecture. Proc. Journal of Physics: Conference Series: City

  50. Subramoniam M: Deep learning based prediction of Alzheimer's disease from magnetic resonance images. arXiv preprint arXiv:210104961, 2021

  51. Liang S, Gu Y: Computer-Aided Diagnosis of Alzheimer’s Disease through Weak Supervision Deep Learning Framework with Attention Mechanism. Sensors 21:220, 2021

    Google Scholar 

  52. Alshammari M, Mezher M: A Modified Convolutional Neural Networks For MRI-based Images For Detection and Stage Classification Of Alzheimer Disease. Proc. 2021 National Computing Colleges Conference (NCCC): City

  53. Murugan S, et al.: DEMNET: a deep learning model for early diagnosis of Alzheimer diseases and dementia from MR images. IEEE Access 9:90319-90329, 2021

    Google Scholar 

  54. Saleh A, Sukaik R, Abu-Naser SS: Brain Tumor Classification Using Deep Learning. Proc. 2020 International Conference on Assistive and Rehabilitation Technologies (iCareTech): City

  55. Kang J, Ullah Z, Gwak J: Mri-based brain tumor classification using ensemble of deep features and machine learning classifiers. Sensors 21:2222, 2021

    PubMed  PubMed Central  Google Scholar 

  56. Shoaib M, Elshamy M, Taha T, El-Fishawy A, Abd El-Samie F: Practical Implementation for Brain Tumor Classification with Convolutional Neural Network: EasyChair, 2021

  57. Khan I, Ahsan K, Hasan MA, Sattar A: Brain Tumor Analysis Using Deep Neural Network. Proc. 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS): City

  58. Raghavendra U, et al.: Feature‐versus deep learning‐based approaches for the automated detection of brain tumor with magnetic resonance images: A comparative study. International Journal of Imaging Systems and Technology, 2021

  59. Hsieh KL-C, Lo C-M, Hsiao C-J: Computer-aided grading of gliomas based on local and global MRI features. Computer methods and programs in biomedicine 139:31–38, 2017

  60. Anaraki AK, Ayati M, Kazemi F: Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms. biocybernetics and biomedical engineering 39:63–74, 2019

  61. Sert E, Özyurt F, Doğantekin A: A new approach for brain tumor diagnosis system: Single image super resolution based maximum fuzzy entropy segmentation and convolutional neural network. Medical hypotheses 133:109413, 2019

    PubMed  Google Scholar 

  62. Banerjee S, Mitra S, Masulli F, Rovetta S: Brain tumor detection and classification from multi-sequence MRI: Study using convnets. Proc. International MICCAI brainlesion workshop: City

  63. Cha S: Update on brain tumor imaging: from anatomy to physiology. American Journal of Neuroradiology 27:475-487, 2006

    CAS  PubMed  PubMed Central  Google Scholar 

  64. Kim R, et al.: Prognosis prediction of non-enhancing T2 high signal intensity lesions in glioblastoma patients after standard treatment: application of dynamic contrast-enhanced MR imaging. European radiology 27:1176-1185, 2017

    PubMed  Google Scholar 

  65. Gharzeddine K, Hatzoglou V, Holodny AI, Young RJ: MR perfusion and MR spectroscopy of brain neoplasms. Radiologic Clinics 57:1177-1188, 2019

    PubMed  Google Scholar 

  66. Frisoni GB, Fox NC, Jack CR, Scheltens P, Thompson PM: The clinical use of structural MRI in Alzheimer disease. Nature Reviews Neurology 6:67-77, 2010

    PubMed  PubMed Central  Google Scholar 

  67. Jack Jr CR, Holtzman DM: Biomarker modeling of Alzheimer’s disease. Neuron 80:1347-1358, 2013

    CAS  PubMed  PubMed Central  Google Scholar 

  68. Arbabshirani MR, Plis S, Sui J, Calhoun VD: Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls. Neuroimage 145:137-165, 2017

    PubMed  Google Scholar 

  69. Patterson C: The state of the art of dementia research: New frontiers. World Alzheimer Report 2018, p. 148. 2018, Available online: https://apo.org.au/node/260056

Download references

Author information

Authors and Affiliations

  1. Department of Radiology, Elazig Fethi Sekin City Hospital, Elazig, Turkey

    Ela Kaplan

  2. Imaging Department, Gleneagles Hospital Kuala Lumpur, Jalan Ampang, Kampung Berembang, 50450, Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, Malaysia

    Wai Yee Chan

  3. Department of Radiology, Faculty of Medicine, Duzce University, Duzce, Turkey

    Hasan Baki Altinsoy

  4. Department of Computer Engineering, College of Engineering, Erzurum Technical University, Erzurum, Turkey

    Mehmet Baygin

  5. School of Business (Information System), University of Southern Queensland, Springfield, Australia

    Prabal Datta Barua

  6. Faculty of Science, Agriculture, Business and Law, School of Science and Technology, University of New England, Armidale, NSW, 2351, Australia

    Subrata Chakraborty

  7. Center for Advanced Modelling and Geospatial Information Systems, Faculty of Engineering and IT, University of Technology Sydney, Sydney, NSW, 2007, Australia

    Subrata Chakraborty

  8. Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey

    Sengul Dogan & Turker Tuncer

  9. School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia

    U. Rajendra Acharya

Authors
  1. Ela Kaplan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wai Yee Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hasan Baki Altinsoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mehmet Baygin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Prabal Datta Barua
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Subrata Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sengul Dogan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Turker Tuncer
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. U. Rajendra Acharya
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA; formal analysis, EK, WYC, HBA, MB, PDB; investigation, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA; methodology, EK, WYC, HBA, MB, PDB; software, SD, TT; project administration, URA; resources, EK, WYC, HBA; supervision, URA; validation, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA; visualization, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA; writing—original draft, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA; writing—review and editing, EK, WYC, HBA, MB, PDB, SC, SD, TT, URA. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Sengul Dogan.

Ethics declarations

Ethical Approved

Not applicable.

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kaplan, E., Chan, W.Y., Altinsoy, H.B. et al. PFP-HOG: Pyramid and Fixed-Size Patch-Based HOG Technique for Automated Brain Abnormality Classification with MRI. J Digit Imaging 36, 2441–2460 (2023). https://doi.org/10.1007/s10278-023-00889-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-023-00889-8

Keywords

Search

Navigation