skip to main content
research-article

Doctor's Dilemma: Evaluating an Explainable Subtractive Spatial Lightweight Convolutional Neural Network for Brain Tumor Diagnosis

Published: 26 October 2021 Publication History

Abstract

In Medicine Deep Learning has become an essential tool to achieve outstanding diagnosis on image data. However, one critical problem is that Deep Learning comes with complicated, black-box models so it is not possible to analyze their trust level directly. So, Explainable Artificial Intelligence (XAI) methods are used to build additional interfaces for explaining how the model has reached the outputs by moving from the input data. Of course, that's again another competitive problem to analyze if such methods are successful according to the human view. So, this paper comes with two important research efforts: (1) to build an explainable deep learning model targeting medical image analysis, and (2) to evaluate the trust level of this model via several evaluation works including human contribution. The target problem was selected as the brain tumor classification, which is a remarkable, competitive medical image-based problem for Deep Learning. In the study, MR-based pre-processed brain images were received by the Subtractive Spatial Lightweight Convolutional Neural Network (SSLW-CNN) model, which includes additional operators to reduce the complexity of classification. In order to ensure the explainable background, the model also included Class Activation Mapping (CAM). It is important to evaluate the trust level of a successful model. So, numerical success rates of the SSLW-CNN were evaluated based on the peak signal-to-noise ratio (PSNR), computational time, computational overhead, and brain tumor classification accuracy. The objective of the proposed SSLW-CNN model is to obtain faster and good tumor classification with lesser time. The results illustrate that the SSLW-CNN model provides better performance of PSNR which is enhanced by 8%, classification accuracy is improved by 33%, computation time is reduced by 19%, computation overhead is decreased by 23%, and classification time is minimized by 13%, as compared to state-of-the-art works. Because the model provided good numerical results, it was then evaluated in terms of XAI perspective by including doctor-model based evaluations such as feedback CAM visualizations, usability, expert surveys, comparisons of CAM with other XAI methods, and manual diagnosis comparison. The results show that the SSLW-CNN provides good performance on brain tumor diagnosis and ensures a trustworthy solution for the doctors.

References

[1]
A. B. Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, ... and R. Chatila. 2020. Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion 58, 82–115.
[2]
W. Samek, G. Montavon, A. Vedaldi, L. K. Hansen, and K. R. Müller, (Eds.). 2019. Explainable AI: Interpreting, explaining and visualizing deep learning, Vol. 11700. Springer Nature.
[3]
A. Shrestha and A. Mahmood. 2019. Review of deep learning algorithms and architectures. IEEE Access 7 (2019), 53040–53065.
[4]
E. Charniak. 2019. Introduction to Deep Learning. The MIT Press.
[5]
M. Z. Alom, T. M. Taha, C. Yakopcic, S. Westberg, P. Sidike, M. S. Nasrin, ... and V. K. Asari. 2019. A state-of-the-art survey on deep learning theory and architectures. Electronics 8, 3 (2019), 292.
[6]
C. P. Janssen, S. F. Donker, D. P. Brumby, and A. L. Kun. 2019. History and future of human-automation interaction. International Journal of Human-Computer Studies 131, 99–107.
[7]
W. L. Woo. 2020. Future trends in I&M: Human-machine co-creation in the rise of AI. IEEE Instrumentation & Meas. Magazine 23, 2 (2020), 71–73.
[8]
A. Adadi and M. Berrada. 2018. Peeking inside the black-box: A survey on explainable artificial int. (XAI). IEEE Access 6, 52138–52160.
[9]
W. Samek, T. Wiegand, and K. R. Müller. 2017. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296.
[10]
E. Daglarli. 2020. Explainable artificial intelligence (xAI) approaches and deep meta-learning models. In Adv. in Deep Learning. IntechOpen.
[11]
A. Mortazi and U. Bagci. 2018. Automatically designing CNN architectures for medical image segmentation. In International Workshop on Machine Learning in Medical Imaging. Springer, Cham, 98–106.
[12]
F. Gao, T. Wu, J. Li, B. Zheng, L. Ruan, D. Shang, and B. Patel. 2018. SD-CNN: A shallow-deep CNN for improved breast cancer diagnosis. Computerized Medical Imaging and Graphics 70, 53–62.
[13]
L. Zou, J. Zheng, C. Miao, M. J. Mckeown, and Z. J. Wang. 2017. 3D CNN based automatic diagnosis of attention deficit hyperactivity disorder using functional and structural MRI. IEEE Access 5 (2017), 23626–23636.
[14]
L. Duran-Lopez, J. P. Dominguez-Morales, A. F. Conde-Martin, S. Vicente-Diaz, and A. Linares-Barranco. 2020. PROMETEO: A CNN-based computer-aided diagnosis system for WSI prostate cancer detection. IEEE Access 8 (2020), 128613–128628.
[15]
S. H. Wang, V. V. Govindaraj, J. M. Górriz, X. Zhang, and Y. D. Zhang. 2020. Covid-19 classification by FGCNet with deep feature fusion from graph convolutional network and convolutional neural network. Information Fusion 67 (2020), 208–229.
[16]
S. H. Wang, D. R. Nayak, D. S. Guttery, X. Zhang, and Y. D. Zhang. 2020. COVID-19 classification by CCSHNet with deep fusion using transfer learning and discriminant correlation analysis. Information Fusion 68 (2020), 131–148.
[17]
Y. D. Zhang, S. C. Satapathy, D. S. Guttery, J. M. Górriz, and S. H. Wang. 2021. Improved breast cancer classification through combining graph convolutional network and convolutional neural network. Information Processing & Management 58, 2 (2021), 102439.
[18]
J. B. Lamy, B. Sekar, G. Guezennec, J. Bouaud, and B. Séroussi. 2019. Explainable artificial intelligence for breast cancer: A visual case-based reasoning approach. Artificial Intelligence in Medicine 94, 42–53.
[19]
Z. Papanastasopoulos, R. K. Samala, H. P. Chan, L. Hadjiiski, C. Paramagul, M. A. Helvie, and C. H. Neal. 2020. Explainable AI for medical imaging: Deep-learning CNN ensemble for classification of estrogen receptor status from breast MRI. In Medical Imaging 2020: Computer-Aided Diagnosis, Vol. 11314. International Society for Optics and Photonics, p. 113140Z.
[20]
R. LaLonde, D. Torigian, and U. Bagci. 2020. Encoding visual attributes in capsules for explainable medical diagnoses. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 294–304.
[21]
H. Mohsen, E. S. A. El-Dahshan, E. S. M. El-Horbaty, and A. B. M. Salem. 2018. Classification using deep learning neural networks for brain tumors. Future Computing and Informatics Journal 3, 1 (2018), 68–71.
[22]
M. Sajjad, S. Khan, K. Muhammad, W. Wu, A. Ullah, and S. W. Baik. 2019. Multi-grade brain tumor classification using deep CNN with extensive data augmentation. Journal of Computational Science 30, 174–182.
[23]
P. R. E. Arasi and M. A. Suganthi. 2019. Clinical support system for brain tumor classification using soft computing techniques. Journal of Medical Systems 43, 5 (2019), 144.
[24]
A. Ari and D. Hanbay. 2018. Deep learning based brain tumor classification and detection system. Turkish Journal of Electrical Engineering & Computer Sciences 26, 5 (2018), 2275–2286.
[25]
J. Seetha and S. S. Raja. 2018. Brain tumor classification using convolutional neural networks. Biomedical & Pharmacology Jour 11, 3 (2018), 1457.
[26]
K. R. Laukamp, F. Thiele, G. Shakirin, D. Zopfs, A. Faymonville, M. Timmer, and J. Borggrefe. 2019. Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI. European Radiology 29, 1 (2019), 124–132.
[27]
N. B. Bahadure, A. K. Ray, and H. P. Thethi. 2017. Image analysis for MRI based brain tumor detection and feature extraction using biologically inspired BWT and SVM. Hindawi, International Journal of Biomedical Imaging 2017, 1–12.
[28]
E. Abdel-Maksoud, M. Elmogy, and R. Al-Awadi. 2015. Brain tumor segmentation based on a hybrid clustering technique. Egyptian Informatics Journal 16, 1 (2015), 71–81.
[29]
E. Gibson, W. Li, C. Sudre, L. Fidon, D. I. Shakir, G. Wang, ... and T. Whyntie. 2018. Nifty net: A deep-learning platform for medical imaging. Computer Methods and Programs in Biomedicine 158, 113–122.
[30]
A. Kumar, M. Ramachandran, A. H. Gandomi, R. Patan, S. Lukasik, and R. K. Soundarapandian. 2019. A deep neural network based classifier for brain tumor diagnosis. Applied Soft Computing 82, 105528.
[31]
P. Tiwari, J. Sachdeva, C. K. Ahuja, and N. Khandelwal. 2017. Computer aided diagnosis system - A decision support system for clinical diagnosis of brain tumors. International Journal of Computational Intelligence Systems 10, 1 (2017), 104–119.
[32]
T. Gupta, P. Manocha, T. K. Gandhi, R. K. Gupta, and B. K. Panigrahi. 2017. Tumor classification and segmentation of MR brain images. ArXiv preprint arXiv: 1710.11309, 1–20.
[33]
A. S. Lundervold and A. Lundervold. 2019. An overview of deep learning in medical imaging focusing on MRI. Zeitschrift für Medizinische Physik 29, 2 (2019), 102–127.
[34]
S. Cui, L. Mao, J. Jiang, C. Liu, and S. Xiong. 2018. Automatic semantic segmentation of brain gliomas from MRI images using a deep cascaded neural network. Hindawi, Journal of Healthcare Engineering 2018, 1–14.
[35]
P. M. Shakeel, T. E. E. Tobely, H. Al-Feel, G. Manogaran, and S. Baskar. 2019. Neural network based brain tumor detection using wireless infrared imaging sensor. IEEE Access 7, 5577–5588.
[36]
C. Zhang, X. Shen, H. Cheng, and Q. Qian. 2019. Brain tumor segmentation based on hybrid clustering and morphological operations. Hindawi, International Journal of Biomedical Imaging (2019), 1–11.
[37]
N. V. Shree and T. N. R. Kumar. 2018. Identification and classification of brain tumor MRI images with feature extraction using DWT and probabilistic neural network. Springer, Brain Informatics 5, 1 (2018), 23–30.
[38]
S. Alqazzaz, X. Sun, X. Yang, and L. Nokes. 2019. Automated brain tumor segmentation on multi-modal MR image using SegNet. Springer, Computational Visual Media 5, 2 (2019), 209–219.
[39]
M. K. Abd-Ellah, A. I. Awad, A. A. Khalaf, and H. F. Hamed. 2018. Two-phase multi-model automatic brain tumour diagnosis system from magnetic resonance images using convolutional neural networks. Springer, EURASIP Jour. on Image and Video Processing 1, 97 (2018), 1–10.
[40]
Y. Xue, S. Chen, J. Qin, Y. Liu, B. Huang, and H. Chen. 2017. Application of deep learning in automated analysis of molecular images in cancer: A survey. Hindawi, Contrast Media & Molecular Imaging 2017, 1–10.
[41]
N. V. Shree and T. N. R. Kumar. 2018. Identification and classification of brain tumor MRI images with feature extraction using DWT and probabilistic neural network. Springer, Brain Informatics 5, 1 (2018), 23–30.
[42]
R. M. Sarmento, F. F. Vasconcelos, P. P. Rebouças Filho, and V. H. C. de Albuquerque. 2020. An IoT platform for the analysis of brain CT images based on Parzen analysis. Elsevier, Future Generation Computer Systems 105, 135–147.
[43]
F. F. Vasconcelos, R. M. Sarmento, P. P. Rebouças Filho, and V. H. C. de Albuquerque. 2020. Artificial intelligence techniques empowered edge-cloud architecture for brain CT image analysis. Elsevier, Engineering Applications of Artificial Intelligence 91, 1–13 (2020), 103585.
[44]
B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba. 2016. Learning deep features for discriminative localization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2921–2929.
[45]
B. Gagana. 2019. Class activation maps. Medium Blog, Online: https://medium.com/@GaganaB/class-activation-maps-551477720679 (Retrieved 2 November 2020).
[46]
M. Alonso-Dos-Santos, R. Quilodrán Ulloa, Á. Salgado Quintana, D. Vigueras Quijada, and P. Farías Nazel. 2019. Nutrition labeling schemes and the time and effort of consumer processing. Sustainability 11, 4 (2019), 1079.
[47]
N. Kumar, V. Maheshwari, and J. Kumar. 2016. A comparative study of user experience in online social media branding web pages using eye tracker. In 2016 International Conference on Advances in Human Machine Interaction (HMI). IEEE, 1–8.
[48]
R. Wahler, A. Zehrer, and A. Groth. 2020. Areas of interest on destination websites: A generation Y's perspective. In Eye Tracking in Tourism. Springer, Cham, 85–99.
[49]
S. M. Gass and M. J. A. Torres. 2005. Attention when?: An investigation of the ordering effect of input and interaction. Studies in Second Language Acquisition 27, 1 (2005), 1–31.
[50]
K. Kim, J. Jacko, and G. Salvendy. 2011. Menu design for computers and cell phones: Review and reappraisal. Intl. Journal of Human–Computer Interaction 27, 4 (2011), 383–404.
[51]
R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International Conference on Computer Vision 618–626.
[52]
R. Fu, Q. Hu, X. Dong, Y. Guo, Y. Gao, and B. Li. 2020. Axiom-based grad-cam: Towards accurate visualization and explanation of cnns. arXiv preprint arXiv:2008.02312.
[53]
H. Fukui, T. Hirakawa, T. Yamashita, and H. Fujiyoshi. 2019. Attention branch network: Learning of attention mechanism for visual explanation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10705–10714.
[54]
S. Korolev, A. Safiullin, M. Belyaev, and Y. Dodonova. 2017. Residual and plain convolutional neural networks for 3D brain MRI classification. In 2017 IEEE 14th International Symposium on Biomedical Imaging (2017), 835–838.
[55]
Y. Chen, H. Gao, L. Cai, M. Shi, D. Shen, and S. Ji. 2018. Voxel deconvolutional networks for 3D brain image labeling. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1226–1234.
[56]
M. Maitra. 2019. 3D unsupervised modified spatial fuzzy c-means method for segmentation of 3D brain MR image. Pattern Analysis and Applications 22, 4 (2019), 1561–1571.
[57]
X. A. Bi, Y. Liu, Y. Wang, and R. Cai. 2019. Effective diagnosis of Alzheimer's disease via multimodal fusion analysis framework. Frontiers in Genetics 10, 976.
[58]
Y. D. Zhang, Z. Dong, S. H. Wang, X. Yu, X. Yao, Q. Zhou, ... and F. J. Martinez. 2020. Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation. Information Fusion 64, 149–187.
[59]
J. Gao, P. Li, Z. Chen, and J. Zhang. 2020. A survey on deep learning for multimodal data fusion. Neural Computation 32, 5 (2020), 829–864.
[60]
S. Lu, Z. Lu, and Y. Zhang. 2019. Pathological brain detection based on AlexNet and Transfer Learning. Journal of Computational Science 30, 41–47.
[61]
S. Lu., S. Wang, and Y. Zhang. 2020. Detection of abnormal brain in MRI via improved AlexNet and ELM optimized by chaotic bat algorithm. Neural Computing and Applications 1 (2020), 1–13.
[62]
N. Arunkumar, M. A. Mohammed, S. A. Mostafa, and D. A. Ibrahim. 2018. Fully automatic model-based segmentation and classification approach for MRI brain tumor using artificial neural networks. Concurrency and Computation: Practice and Experience 22.
[63]
N. Arunkumar, M. A. Mohammed, M. K. A. Ghani, D. A. Ibrahim, E. Abdulhay, G. Ramirez-Gonzalez, and V. H. C. d. Albuquerque. 2018. K-Means clustering and neural network for object detecting and identifying abnormality of brain tumor. Soft Computing 23, 9083–9096.
[64]
M. K. A. Ghani, M. A. Mohammed, N. Arunkumar, S. A. Mostafa, D. A. Ibrahim, M. K. Abdullah, M. M. Jaber, E. Abdulhay, G. Ramirez-Gonzalez, and M. A. Burhanuddin. 2020. Decision-level fusion scheme for nasopharyngeal carcinoma identification using machine learning techniques. Neural Computing and Applications 32, 625–638.
[65]
N. Siddique, P. Sidike, C. Elkin, and V. Devabhaktuni. 2020. U-Net and its variants for medical image segmentation: Theory and applications. Image and Video Processing 1–12.
[66]
S. Varela-Santos and P. Melin. 2021. A new approach for classifying coronavirus COVID-19 based on its manifestation on chest X-rays using texture features and neural networks. Elsevier Public Health Emergency Collection 545, 403–414.
[67]
Y. Poma, P. Melin, C. I. González, and G. Martinez. 2020. Optimal recognition model based on convolutional neural networks and fuzzy gravitational search algorithm method. 2020. Journal of Automation Mobile Robotics & Intelligent Systems 14, 1 (2020), 109–120.

Cited By

View all
  • (2025)Enhancing Brain Disease Diagnosis with XAI: A Review of Recent StudiesACM Transactions on Computing for Healthcare10.1145/37091526:2(1-35)Online publication date: 9-Jan-2025
  • (2024)Recent Applications of Explainable AI (XAI): A Systematic Literature ReviewApplied Sciences10.3390/app1419888414:19(8884)Online publication date: 2-Oct-2024
  • (2024)How Explainable Artificial Intelligence Can Increase or Decrease Clinicians’ Trust in AI Applications in Health Care: Systematic ReviewJMIR AI10.2196/532073(e53207)Online publication date: 30-Oct-2024
  • Show More Cited By

Index Terms

  1. Doctor's Dilemma: Evaluating an Explainable Subtractive Spatial Lightweight Convolutional Neural Network for Brain Tumor Diagnosis

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Multimedia Computing, Communications, and Applications
    ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 17, Issue 3s
    October 2021
    324 pages
    ISSN:1551-6857
    EISSN:1551-6865
    DOI:10.1145/3492435
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 October 2021
    Accepted: 01 March 2021
    Revised: 01 March 2021
    Received: 01 December 2020
    Published in TOMM Volume 17, Issue 3s

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Explainable artificial intelligence
    2. subtractive spatial lightweight convolutional neural networks
    3. brain tumor diagnosis
    4. medical imaging
    5. deep learning

    Qualifiers

    • Research-article
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)242
    • Downloads (Last 6 weeks)13
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Enhancing Brain Disease Diagnosis with XAI: A Review of Recent StudiesACM Transactions on Computing for Healthcare10.1145/37091526:2(1-35)Online publication date: 9-Jan-2025
    • (2024)Recent Applications of Explainable AI (XAI): A Systematic Literature ReviewApplied Sciences10.3390/app1419888414:19(8884)Online publication date: 2-Oct-2024
    • (2024)How Explainable Artificial Intelligence Can Increase or Decrease Clinicians’ Trust in AI Applications in Health Care: Systematic ReviewJMIR AI10.2196/532073(e53207)Online publication date: 30-Oct-2024
    • (2024)Errors in Physician-AI Collaboration: Insights From a Mixed-methods Study of Explainable AI and Trust in Clinical Decision-makingSSRN Electronic Journal10.2139/ssrn.4773350Online publication date: 2024
    • (2024)User‐Centered Evaluation of Explainable Artificial Intelligence (XAI): A Systematic Literature ReviewHuman Behavior and Emerging Technologies10.1155/2024/46288552024:1Online publication date: 15-Jul-2024
    • (2024)Efficient Brain Tumor Segmentation with Lightweight Separable Spatial Convolutional NetworkACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365371520:7(1-19)Online publication date: 16-May-2024
    • (2024)Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.343719012(106385-106414)Online publication date: 2024
    • (2024)Deep learning for enhanced brain Tumor Detection and classificationResults in Engineering10.1016/j.rineng.2024.10211722(102117)Online publication date: Jun-2024
    • (2024)Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysisComputational and Structural Biotechnology Journal10.1016/j.csbj.2024.08.00524(542-560)Online publication date: Dec-2024
    • (2024)A comprehensive review of explainable AI for disease diagnosisArray10.1016/j.array.2024.10034522(100345)Online publication date: Jul-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media