skip to main content
10.1145/3365109.3368791acmconferencesArticle/Chapter ViewAbstractPublication PagesbdcatConference Proceedingsconference-collections
research-article

Explainable AI: Classification of MRI Brain Scans Orders for Quality Improvement

Published:02 December 2019Publication History

ABSTRACT

The American College of Radiology (ACR) has guidelines on appropriate ordering of Magnetic Resonance Imaging (MRI) brain scans. MRI requests are currently manually reviewed by radiologists to ensure compliance to these guidelines. In this paper, we implemented a stacked recurrent neural network (RNN) utilizing a bidirectional long short-term memory (Bi-LSTM) sequence with BioWordVec, a biomedical word embedding vector that uses word representations from a lexicon developed from medical publications, to develop an automated classification system for request audit. To overcome the problems of interpretation by black-box models, the RNN is integrated with a model agnostic explainer LIME (Local Interpretable Model-Agnostic Explanations) to provide explainable support for clinicians in the healthcare environment. The performance of the RNN is compared with a Random Forest (RF) algorithm that utilizes the bag-of-words concept. The RNN was trained and validated on 2470 rows of different patient free-text orders and tested on a separate 2711 orders, producing an accuracy of 82.51% and a ROC value of 0.89 which was either comparable to or surpassing RF both in performance and usability. The use of deep learning with explainable LIME in this study provided a good use case towards an augmented decision-making framework in healthcare.

References

  1. E. Pons, L. M. M. Braun, M. G. M. Hunink, and J. A. Kors, "Natural language processing in radiology: a systematic review," Radiology, vol. 279, no. 2, pp. 329--343, 2016.Google ScholarGoogle Scholar
  2. A. S. Lundervold and A. Lundervold, "An overview of deep learning in medical imaging focusing on MRI," Z. Med. Phys., vol. 29, no. 2, pp. 102--127, 2019.Google ScholarGoogle Scholar
  3. H. Li and Y. Fan, "Brain decoding from functional MRI using long short-term memory recurrent neural networks," in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 320--328, 2018.Google ScholarGoogle Scholar
  4. C. Qin, J. Schlemper, J. Caballero, A. N. Price, J. V Hajnal, and D. Rueckert, "Convolutional recurrent neural networks for dynamic MR image reconstruction," IEEE Trans. Med. Imaging, vol. 38, no. 1, pp. 280--290, 2018.Google ScholarGoogle Scholar
  5. I. Banerjee et al., "Comparative effectiveness of convolutional neural network (CNN) and recurrent neural network (RNN) architectures for radiology text report classification," Artif. Intell. Med., vol. 97, pp. 79--88, 2019.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. C. of Radiology, "ACR-ASNR-SPR practice parameter for the performance and interpretation of magnetic resonance imaging of the brain." 2015.Google ScholarGoogle Scholar
  7. D. Remedios, B. France, and M. Alexander, "Making the best value of clinical radiology: iRefer Guidelines," Clin. Radiol., vol. 72, no. 9, pp. 705--707, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  8. H. T. Huhdanpaa et al., "Using Natural Language Processing of Free-Text Radiology Reports to Identify Type 1 Modic Endplate Changes," J. Digit. Imaging, vol. 31, no. 1, pp. 84--90, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  9. L. T. E. Cheng, J. Zheng, G. K. Savova, and B. J. Erickson, "Discerning tumor status from unstructured MRI reports-completeness of information in existing reports and utility of automated natural language processing," J. Digit. Imaging, vol. 23, no. 2, pp. 119--132, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  10. S. H. Lee, D. Levin, P. D. Finley, and C. M. Heilig, "Chief complaint classification with recurrent neural networks," J. Biomed. Inform., vol. 93, p. 103158, 2019.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Y. Zhang, S. S. W. Lam, N. Liu, Y. Pang, L. L. Chan, and P. H. Tang, "Development of a Radiology Decision Support System for the Classification of MRI Brain Scans," in 2018 IEEE/ACM 5th International Conference on Big Data Computing Applications and Technologies (BDCAT), pp. 107--115, 2018.Google ScholarGoogle Scholar
  12. L. Rokach, R. Romano, and O. Maimon, "Negation recognition in medical narrative reports," Inf. Retr. Boston., vol. 11, no. 6, pp. 499--538, 2008.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. C. Francois, "Deep learning with Python." Manning Publications Company, 2017.Google ScholarGoogle Scholar
  14. Y. Zhang, Q. Chen, Z. Yang, H. Lin, and Z. Lu, "BioWordVec, improving biomedical word embeddings with subword information and MeSH," Sci. data, vol. 6, no. 1, p. 52, 2019.Google ScholarGoogle Scholar
  15. R. Socher, "CS224d: Deep Learning for Natural Language Processing." Stanford University CS224d: Deep Learning for Natural Language Processing.Google ScholarGoogle Scholar
  16. M. T. Ribeiro, S. Singh, and C. Guestrin, "Why should i trust you? Explaining the predictions of any classifier," in Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135--1144, 2016.Google ScholarGoogle Scholar

Index Terms

  1. Explainable AI: Classification of MRI Brain Scans Orders for Quality Improvement

                    Recommendations

                    Comments

                    Login options

                    Check if you have access through your login credentials or your institution to get full access on this article.

                    Sign in
                    • Published in

                      cover image ACM Conferences
                      BDCAT '19: Proceedings of the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies
                      December 2019
                      174 pages
                      ISBN:9781450370165
                      DOI:10.1145/3365109

                      Copyright © 2019 ACM

                      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                      Publisher

                      Association for Computing Machinery

                      New York, NY, United States

                      Publication History

                      • Published: 2 December 2019

                      Permissions

                      Request permissions about this article.

                      Request Permissions

                      Check for updates

                      Qualifiers

                      • research-article

                      Acceptance Rates

                      Overall Acceptance Rate27of93submissions,29%

                    PDF Format

                    View or Download as a PDF file.

                    PDF

                    eReader

                    View online with eReader.

                    eReader