Abstract
With the huge expansion of artificial intelligence in medical imaging, many clinical warehouses, medical centres and research communities, have organized patients’ data in well-structured datasets. These datasets are one of the key elements to train AI-enabled solutions. Additionally, the value of such datasets depends on the quality of the underlying data. To maintain the desired high-quality standard, these datasets are actively cleaned and continuously expanded. This labelling process is time-consuming and requires clinical expertise even when a simple classification task must be performed. Therefore, in this work, we propose to tackle this problem by developing a new pipeline for the modality classification of medical images. Our pipeline has the purpose to provide an initial step in organizing a large collection of data and grouping them by modality, thus reducing the involvement of costly human raters. In our experiments, we consider 4 popular deep neural networks as the core engine of the proposed system. The results show that when limited datasets are available simpler pre-trained networks achieved better results than more complex and sophisticated architectures. We demonstrate this by comparing the considered networks on the ADNI dataset and by exploiting explainable AI techniques that help us to understand our hypothesis. Still today, many medical imaging studies make use of limited datasets, therefore we believe that our contribution is particularly relevant to drive future developments of new medical imaging technologies when limited data are available.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Bardis, M., et al.: Deep learning with limited data: organ segmentation performance by U-Net. Electronics 9(8), 1199 (2020)
Brock, A., De, S., Smith, S.L., Simonyan, K.: High-performance large-scale image recognition without normalization. arXiv preprint arXiv:2102.06171 (2021)
Chen, X., Hsieh, C.J., Gong, B.: When vision transformers outperform ResNets without pretraining or strong data augmentations. arXiv preprint arXiv:2106.01548 (2021)
Cheng, D., Liu, M.: CNNs based multi-modality classification for ad diagnosis. In: 2017 10th International Congress on Image and Signal Processing, Biomedical Engineering and Informatics (CISP-BMEI), pp. 1–5. IEEE (2017)
Chiang, C.H., Weng, C.L., Chiu, H.W.: Automatic classification of medical image modality and anatomical location using convolutional neural network. PLoS ONE 16(6), e0253205 (2021)
Cho, J., Lee, K., Shin, E., Choy, G., Do, S.: How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? arXiv preprint arXiv:1511.06348 (2015)
Dosovitskiy, A., et al.: An image is worth 16\(\times \)16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Han, X.H., Chen, Y.W.: Biomedical imaging modality classification using combined visual features and textual terms. Int. J. Biomed. Imaging 2011 (2011)
Hassan, M., Ali, S., Alquhayz, H., Safdar, K.: Developing intelligent medical image modality classification system using deep transfer learning and LDA. Sci. Rep. 10(1), 1–14 (2020)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Kalpathy-Cramer, J., Hersh, W., et al.: Automatic image modality based classification and annotation to improve medical image retrieval. In: Medinfo 2007: Proceedings of the 12th World Congress on Health (Medical) Informatics; Building Sustainable Health Systems, p. 1334. IOS Press (2007)
Khachane, M.Y., Ramteke, R.J.: Modality based medical image classification. In: Shetty, N.R., Prasad, N.H., Nalini, N. (eds.) Emerging Research in Computing, Information, Communication and Applications, pp. 597–606. Springer, Singapore (2016). https://doi.org/10.1007/978-981-10-0287-8_55
Kiefer, J., Wolfowitz, J., et al.: Stochastic estimation of the maximum of a regression function. Ann. Math. Stat. 23(3), 462–466 (1952)
Li, S., Chen, X., He, D., Hsieh, C.J.: Can vision transformers perform convolution? arXiv preprint arXiv:2111.01353 (2021)
Paszke, A., et al.: Automatic differentiation in PyTorch (2017)
Schouten, J.P., Matek, C., Jacobs, L.F., Buck, M.C., Bošnački, D., Marr, C.: Tens of images can suffice to train neural networks for malignant leukocyte detection. Sci. Rep. 11(1), 1–8 (2021)
Selvaraju, R.R., Das, A., Vedantam, R., Cogswell, M., Parikh, D., Batra, D.: Grad-CAM: why did you say that? arXiv preprint arXiv:1611.07450 (2016)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Singh, S., Ho-Shon, K., Karimi, S., Hamey, L.: Modality classification and concept detection in medical images using deep transfer learning. In: 2018 International conference on image and vision computing New Zealand (IVCNZ), pp. 1–9. IEEE (2018)
Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)
Willemink, M.J., et al.: Preparing medical imaging data for machine learning. Radiology 295(1), 4–15 (2020)
Yu, Y., et al.: Modality classification for medical images using multiple deep convolutional neural networks. J. Comput. Inf. Syst. 11(15), 5403–5413 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Trenta, F., Battiato, S., Ravì, D. (2022). An Explainable Medical Imaging Framework for Modality Classifications Trained Using Small Datasets. In: Sclaroff, S., Distante, C., Leo, M., Farinella, G.M., Tombari, F. (eds) Image Analysis and Processing – ICIAP 2022. ICIAP 2022. Lecture Notes in Computer Science, vol 13231. Springer, Cham. https://doi.org/10.1007/978-3-031-06427-2_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-06427-2_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06426-5
Online ISBN: 978-3-031-06427-2
eBook Packages: Computer ScienceComputer Science (R0)