Abstract
Deep learning models have demonstrated state of the art performance in varied domains, however there is still room for improvement when it comes to learning new concepts from little data. Learning relevant features from a few training samples remains a challenge in machine learning applications. In this study, we propose an automated approach for the classification of Viral, Bacterial, and Fungal pneumonia using chest X-rays on a publicly available dataset. We employ distance learning based Siamese Networks with visual explanations for pneumonia detection. Our results demonstrate remarkable improvement in performance over conventional deep convolutional models with just a few training samples. We exhibit the powerful generalization capability of our model which once trained, effectively predicts new unseen data in the test set. Furthermore, we also illustrate the effectiveness of our model by classifying diseases from the same genus like COVID-19 and SARS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012)
Mikolov, T., Karafiát, M., Burget, L., Černockỳ, J., Khudanpur, S.: Recurrent neural network based language model. In: Eleventh Annual Conference Of The International Speech Communication Association (2010)
Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process. Mag. 29(6), 82–97 (2012)
World health organization. https://www.who.int/health-topics/pneumonia. Accessed 08 June 2021
Wu, F., et al.: A new coronavirus associated with human respiratory disease in China. Nature 579(7798), 265–269 (2020)
Clinical management of severe acute respiratory infection when novel coronavirus (2019ncov) infection is suspected: interim guidance, 28 Jan 2020. https://www.who.int/docs/default-source/coronaviruse/clinical-management-of-novel-cov.pdf. Accessed 08 June 2021
Mettler, F.A., Jr., Huda, W., Yoshizumi, T.T., Mahesh, M.: Effective doses in radiology and diagnostic nuclear medicine: a catalog. Radiology 248(1), 254–263 (2008)
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., Samek, W.: On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 10(7), e0130140 (2015)
Smilkov, D., Thorat, N., Kim, B., Viégas, F., Wattenberg, M.: Smoothgrad: removing noise by adding noise, arXiv preprint arXiv:1706.03825 (2017)
Suárez, J.L., García, S., Herrera, F.: A tutorial on distance metric learning: mathematical foundations, algorithms, experimental analysis, prospects and challenges. Neurocomputing 425, 300–322 (2021)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Chen, S., Ma, K., Zheng, Y.: Med3d: transfer learning for 3D medical image analysis, arXiv preprint arXiv:1904.00625 (2019)
Eslami, M., Tabarestani, S., Albarqouni, S., Adeli, E., Navab, N., Adjouadi, M.: Image-to-images translation for multi-task organ segmentation and bone suppression in chest x-ray radiography. IEEE Trans. Med. Imaging 39(7), 2553–2565 (2020)
Gessert, N., et al.: Skin lesion classification using CNNs with patch-based attention and diagnosis-guided loss weighting. IEEE Trans. Biomed. Eng. 67(2), 495–503 (2019)
Tang, Y.-B., Tang, Y.-X., Xiao, J., Summers, R.M.: XLSor: a robust and accurate lung segmentor on chest X-rays using Criss-Cross attention and customized radiorealistic abnormalities generation. In: International Conference on Medical Imaging with Deep Learning, PMLR, pp. 457–467 (2019)
Vinyals, O., Blundell, C., Lillicrap, T., Kavukcuoglu, K., Wierstra, D.: Matching networks for one shot learning, arXiv preprint arXiv:1606.04080 (2016)
Snell, J., Swersky, K., Zemel, R.S.: Prototypical networks for few-shot learning, arXiv preprint arXiv:1703.05175 (2017)
Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: International Conference on Machine Learning, PMLR, pp. 1126–1135 (2017)
Ravi, S., Larochelle, H.: Optimization as a model for few-shot learning (2016)
Jaiswal, A.K., Tiwari, P., Kumar, S., Gupta, D., Khanna, A., Rodrigues, J.J.: Identifying pneumonia in chest X-rays: a deep learning approach. Measurement 145, 511–518 (2019)
Madan, S., Chaudhury, S., Gandhi, T.K.: Automated detection of COVID-19 on a small dataset of chest CT images using metric learning. In: 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2021)
Singh, R., et al.: Deep learning in chest radiography: detection of findings and presence of change. PLoS ONE 13(10), e0204155 (2018)
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M.: ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2097–2106 (2017)
Rajpurkar, P., et al.: Chexnet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv preprint arXiv:1711.05225 (2017)
Koch, G., Zemel, R., Salakhutdinov, R.: Siamese neural networks for one-shot image recognition. In: ICML Deep Learning Workshop, vol. 2. Lille (2015)
Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_53
Cohen, J.P., Morrison, P., Dao, L., Roth, K., Duong, T.Q., Ghassemi, M.: Covid-19 image data collection: prospective predictions are the future. arXiv 2006.11988 (2020). https://github.com/ieee8023/covid-chestxray-dataset
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
Nichol, A., Schulman, J.: Reptile: a scalable meta-learning algorithm. arXiv preprint arXiv:1803.02999 2(2) (2018). 1
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Madan, S., Diwakar, A., Chaudhury, S., Gandhi, T. (2022). Pneumonia Classification Using Few-Shot Learning with Visual Explanations. In: Kim, JH., Singh, M., Khan, J., Tiwary, U.S., Sur, M., Singh, D. (eds) Intelligent Human Computer Interaction. IHCI 2021. Lecture Notes in Computer Science, vol 13184. Springer, Cham. https://doi.org/10.1007/978-3-030-98404-5_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-98404-5_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98403-8
Online ISBN: 978-3-030-98404-5
eBook Packages: Computer ScienceComputer Science (R0)