Skip to main content

Transfer Learning with Fine-Tuning on MobileNet and GRAD-CAM for Bones Abnormalities Diagnosis

  • Conference paper
  • First Online:
Complex, Intelligent and Software Intensive Systems (CISIS 2022)

Abstract

Osteoarthritis is a common medical condition. Unfortunately, despite the support of X-ray imaging technology in diagnosis, the accuracy of diagnostic results still depends on human factors. Furthermore, when errors do occur, they are often detected late, leading to a waste of time, money, and even disability for the patient. This study has deployed and evaluated transfer learning techniques in abnormal and normal bone images classification on X-ray images collected from the dataset of MUsculoskeletal RAdiographs (MURA) with 17,367 images and then leveraged techniques for results explanations of learning algorithms such as Gradient-weighted Class Activation Mapping (GRAD-CAM) to provide visual highlighted interesting areas in the images which can be signals for anomalies in bones. The classification performance using MobileNet with techniques of hyper-parameters fine-tuning can reach an accuracy of 0.84 in abnormal and normal bone classification tasks on the wrist, humerus, and elbow. The work is expected to provide visual support for doctors in diagnosing and identifying bone anomalies on X-ray images based on leveraging advancements from Artificial Intelligence techniques for medical imaging analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://tuoitre.vn/song-tu-chu-hon-nho-cham-soc-xuong-khop-dung-cach-20211010205952585.htm, accessed on 20 March 2022.

References

  1. Antony, B., Singh, A.: Imaging and biochemical markers for osteoarthritis. Diagnostics 11(7), 1205 (2021). https://doi.org/10.3390/diagnostics11071205

  2. Hallas, P., Ellingsen, T.: Errors in fracture diagnoses in the emergency department–characteristics of patients and diurnal variation. BMC Emerg. Med. 6(1) (2006). https://doi.org/10.1186/1471-227x-6-4

  3. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. Int. J. Comput. Vis. 128(2), 336–359 (2019). https://doi.org/10.1007%2Fs11263-019-01228-7

  4. Rajpurkar, P., et al.: Mura: large dataset for abnormality detection in musculoskeletal radiographs (2017). https://arxiv.org/abs/1712.06957

  5. Solovyova, A., Solovyov, I.: X-ray bone abnormalities detection using mura dataset (2020). https://arxiv.org/abs/2008.03356

  6. Uysal, F., Hardalaç, F., Peker, O., Tolunay, T., Tokgöz, N.: Classification of shoulder x-ray images with deep learning ensemble models. Appl. Sci. 11(6), 2723 (2021). https://doi.org/10.3390/app11062723

  7. Tanzi, L., Vezzetti, E., Moreno, R., Moos, S.: X-ray bone fracture classification using deep learning: a baseline for designing a reliable approach. Appl. Sci. 10(4), 1507 (2020). https://doi.org/10.3390/app10041507

  8. Nandi, R., Mulimani, M.: Detection of COVID-19 from x-rays using hybrid deep learning models (April 2021). https://doi.org/10.21203/rs.3.rs-468236/v1

  9. Chada, G.: Machine learning models for abnormality detection in musculoskeletal radiographs. Reports 2(4), 26 (2019). https://doi.org/10.3390/reports2040026

  10. Jakaite, L., Schetinin, V., Hladůvka, J., Minaev, S., Ambia, A., Krzanowski, W.: Deep learning for early detection of pathological changes in x-ray bone microstructures: case of osteoarthritis. Sci. Rep. 11(1) (2021). https://doi.org/10.1038/s41598-021-81786-4

  11. Hardalaç, F., et al.: Fracture detection in wrist x-ray images using deep learning-based object detection models. Sensors 22(3), 1285 (2022). https://doi.org/10.3390%2Fs22031285

  12. Ma, Y., Luo, Y.: Bone fracture detection through the two-stage system of crack-sensitive convolutional neural network. Inform. Med. Unlocked 22, 100452 (2021). https://doi.org/10.1016/j.imu.2020.100452

  13. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). https://arxiv.org/abs/1409.1556

  14. Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition (2017). https://arxiv.org/abs/1707.07012

  15. Mall, P.K., Singh, P.K., Yadav, D.: GLCM based feature extraction and medical x-ray image classification using machine learning techniques. In: 2019 IEEE Conference on Information and Communication Technology, pp. 1–6 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hai Thanh Nguyen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Luong, H.H. et al. (2022). Transfer Learning with Fine-Tuning on MobileNet and GRAD-CAM for Bones Abnormalities Diagnosis. In: Barolli, L. (eds) Complex, Intelligent and Software Intensive Systems. CISIS 2022. Lecture Notes in Networks and Systems, vol 497. Springer, Cham. https://doi.org/10.1007/978-3-031-08812-4_17

Download citation

Publish with us

Policies and ethics