Skip to main content
Springer Nature Link
Log in

A real-time human bone fracture detection and classification from multi-modal images using deep learning technique

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Human bone is an essential structure that allows the body to move. It is a common observation in contemporary society that bone fractures occur frequently. The doctors use X-rays, Computed Tomography scans, and Magnetic Resonance Imaging to determine the location of the broken bone. The previous method of evaluating broken bones in person was inefficient, often leading to errors. However, introducing new, advanced evaluation techniques has obliterated these issues. Consequently, it is essential to develop an automated system for identifying fractured bones. This research uses a new deep-learning model named "You Only Look Once (version 8)" to distinguish between healthy and broken bones from multi-modal images. We utilized a customized dataset named "Human Bone Fractures Multi-modal Image Dataset", which includes 641 images representing ten different classes of bone fractures. The small data set leads to an over-fitting of the model. To increase the amount of data, we utilized a data augmentation technique. Three experiments were conducted to assess the effectiveness of the model. The findings of the experiments show that the proposed study effectively identifies and classifies different types of fractures in this area. Our system attained 95% precision, 93% recall, and 92% of mean average precision. The outcomes demonstrated that the method achieves cutting-edge performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The first author can be contacted to access the data supporting the research findings.

References

  1. Andrew W (2023) human skeleton. Encyclopedia Britannica. [Online] Available: https://www.britannica.com/science/human-skeleton

  2. K US, Menon PR (2022) Automatic bone fracture detection methods: A review. Int J Adv Res Sci, Commun Technol (IJARSCT) 2(1) https://doi.org/10.48175/568

  3. Singh S (2022) Common types of bone fractures. [Online] Available: https://drsandeeportho.com/blogs/common-types-of-bone-fractures

  4. Danielle Campagne M (2022) Overview of fractures. University of California, San Francisco. [Online] Available: https://www.msdmanuals.com/professional/injuries-poisoning/fractures/overview-of-fractures

  5. mrrobert (2013) Types and causes of bone fractures. [Online] Available: https://personalinjuriesclaims.wordpress.com/2013/07/30/types-and-causes-of-bone-fractures/

  6. Orthopaedic H (2021) Types of broken bones: Symptoms, treatment, healing. [Online] Available: https://www.topbonedude.com/types-of-broken-bones-symptoms-treatment-healing/

  7. Dlshad Ahmed K, Hawezi R (2023) Detection of bone fracture based on machine learning techniques. Measurement: Sensors 27:100723. https://doi.org/10.1016/j.measen.2023.100723

  8. Paul C, Edward, HildaHepzibah S (2015) A robust approach for detection of the type of fracture from x-ray images. Int J Adv Res Computer Commun Eng 4(3). https://api.semanticscholar.org/CorpusID:54824681

  9. Setty BR, Vishwanath K, J PG, Sreepathi DB (2020) Survey on features and techniques used for bone fracture detection and classification. Int Res J Eng Technol 7(5):1585–1594. https://www.irjet.net/archives/V7/i5/IRJET-V7I5308.pdf

  10. Khatik I, Kadam S (2022) A systematic review of bone fracture detection models using convolutional neural network approach. J Pharmaceutical Negative Results 13(9):153–158. https://doi.org/10.3390/diagnostics12102420

    Article  Google Scholar 

  11. Meena T, Roy S (2022) Bone fracture detection using deep supervised learning from radiological images: A paradigm shift. Diagnostics 12(10). https://doi.org/10.47750/PNR.2022.13.S09.019

  12. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson PC, Mega JL, Webster DR (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22):2402–2410. https://doi.org/10.1001/jama.2016.17216

  13. Yadav DP, Rathor S (2020) Bone fracture detection and classification using deep learning approach. In: 2020 International conference on power electronics & IoT applications in renewable energy and its control (PARC). 282–285. https://doi.org/10.1109/PARC49193.2020.236611

  14. Deo G, Totlani J, Mahamuni CV (2024) A survey on bone fracture detection methods using image processing and artificial intelligence (AI) approaches. AIP Conference Proceedings 2802(1):120022. https://doi.org/10.1063/5.0188460

    Article  Google Scholar 

  15. Hussain A, Fareed A, Taseen S (2023) Bone fracture detection–can artificial intelligence replace doctors in orthopedic radiography analysis? Front Artif Intell 6:1223909. https://doi.org/10.3389/frai.2023.1223909

    Article  Google Scholar 

  16. Su Z, Adam A, Nasrudin MF, Ayob M, Punganan G (2023) Skeletal fracture detection with deep learning: A comprehensive review - pubmed. Diagnostics (Basel, Switzerland) 13(20). https://doi.org/10.3390/diagnostics13203245

  17. Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  Google Scholar 

  18. Al-Ayyoub M, Hmeidi I, Rababah H (2013) Detecting hand bone fractures in x-ray images. J Multimed Process Technol (JMPT) 4:155–168. [Online] Available: https://www.researchgate.net/publication/279963895_Detecting_Hand_Bone_Fractures_in_X-Ray_Images

  19. Karanam SR, Srinivas Y, Chakravarty S (2023) A supervised approach to musculoskeletal imaging fracture detection and classification using deep learning algorithms. Computer Assisted Methods Eng Sci 30(3):369–385. https://doi.org/10.24423/cames.682

  20. Rao Karanam S, Srinivas Y, Chakravarty S (2023) A systematic review on approach and analysis of bone fracture classification. Materials Today: Proceedings 80:2557–2562. https://doi.org/10.1016/j.matpr.2021.06.408

    Article  Google Scholar 

  21. R R, J HD, A V, G A, G K (2023) Deep learning analysis of bone fracture using images processing techniques. J Survey Fisheries Sci 10(4S):1592–1608. https://sifisheriessciences.com/journal/index.php/journal/article/view/1296

  22. Yadav DP, Sharma A, Athithan S, Bhola A, Sharma B, Dhaou IB (2022) Hybrid sfnet model for bone fracture detection and classification using ml/dl. Sensors 22(15). https://doi.org/10.3390/s22155823

  23. Dr. S Govindaraju RD (2023) Bone fracture detection using random forest classifier. Int J Res Publication Rev 4(5):1549–1553. https://ijrpr.com/uploads/V4ISSUE5/IJRPR12862.pdf

  24. Miss. Swapna MRM (2022) Classification and detection of bone fracture using machine learning. Int J Res Appl Sci & Eng Technol (IJRASET) 10(7). https://doi.org/10.22214/ijraset.2022.45523

  25. Patel S, Talati B, Shah S, Panchal BY (2022) Bone fracture classification using modified alexnet. Stochastic Model & Appl 26(3). https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4167702

  26. J Raja Santhiya MPJLE (2022) Bone fracture detection using python. Int J Creative Res Thoughts 10(12). https://ijcrt.org/papers/IJCRT2212191.pdf

  27. Selin Vironicka A DJGRS (2022) Framework for classifying long bone detection using image processing techniques. Int J Intell Syst Appl Eng 10(1S):56–66. https://ijisae.org/index.php/IJISAE/article/view/2237/820

  28. Abbas W, Adnan SM, Javid MA, Ahmad W, Ali F (2021) Analysis of tibia-fibula bone fracture using deep learning technique from x-ray images. Int J Multiscale Comput Eng 9(1):25–39. https://doi.org/10.1615/IntJMultCompEng.2021036137

  29. Luo J, Kitamura G, Doganay E, Arefan D, Wu S (2021) Medical knowledge-guided deep curriculum learning for elbow fracture diagnosis from x-ray images. SPIE Medical Imaging 11597. https://doi.org/10.1117/12.2582184

  30. Beyaz S, Açıcı K, Sümer E, (2020) Femoral neck fracture detection in x-ray images using deep learning and genetic algorithm approaches. Joint Diseases and Related Surgery 31(2):175–183. https://doi.org/10.5606/ehc.2020.72163

  31. Jones RM, Sharma A, Hotchkiss R, Sperling JW, Hamburger J, Ledig C, Lindsey RV (2020) Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs. NPJ digital medicine 3. https://doi.org/10.1038/s41746-020-00352-w

  32. Dupuis M, Delbos L, Veil R, Adamsbaum C (2022) External validation of a commercially available deep learning algorithm for fracture detection in children. Diagnostic and Interventional Imaging 103(3):151–159. https://doi.org/10.1016/j.diii.2021.10.007

    Article  Google Scholar 

  33. Hardalaç F, Uysal F, Peker O, Çiçeklidağ M, Tolunay T, Tokgöz N, Kutbay U, Demirciler B, Mert F (2022) Fracture detection in wrist x-ray images usingdeep learning-based object detection models. Sensors (Basel, Switzerland) 22(3). https://doi.org/10.3390/s22031285

  34. Ju R, Cai W (2023) Fracture detection in pediatric wrist trauma x-ray images using yolov8 algorithm. Scientific Reports 13(1). https://doi.org/10.1038/s41598-023-47460-7

  35. Nagy E, Janisch M, Hržić F, Sorantin E, Tschauner S (2022) A pediatric wrist trauma x-ray dataset (grazpedwri-dx) for machine learning. Scientific Data 9(1). https://doi.org/10.1038/s41597-022-01328-z

  36. Nguyen HP, Hoang TP, Nguyen HH (2021) A deep learning based fracture detection in arm bone x-ray images. In: 2021 International conference on multimedia analysis and pattern recognition (MAPR), 1–6. https://doi.org/10.1109/MAPR53640.2021.9585292

  37. Guan B, Zhang G, Yao J, Wang X, Wang M (2020) Arm fracture detection in x-rays based on improved deep convolutional neural network. Computers & Electrical Eng 81:106530. https://doi.org/10.1016/j.compeleceng.2019.106530

    Article  Google Scholar 

  38. Nguyn HH, Nghiem K, Dang N (2023) A novel arm bone fracture detection using deep learning. Adv Inf Commun Technol 11–19. https://doi.org/10.1007/978-3-031-49529-8_2

  39. Sairam VA bone fracture detection using x-rays. Kaggle. [Online] Available: https://www.kaggle.com/datasets/vuppalaadithyasairam/bone-fracture-detection-using-xrays?rvi=1

  40. fyp (2023) bone fracture detection dataset. Roboflow Universe. [Online] Available: https://universe.roboflow.com/fyp-l87nq/bone-fracture-detection-rkuqr

  41. Petrosyan T (2022) What is image annotation? introduction to image annotation for machine learning. SuperAnnotate. [Online] Available: https://www.superannotate.com/blog/introduction-to-image-annotation

  42. Mahato A (2023) Getting started with image processing using opencv. Analytics Vidhya. [Online] Available: https://www.analyticsvidhya.com/blog/2023/03/getting-started-with-image-processing-using-opencv/

  43. Korfiatis VC, Tassani S, Matsopoulos GK (2018) A new ensemble classification system for fracture zone prediction using imbalanced micro-ct bone morphometrical data. IEEE J Biomed Health Inf 22(4):1189–1196. https://doi.org/10.1109/JBHI.2017.2723463

    Article  Google Scholar 

  44. Nelson J (2022) How to train yolov6 on a custom dataset. roboflow. [Online] Available: https://blog.roboflow.com/how-to-train-yolov6-on-a-custom-dataset/

  45. Sultana N, Jahan M, Uddin MS (2022) An extensive dataset for successful recognition of fresh and rotten fruits. Data Brief 44:108552. https://doi.org/10.1016/j.dib.2022.108552

    Article  Google Scholar 

  46. Solawetz J (2023) What is yolov8? the ultimate guide. Roboflow. [Online] Available: https://blog.roboflow.com/whats-new-in-yolov8/

  47. Tamang S, Sen B, Pradhan A, Sharma K, Singh VK (2023) Enhancing covid-19 safety: Exploring yolov8 object detection for accurate face mask classification. Int J Intell Syst Appl Eng 11(2):892–897. [Online] Available: https://ijisae.org/index.php/IJISAE/article/view/2966

  48. Adarsh P, Rathi P, Kumar M (2020) Yolo v3-tiny: Object detection and recognition using one stage improved model. 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), 687–694. https://doi.org/10.1109/ICACCS48705.2020.9074315

  49. Hussain M (2023) Yolo-v1 to yolo-v8, the rise of yolo and its complementary nature toward digital manufacturing and industrial defect detection. Machines 11(7). https://doi.org/10.3390/machines11070677

  50. Terven J, Cordova-Esparza D-M (2023) A comprehensive review of yolo architectures in computer vision: From yolov1 to yolov8 and yolo-nas. Mach Learn Knowl Extraction 5(4):1680–1716. https://doi.org/10.48550/arXiv.2304.00501

  51. Sandu V Yolo 1 through 5: A complete and detailed overview. Kaggle. [Online] Available: https://www.kaggle.com/code/vikramsandu/yolo-1-through-5-a-complete-and-detailed-overview

  52. Norkobil Saydirasulovich S, Abdusalomov A, Jamil MK, Nasimov R, Kozhamzharova D, Cho Y-I (2023) A yolov6-based improved fire detection approach for smart city environments. Sensors 23(6). https://doi.org/10.3390/s23063161

  53. Redmon J, Farhadi A (2018) Yolov3: An incremental improvement. CoRR. https://doi.org/10.48550/arXiv.1804.02767

  54. Mehra A (2023) Understanding yolov8 architecture, applications & features. Labellerr. [Online] Available: https://www.labellerr.com/blog/understanding-yolov8-architecture-applications-features/

  55. He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. Computer Vision - ECCV 2014:346–361. https://doi.org/10.1007/978-3-319-10578-9_23

    Article  Google Scholar 

  56. Zheng Z, Wang P, Liu W, Li J, Ye R, Ren D (2019) Distance-iou loss: Faster and better learning for bounding box regression. CoRR. [Online] Available: http://arxiv.org/abs/1911.08287

  57. Li X, Wang W, Wu L, Chen S, Hu X, Li J, Tang J, Yang J (2020) Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. https://doi.org/10.48550/arXiv.2006.04388

  58. Yang G, Wang J, Nie Z, Yang H, Yu S (2023) A lightweight yolov8 tomato detection algorithm combining feature enhancement and attention. Agronomy 13(7). https://doi.org/10.3390/agronomy13071824

  59. Li Y, Fan Q, Huang H, Han Z, Gu Q (2023) A modified yolov8 detection network for uav aerial image recognition. Drones 7(5). https://doi.org/10.3390/drones7050304

  60. Saxena S (2021) Binary cross entropy/log loss for binary classification. Analytics Vidhya. [Online] Available: https://www.analyticsvidhya.com/blog/2021/03/binary-cross-entropy-log-loss-for-binary-classification/

  61. Gupta A (2024) A comprehensive guide on optimizers in deep learning. Analytics Vidhya. [Online] Available: https://www.analyticsvidhya.com/blog/2021/10/a-comprehensive-guide-on-deep-learning-optimizers/

  62. Kingma D, Ba J (2014) Adam: A method for stochastic optimization. International Conference on Learning Representations. https://doi.org/10.48550/arXiv.1412.6980

  63. Ruder S (2016) An overview of gradient descent optimization algorithms. https://doi.org/10.48550/arXiv.1609.04747

  64. Wu T, Dong Y (2023) Yolo-se: Improved yolov8 for remote sensing object detection and recognition. Appl Sci 13(24). https://doi.org/10.3390/app132412977

  65. Das P, Chakraborty A, Sankar R, Singh OK, Ray H, Ghosh A (2023) Deep learning-based object detection algorithms on image and video. In: 2023 3rd International conference on intelligent technologies (CONIT), 1–6. https://doi.org/10.1109/CONIT59222.2023.10205601

  66. Lou H, Duan X, Guo J, Liu H, Gu J, Bi L, Chen H (2023) Dc-yolov8: Small size object detection algorithm based on camera sensor. https://doi.org/10.20944/preprints202304.0124.v1

Download references

Acknowledgements

We are thankful to the Department of Computer Science and Engineering, American International University-Bangladesh (AIUB), and IUBAT-International University of Business Agriculture and Technology.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, American International University-Bangladesh (AIUB), Dhaka, 1229, Bangladesh

    Shahnaj Parvin

  2. Department of Computer Science and Engineering, IUBAT-International University of Business Agriculture and Technology, Dhaka, 1230, Bangladesh

    Abdur Rahman

Authors
  1. Shahnaj Parvin
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Abdur Rahman
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Shahnaj Parvin.

Ethics declarations

Conflict of interest

The authors declare no conflicts of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parvin, S., Rahman, A. A real-time human bone fracture detection and classification from multi-modal images using deep learning technique. Appl Intell 54, 9269–9285 (2024). https://doi.org/10.1007/s10489-024-05588-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05588-7

Keywords