Skip to main content

Advertisement

SpringerLink
Log in

A literature review on deep learning algorithms for analysis of X-ray images

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Since the invention of the X-ray beam, it has been used for useful applications in various fields, such as medical diagnosis, fluoroscopy, radiation therapy, and computed tomography. In addition, it is also widely used to identify prohibited or illegal materials using X-ray imaging in the security field. However, these procedures are generally dependent on the human factor. An operator detects prohibited objects by projecting pseudo-color images onto a computer screen. Because these processes are prone to error, much work has gone into automating the processes involved. Initial research on this topic consisted mainly of machine learning and methods using hand-crafted features. The newly developed deep learning methods have subsequently been more successful. For this reason, deep learning algorithms are a trend in recent studies and the number of publications has increased in areas such as X-ray imaging. Therefore, we surveyed the studies published in the literature on Deep Learning-based X-ray imaging to attract new readers and provide new perspectives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

This is a review paper, and any data has not been generated during the the study.

References

  1. AYDIN I, KARAKOSE M, Erhan A (2018) A new approach for baggage inspection by using deep convolutional neural networks. 2018 International Conference on Artificial Intelligence and Data Processing (IDAP), IEEE

  2. Akcay S, Kundegorski ME, Willcocks CG, Breckon TP (2018b) Using deep convolutional neural network architectures for object classification and detection within x-ray baggage security imagery. IEEE Trans Inf Forensics Secur 13(9):2203–2215

    Article  Google Scholar 

  3. Akcay S, Breckon TP (2017) An evaluation of region based object detection strategies within x-ray baggage security imagery. 2017 IEEE International Conference on Image Processing (ICIP), IEEE

  4. Akcay S, Atapour-Abarghouei A, Breckon TP (2018a) Ganomaly: Semi-supervised anomaly detection via adversarial training. Asian conference on computer vision, Springer

  5. Akçay S, Kundegorski ME, Devereux M, Breckon TP (2016) Transfer learning using convolutional neural networks for object classification within x-ray baggage security imagery. 2016 IEEE International Conference on Image Processing (ICIP), IEEE

  6. Andrews JT, Jaccard N, Rogers TW, Griffin LD (2017) Representation-learning for anomaly detection in complex x-ray cargo imagery. Anomaly Detection and Imaging with X-Rays (ADIX) II. International Society for Optics and Photonics, Washington

    Google Scholar 

  7. Benedykciuk E, Denkowski M, Dmitruk K (2021) Material classification in X-ray images based on multi-scale CNN. Signal Image and Video Process 2021:1–9

    Google Scholar 

  8. Bhowmik N, Wang Q, Gaus YFA, Szarek M, Breckon TP (2019c) The good, the bad and the ugly: evaluating convolutional neural networks for prohibited item detection using real and synthetically composited X-ray imagery. arXiv preprint. https://arxiv.org/abs/1909.11508

  9. Bhowmik N, Gaus YFA, Akçay S, Barker JW, Breckon TP (2019a) On the impact of object and sub-component level segmentation strategies for supervised anomaly detection within x-ray security imagery. 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), IEEE

  10. Bhowmik N, Gaus YFA, Breckon TP (2019b) Using deep neural networks to address the evolving challenges of concealed threat detection within complex electronic items. 2019 IEEE International Symposium on Technologies for Homeland Security (HST), IEEE

  11. Caldwell M, Griffin LD (2019) Limits on transfer learning from photographic image data to X-ray threat detection. J X-Ray Sci Technol 27(6):1007–1020

    Google Scholar 

  12. Caldwell M, Ransley M, Rogers TW, Griffin LD (2017) Transferring x-ray based automated threat detection between scanners with different energies and resolution. Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies 10441:130–139

    Google Scholar 

  13. Cao C, Huang Y, Yang Y, Wang L, Wang Z, Tan T (2018) Feedback convolutional neural network for visuallocalization and segmentation. IEEE Transact Patt Analys Mach Intel 41(7):1627–1640

    Article  PubMed  Google Scholar 

  14. Chang A, Zhang Y, Zhang S, Zhong L, Zhang L (2022) Detecting prohibited objects with physical size constraint from cluttered X-ray baggage images. Knowl Based Syst 237:107916

    Article  Google Scholar 

  15. Chouai M, Merah M, Mimi M (2020) CH-Net: deep adversarial autoencoders for semantic segmentation in X-ray images of cabin baggage screening at airports. J Transp Secur 13(1):71–89

    Article  Google Scholar 

  16. Dumagpi JK, Jeong Y-J (2021) Pixel-level analysis for enhancing threat detection in large-scale X-ray security images. " Appl Sci 11(21):10261

    Article  CAS  Google Scholar 

  17. Dumagpi JK, Jeong Y-J (2021a) Evaluating GAN-Based image augmentation for threat detection in large-scale Xray Security images. " Appl Sci 11(1):36

    Article  CAS  Google Scholar 

  18. Dumagpi JK, Jung W-Y, Jeong Y-J (2019) KNN-Based automatic cropping for improved threat object recognition in X-Ray Security images. J IKEEE 23(4):1134–1139

    Google Scholar 

  19. Dumagpi JK, Jung W-Y, Jeong Y-J (2020) A new GAN-based anomaly detection (GBAD) approach for multi-threat object classification on large-scale x-ray security images. IEICE Trans Inf Syst 103(2):454–458

    Article  Google Scholar 

  20. Gaus YFA, Bhowmik N, Akcay S, Breckon T (2019) Evaluating the transferability and adversarial discrimination of convolutional neural networks for threat object detection and classification within x-ray security imagery. 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), IEEE

  21. Gaus YFA, Bhowmik N, Akçay S, Guillén-Garcia PM, Barker JW, Breckon TP (2019b) Evaluation of a dual convolutional neural network architecture for object-wise anomaly detection in cluttered X-ray security imagery. 2019 International Joint Conference on Neural Networks (IJCNN), IEEE

  22. Gaus YFA, Bhowmik N, Breckon TP (2019c) On the use of deep learning for the detection of firearms in x-ray baggage security imagery. 2019 IEEE International Symposium on Technologies for Homeland Security (HST), IEEE

  23. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition

  24. Griffin LD, Caldwell M, Andrews JT, Bohler H (2018) Unexpected item in the bagging area: Anomaly detection in x-ray security images. IEEE Trans Inf Forensics Secur 14(6):1539–1553

    Article  Google Scholar 

  25. Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48

    Article  Google Scholar 

  26. Jaccard N, Rogers TW, Morton EJ, Griffin LD (2016) Tackling the X-ray cargo inspection challenge using machine learning. Anomaly Detection and Imaging with X-Rays 9847:131–143

    Google Scholar 

  27. Jaccard N, Rogers TW, Morton EJ, Griffin LD (2017) Detection of concealed cars in complex cargo X-ray imagery using deep learning. J X-Ray Sci Technol 25(3):323–339

    Google Scholar 

  28. Jain DK (2019) An evaluation of deep learning based object detection strategies for threat object detection in baggage security imagery. Pattern Recognit Lett 120:112–119

    Article  ADS  Google Scholar 

  29. Janiesch C, Zschech P, Heinrich K (2021) “Machine Learn deep Learn " Electron Markets 31(3):685–695

    Google Scholar 

  30. LeCun Y, Jackel L, Bottou L, Brunot A, Cortes C, Denker J, Drucker H, Guyon I, Muller U, Sackinger E (1995) Comparison of learning algorithms for handwritten digit recognition. International conference on artificial neural networks, Perth, Australia

  31. Liang KJ, Sigman JB, Spell GP, Strellis D, Chang W, Liu F, Mehta T, Carin L (2019) Toward automatic threat recognition for airport X-ray baggage screening with deep convolutional object detection. arXiv preprint. https://arxiv.org/abs/1912.06329

  32. Liu D, Liu J, Yuan P, Yu F (2022) A Lightweight Dangerous Liquid Detection Method Based on Depthwise Separable Convolution for X-Ray Security Inspection. Comput Intell Neurosci 18:2022

    Google Scholar 

  33. Liu D, Liu J, Yuan P, Yu F (2022) A data augmentation method for prohibited item X-ray pseudocolor images in X-ray security inspection based on wasserstein generative adversarial network and spatial-and-channel attention block. Comput Intell Neurosci 18:2022

    Google Scholar 

  34. Liu Z, Li J, Shu Y, Zhang D (2018) Detection and recognition of security detection object based on YOLO9000. 2018 5th International Conference on Systems and Informatics (ICSAI), IEEE

  35. Liu J, Leng X, Liu Y (2019) Deep convolutional neural network based object detector for X-Ray baggage security imagery. 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), IEEE

  36. Ma B, Jia T, Su M, Jia X, Chen D, Zhang Y (2022a) Automated segmentation of prohibited items in X-ray baggage images using dense de-overlap attention snake. IEEE Transactions on Multimedia 14(8):1–14

    Google Scholar 

  37. Ma C, Zhuo L, Li J, Zhang Y, Zhang J (2022b) EAOD-Net: effective anomaly object detection networks for X-ray images. IET Image Processing 16:2638–2651

    Article  Google Scholar 

  38. Mery D, Kaminetzky A, Golborne L, Figueroa S, Saavedra D (2022) Target detection by Target Simulation in X-ray testing. J Nondestr Eval 41(1):1–12

    Article  Google Scholar 

  39. Mery D, Svec E, Arias M, Riffo V, Saavedra JM, Banerjee S (2016) Modern computer vision techniques for x-ray testing in baggage inspection. IEEE Trans Syst Man Cybernetics: Syst 47(4):682–692

    Article  Google Scholar 

  40. Mery D, Riffo V, Zuccar I, Pieringer C (2013) Automated X-ray object recognition using an efficient search algorithm in multiple views. Proceedings of the IEEE conference on computer vision and pattern recognition workshops

  41. Miao C, Xie L, Wan F, Su C, Liu H, Jiao J, Ye Q (2019) Sixray: A large-scale security inspection x-ray benchmark for prohibited item discovery in overlapping images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

  42. Morris T, Chien T, Goodman E (2018) Convolutional neural networks for automatic threat detection in security X-Ray images. 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), IEEE

  43. Nguyen HD, Cai R, Zhao H, Kot AC, Wen B (2022) Towards more efficient security inspection via Deep Learning: a Task-Driven X-ray image. Cropping Scheme " Micromachines 13(4):565

    Article  PubMed  Google Scholar 

  44. Petrozziello A, Jordanov I (2019) Automated deep learning for threat detection in luggage from X-ray images. International Symposium on Experimental Algorithms, Springer

  45. Rogers TW, Jaccard N, Griffin LD (2017) A deep learning framework for the automated inspection of complex dual-energy x-ray cargo imagery. Anomaly Detection and Imaging with X-Rays 10187:106–117

    Google Scholar 

  46. Saavedra D, Banerjee S, Mery D (2020) Detection of threat objects in baggage inspection with X-ray images using deep learning. Neural Comput Appl 33:1–17

    Google Scholar 

  47. Shao F, Liu J, Wu P, Yang Z, Wu Z (2022) Exploiting foreground and background separation for prohibited item detection in overlapping X-Ray images. Pattern Recogn 122:108261

    Article  Google Scholar 

  48. Sigman JB, Spell GP, Liang KJ, Carin L (2020) Background adaptive faster R-CNN for semi-supervised convolutional object detection of threats in x-ray images. Anomaly Detection and Imaging with X-Rays (ADIX) V, International Society for Optics and Photonics

  49. Singh S, Singh M (2003) Explosives detection systems (EDS) for aviation security. Sig Process 83(1):31–55

    Article  Google Scholar 

  50. Steitz J-MO, Saeedan F, Roth S (2018) Multi-view x-ray R-CNN. German Conference on Pattern Recognition, Springer

  51. Subramani M, Rajaduari K, Choudhury SD, Topkar A, Ponnusamy V (2020) Evaluating one stage detector Architecture of Convolutional neural network for threat object detection using X-Ray Baggage Security Imaging. Revue d’Intelligence Artificielle 34(4):495–500

    Article  Google Scholar 

  52. Wang Q, Bhowmik N, Breckon TP (2020) Multi-Class 3D object detection within volumetric 3D computed Tomography Baggage Security Screening Imagery.“ arXiv preprint. https://arxiv.org/abs/2008.01218.

  53. Wei Y, Liu X (2020) Dangerous goods detection based on transfer learning in X-ray images. Neural Comput Appl 32(12):8711–8724

    Article  Google Scholar 

  54. Wikipedia (26.08.2022). “X-ray.“ from https://en.wikipedia.org/wiki/X-ray

  55. Wu J, Liao S (2022) Intelligent detection of dangerous Goods in Security Inspection based on Cascade Cross Stage YOLOv3 Model. " Tehnički vjesnik 29(3):888–895

    Google Scholar 

  56. Xu M, Zhang H, Yang J (2018) Prohibited item detection in airport X-ray security images via attention mechanism based CNN. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Springer

  57. Yang J, Zhao Z, Zhang H, Shi Y (2019) Data augmentation for X-ray prohibited item images using generative adversarial networks. IEEE Access 7:28894–28902

    Article  Google Scholar 

  58. Yao S-q, Su Z-g, Yang J-f, Zhang H (2021) A prohibited items identification approach based on semantic segmentation. Optoelectron Lett 17(4):247–251

    Article  ADS  Google Scholar 

  59. Zhao C, Zhu L, Dou S, Deng W, Wang L (2022) Detecting overlapped objects in X-Ray Security Imagery by a label-aware mechanism. IEEE Trans Inf Forensics Secur 17:998–1009

    Article  Google Scholar 

  60. Zhou Z-H (2021) Machine learning. Springer Nature, Berlin

    Book  Google Scholar 

  61. Zou L, Yusuke T, Hitoshi I (2018) Dangerous objects detection of X-ray images using convolution neural network. International Conference on Security with Intelligent Computing and Big-data Services, Springer

Download references

Acknowledgements

This work is supported by The Scientific and Technological Research Council of Türkiye (Grant Number: 122E024). The authors would like to thank the council for the institutional support.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Konya Technical University, 42075, Konya, Turkey

    Gokhan Seyfi, Merve Yilmaz & Mustafa Servet Kiran

  2. Department of Software Engineering, Faculty of Engineering and Natural Sciences, Konya Technical University, 42075, Konya, Turkey

    Engin Esme

Authors
  1. Gokhan Seyfi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Engin Esme
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Merve Yilmaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mustafa Servet Kiran
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GS: Paper reading and review, writing original draft. EE: Conceptualization, writing original draft, review and editing. MY: Paper reading and review, writing original draft. MSK: Conceptualization, categorization, methodology, writing original draft, review and editing.

Corresponding author

Correspondence to Mustafa Servet Kiran.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Seyfi, G., Esme, E., Yilmaz, M. et al. A literature review on deep learning algorithms for analysis of X-ray images. Int. J. Mach. Learn. & Cyber. 15, 1165–1181 (2024). https://doi.org/10.1007/s13042-023-01961-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01961-z

Keywords

Search

Navigation