Abstract
Detection of Landmines, especially anti-tank mines, bombs, and unexploded substances, is one of the major challenges facing humanity. The devastation and human tragedy associated with undetected explosives are self-evident in war-torn communities. To deal with this problem, we are only left with proactive measures that such substances must be detected and dealt with before the fallout. Most available solutions have major shortcomings, such as cost, efficiency, and accuracy, where the trade-offs among them are inversely related. On the other hand, advances in deep learning, unmanned aerial vehicle, and sensing are making their way as potential technologies to revolutionize the detection and removal of landmines. In this paper, we go through the literature reviewing the most recent work featuring computerized technologies to detect landmines. To our knowledge, no such study has taken place in this respect. Our aim is to find out how deep learning can be integrated with landmine detection. We identify open challenges toward viable automated solutions that enable deep learning to optimize performance effectively.



Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Referencese
Robledo L, Carrasco M, Mery D (2009) A survey of land mine detection technology. Int J Remote Sens 30(9):2399–2410
Merriam-Webster (2021) Landmine. Merriam-Webster.com Dictionary, June 2021, https://www.merriam- webster.com/dictionary/land
U. Nations, Demining, Mayback Machine, May 2021, http://www.un.org/en/sections/issues- depth/demining/index.html
L. M. (Report), “Casualties,” International Campaign for the Banning of Landmines, March 2017.
Keeley R (2017) Improvised explosive devices (IED): a human- itarian mine action perspective. J Conv Weapons Destr 21(1):3
Hafiz AM, Bhat GM (2020) A survey on instance segmen- tation: state of the art. Int J Multimed Inf Retr 9(3):171–189
Fernández MG, López YÁ, Arboleya AA, Valdés BG, Vaqueiro YR, Andrés FL-H, García AP (2018) Synthetic aperture radar imaging system for landmine detection using a ground penetrating radar on board a unmanned aerial vehicle. IEEE Access 6:45100–45112
Osco LP, Junior JM, Ramos APM, deCastroJorge LA, Fatholahi SN, deAndradeSilva J, Matsubara ET, Pistori H, Gonçalves WN, Li J (2021) “A review on deep learning in UAV remote sensing. Int J Appl Earth Observ Geoinf 102:102456
Mozaffari M, Saad W, Bennis M, Nam Y-H, Debbah M (2019) A tutorial on UAVs for wireless networks: Applications, challenges, and open problems. IEEE Commun Surv Tutor 21(3):2334–2360
Mohamed N, Al-Jaroodi J, Jawhar I, Noura H, Mahmoud S (2017) Uavfog: a UAV-based fog computing for internet of things. In: 2017 IEEE SmartWorld, ubiquitous intelligence and computing, advanced and trusted computed, scalable computing and communications, cloud and big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, 2017, pp 1–8
Suganthi G, Korah R (2014) Discrimination of mine-like objects in infrared images using artificial neural network. Indian J Appl Res 4(12):206–208
M. Bajić, (2021) Modeling and simulation of very high spatial resolution uxos and landmines in a hyperspectral scene for uav survey. Remote Sensing 13(5):837
Yuksel SE, Bolton J, Gader P (2015) Multiple-instance hidden markov models with applications to landmine detection. IEEE Trans Geosci Remote Sens 53(12):6766–6775
Yuksel SE, Gader PD (2016) Context-based classification via mixture of hidden markov model experts with applications in landmine detection. IET Comput Vis 10(8):873–883
Makki I, Younes R, Francis C, Bianchi T, Zucchetti M (2017) A Survey of Landmine Detection Using Hyperspectral Imag- ing. ISPRS J Photogramm Remote Sens 124:40–53
Bestagini P, Lombardi F, Lualdi M, Picetti F, Tubaro S (2020) Landmine detection using autoencoders on multipolarization gpr volumetric data. IEEE Trans Geosci Remote Sens 59(1):182–195
Silva JS, Guerra IFL, Bioucas-Dias J, Gasche T (2019) Landmine detection using multispectral images. IEEE Sens J 19(20):9341–9351
Gürkan S, Karapınar M, Doğan S (2019) Detection and imaging of underground objects for distinguishing explosives by using a fluxgate sensor array. Appl Sci 9(24):5415
Rafique W, Zheng D, Barras J, Joglekar S, Kosmas P (2019) Predictive analysis of landmine risk”. IEEE Access 7:107259–107269
Tong Z, Gao J, Yuan D (2020) Advances of deep learning applications in ground-penetrating radar: a survey. Construction and Build Mater 258:120371
Baur J, Steinberg G, Nikulin A, Chiu K, de Smet TS (2020) Applying deep learning to automate uav-based detection of scatterable landmines. Remote Sens 12(5):859
Safatly L, Baydoun M, Alipour M, Al-Takach A, Atab K, Al-Husseini M, El-Hajj A, Ghaziri H (2021) Detection and classification of landmines using machine learning applied to metal detector data. J Exp Theor Artif Intell 33(2):203–226
Priya CN, Ashok SD, Maji B, Kumaran KS (2021) Deep learning based thermal image processing approach for detection of buried objects and mines. Eng J 25(3):61–67
Girshick R, Donahue J, Darrell T, Malik J (2015) Region- based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38(1):142–158
Bello R (2013) Literature review on landmines and detection meth- ods. Front Sci 3(1):27–42
Habib MK (2007) Controlled biological and biomimetic sys- tems for landmine detection. Biosens Bioelectron 23(1):1–18
Sargisson RJ, McLean IG, Brown J, Bach H (2012) Environmental determinants of landmine detection by dogs: findings from a large-scale study in Afghanistan. 16:74–81
Poling A, Weetjens BJ, Cox C, Beyene NW, Sully A (2010) Using giant african pouched rats (Cricetomys gambianus) to detect landmines. Psychol Record 60(4):715–728
Masunaga S, Nonami K (2007) Controlled metal detector mounted on mine detection robot. Int J Adv Rob Syst 4(2):26
Achal S, Mcfee J, Howse J (2010) Gradual dispersal of explosives by ants and its possible implication for smart- landmine production. In: International Symposium of Human- itarian Demining, Šibenik, Croatia, pp 60–65
Yagur-Kroll S, Lalush C, Rosen R, Bachar N, Moskovitz Y, Belkin S (2014) Escherichia coli bioreporters for the detection of 2, 4-dinitrotoluene and 2, 4, 6-trinitrotoluene. Appl Microbiol Biotechnol 98(2):885–895
Kasban H, Zahran O, Elaraby SM, El-Kordy M, Abd El-Samie FE (2010) A comparative study of landmine detection techniques. Sens Imaging Int J 11(3):89–112
Cardona Rendón L, Jiménez Builes JA, Vane-gas Molina NA (2014) Landmine detection technologies to face the demining problem in antioquia. Dyna; 81(183)
Dula J, Zare A, Ho D, Gader P (2013) Landmine classifi- cation using possibilistic k-nearest neighbors with wideband electromagnetic induction data. In: Detection and sensing of mines, explosive objects, and obscured targets XVIII, vol. 8709. International Society for Optics and Photonics, p 87091F
Kaneko AM, Fukushima E, Endo G (2014) A discrimination method for landmines and metal fragments using metal detectors. J Conv Weapons Destr 18(1):16
Kruger H, Ewald H (2008) Handheld metal detector with online visualisation and classification for the humanitarian mine clearance. In SENSORS, Lecce, Italy. IEEE, pp 415–418
Collins L, Gao P, Makowsky L, Moulton J, Reidy D, Weaver D (2000) Improving detection of low-metallic content landmines using EMI data. In: IGARSS 2000. IEEE 2000 inter- national geoscience and remote sensing symposium. taking the pulse of the planet: the role of remote sensing in managing the environment. Proceedings (Cat. No. 00CH37120), vol. 4. IEEE, pp 1631–1633
Mazhar R, Gader PD, Wilson JN (2009) Matching-pursuits dissimilarity measure for shape-based comparison and classifi- cation of high-dimensional data. IEEE Trans Fuzzy Syst 17(5):1175–1188
Tantum SL, Collins LM (2001) A comparison of algorithms for subsurface target detection and identification using time- domain electromagnetic induction data. IEEE Trans Geosci Remote Sens 39(6):1299–1306
Tran MD-J, Abeynayake C, Jain LC (2011) A target discrimination methodology utilizing wavelet-based and morphological feature extraction with metal detector array data. IEEE Trans Geosci Remote Sens 50(1):119–129
Bruschini C, Gros B, Guerne F, Pièce P-Y, Carmona O (1998) Ground penetrating radar and imaging metal detector for antipersonnel mine detection. J Appl Geophys 40(1–3):59–71
Nguyen TT, Hao DN, Lopez P, Cremer F, Sahli H (2005) Thermal infrared identification of buried landmines. In: De tection and remediation technologies for mines and Minelike targets X, vol 5794. International Society for Optics and Photonics, pp 198–208
Richards JA, Jia X (2005) The effect of the atmosphere on radiation. In: Remote sensing digital image analysis: an introduction, Canbeerra, June 2005, pp. 28–34.
Kaya S, Leloglu UM (2017) Buried and surface mine detec- tion from thermal image time series. IEEE J Sel Top Appl Earth Observ Remote Sens 10(10):4544–4552
Janssen YH, de Jong AN, Winkel H, van Putten FJ (1996) Detection of surface-laid and buried mines with IR and CCD cameras: an evaluation based on measurements. In: Detection and remediation technologies for mines and minelike targets, vol 2765. International Society for Optics and Photonics, pp 448–459
Ederra GB (1999) Mathematical morphology techniques applied to anti-personnel mine detection. Ph.D. dissertation, MS The- sis, Department of Electronics and Information Processing, vol 8, pp 1–6
Thành NT, Hào DN, Sahli H (2009) Infrared thermography for land mine detection. In: Augmented vision perception in infrared. Springer, pp 3–36
Van Kempen L, Kaczmarec M, Sahli H, Cornelis J (1998) Dynamic infrared image sequence analysis for anti-personnel mine detection. In: IEEE benelux signal processing chap ter, signal processing symposium; leuven, belgium. ieee benelux signal processing chapter, signal processing sym posium, pp. 215–218
Thanh NT, Sahli H, Hao DN (2007) Finite-difference methods and validity of a thermal model for landmine detection with soil property estimation. IEEE Trans Geosci Remote Sens 45(3):656–674
Ajlouni A, Sheta A (2008) Landmind detection with IR sensors using karhunen loeve transformation and watershed segmen-tation. In: 5th international multi-conference on systems, signals and devices, Amman, Jordan. IEEE, pp 1–6
Sendur IK, Baertlein BA (2000) Numerical simulation of thermal signatures of buried mines over a diurnal cycle. Iin: Detection and remediation technologies for mines and minelike targets V, vol 4038. International Society for Optics and Photonics, pp 156–167
Paik J, Lee CP, Abidi MA (2002) Image processing-based mine detection techniques: a review. Subsurf Sens Technol Appl 3(3):153–202
Ko KH, Jang G, Park K, Kim K (2012) GPR-based land- mine detection and identification using multiple features. Int J Antennas Propag, Article ID 826404
Becker J, Havens TC, Pinar A, Schulz TJ (2015) Deep belief networks for false alarm rejection in forward-looking ground-penetrating radar. In: Detection and sensing of mines, explosive objects, and obscured targets XX, vol 9454. In ternational Society for Optics and Photonics, p 94540W
Besaw LE, Stimac PJ (2015) Deep convolutional neural networks for classifying GPR B-scans. In: Detection and sensing of mines, explosive objects, and obscured targets XX, vol 9454. SPIE, pp 385–394
Giannakis I, Giannopoulos A, Warren C, Davidson N (2015) Numerical modelling and neural networks for landmine de-tection using ground penetrating radar. In: 8th international workshop on advanced ground penetrating radar (IWAGPR), Florence, Italy. IEEE, pp 1–4
Dou Q, Wei L, Magee DR, Cohn AG (2016) Realtime hyperbola recognition and fitting in GPR data. IEEE Trans Geosci Remote Sens 55(1):51–62
Lameri S, Lombardi F, Bestagini P, Lualdi M, Tubaro S (2017) Landmine detection from GPR data using convolutional neural networks. In: 25th European signal processing conference (EUSIPCO), Kos, Greece. IEEE, pp 508–512
Kim N, Kim S, An Y-K, Lee J-J (2021) A novel 3d gpr im- age arrangement for deep learning-based underground object classification. Int J Pavement Eng 22(6):740–751
Pham M-T, Lefèvre S (2018) Buried object detection from b-scan ground penetrating radar data using faster-RCNN. In: IGARSS 2018–2018 IEEE international geoscience and re- mote sensing symposium. IEEE, pp 6804–6807
Ren S, He K, Girshick R, Sun J (2015) Faster r-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst, 28
Warren C, Giannopoulos A, Giannakis I (2016) gprmax: Open source software to simulate electromagnetic wave propagation for ground penetrating radar. Comput Phys Commun 209:163–170
Ozkaya U, Melgani F, Bejiga MB, Seyfi L, Donelli M (2020) Gpr b scan image analysis with deep learning methods. Measurement 165:107770
Pambudi AD, Fauß M, Ahmad F, Zoubir AM (2020) Minimax robust landmine detection using forward-looking ground-penetrating radar. IEEE Trans Geosci Remote Sens 58(7):5032–5041
K.Ishitsuka, S. Iso, K. Onishi, and T. Matsuoka, “Object detection in ground-penetrating radar images using a deep convolutional neural network and image set preparation by migration,” International Journal of Geophysics, vol. 2018, 2018.
Dinh K, Gucunski N, Duong TH (2018) An algorithm for automatic localization and detection of rebars from GPR data of concrete bridge decks. Autom Constr 89:292–298
Lei W, Hou F, Xi J, Tan Q, Xu M, Jiang X, Liu G, Gu Q (2019) Automatic hyperbola detection and fitting in GPR B- scan image. Autom Constr 106:102839
Alvarez JK, Kodagoda S (2018) Application of deep learning image-to-image transformation networks to GPR radargrams for sub-surface imaging in infrastructure monitoring. In: 2018 13th IEEE conference on industrial electronics and applications (ICIEA). IEEE, pp 611–616
Picetti F, Testa G, Lombardi F, Bestagini P, Lualdi M, Tubaro S (2018) Convolutional autoencoder for landmine detection on GPR scans. In: 2018 41st international conference on telecommunications and signal processing (TSP). IEEE, pp 1–4
Tong Z, Gao J, Zhang H (2017) Recognition, location, mea- surement, and 3d reconstruction of concealed cracks using convolutional neural networks. Constr Build Mater 146:775–787
Manolakis D, Shaw G (2002) Detection algorithms for hyperspectral imaging applications. IEEE Signal Process Mag 19(1):29–43
Manolakis D, Truslow E, Pieper M, Cooley T, Brueggeman M (2013) Detection algorithms in hyperspectral imaging systems: an overview of practical algorithms. IEEE Signal Process Mag 31(1):24–33
Axelsson M, Friman O, Haavardsholm TV, Renhorn I (2016) Target detection in hyperspectral imagery using forward modeling and in-scene information. ISPRS Journal of Photogram- metry and Remote Sensing 119:124–134
Zhang L, Zhang L, Tao D, Huang X, Du B (2013) Hyperspectral remote sensing image subpixel target detection based on supervised metric learning. IEEE Trans Geosci Remote Sens 52(8):4955–4965
Makki I, Younes R, Francis C, Bianchi T, Zucchetti M (2017) Classification algorithms for landmine detection using hyperspectral imaging. In: 2017 first international conference on landmine: detection, clearance and legislations (LDCL). IEEE, pp 1–6
Scharf LL, McWhorter LT (1996) Adaptive matched sub- space detectors and adaptive coherence estimators. In: Confer ence record of the thirtieth Asilomar conference on signals, systems and computers. IEEE, pp 1114–1117
Ren H, Du Q, Chang C-I, Jensen JO (2003) Comparison between constrained energy minimization based approaches for hyperspectral imagery. In: IEEE workshop on advances in techniques for analysis of remotely sensed data, 2003. IEEE, pp 244–248
Harsanyi JC, Chang C-I (1994) Hyperspectral image classifi- cation and dimensionality reduction: An orthogonal subspace projection approach. IEEE Trans Geosci Remote Sens 32(4):779–785
Wang L, Zhao C (2016) Hyperspectral image processing. Springer, Berlin
Chang C-I (1999) Spectral information divergence for hyper- spectral image analysis. In: IEEE 1999 international geo- science and remote sensing symposium. IGARSS’99 (Cat. No. 99CH36293), vol 1. IEEE, pp 509–511
Yin J, Wang Y, Wang Y, Zhao Z (2010) A modified algorithm for multi-target detection in hyperspectral image. In: IEEE 2nd international asia conference on informatics in control, automation and robotics (CAR 2010), vol 3, pp 105–108
Golovin A, Demin A (2018) Optical-digital complex for detection of remote mines and mapping of minefields. In J Phys Conf Ser 1096(1):012011
Khodor M, Makki I, Younes R, Bianchi T, Khoder J, Francis C, Zucchetti M (2021) Landmine detection in hy- perspectral images based on pixel intensity. Remote Sens Appl Soc Environ 21:100468
Cunliffe A, Brazier R, Anderson K (2016) Remote sensing of environment ultra-fi ne grain landscape-scale quantification of dryland vegetation structure with drone-acquired structure-from-motion photogrammetry. Remote Sens Environ [Internet] 183:129–143
Bhardwaj A, Sam L, Martín-Torres FJ, Kumar R et al (2016) UAVs as remote sensing platform in glaciology: present applications and future prospects. Remote Sens Environ 175:196–204
Ding M-L, Ding C-B, Tang L, Wang X-M, Qu J-M, Wu R (2020) A w-band 3-d integrated mini-SAR system with high imaging resolution on UAV platform. IEEE Access 8:113601–113609
García-Fernández M, López YÁ, Arboleya A, González- Valdés B, Rodríguez-Vaqueiro Y, Gómez MEDC, Andrés FL-H (2017) Antenna diagnostics and characterization using unmanned aerial vehicles. IEEE Access 5:23563–23575
Ismail A, Elmogy M, ElBakry H (2014) Landmines detection using autonomous robots: a survey. Int J Emerging Trends Technol Comput Sci 3(4):184–187
Castiblanco C, Rodriguez J, Mondragon I, Parra C, Colorado J (2014) Air drones for explosive landmines detection. In: ROBOT2013: first iberian robotics conference. Springer, pp 107–114
Gavazzi B, Le Maire P, Munschy M, Dechamp A (2016) Fluxgate vector magnetometers: a multisensor device for ground, UAV, and airborne magnetic surveys. Lead Edge 35(9):795–797
Sipos D, Planinsic P, Gleich D (2017) On drone ground penetrating radar for landmine detection. In: 2017 First inter- national conference on landmine: detection, clearance and legislations (LDCL). IEEE, pp 1–4
Šipoš D, Gleich D (2020) A lightweight and low-power UAV- borne ground penetrating radar design for landmine detection. Sensors 20(8):2234
Colorado J, Perez M, Mondragon I, Mendez D, Parra C, Devia C, Martinez-Moritz J, Neira L (2017) An integrated aerial system for landmine detection: SDR-based ground penetrating radar onboard an autonomous drone. Adv Robot 31(15):791–808
Cerquera MRP, Montaño JDC, Mondragón I, Canbolat H (2017) Uav for landmine detection using SDR-based GPR technology. In: Robots operating in hazardous environments. IntechOpen, pp 26–55
Burr R, Schartel M, Schmidt P, Mayer W, Walter T, Waldschmidt C (2018) Design and implementation of a FMCW GPR for UAV-based mine detection. In: 2018 IEEE MTT-S international conference on microwaves for intelligent mobility (ICMIM). IEEE, pp 1–4
Reigber A, Moreira A (2000) First demonstration of airborne SAR tomography using multibaseline l-band data. IEEE Trans Geosci Remote Sens 38(5):2142–2152
Krieger G, Hajnsek I, Papathanassiou KP, Younis M, Moreira A (2010) Interferometric synthetic aperture radar (SAR) missions employing formation flying. Proc IEEE 98(5):816–843
Schartel M, Burr R, Bähnemann R, Mayer W, Wald- Schmidt C (2020) An experimental study on airborne landmine detec tion using a circular synthetic aperture radar. arXiv preprint arXiv:2005.02600, mMy
Almutiry M (2020) UAV tomographic synthetic aperture radar for landmine detection. Eng Technol Appl Sci Res 10(4):5933–5939
Alvey BJ, Anderson DT, Yang C, Buck A, Keller JM, Yasuda KE, Ryan HA (2021) Characterization of deep learning-based aerial explosive hazard detection using simulated data. In: 2021 IEEE symposium series on computational intelligence (SSCI). IEEE, 2, pp 1–8
Shah S,Dey D, Lovett C, Kapoor A (2018) Airsim: high- fidelity visual and physical simulation for autonomous vehicles. In: Field and service robotics. Springer, pp 621–635
Travassos XL, Avila SL, Ida N (2020) Artificial neural networks and machine learning techniques applied to ground penetrating radar: a review. Appl Comput Inf 17(2)
Yoo L-S, Lee J-H, Lee Y-K, Jung S-K, Choi Y (2021) Application of a drone magnetometer system to military mine detection in the demilitarized zone. Sensors 21(9):3175
Acknowledgements
This research work was funded by Institutional Fund Projects under grant no (IFPNC-001-611-2020). Therefore, the authors gratefully acknowledge technical and financial support from the Ministry of Education and King Abdelaziz University, Jeddah, Saudi Arabia.
Author information
Authors and Affiliations
Contributions
The work is done by equal cooperation of authors.
Corresponding author
Ethics declarations
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Conflict of interest
Authors declare that they do not have conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Barnawi, A., Budhiraja, I., Kumar, K. et al. A comprehensive review on landmine detection using deep learning techniques in 5G environment: open issues and challenges. Neural Comput & Applic 34, 21657–21676 (2022). https://doi.org/10.1007/s00521-022-07819-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07819-9