Skip to main content
SpringerLink
Log in

Evaluation of machine learning in recognizing images of reinforced concrete damage

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Damage to reinforced concrete (RC) facilities occurs through the process of natural deterioration. Machine learning can be employed to effectively identify various damage areas and ensure safety. The performance of machine vision methods depends on image quality. In this study, five image types (Types I–V) with combinations of image deficiencies pertaining to uniform illuminance, uneven illuminance, orthoimage, tilt angle, and image blur were used to evaluate the damage recognition capabilities of maximum likelihood (MLH), support vector machine (SVM), and random forest (RF) methods. Type I images were orthoimages with uniform illuminance, Type II images were tilted images with uniform illuminance, Type III images were orthoimages with uneven illuminance, Type IV images were tilted images with uneven illuminance, and Type V images were tilted, blurred images with uneven illuminance. MLH was most accurate (98.6%) in Type I images, and RF was the least accurate (62.8%) in Type V images. Image tilt (in Type II images) did not diminish the damage recognition capabilities of the three types of machine learning methods (mean accuracy = 97.2%). For tilted images with uneven illuminance (Type IV), a severe expansion effect was produced, reducing the mean accuracy to 70.1%. Type III images were recognized with a mean accuracy of 87.1%; uneven illuminance increased the error rate for three classes of damage. By testing various image types, the impact of image quality on the variability of machine learning recognition is understood, and the ability of automated machine learning recognition in the future is improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Abdel-Qader I, Pashaie-Rad S, Abudayyeh O, Yehia S (2016) PCA-based algorithm for unsupervised bridge crack detection. Adv Eng Softw 37(12):771–778

    Google Scholar 

  2. Abid MA, Ullah S, Siddique MA, Mushtaq MF, Aljedaani W, Rustam F (2022) Spam SMS filtering based on text features and supervised machine learning techniques. Multimed Tools Appl 81:39853–39871

    Google Scholar 

  3. Adhikari RS, Moselhi O, Bagchi A, Rahmatian A (2016) Tracking of defects in reinforced concrete bridges using digital images. J Comput Civ Eng 30(5):04016004

    Google Scholar 

  4. Alzubi JA (2015) Diversity based improved bagging algorithm. In proceedings of the the international conference on engineering & MIS. September, 1–5; Istanbul, Turkey

  5. Alzubi OA, Alzubi JAA, Tedmori S, Rashaideh H, Almomani O (2018) Consensus-based combining method for classifier ensembles. Int Arab J Inf Technol 15(1):76–86

    Google Scholar 

  6. Alzubi JA, Jain R, Nagrath P, Satapathy S, Taneja S, Gupta P (2021) Deep image captioning using an ensemble of CNN and LSTM based deep neural networks. J Intell Fuzzy Syst 40(4):5761–5769

    Google Scholar 

  7. Annadurai S, Arock M, Vadivel A (2023) Real and fake emotion detection using enhanced boosted support vector machine algorithm. Multimed Tools Appl 82:1333–1353

    Google Scholar 

  8. Athanasiou A, Ebrahimkhanlou A, Zaborac J, Hrynyk T, Salamone S (2020) A machine learning approach based on multifractal features for crack assessment of reinforced concrete shells. Comput Civ Infrastruct Eng 35:565–578

    Google Scholar 

  9. Babu HG, Venkatram N (2022) An efficient image dahazing using Googlenet based convolution neural networks. Multimed Tools Appl 81(30):43897–43917

    Google Scholar 

  10. Bae H, Jang K, An YK (2021) Deep super resolution crack network (SrcNet) for improving computer vision–based automated crack detectability in in situ bridges. Struct Heal Monit 20(4):1428–1442

    Google Scholar 

  11. Breiman L (2001) Random forests. Mach Learn 45:5–32

    MATH  Google Scholar 

  12. Bu GP, Chanda S, Guan H, Jo J, Blumenstein M, Loo YC (2015) Crack detection using a texture analysis-based technique for visual bridge inspection. Electron J Struct Eng 14(1):41–48

    Google Scholar 

  13. Cha YJ, Choi W, Büyüköztürk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput Civ Infrastruct Eng 32:361–378

    Google Scholar 

  14. Chen PH, Shen HK, Lei CY, Chang LM (2012) Support-vector-machine-based method for automated steel bridge rust assessment. Autom Constr 23:9–19

    Google Scholar 

  15. Chen JH, Su MC, Cao R, Hsu SC, Lu JC (2017) A self organizing map optimization based image recognition and processing model for bridge crack inspection. Autom Constr 73:58–66

    Google Scholar 

  16. Chun PJ, Ujike I, Mishima K, Kusumoto M, Okazaki S (2020) Random forest-based evaluation technique for internal damage in reinforced concrete featuring multiple nondestructive testing results. Constr Build Mater 253:119238

    Google Scholar 

  17. Cord A, Chambon S (2012) Automatic road defect detection by textural pattern recognition based on AdaBoost. Comput Civ Infrastruct Eng 27(4):244–259

    Google Scholar 

  18. Dawood T, Zhu Z, Zayed T (2017) Machine vision-based model for spalling detection and quantification in subway networks. Autom Constr 81:149–160

    Google Scholar 

  19. Erkal BG, Hajjar JF (2017) Laser-based surface damage detection and quantification using predicted surface properties. Autom Constr 83:285–302

    Google Scholar 

  20. Fan CL (2021) Detection of multidamage to reinforced concrete using support vector machine-based clustering from digital images. Struct Control Health Monit 28(12):e2841

    Google Scholar 

  21. Fan X, Wu J, Shi P, Zhang X, Xie Y (2018) A novel automatic dam crack detection algorithm based on local-global clustering. Multimed Tools Appl 77(20):26581–26599

    Google Scholar 

  22. Fang Q, Li H, Luo X, Ding L, Luo H, Rose TM, An W (2018) Detecting non-hardhat-use by a deep learning method from far-field surveillance videos. Autom Constr 85:1–9

    Google Scholar 

  23. Figuerêdo JSL, Calumby RT (2022) Unsupervised query-adaptive implicit subtopic discovery for diverse image retrieval based on intrinsic cluster quality. Multimed Tools Appl 81:42991–43011

    Google Scholar 

  24. German S, Brilakis I, Desroches R (2012) Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments. Adv Eng Inform 26(4):846–858

    Google Scholar 

  25. Gui G, Pan H, Lin Z, Li Y, Yuan Z (2017) Data-driven support vector machine with optimization techniques for structural health monitoring and damage detection. KSCE J Civ Eng 21(2):523–534

    Google Scholar 

  26. Gupta P, Dixit M (2022) Image-based crack detection approaches: a comprehensive survey. Multimed Tools Appl 81:40181–40229

    Google Scholar 

  27. Hüthwohl P, Lu R, Brilakis I (2019) Multi-classifier for reinforced concrete bridge defects. Autom Constr 105:102824

    Google Scholar 

  28. Jahanshahi MR, Masri SF (2012) Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures. Autom Constr 22:567–576

    Google Scholar 

  29. Jain DK, Jacob S, Alzubi J, Menon V (2020) An efficient and adaptable multimedia system for converting PAL to VGA in real-time video processing. J Real Time Image Process 17(6):2113–2125

    Google Scholar 

  30. Jang K, Kim N, An YK (2019) Deep learning–based autonomous concrete crack evaluation through hybrid image scanning. Struct Heal Monit 18:1722–1737

    Google Scholar 

  31. Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 4(3):1106–1122

    MATH  Google Scholar 

  32. Kim H, Ahn E, Shin M, Sim SH (2019) Crack and noncrack classification from concrete surface images using machine learning. Struct Heal Monit 18:725–738

    Google Scholar 

  33. Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29:196–210

    Google Scholar 

  34. Laory I, Trinh TN, Posenato D, Smith IFC (2013) Combined model-free data-interpretation methodologies for damage detection during continuous monitoring of structures. J Comput Civ Eng 27(6):657–666

    Google Scholar 

  35. Lattanzi D, Miller GR (2014) Robust automated concrete damage detection algorithms for field applications. J Comput Civ Eng 28(2):253–262

    Google Scholar 

  36. Li G, Zhao X, Du K, Ru F, Zhang Y (2017) Recognition and evaluation of bridge cracks with modified active contour model and greedy search-based support vector machine. Autom Constr 78:51–61

    Google Scholar 

  37. Li S, Zhao X, Zhou G (2019) Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Comput Civ Infrastruct Eng 34(7):616–634

    Google Scholar 

  38. Liu C, Liu C, Liu C, Huang X, Miao J, Xu W (2019) Fire damage identification in RC beams based on support vector machines considering vibration test. KSCE J Civ Eng 23(10):4407–4416

    Google Scholar 

  39. Ma Y, Wang L, Zhang J, Xiang Y, Peng T, Liu Y (2015) Hybrid uncertainty quantification for probabilistic corrosion damage prediction for aging RC bridges. J Mater Civ Eng 27(4):04014152

    Google Scholar 

  40. Mathavan S, Rahman M, Kamal K (2015) Use of a self-organizing map for crack detection in highly textured pavement images. J Infrastruct Syst 21(3):04014052

    Google Scholar 

  41. McNeil S, Humplick F (1991) Evaluation of errors in automated pavementdistress data acquisition. J Transp Eng 117(2):224–241

    Google Scholar 

  42. Meijer D, Scholten L, Clemens F, Knobbe A (2019) A defect classification methodology for sewer image sets with convolutional neural networks. Autom Constr 104:281–298

    Google Scholar 

  43. Mizoguchi T, Koda Y, Iwaki I, Wakabayashi H, Kobayashi Y, Shirai K, Hara Y, Lee HS (2013) Quantitative scaling evaluation of concrete structures based on terrestrial laser scanning. Autom Constr 35:263–274

    Google Scholar 

  44. Mohan A, Poobal S (2018) Crack detection using image processing: a critical review and analysis. Alexandria Eng J 57:787–798

    Google Scholar 

  45. Moselhi O, Shehab-Eldeen T (2000) Classification of defects in sewer pipes using neural networks. J Infrastruct Syst 6(3):97–104

    Google Scholar 

  46. Movassagh AA, Alzubi JA, Gheisari M, Rahimi M, Mohan S, Abbasi AA, Nabipour N (2021) Artificial neural networks training algorithm integrating invasive weed optimization with differential evolutionary model. J Ambient Intell Humaniz Comput 1–9

  47. Mustafa S, Debnath N, Dutta A (2015) Bayesian probabilistic approach for model updating and damage detection for a large truss bridge. Int J Steel Struct 15:473–485

    Google Scholar 

  48. Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Civ Infrastruct Eng 27(1):29–47

    Google Scholar 

  49. Okazaki Y, Okazaki S, Asamoto S, Chun P (2020) Applicability of machine learning to a crack model in concrete bridges. Comput Civ Infrastruct Eng 35:775–792

    Google Scholar 

  50. Omar T, Nehdi ML (2017) Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography. Autom Constr 83:360–371

    Google Scholar 

  51. Prasanna P, Dana KJ, Gucunski N, Basily BB, La HM, Lim RS, Parvardeh H (2014) Automated crack detection on concrete bridges. IEEE Trans Autom Sci Eng 13:591–599

    Google Scholar 

  52. Rashidi A, Sigari MH, Maghiar M, Citrin D (2016) An analogy between various machine-learning techniques for detecting construction materials in digital images. KSCE J Civ Eng 20:1178–1188

    Google Scholar 

  53. Rodríguez-Martín M, Lagüela S, González-Aguilera D, Martínez J (2016) Thermographic test for the geometric characterization of cracks in welding using IR image rectification. Autom Constr 61:58–65

    Google Scholar 

  54. Rubio JJ, Kashiwa T, Laiteerapong T, Deng W, Nagai K, Escalera S, Nakayama K, Matsuo Y, Prendinger H (2019) Multi-class structural damage segmentation using fully convolutional networks. Comput Ind 112:103121

    Google Scholar 

  55. Schnebele E, Tanyu BF, Cervone G, Waters N (2015) Review of remote sensing methodologies for pavement management and assessment. Eur Transp Res Rev 27:1–19

    Google Scholar 

  56. Sinha SK, Fieguth PW (2016) Neuro-fuzzy network for the classification of buried pipe defects. Autom Constr 15(1):73–83

    Google Scholar 

  57. Son H, Kim C, Kim C (2012) Automated color model–based concrete detection in construction-site images by using machine learning algorithms. J Comput Civ Eng 26:421–433

    Google Scholar 

  58. Spencer BF, Hoskere V, Narazaki Y (2019) Advances in computer vision-based civil infrastructure inspection and monitoring. Engineering 5(2):199–222

    Google Scholar 

  59. Taffese WZ, Sistonen E (2017) Machine learning for durability and service-life assessment of reinforced concrete structures: recent advances and future directions. Autom Constr 77:1–14

    Google Scholar 

  60. Valero E, Forster A, Bosché F, Hyslop E, Wilson L, Turmel A (2019) Automated defect detection and classification in ashlar masonry walls using machine learning. Autom Constr 106:102846

    Google Scholar 

  61. Vapnik V (1995) The nature of statistical learning theory. Springer-Verlag, New York

    MATH  Google Scholar 

  62. Wang W, Jiang L, Lin S, Fang H, Meng Q (2022) Imitation learning based decision-making for autonomous vehicle control at traffic roundabouts. Multimed Tools Appl 81:39873–39889

    Google Scholar 

  63. Weixing W, Limin L, Zhen Z (2022) Road extraction in vague images on gray scale consistency and improved MSR and DS evidence. Multimed Tools Appl 81:43657–43678

    Google Scholar 

  64. Yao Y, Tung STE, Glisic B (2014) Crack detection and characterization techniques - An overview. Struct Control Heal Monit 21(12):1378–1413

    Google Scholar 

  65. Yeum CM, Dyke SJ (2015) Vision-based automated crack detection for bridge inspection. Comput Civ Infrastruct Eng 30(10):759–770

    Google Scholar 

  66. Zakeri H, Nejad FM, Fahimifar A (2017) Image based techniques for crack detection, classification and quantification in asphalt pavement: a review. Arch Comput Methods Eng 24:935–977

    MATH  Google Scholar 

  67. Zalama E, Gómez-García-Bermejo J, Medina R, Llamas J (2014) Road crack detection using visual features extracted by Gabor filters. Comput Civ Infrastruct Eng 29(5):342–358

    Google Scholar 

  68. Zhang C, Chang CC, Jamshidi M (2020) Concrete bridge surface damage detection using a single-stage detector. Comput Civ Infrastruct Eng 35:389–409

    Google Scholar 

  69. Zhu Z, German S, Brilakis I (2011) Visual retrieval of concrete crack properties for automated post-earthquake structural safety evaluation. Autom Constr 20(7):874–883

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Civil Engineering, Republic of China Military Academy, No. 1, Weiwu Rd., Fengshan, Kaohsiung, 83059, Taiwan

    Ching-Lung Fan

Authors
  1. Ching-Lung Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ching-Lung Fan.

Ethics declarations

Competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, CL. Evaluation of machine learning in recognizing images of reinforced concrete damage. Multimed Tools Appl 82, 30221–30246 (2023). https://doi.org/10.1007/s11042-023-14911-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14911-2

Keywords

Search

Navigation