skip to main content
10.1145/3638682.3638705acmotherconferencesArticle/Chapter ViewAbstractPublication PagesvsipConference Proceedingsconference-collections
research-article

A Novel Approach for Concrete Crack and Spall Detection Based on Improved YOLOv8

Published: 22 May 2024 Publication History

Abstract

The detection and prevention of concrete cracks and spalls is crucial to ensure the structural integrity and longevity of civil infrastructure. In this research paper, we propose a novel method for concrete crack and spall detection based on YOLOv8 with ByteTrack and supervision. The proposed method exploits the advantages of the YOLOv8 object detection framework, which provides real-time and accurate detection, tracking and counting of various objects. By integrating ByteTrack, a state-of-the-art tracking algorithm, we increase system performance and robustness in tracking cracks and spalls over time. Furthermore, supervision is employed to improve detection accuracy through iterative training and fine-tuning. To train the model, an extensive dataset of concrete crack and spall images is collected, annotated, and enhanced. The dataset includes a variety of scenarios, lighting conditions, and crack/spill sizes, which ensures the model's ability to generalize to real-world situations. Transfer learning is used to support the YOLOv8 backbone with pre-trained weights, to accelerate the convergence of the training process. Experimental evaluation is conducted on a benchmark dataset, and the proposed method outperforms existing techniques in terms of accuracy, precision, and recall. YOLOv8 with ByteTrack and Supervision achieves an overall accuracy of 94% detection rate for concrete cracks and spalls, even under challenging conditions. Real-time deployment is achieved on a high-performance computing platform, allowing efficient and timely monitoring of concrete structures. The proposed method demonstrates its potential as a valuable tool for infrastructure management and maintenance, enabling early detection of concrete cracks and spalls. By promptly identifying such defects, necessary repair and reinforcement measures can be implemented, preventing further deterioration and ensuring the safety and longevity of civil infrastructure. The high detection performance of the proposed approach, achieving excellent precision, recall, and F1 score for both crack and spall detection. Our system's overall average precision of 93% indicates its accuracy in detecting concrete cracks and spalls. Additionally, the system exhibits fast real-time processing with an inference speed of 50fps and is highly robust in handling diverse concrete crack and spall scenarios. Future work may focus on expanding the dataset, exploring the integration of additional detection algorithms, and evaluating system performance in large-scale applications.

References

[1]
Jang, K. and An, Y.K., 2018. Multiple crack evaluation on concrete using a line laser thermography scanning system. Smart Struct. Syst, 22(2), pp.201-207.
[2]
Kim, H., Lee, J., Ahn, E., Cho, S., Shin, M. and Sim, S.H., 2017. Concrete crack identification using a UAV incorporating hybrid image processing. Sensors, 17(9), p.2052.
[3]
Fang, F., Li, L., Gu, Y., Zhu, H. and Lim, J.H., 2020. A novel hybrid approach for crack detection. Pattern Recognition, 107, p.107474.
[4]
Rouf, M.A., Wu, Q., Yu, X., Iwahori, Y., Wu, H. and Wang, A., 2023. Real-time Vehicle Detection, Tracking and Counting System Based on YOLOv7. Embedded Selforganising Systems, 10(7), pp.4-8.
[5]
Liu, Y., Cho, S., Spencer Jr, B.F. and Fan, J., 2014. Automated assessment of cracks on concrete surfaces using adaptive digital image processing. Smart Structures and Systems, 14(4), pp.719-741.
[6]
Liu, C., Sui, H., Wang, J., Ni, Z. and Ge, L., 2022. Real-time ground-level building damage detection based on lightweight and accurate YOLOv5 using terrestrial images. Remote Sensing, 14(12), p.2763.
[7]
Savino, P. and Tondolo, F., 2021. Automated classification of civil structure defects based on convolutional neural network. Frontiers of Structural and Civil Engineering, 15(2), pp.305-317.
[8]
Jahanshahi, M.R., Kelly, J.S., Masri, S.F. and Sukhatme, G.S., 2009. A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures. Structure and Infrastructure Engineering, 5(6), pp.455-486.
[9]
Wang, W., Hu, W., Wang, W., Xu, X., Wang, M., Shi, Y., Qiu, S. and Tutumluer, E., 2021. Automated crack severity level detection and classification for ballastless track slab using deep convolutional neural network. Automation in Construction, 124, p.103484.
[10]
Jahanshahi, M.R., Masri, S.F. and Sukhatme, G.S., 2011. Multi-image stitching and scene reconstruction for evaluating defect evolution in structures. Structural Health Monitoring, 10(6), pp.643-657.
[11]
Yang, C., Chen, J., Li, Z. and Huang, Y., 2021. Structural crack detection and recognition based on deep learning. Applied sciences, 11(6), p.2868.
[12]
Zheng, M., Lei, Z. and Zhang, K., 2020. Intelligent detection of building cracks based on deep learning. Image and Vision Computing, 103, p.103987.
[13]
Bae, H., Jang, K. and An, Y.K., 2021. Deep super resolution crack network (SrcNet) for improving computer vision–based automated crack detectability in in situ bridges. Structural Health Monitoring, 20(4), pp.1428-1442.
[14]
Huang, H.W., Li, Q.T. and Zhang, D.M., 2018. Deep learning based image recognition for crack and leakage defects of metro shield tunnel. Tunnelling and underground space technology, 77, pp.166-176.
[15]
Mei, Q., Gül, M. and Azim, M.R., 2020. Densely connected deep neural network considering connectivity of pixels for automatic crack detection. Automation in Construction, 110, p.103018.
[16]
Zhang, Y., Huang, J. and Cai, F., 2020. On bridge surface crack detection based on an improved YOLO v3 algorithm. IFAC-PapersOnLine, 53(2), pp.8205-8210.
[17]
Li, B., Wang, K.C., Zhang, A., Yang, E. and Wang, G., 2020. Automatic classification of pavement crack using deep convolutional neural network. International Journal of Pavement Engineering, 21(4), pp.457-463.
[18]
Chen, X., Yongchareon, S. and Knoche, M., 2023. A review on computer vision and machine learning techniques for automated road surface defect and distress detection. Journal of Smart Cities and Society, (Preprint), pp.1-17.
[19]
Zhang, L., Yang, F., Zhang, Y.D. and Zhu, Y.J., 2016, September. Road crack detection using deep convolutional neural network. In 2016 IEEE international conference on image processing (ICIP) (pp. 3708-3712). IEEE.
[20]
Xu, Y., Li, D., Xie, Q., Wu, Q. and Wang, J., 2021. Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNN. Measurement, 178, p.109316.
[21]
Saleem, M.R., Park, J.W., Lee, J.H., Jung, H.J. and Sarwar, M.Z., 2021. Instant bridge visual inspection using an unmanned aerial vehicle by image capturing and geo-tagging system and deep convolutional neural network. Structural Health Monitoring, 20(4), pp.1760-1777.
[22]
Zhang, A., Wang, K.C., Li, B., Yang, E., Dai, X., Peng, Y., Fei, Y., Liu, Y., Li, J.Q. and Chen, C., 2017. Automated pixel‐level pavement crack detection on 3D asphalt surfaces using a deep‐learning network. Computer‐Aided Civil and Infrastructure Engineering, 32(10), pp.805-819.
[23]
Kim, I.H., Jeon, H., Baek, S.C., Hong, W.H. and Jung, H.J., 2018. Application of crack identification techniques for an aging concrete bridge inspection using an unmanned aerial vehicle. Sensors, 18(6), p.1881.
[24]
Fan, Z., Wu, Y., Lu, J. and Li, W., 2018. Automatic pavement crack detection based on structured prediction with the convolutional neural network. arXiv preprint arXiv:1802.02208.
[25]
Wang, B., Zhao, W., Gao, P., Zhang, Y. and Wang, Z., 2018. Crack damage detection method via multiple visual features and efficient multi-task learning model. Sensors, 18(6), p.1796.

Cited By

View all
  • (2024)Applications of mathematical morphology operators in civil infrastructuresEarth Science Informatics10.1007/s12145-024-01379-317:5(4027-4033)Online publication date: 24-Jun-2024

Index Terms

  1. A Novel Approach for Concrete Crack and Spall Detection Based on Improved YOLOv8

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    VSIP '23: Proceedings of the 2023 5th International Conference on Video, Signal and Image Processing
    November 2023
    237 pages
    ISBN:9798400709272
    DOI:10.1145/3638682
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 May 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. ByteTrack & Supervision
    2. Concrete crack and spall detection
    3. Tracking and counting
    4. YOLOv8

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    VSIP 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)33
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Applications of mathematical morphology operators in civil infrastructuresEarth Science Informatics10.1007/s12145-024-01379-317:5(4027-4033)Online publication date: 24-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media