Abstract
The appearance of cracks is considered an initial sign of the deterioration of structures such as concrete and brick walls. Crack detection plays an important role in ensuring the safety and durability of structures. Conventionally, a maintenance engineer performs crack detection manually, which is laborious and time-consuming. Therefore, a systematic crack detection method is required. Among the existing crack detection methods, convolutional neural networks (CNNs) are more effective; however, CNNs often fail in the case of brick walls. There are several types of bricks, and some may appear to have cracks owing to their structure. Additionally, the joining points of bricks may appear as cracks; therefore, CNN fails. It is theorized that CNN performance can be improved if sub-datasets are generated based on the image attributes, and a proper sub-dataset is selected by matching the test image with the sub-datasets. In this study, sub-dataset generation and matching methods are proposed to improve the performance of crack detection in brick walls using CNN. CNN training is conducted with each sub-dataset generated by the proposed sub-dataset generation method, while crack detection is performed using a proper trained CNN that is selected using the proposed matching method. For numerical experiments, training datasets are first prepared by manual image cropping and rotation, after which the performance of crack detection is evaluated by cross-validation. Numerical experiments show that the proposed method improves crack detection in brick walls. This study will help to ensure the safety of structures as well as the safety of human life.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Liu, Z., Cao, Y., Wang, Y., Wang, W.: Computer vision-based concrete crack detection using U-net fully convolutional networks. Autom. Constr. 104, 129–139 (2019)
Road Bureau Japan: Road maintenance in Japan: Problems and solutions. Ministry of land, infrastructure, transport and tourism, Roads in Japan (2015)
American Society of Civil Engineers (ASCE): Infrastructure Report Card (2017)
Dais, D., Bal, I.E., Smyrou, E., Sarhosis, V.: Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning. Autom. Constr. 125, 1–18 (2021)
Cha, Y.J., Choi, W.: Deep learning-based crack damage detection using convolutional neural networks. Comput.-Aided Civil Infrastruct. Eng. 32, 361–378 (2017)
Ozgenel, C.F., Sorguc, A.G.: Performance comparison of pretrained convolutional neural networks on crack detection in buildings. In: International Symposium on Automation and Robotics in Construction, ISARC (2018)
Choi, D., Jeon, Y., Lee, S.J., Yun, J.P., Kim, S.W.: Algorithm for detecting seam cracks in steel plates using a Gabor filter combination method. Appl. Opt. 53(22), 4865–4872 (2014)
Neogi, N., Mohanta, D.K., Dutta, P.K.: Review of vision-based steel surface inspection systems. EURASIP J. Image Video Process. 2014(1), 1–19 (2014). https://doi.org/10.1186/1687-5281-2014-50
Qader, I.A., Abudayyeh, O., Kelly, M.: Analysis of edge detection techniques for crack identification in bridges. J. Comput. Civ. Eng. 17(4), 255–263 (2003)
Wu, X., Xu, K., Xu, J.: Application of undecimated wavelet transform to surface defect detection of hot rolled steel plates. In: 2008 Congress on Image and Signal Processing (2008)
Yeum, C., Dyke, S.: Vision-based automated crack detection for bridge inspection. Comput.-Aided Civil Infrastruct. Eng. 30, 759–770 (2015)
Talukder, M.H., Ota, S., Takanokura, M., Ishii, N.: Crack detection of concrete walls by CNN using sub-datasets. In: The 2020 Spring National Conference of Operations Research Society of Japan, pp. 82–83, Japan (2020)
Talukder, M.H., Ota, S., Takanokura, M., Ishii, N.: Crack detection in concrete structures under varied environmental conditions using CNN. J. Soc. Plant Eng. Japan 33(1), 14–21 (2021)
Dung, C.V., Anh, L.D.: Autonomous concrete crack detection using deep fully convolutional neural network. Autom. Constr. 99, 52–58 (2019)
Huyan, J., Li, W., Tighe, S., Zhai, J., Xu, Z., Chen, Y.: Detection of sealed and unsealed cracks with complex backgrounds using deep convolutional neural network. Autom. Constr. 107, 1–14 (2019)
Jacob, K., Mark, D.J., Peter, B., Mike, M., Gordon, M.: A convolutional neural network for pavement surface crack segmentation using residual connections and attention gating. In: 2019 IEEE International Conference on Image Processing, ICIP (2019)
Li, S., Zhao, X.: Image-based concrete crack detection using convolutional neural network and exhaustive search technique. Adv. Civil Eng. 2019, 1–12 (2019)
Li, G., Ma, B., He, S., Ren, X., Liu, Q.: Automatic tunnel crack detection based on u-net and a convolutional neural network with alternately updated clique. Sensors 20, 1–23 (2020)
Mahtab, M.K., et al.: Deep-learning-based crack detection with applications for the structural health monitoring of gas turbines. Struct. Health Monit. 19(5), 1440–1452 (2019)
Hoang, N.D., Nguyen, Q.L., Tran, V.D.: Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network. Autom. Constr. 94, 203–213 (2018)
Andrushia, A.D., Anand, N., Godwin, I.A.: Analysis of edge detection algorithms for concrete crack detection. Int. J. Mech. Eng. Technol. 9(11), 689–695 (2018)
Bianconi, F., Harvey, R., Southam, P., Fernandez, A.: Theoretical and experimental comparison of different approaches for colour texture classification. J. Electron. Imaging 20(4), 1–20 (2011)
Varma, M., Zisserman, A.: A statistical approach to texture classification from single images. Int. J. Comput. Vision 62(1), 61–81 (2005)
Zhang, K., Cheng, H.D., Zhang, B.: A unified approach to pavement crack and sealed crack detection using preclassification based on transfer learning. J. Comput. Civil Eng. 32 (2018)
Zhang, L., Yang, F., Zhang, Y.D., Zhu, Y.J.: Road crack detection using a deep convolutional neural network. In: Proceedings of the International Conference on Image Processing (ICIP), pp. 3708–3712, Phoenix, AZ-USA (2016)
Yang, X., Li, H., Yu, Y., Luo, X., Huang, T., Yang, X.: Automatic pixel-level crack detection and measurement using a fully convolutional network. Comput.-Aided Civil Infrastruct. Eng. 33, 1090–1109 (2018)
Talukder, M.H., Ota, S., Takanokura, M., Ishii, N.: Sub-dataset generation and matching for crack detection on brick walls using convolutional neural network. In: Proceedings of 2nd International Conference on Deep Learning Theory and Applications, DeLTA 2021, pp. 191–197, Lisbon-Portugal (Online streaming) (2021)
Wang, Z., Yang, J., Jiang, H., Fan, X.: CNN training with twenty samples for crack detection via data augmentation. Sensors 20(17), 1–17 (2020)
Shorten, C., Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data 6(1), 1–48 (2019)
Takahashi, R., Matsubara, T., Uehara, K.: Data augmentation using random image cropping and patching for deep CNNs. IEEE Trans. Circuits Syst. Video Technol. 30, 2917–2931 (2015)
Takahashi, R., Matsubara, T., Uehara, K.: RICAP: random image cropping and patching data augmentation for deep CNNs. Proc. Mach. Learn. Res. 95, 786–798 (2018)
Berrar, D.: Cross-validation. Encycl. Bioinform. Comput. Biol. 1, 542–545 (2018)
Rawat, A.S.: Introduction to Cross-validation in Machine Learning. Retrieved from https://www.analyticssteps.com/blogs/introduction-cross-validation-machine-learning. Accessed 10 June 2022
Brownlee, J: A Gentle Introduction to k-fold Cross-validation. Retrieved from https://machinelearningmastery.com/k-fold-cross-validation/. Accessed 10 June 2022
Mujtaba, H.: What is Cross-validation in Machine Learning? Types of Cross-Validation. Retrieved from https://www.mygreatlearning.com/blog/cross-validation/. Accessed 10 June 2022
Baratloo, A., Hosseini, M., Negida, A., Ashal, G.: Simple definition and calculation of accuracy, sensitivity and specificity. Emergency 3(2), 48–49 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Talukder, M.H., Ota, S., Takanokura, M., Ishii, N. (2023). Crack Detection on Brick Walls by Convolutional Neural Networks Using the Methods of Sub-dataset Generation and Matching. In: Fred, A., Sansone, C., Madani, K. (eds) Deep Learning Theory and Applications. DeLTA DeLTA 2020 2021. Communications in Computer and Information Science, vol 1854. Springer, Cham. https://doi.org/10.1007/978-3-031-37320-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-37320-6_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37319-0
Online ISBN: 978-3-031-37320-6
eBook Packages: Computer ScienceComputer Science (R0)