Abstract
Detecting and repairing road damage timely is crucial for ensuring traffic safety and reducing hazards. Cracks and potholes are the primary indications of early-stage road damage. However, existing deep learning-based methods for road damage detection often have limited feature extraction capabilities and only perform well in specific detection environments. To address these challenges, this paper proposes an improved UNet-based road damage segmentation method for complex environments. This method incorporates Atrous Spatial Pyramid Pooling (ASPP) and Coordinate Attention (CA) into the network, enhancing its ability to capture features of various sizes and to localize feature information. The proposed model effectively detects both cracks and potholes under different road environments, such as concrete, asphalt, and gravel. Experimental results demonstrate that the proposed network achieves 78.8% and 88.57% segmentation Intersection over Union (IoU) for cracks and potholes, respectively, outperforming classical semantic segmentation networks such as UNet, PSPNet, Attention UNet, UNet++, DANet, SegFormer, and TransUNet. This model can be applied to intelligent road inspection and maintenance to improve inspection efficiency.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rehana, K.C., Remya, G.: Road damage detection and classification using YOLOv5. In: 2022 Third International Conference on Intelligent Computing Instrumentation and Control Technologies (ICICICT), pp. 489–494 (2022). https://doi.org/10.1109/ICICICT54557.2022.9917763
Al Haqi, N.N., Hidayat, F.: Classification of road damage using supervised learning to assist visual assessment of road damage. In: 2022 International Conference on Information Technology Systems and Innovation (ICITSI), pp. 327–332 (2022). https://doi.org/10.1109/ICITSI56531.2022.9971082
Fan, R., Liu, M.: Road damage detection based on unsupervised disparity map segmentation. IEEE Trans. Intell. Transp. Syst. 21, 4906–4911 (2020). https://doi.org/10.1109/TITS.2019.2947206
Fan, X., Cao, P., Shi, P., Wang, J., Xin, Y., Huang, W.: A nested Unet with attention mechanism for road crack image segmentation. In: 2021 IEEE 6th International Conference on Signal and Image Processing (ICSIP), pp. 189–193 (2021). https://doi.org/10.1109/ICSIP52628.2021.9688782
Yamada, T., Ito, T., Ohya, A.: Detection of road surface damage using mobile robot equipped with 2D laser scanner. In: Proceedings of the 2013 IEEE/SICE International Symposium on System Integration, pp. 250–256 (2013). https://doi.org/10.1109/SII.2013.6776679
Chen, H.-T., Lai, C.-Y., Shih, C.-A.: Toward community sensing of road anomalies using monocular vision. IEEE Sens. J. 16, 2380–2388 (2016). https://doi.org/10.1109/JSEN.2016.2517194
Puspita, D.N., Basuki, D.K., Dewantara, B.S.B.: Road damage detection and alert application using smartphone’s built-in sensors. In: 2022 International Electronics Symposium (IES), pp. 506–510 (2022). https://doi.org/10.1109/IES55876.2022.9888366
Feng, Z., et al.: MAFNet: segmentation of road potholes with multimodal attention fusion network for autonomous vehicles. IEEE Trans. Instrum. Meas. 71, 1–12 (2022). https://doi.org/10.1109/TIM.2022.3200100
Zhang, B., Liu, X.: Intelligent pavement damage monitoring research in China. IEEE Access. 7, 45891–45897 (2019). https://doi.org/10.1109/ACCESS.2019.2905845
Iraldi, F., Al Maki, W.F.: Damage classification on roads using machine learning. In: 2021 International Conference on Data Science and Its Applications (ICoDSA), pp. 151–156 (2021). https://doi.org/10.1109/ICoDSA53588.2021.9617520
Wang, L., Ma, X., Ye, Y.: Computer vision-based road crack detection using an improved I-UNet convolutional networks. In: 2020 Chinese Control and Decision Conference (CCDC), pp. 539–543 (2020). https://doi.org/10.1109/CCDC49329.2020.9164476
Mouzinho, F.A.L.N., Fukai, H.: Hierarchical semantic segmentation based approach for road surface damages and markings detection on paved road. In: 2021 8th International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA), pp. 1–5 (2021). https://doi.org/10.1109/ICAICTA53211.2021.9640296
Subha, T.D., Sasirekha, N., Shamitha, C., Radhika, S., Tamilselvi, M.: Analysis of deep learning methods for fracture segmentation of road surface under on encoder and decoder. In: 2022 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), pp. 1–9 (2022). https://doi.org/10.1109/ICSES55317.2022.9914306
Chen, J., Zhao, N., Zhang, R., Chen, L., Huang, K., Qiu, Z.: Refined crack detection via LECSFormer for autonomous road inspection vehicles. IEEE Trans. Intell. Vehicles 8, 2049–2061 (2022). https://doi.org/10.1109/TIV.2022.3204583
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. In: 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, July 21, 2017 - July 26, 2017, Honolulu, HI, United states, pp. 6230–6239. Institute of Electrical and Electronics Engineers Inc. (2017). https://doi.org/10.1109/CVPR.2017.660
Oktay, O., et al.: Attention U-Net: learning where to look for the pancreas (2018)
Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: UNet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 39, 1856–1867 (2020). https://doi.org/10.1109/TMI.2019.2959609
Fu, J., et al.: Dual attention network for scene segmentation. In: 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019, June 16, 2019 - June 20, 2019, pp. 3141–3149. IEEE Computer Society, Long Beach, CA, United states (2019). https://doi.org/10.1109/CVPR.2019.00326
Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., Luo, P.: SegFormer: simple and efficient design for semantic segmentation with transformers. In: 35th Conference on Neural Information Processing Systems, NeurIPS 2021, December 6, 2021 - December 14, 2021, pp. 12077–12090. Neural information processing systems foundation, Virtual (2021)
Chen, J., et al.: TransUNet: transformers make strong encoders for medical image segmentation (2021)
Acknowledgement
This research was funded by the Basic Research Program of Qinghai Province (Grant No.2021-ZJ-704).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, P., Yuan, J., Chen, S. (2023). A Road Damage Segmentation Method for Complex Environment Based on Improved UNet. In: Lu, H., et al. Image and Graphics. ICIG 2023. Lecture Notes in Computer Science, vol 14355. Springer, Cham. https://doi.org/10.1007/978-3-031-46305-1_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-46305-1_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46304-4
Online ISBN: 978-3-031-46305-1
eBook Packages: Computer ScienceComputer Science (R0)