Skip to main content
SpringerLink
Log in

Yolo-inspection: defect detection method for power transmission lines based on enhanced YOLOv5s

  • Research
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Accurate identification of defective components in transmission lines and timely feedback to inspectors for timely maintenance can ensure the stable operation of the power system. A defect detection system based on “edge-cloud-end” collaboration is introduced to solve the problems of high bandwidth consumption and response delay in the cloud server-based approach. The system transfers the operation of image detection to the edge device, which reduces the data transmission and improves the response speed of the system. To balance the detection speed and accuracy of the algorithm, the YOLO-inspection algorithm applied on edge devices is proposed. The algorithm uses GhostNetV2 to reconstruct the C3 module in the YOLOv5 model, which reduces the computational complexity and captures the correlation between distant pixels so that it is more targeted to the critical region of the defective target. Meanwhile, based on the feature fusion network, a dynamic adaptive weight assignment module and cross-scale connectivity are designed to effectively reduce information loss and help the network learn fine-grained features. The improved algorithm is deployed on the NVIDIA Jetson Xavier NX platform, and the model is optimally accelerated using TensorRT. Experimental results show that the method proposed in this paper can accurately identify defective samples, and the YOLO-inspection algorithm has superior generalization ability under the harsh conditions of low light and snowfall weather conditions. On the edge computing platform, the mean average precision (mAP) can reach 94.3\(\%\), and the inference speed can reach 63 frames per second (FPS). It can be proved that the method has good detection performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., Berg, A.: Ssd: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer, New York (2016). https://doi.org/10.1007/978-3-319-46448-0_2

    Chapter  Google Scholar 

  2. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.:You only look once: Unifed, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779-788 (2016). https://doi.org/10.48550/Arxiv.1506.02640

  3. Redmon, J., Farhadi, A.: Yolo9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271(2017). https://doi.org/10.1109/CVPR.2017.690

  4. Redmon, J., Farhadi, A.: Yolov3: An Incremental Improvement. arXiv preprint, (2018). Arxiv:1804.02767

  5. Bochkovskiy, A., Wang, C., Liao, H.: Yolov4: Optimal Speed and Accuracy of Object Detection. arxiv preprint, (2020). Arxiv:2004.10934

  6. Glenn, J.: yolov5. Git code, (2020). https://github.com/ultralytics/yolov5

  7. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., Nie, W., Li, Y., Zhang, B., Liang, Y., Zhou, L., Xu, X., Chu, X., Wei, X., Wei, X.: YOLOv6: A Single-stage Object Detection Framework for Industrial Applications. arxiv preprint, (2022). arxiv:2209.02976

  8. Wang, C., Bochkovskiy, A., Liao, H.: YOLOv7: Trainable Bag-of-freebies Sets New State-of-the-art for Real-time Objectdetectors. arxiv preprint, (2022). Arxiv:2207.02696

  9. Glenn, J.: yolov8. Git code, (2023). https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/v8

  10. Cai, Z., Vasconcelos, N.: Cascade r-cnn: delving into high quality object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6154–6162 (2018). arXiv:1712.00726

  11. He, K., Gkioxari, G., Dollar, P., Girshick, R.:Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969(2017). arXiv:1703.06870

  12. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  13. Zhang, W., Liu, X., Yuan, J., Xu, L., Sun, H., Zhou, J., Liu, X.: RCNN-based foreign object detection for securing power transmission lines (RCNN4SPTL). Proc. Comput. Sci. 147, 331–337 (2019). https://doi.org/10.1016/j.procs.2019.01.232

    Article  Google Scholar 

  14. Li, J., Yan, D., Luan, K., Li, K., Li, Z., Liang, H.: Deep learning-based bird’s nest detection on transmission lines using UAV imagery. Appl. Sci. 10(18), 6147 (2020). https://doi.org/10.3390/app10186147

    Article  Google Scholar 

  15. Bao, W., Du, X., Wang, N., Yuan, M., Yang, X.: A defect detection method based on BC-YOLO for transmission line components in UAV remote sensing images. Remote Sens. 14(20), 5176 (2022). https://doi.org/10.3390/rs14205176

    Article  Google Scholar 

  16. Liu, X., Li, Y., Shuang, F., Gao, F., Zhou, X., Chen, X.: ISSD: improved SSD for insulator and spacer online detection based on UAV system. Sensors 20(23), 6961 (2020). https://doi.org/10.3390/s20236961

    Article  Google Scholar 

  17. Huang, Y., Jiang, L., Han, T., Xu, S., Liu, Y., Fu, J.: High-accuracy insulator defect detection for overhead transmission lines based on improved YOLOv5. Appl. Sci. 12(24), 12682 (2022). https://doi.org/10.3390/app122412682

    Article  Google Scholar 

  18. Zhang, Y., Gong, X., Sun, J., Tao, Y., Su, W.:Research on Transmission Line Foreign Object Detection Based on Edge Calculation. In: Proceedings of the 2022 International Conference on Computational Infrastructure and Urban Planning. 22–25 (2022). https://doi.org/10.1145/3546632.3546876

  19. Shen, H., Fan, P., Wei, Z., Zhao, C., Zhou, S., Wu, Q.: Research on transmission equipment defect detection based on edge intelligent analysis. J. Phys. Conf. Ser. 1828, (2021)

  20. Tang, Y., Guo, J., Xu, C., Xu, C., Wang, Y.: GhostNetV2: Enhance Cheap Operation with Long-Range Attention. arxiv preprint, (2022). Arxiv:2211.12905

  21. Kupyn, O., Martyniuk, T., Wu, J., Wang, Z.: DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better. In: 2019 IEEE/CVF International Conference on Computer Vision, pp. 8877–8886(2019). arXiv:1908.03826

  22. Tan, M., Pang, R., Le, Q.: EfficientDet: Scalable and Efficient Object Detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10778–10787 (2020)

  23. Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., Adam, H., Le, Q.: Searching for MobileNetV3. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314–1324(2019)

  24. Ma, N., Zhang, X., Zheng, H., Sun, J.: Shufenet v2: practical guidelines for efficient cnn architecture design. In: Proceedings of the European conference on computer vision (ECCV), pp. 116–131(2018). https://doi.org/10.1007/978-3-030-01264-9_8

  25. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., Xu, C.: Ghostnet: more features from cheap operations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1580–1589 (2020). https://doi.org/10.1109/CVPR42600.2020.00165

Download references

Acknowledgements

This work is supported by the the Shandong Natural Science Foundation under Grant ZR2019MEE054, and the National Natural Science Foundation of China under Grant no. 51405262.

Author information

Authors and Affiliations

  1. School of Engineering, Qufu Normal University, Rizhao, 276826, China

    Lihui Lu, Zhencong Chen, Rifan Wang, Li Liu & Haoqing Chi

  2. Rizhao Huilian Zhongchuang Institute of Intelligent Technology, Rizhao, 276826, China

    Lihui Lu

Authors
  1. Lihui Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhencong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rifan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Li Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haoqing Chi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lihui Lu.

Ethics declarations

Conflict of interest

This paper does not contain any studies with human or animal subjects and all authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, L., Chen, Z., Wang, R. et al. Yolo-inspection: defect detection method for power transmission lines based on enhanced YOLOv5s. J Real-Time Image Proc 20, 104 (2023). https://doi.org/10.1007/s11554-023-01360-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11554-023-01360-1

Keywords

Search

Navigation