Skip to main content
SpringerLink
Log in

Power line insulator defect detection using CNN with dense connectivity and efficient attention mechanism

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Power line insulator defect detection is an extremely important technology to ensure the safety of power lines. In recent years, electric power enterprises often use UAVs to conduct safety inspections of power lines. This is a resource-limited terminal platform that cannot sustain the huge computational burden. In addition, insulator images taken by UAVs usually have complex background interference. All these require that the power line insulator defect detection algorithm must guarantee high detection accuracy while keeping the computational cost low. To this end, we designed a novel single-stage detection model that can be trained end-to-end based on Yolov3. Our improved model replaces the backbone network of Yolov3 with ResNet50 to reduce the number of model parameters. We changed the original connection structure in ResNet50 to a dense connection to improve the feature extraction capability of the backbone network. To overcome the complex background interference, we add an effective attention mechanism at the end of each layer of the backbone network to enable the model to focus effectively on the detected objects. We also use Mosaic and Random Erasing methods to enhance the dataset. Extensive experimental results show that the model achieves better prediction performance compared to other state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data Availability

The datasets analysed during the current study are available in (https://github.com/InsulatorData/InsulatorDataSet).

References

  1. Amin M (2003) North America’s electricity infrastructure: are we ready for more perfect storms? IEEE Secur 1(5):19–25

    Article  Google Scholar 

  2. Cao Y, Xu J, Lin S, Wei F, Hu H (2019) Gcnet: non-local networks meet squeeze-excitation networks and beyond. In: Proceedings of the IEEE/CVF international conference on computer vision workshops

  3. Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille A L (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    Article  PubMed  Google Scholar 

  4. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  5. He H, Hu Z, Wang B, Luo D, Lee W-J, Li J (2020) A contactless zero-value insulators detection method based on infrared images matching. IEEE Access 8:133882–133889

    Article  Google Scholar 

  6. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

  7. Huang Z, Wang X, Huang L, Huang C, Wei Y, Liu W (2019) Ccnet: criss-cross attention for semantic segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 603–612

  8. Huang W, Gu J, Ma X, Li Y (2020) End-to-end multitask siamese network with residual hierarchical attention for real-time object tracking. Appl Intell 50 (6):1908–1921

    Article  Google Scholar 

  9. Jin H, Lv Z, Yuan Z, Wei Z, Wang C, Wang C, Tu Y, Li F, Chen T, Xiao P (2020) Micro-cracks identification and characterization on the sheds of composite insulators by fractal dimension. IEEE Trans Smart Grid 12 (2):1821–1824

    Article  Google Scholar 

  10. Kang G, Gao S, Yu L, Zhang D (2018) Deep architecture for high-speed railway insulator surface defect detection: denoising autoencoder with multitask learning. IEEE Trans Instrum Meas 68(8):2679–2690

    Article  ADS  Google Scholar 

  11. Krizhevsky A, Hinton G et al (2009) Learning multiple layers of features from tiny images

  12. Li H, Duan H, Zheng Y, Wang Q, Wang Y (2020) A ctr prediction model based on user interest via attention mechanism. Appl Intell 50 (4):1192–1203

    Article  Google Scholar 

  13. Liao S, An J (2014) A robust insulator detection algorithm based on local features and spatial orders for aerial images. IEEE Geosci Remote Sens Lett 12 (5):963–967

    Article  ADS  Google Scholar 

  14. Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988

  15. Liu C, Wu Y, Liu J, Sun Z (2021) Improved yolov3 network for insulator detection in aerial images with diverse background interference. Electronics 10(7):771

    Article  Google Scholar 

  16. Ma Y, Li Q, Chu L, Zhou Y, Xu C (2021) Real-time detection and spatial localization of insulators for uav inspection based on binocular stereo vision. Remote Sens 13(2):230

    Article  ADS  Google Scholar 

  17. Mittal P, Sharma A, Singh R (2020) Deep learning-based object detection in low-altitude uav datasets: a survey. Image Vis Comput 104046

  18. Ohta H, Sato Y, Mori T, Takaya K, Kroumov V (2019) Image acquisition of power line transmission towers using uav and deep learning technique for insulators localization and recognition. In: 2019 23rd International conference on system theory, control and computing (ICSTCC). IEEE, pp 125–130

  19. Ouyang Y, Zeng Y, Gao R, Yu Y, Wang C (2020) Elective future: the influence factor mining of students’ graduation development based on hierarchical attention neural network model with graph. Appl Intell 50(10):3023–3039

    Article  Google Scholar 

  20. Rabinovich A, Vedaldi A, Galleguillos C, Wiewiora E, Belongie S (2007) Objects in context. In: 2007 IEEE 11th international conference on computer vision. IEEE, pp 1–8

  21. Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv:1804.02767

  22. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, vol 28, pp 91–99

  23. Selvaraju R R, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618–626

  24. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  25. Tao X, Zhang D, Wang Z, Liu X, Zhang H, Xu D (2018) Detection of power line insulator defects using aerial images analyzed with convolutional neural networks. IEEE Trans Syst Man Cybern: Syst 50(4):1486–1498

    Article  Google Scholar 

  26. Tian C, Zhu X, Hu Z, Ma J (2020) Deep spatial-temporal networks for crowd flows prediction by dilated convolutions and region-shifting attention mechanism. Appl Intell 50(10):3057–3070

    Article  Google Scholar 

  27. Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) Eca-net: efficient channel attention for deep convolutional neural networks. In: 2020 IEEE CVF conference on computer vision and pattern recognition (CVPR). IEEE

  28. Woo S, Park J, Lee J-Y, Kweon I S (2018) Cbam: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19

  29. Zhang D, Gao S, Yu L, Kang G, Wei X, Zhan D (2020) Defgan: defect detection gans with latent space pitting for high-speed railway insulator. IEEE Trans Instrum Meas 70:1–10

    Google Scholar 

  30. Zhao Z, Zhang K, Cui Y, Liu N, Xu G, Zhai Y (2018) Localization of multiple power line insulators based on shape feature points and equidistant model in aerial images. In: 2018 IEEE fourth international conference on multimedia big data (BigMM). IEEE, pp 1–5

  31. Zhong Z, Zheng L, Kang G, Li S, Yang Y (2020) Random erasing data augmentation. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 13001–13008

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (No. 61772327), State Grid Gansu Electric Power Company(No. H2019-275), and Shanghai Engineering Research Center on Big Data Management System (No.H2020-216).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Shanghai University of Electric Power, Shanghai, 200090, China

    XiuXia Tian, Mengting Zhang & Guanyu Lu

Authors
  1. XiuXia Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mengting Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guanyu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to XiuXia Tian.

Ethics declarations

Conflict of interest

The authors declare that they have no known conflict of interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tian, X., Zhang, M. & Lu, G. Power line insulator defect detection using CNN with dense connectivity and efficient attention mechanism. Multimed Tools Appl 83, 28305–28322 (2024). https://doi.org/10.1007/s11042-023-15522-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15522-7

Keywords

Search

Navigation