Skip to main content

Advertisement

SpringerLink
Log in

Fast detection of wind turbine blade damage using Cascade Mask R-DSCNN-aided drone inspection analysis

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, a fast wind turbine defect detection model is proposed with a Cascade Mask region Convolutional Neural network (Cascade Mask R-CNN). Instead of standard convolution in the backbone network of Cascade Mask R-CNN, a depthwise separable convolution is used to minimize the computation cost. Moreover, image augmentation and transfer learning techniques are also involved to enhance the performance of the proposed model. The detection and instance segmentation performance of the proposed model is compared with existing techniques in terms of mean intersection over union (MIoU), mean average precision (MAP) and classifier accuracy. The experimental results show that the proposed WTB defect detection and classification model shows better performance with 82.42% MAP, 87.49% MIoU and 97.8% classifier accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Canizo, M., Onieva, E., Conde, A., Charramendieta, S., Trujillo, S.: Real-time predictive maintenance for wind turbines using Big Data frameworks. In: International conference on prognostics and health management, pp. 70–77 (2017)

  2. Zhou, K., Fu, C., Yang, S.: Big data driven smart energy management: From big data to big insights. Renew. Sustain. Energy Rev. 56, 215–225 (2016)

    Article  Google Scholar 

  3. Stock-Williams, C., Swamy, S.K.: Automated daily maintenance planning for offshore wind farms. Renew. 133, 1393–1403 (2019)

    Article  Google Scholar 

  4. Jha, S.K., Bilalovic, J., Jha, A., Patel, N., Zhang, H.: Renewable energy: present research and future scope of artificial intelligence. Renew. Sustain. Energy Rev. 77, 297–317 (2017)

    Article  Google Scholar 

  5. Wymore, M.L., Van Dam, J.E., Ceylan, H., Qiao, D.: A survey of health monitoring systems for wind turbines. Renew. Sustain. Energy Rev. 52, 976–990 (2015)

    Article  Google Scholar 

  6. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)

    Article  Google Scholar 

  7. Morgenthal, G., Hallermann, N.: Quality assessment of unmanned aerial vehicle (UAV) based visual inspection of structures. Adv. Struct. Eng. 17(3), 289–302 (2014)

    Article  Google Scholar 

  8. Cai, Z., Vasconcelos, N.: Cascade R-CNN: high quality object detection and instance segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 43(5), 1483–1498 (2019)

    Article  Google Scholar 

  9. Zhang, Q., Chang, X., Bian, S.B.: Vehicle-damage-detection segmentation algorithm based on improved mask RCNN. IEEE Access. 8, 6997–7004 (2020)

    Article  Google Scholar 

  10. He, K., Gkioxari, G., Dollár, P., Girshick, R. Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)

  11. Hauberg, S., Freifeld, O., Larsen, A. B. L., Fisher, J., Hansen, L.: Dreaming more data: class-dependent distributions over diffeomorphisms for learned data augmentation. In: Artificial Intelligence and Statistics, pp. 342–350 (2016)

  12. Xu, C., Wang, G., Yan, S., Yu, J., Zhang, B., Dai, S., Xu, L.: Fast vehicle and pedestrian detection using improved Mask R-CNN. Mathematical Problems in Engineering, pp. 1–15 (2020)

  13. Wang, L., Zhang, Z.: Automatic detection of wind turbine blade surface cracks based on UAV-taken images. IEEE Trans. Ind. Electron. 64(9), 7293–7303 (2017)

    Article  Google Scholar 

  14. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2001)

  15. Shihavuddin, A., Arefin, M.M.N., Ambia, M.N., Haque, S.A., Ahammad, T.: Development of real time face detection system using Haar like features and Adaboost algorithm. Int. J. Comput. Sci. Netw. 10, 171–178 (2010)

    Google Scholar 

  16. Liaw, A., Wiener, M.: Classification and regression by random Forest. R News. 2(3), 18–22 (2002)

    Google Scholar 

  17. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)

  18. Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 28, 337–407 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  19. Reddy, A., Indragandhi, V., Ravi, L., Subramaniyaswamy, V.: Detection of cracks and damage in wind turbine blades using artificial intelligence-based image analytics. Measurement 147 (2019)

  20. Shihavuddin, A.S.M., Chen, X., Fedorov, V., Nymark Christensen, A., Andre Brogaard Riis, N., Branner, K., Reinhold Paulsen, R.: Wind turbine surface damage detection by deep learning aided drone inspection analysis. Energies 12(4) (2019)

  21. Zhang, J., Cosma, G., Watkins, J.: Image enhanced mask R-CNN: a deep learning pipeline with new evaluation measures for wind turbine blade defect detection and classification. J. Imaging. 7(3) (2021)

  22. Zhang, C., Wen, C., Liu, J.: Mask-MRNet: A deep neural network for wind turbine blade fault detection. J. Renew. Sustain. Energy 12(5) (2020)

  23. Lin, X., Zhu, S., Zhang, J., Liu, D.: Rice planthopper image classification method based on transfer learning and mask R-CNN. Trans. Chin. Soc. Agricult. Mach. 13(4), 181–184 (2019)

    Google Scholar 

  24. Wang, G., Liang, S.: Ship object detection based on Mask RCNN. Radio Eng., pp. 947–952 (2018)

  25. Shi, J., Zhou, Y., Zhang, Q.: Service robot item recognition system based on improved Mask RCNN and Kinect. Chin. J. Sci. Instrum. 11(9), 40–52 (2019)

    Google Scholar 

  26. Li, Y., Xu, X., & Yuan, C.: Enhanced Mask R-CNN for Chinese Food Image Detection. Mathematical Problems in Engineering (2020)

  27. Shihavuddin, A. S. M., Chen, X.: DTU-Drone inspection images of wind turbine (2018)

  28. Mathew, A., Mathew, J., Govind, M., Mooppan, A.: An improved transfer learning approach for intrusion detection. Procedia Comput. Sci. 115, 251–257 (2017)

    Article  Google Scholar 

  29. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L.: Microsoft coco: common objects in context. In: European Conference on Computer Vision, pp. 740–755 (2014)

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Ponjesly College of Engineering, Nagercoil, Tamil Nadu, India

    P. M. Diaz

  2. Anna University, Chennai, India

    P. Tittus

Authors
  1. P. M. Diaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. Tittus
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. M. Diaz.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Diaz, P.M., Tittus, P. Fast detection of wind turbine blade damage using Cascade Mask R-DSCNN-aided drone inspection analysis. SIViP 17, 2333–2341 (2023). https://doi.org/10.1007/s11760-022-02450-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02450-6

Keywords

Search

Navigation