Skip to main content
SpringerLink
Log in

Fault detection of railway freight cars mechanical components based on multi-feature fusion convolutional neural network

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

The fault detection of the mechanical components in railway freight cars is important to the safety of railway transportation. Owing to the small size of the mechanical components, a manual detection method has a low detection efficiency. In addition, traditional computer vision technology has difficulty detecting multiple categories of objects simultaneously. Inspired by the use of one-stage deep-learning-based object detectors, in this paper, a multi-feature fusion network (MFF-net) for the simultaneous detection of three typical mechanical component faults is proposed. By embedding three modules in the network to improve the detection effect of small mechanical component faults, the feature fusion module is used to supplement the deep semantic information of the shallow feature maps. A multi-branch dilated convolution module uses dilated convolution and multi-branch networks to obtain the fusion features of multi-scale receptive fields, and the squeeze-and-excitation block is embedded in the network to enhance the channel features. All experiments used Nvidia 1080Ti GPUs for training on the PyTorch platform. The experimental results show that the three modules used in the network all contribute to the fault detection of railway freight car mechanical components, and that the detection performance of MFF-net is better than that of most other popular SSD-based one-stage object detectors. When the input image size is 300 pixels × 300 pixels, MFF-net can achieve 0.8872 mAP and 33 frames per second. It has good robustness to complex noise environment and can realize real-time fault detection of railway freight car mechanical components.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Liu R, Wang Y (2005) Principle and application of TFDS. Chin Railw 5:26–27

    Google Scholar 

  2. Liu W, Anguelov D, Erhan D et al (2016) SSD: Single shot multibox detector. In. Lecture Notes in Computer Science European conference on computer vision (ECCV), Springer, Cham, pp 21–37

  3. Li Z X, Zhou F Q (2017) FSSD: Feature fusion single shot multibox detector. arXiv preprint arXiv:1712.00960

  4. Liu S, Huang D, Wang Y (2018) Receptive field block net for accurate and fast object detection. In: Lecture Notes in Computer Science Proceedings of the European Conference on computer vision (ECCV), pp 404–419

  5. Liu Z, Xiao D, Chen Y (2012) Displacement fault detection of bearing weight saddle in TFDS based on though transform and symmetry validation. In: 9th International Conference on fuzzy systems and knowledge discovery 2012, IEEE, pp 1404–1408

  6. Xia Y, Xie F, Jiang Z (2010) Broken railway fastener detection based on Adaboost algorithm. In: International Conference on optoelectronics and image processing 2010, IEEE, 1, pp 313–316.

  7. Liu L, Zhou F, He Y (2015) Automated visual inspection system for bogie block key under complex freight train environment. IEEE Trans Instrum Meas 65(1):2–14

    Article  Google Scholar 

  8. Zou R, Xu ZY, Li JY et al (2015) Real-time monitoring of brake shoe keys in freight cars. Front Inf Technol Electron Eng 16(3):191–204

    Article  Google Scholar 

  9. Min Y, Xiao B, Dang J et al (2018) Real time detection system for rail surface defects based on machine vision. EURASIP J Image Video Process 1:3

    Article  Google Scholar 

  10. Sun J, Xiao Z, Xie Y (2017) Automatic multi-fault recognition in TFDS based on convolutional neural network. Neurocomputing 222:127–136

    Article  Google Scholar 

  11. Chen J, Liu Z, Wang H et al (2017) Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network. IEEE Trans Instrum Meas 67(2):257–269

    Article  Google Scholar 

  12. Xu X, Lei Y, Yang F (2018) Railway subgrade defect automatic recognition method based on improved Faster R-CNN. Sci Program 2018:1–12

    Google Scholar 

  13. Zhou F, Li J, Li X et al (2019) Freight car target detection in a complex background based on convolutional neural networks. Proc Inst Mech Eng Part F J Rail Rapid Transit 233(3):298–311

    Article  Google Scholar 

  14. Chen DJ, Zhang WS, Yang Y (2017) Detection and recognition of high-speed railway catenary locator based on deep learning. J Univ Sci Technol China 47(4):320–327

    Google Scholar 

  15. Krizhevsky A, Sutskever I, Hinton G E (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on neural information processing systems—Volume 1 (NIPS'12),pp 1097–1105

  16. Sermanet P, Eigen D, Zhang X et al (2013) Overfeat: integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229.

  17. Girshick R, Donahue J, Darrell T et al (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587.

  18. Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE International Conference on computer vision, pp 1440–1448.

  19. Ren S, He KM, Girshick R et al (2015) Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  20. Redmon J, Divvala S, Girshick R et al (2016) You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 779–788.

  21. Lin T Y, Dollár P, Girshick R et al (2017) Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 2117–2125

  22. Fu C Y, Liu W, Ranga A et al (2017) DSSD: Deconvolutional single shot detector. arXiv preprint arXiv:1701.06659.

  23. Szegedy C, Liu W, Jia Y (2015) Going deep with convolutions. In: Proceedings of the IEEE Conference on computer vision and pattern recognition (CVPR), Boston, MA, pp 1–9.

  24. Hu J, Shen L, Sun G et al (2017) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023

    Article  Google Scholar 

  25. Zhang S, Wen L, Bian X et al (2018) Single-shot refinement neural network for object detection. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4203–4212

  26. Howard A G, Zhu M, Chen B et al (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

  27. Zhang X, Zhou X, Lin M et al (2017) ShuffleNet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 6848–6856

  28. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  29. He K M, Zhang X Y, Ren S Q et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, pp 770–778

  30. Lin TY, Goyal P, Girshick R et al (2018) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327

    Article  Google Scholar 

Download references

Acknowledgement

We thank the China University of Mining and Technology (Beijing) for providing the experimental hardware platform. This work was supported by the National Natural Science Foundation of China (No. 52075027) and the Fundamental Research Funds for the Central Universities (2020XJJD03) the Fundamental Research Funds for the Central Universities (2020XJJD03).

Author information

Authors and Affiliations

  1. School of Energy and Mining Engineering, China University of Mining and Technology-Beijing, Ding 11 Xueyuan Road, Haidian District, Beijing, 100083, China

    Tao Ye, Zhihao Zhang & Xi Zhang

  2. Mining Products Safety Approval and Certification Center Co., Ltd., Beijing, 100013, China

    Yongran Chen

  3. School of Instrumentation Science and Opto-Electronics Engineering, Beihang University, 37 Xueyuan Road, Haidian District, Beijing, 100191, China

    Fuqiang Zhou

Authors
  1. Tao Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhihao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xi Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yongran Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fuqiang Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Tao Ye or Fuqiang Zhou.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ye, T., Zhang, Z., Zhang, X. et al. Fault detection of railway freight cars mechanical components based on multi-feature fusion convolutional neural network. Int. J. Mach. Learn. & Cyber. 12, 1789–1801 (2021). https://doi.org/10.1007/s13042-021-01274-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-021-01274-z

Keywords

Search

Navigation