Skip to main content
SpringerLink
Log in

An effective framework using identification and image reconstruction algorithm for train component defect detection

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Under long-term high-speed movement, the precision components of trains are extremely prone to defects, which could potentially endanger the safe operation of the train. However, there are many types of precision train components prone to defects; they are small in size and difficult to locate accurately. The defects themselves are also highly uncertain and diverse, making it impossible to establish an effective defect database. Meanwhile, a detection algorithm should have a high processing speed to ensure timely maintenance. Within the above context, in this paper an effective framework for multi-type train component defect detection based on an identification and image reconstruction algorithm is proposed. The framework is composed of a component identification stage and a defect diagnosis stage. The component identification method based on a component pre-location algorithm focuses attention on key areas of the train and ensures the visual integrity of the detected components. The component defect diagnosis method is based on an image-similarity generative adversarial network, which allows unsupervised reconstruction of template images to participate in defect diagnosis, thus coping with the diversity of component types and defect conditions effectively. The evaluation results on a CR400BF electric multiple unit series image dataset show that the framework has good robustness in complex environments and better performance in defect detection of train components.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Akcay S, Atapour-Abarghouei A, Breckon TP (2018) Ganomaly: Semi-supervised anomaly detection via adversarial training. In: Asian Conference on Computer Vision. Springer, pp 622–637

  2. Akcay S, Atapour-Abarghouei A, Breckon T P (2019) Skip-ganomaly: Skip Connected and adversarially trained encoder-decoder anomaly detection. In: 2019 International joint conference on neural networks. IEEE, IJCNN, pp 1–8

  3. Bi J, Zhang C (2018) An empirical comparison on state-of-the-art multi-class imbalance learning algorithms and a new diversified ensemble learning scheme. Knowl-Based Syst 158:81–93

    Article  Google Scholar 

  4. Bochkovskiy A, Wang CY, Liao HYM (2020) Yolov4: Optimal speed and accuracy of object detection. arXiv:http://arxiv.org/abs/200410934

  5. Carletti V, Greco A, Saggese A, Vento M (2020) An intelligent flying system for automatic detection of faults in photovoltaic plants. J Ambient Intell Human Comput 11(5):2027–2040

    Article  Google Scholar 

  6. Cha YJ, Choi W, Suh G, Mahmoudkhani S, Büyüköztürk O (2018) Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput-aided Civil Infrastruct Eng 33(9):731–747

    Article  Google Scholar 

  7. Chen H, Jiang B (2020) A review of fault detection and diagnosis for the traction system in high-speed trains. IEEE Trans Intell Transp Syst 21(2):450–465

    Article  Google Scholar 

  8. Chen J, Liu Z, Wang H, Nunez A, Han Z (2018) Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network. IEEE Trans Instrum Meas 67 (2):257–269

    Article  Google Scholar 

  9. Gao X, Wu Y, Yang K, Li J (2015) Vehicle bottom anomaly detection algorithm based on sift. Optik 126(23):3562–3566

    Article  Google Scholar 

  10. Ge Z, Liu S, Wang F, Li Z, Sun J (2021) Yolox: Exceeding yolo series in 2021. arXiv:http://arxiv.org/abs/210708430

  11. Gibert X, Patel VM, Chellappa R (2017) Deep multitask learning for railway track inspection. IEEE Trans Intell Transp Syst 18(1):153–164

    Article  Google Scholar 

  12. Gong D, Liu L, Le V, Saha B, Mansour MR, Venkatesh S, Hengel AVD (2019) Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp 1705–1714

  13. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, vol 27, pp 2672–2680

  14. Harikrishnan PM, Thomas A, Gopi VP, Palanisamy P, Wahid KA (2021) Inception single shot multi-box detector with affinity propagation clustering and their application in multi-class vehicle counting. Appl Intell 51(7):4714–4729

    Article  Google Scholar 

  15. Hore A, Ziou D (2010) Image quality metrics: Psnr vs. ssim. In: 2010 20th International Conference on Pattern Recognition, pp 2366–2369

  16. Huang Y, Qiu C, Yuan K (2020) Surface defect saliency of magnetic tile. Vis Comput 36 (1):85–96

    Article  MathSciNet  Google Scholar 

  17. Hughes LH, Schmitt M, Mou L, Wang Y, Zhu XX (2018) Identifying corresponding patches in sar and optical images with a pseudo-siamese cnn. IEEE Geosci Remote Sens Lett 15(5):784–788

    Article  Google Scholar 

  18. Kingma DP, Ba JL (2015) Adam: A method for stochastic optimization. In: ICLR 2015: International Conference on learning representations

  19. Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. european conference on computer vision, pp 21–37

  20. Mei S, Yang H, Yin Z (2018) An unsupervised-learning-based approach for automated defect inspection on textured surfaces. IEEE Trans Instrum Meas 67(6):1266–1277

    Article  Google Scholar 

  21. Napoletano P, Piccoli F, Schettini R (2018) Anomaly detection in nanofibrous materials by cnn-based self-similarity. Sensors 18(1):209–209

    Article  Google Scholar 

  22. Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch

  23. Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: ICLR 2016: International Conference on Learning Representations 2016

  24. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 779–788

  25. Ren S, He K, Girshick R, Sun J (2017) Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  26. Schlegl T, Seeböck P, Waldstein SM, Langs G, Schmidt-Erfurth U (2019) f-anogan: Fast unsupervised anomaly detection with generative adversarial networks. Med Image Anal 54:30–44

  27. Sun J, Lang J, Fujita H, Li H (2018) Imbalanced enterprise credit evaluation with dte-sbd: Decision tree ensemble based on smote and bagging with differentiated sampling rates. Inf Sci 425:76– 91

    Article  MathSciNet  Google Scholar 

  28. Sun J, Li H, Fujita H, Fu B, Ai W (2020) Class-imbalanced dynamic financial distress prediction based on adaboost-svm ensemble combined with smote and time weighting. Inf Fusion 54:128–144

    Article  Google Scholar 

  29. Tabernik D, Šela S, Skvarč J, Skočaj D (2020) Segmentation-based deep-learning approach for surface-defect detection. J Intell Manuf 31(3):759–776

    Article  Google Scholar 

  30. Tan M, Pang R, Le QV (2020) Efficientdet: Scalable and efficient object detection. In: CVPR 2020: Computer Vision and Pattern Recognition, pp 10781–10790

  31. Wang D (2021) Important components technology and typical troubles of railroad wagons (in Chinese). China Railway Publishing House Co., Ltd.

  32. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  33. Wu Y, Jin W, Ren J, Sun Z (2019) A multi-perspective architecture for high-speed train fault diagnosis based on variational mode decomposition and enhanced multi-scale structure. Appl Intell 49 (11):3923–3937

    Article  Google Scholar 

  34. Yi J, Yoon S (2020) Patch svdd: Patch-level svdd for anomaly detection and segmentation. In: Proceedings of the Asian Conference on Computer Vision, pp 375–390

  35. Zaheer MZ, Lee JH, Astrid M, Lee SI (2020) Old is gold: Redefining the adversarially learned one-class classifier training paradigm. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 14183–14193

  36. Zhang C, Liu C, Zhang X, Almpanidis G (2017) An up-to-date comparison of state-of-the-art classification algorithms. Expert Syst Appl 82:128–150

    Article  Google Scholar 

  37. Zhang C, Bi J, Xu S, Ramentol E, Fan G, Qiao B, Fujita H (2019) Multi-imbalance: an open-source software for multi-class imbalance learning. Knowl-Based Syst 174:137–143

    Article  Google Scholar 

  38. Zhang X, Yan J, Feng S, Lei Z, Yi D, Li SZ (2012) Water filling: Unsupervised people counting via vertical kinect sensor. In: 2012 IEEE Ninth international conference on advanced video and signal-based surveillance, vol 1, pp 215–220

  39. Zhou L, Fujita H (2017) Posterior probability based ensemble strategy using optimizing decision directed acyclic graph for multi-class classification. Inf Sci 400-401:142–156

    Article  Google Scholar 

  40. Zhou X, Koltun V, Krähenbühl P (2021) Probabilistic two-stage detection. arXiv:http://arxiv.org/abs/210307461

  41. Zhu L, Yu FR, Wang Y, Ning B, Tang T (2019) Big data analytics in intelligent transportation systems: a survey. IEEE Trans Intell Transp Syst 20(1):383–398

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Fundamental Research Funds for the National Natural Science Foundation of China under Grant No. 61871024, the Project of Science and Technology Research and Development Plan of Beijing Bureau No. 2019CC17, and the Foundation Project of China Academy of Railway Sciences Group Co., Ltd. No.2020YJ167. We are grateful to the China Railway Beijing Group Co., Ltd. and the China Railway Jinan Group Co., Ltd. for providing data support for this work.

Author information

Authors and Affiliations

  1. School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing, China

    Hao-Dong Zhang, Xue Yuan & Dan-Yong Li

  2. China Academy of Railway Sciences Corporation Limited, Beijing, China

    Jia You & Bing Liu

  3. Beijing EMU Depot, China Railway Beijing Group Co., Ltd., Beijing, China

    Xiao-Ming Zhao & Wen-Ming Cai

  4. Vehicle Department, China Railway Jinan Group Co., Ltd., Jinan, China

    Shan Ju

Authors
  1. Hao-Dong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xue Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dan-Yong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jia You
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiao-Ming Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wen-Ming Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Shan Ju
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xue Yuan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, HD., Yuan, X., Li, DY. et al. An effective framework using identification and image reconstruction algorithm for train component defect detection. Appl Intell 52, 10116–10134 (2022). https://doi.org/10.1007/s10489-021-02981-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02981-4

Keywords

Search

Navigation