Skip to main content

From Digital Model to Reality Application: A Domain Adaptation Method for Rail Defect Detection

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 13020))

Included in the following conference series:

Abstract

Recently, vision-based rail defect detection has attracted much attention owing to its practical significance. However, it still faces some challenges, such as high false alarm rate and poor feature robustness. With the development of deep neural networks (DNNs), deep learning based models have shown the potential to solve the problems. Nevertheless, these models usually require a large number of training samples, while collecting and labeling sufficient defective rail images is somewhat impractical. On the one hand, the probability of defect occurrence is low. On the other hand, we are not able to annotate samples that include all types of defects. To this end, we propose to generate defective training images in the digital space. In order to bridge the gap between virtual and real defective samples, this paper presents a domain adaptation based model for rail defect detection. The proposed method is evaluated on a real-world dataset. Experimental results show that our proposed method is superior to five established baselines.

This work was supported in part by the National Natural Science Foundation of China under Grant U2034211, in part by the Fundamental Research Funds for the Central Universities under Grant 2020JBZD010, in part by the Beijing Natural Science Foundation under Grant L191016 and in part by the China Railway R&D Program under Grant P2020T001.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    [2021-05-30] https://github.com/adafruit/Adafruit_SSD1306.

References

  1. Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Vaughan, J.W.: A theory of learning from different domains. Mach. Learn. 79(1), 151–175 (2010)

    Article  MathSciNet  Google Scholar 

  2. Ben-David, S., Blitzer, J., Crammer, K., Pereira, F., et al.: Analysis of representations for domain adaptation. In: Advances in Neural Information Processing Systems, vol. 19, p. 137. MIT 1998 (2007)

    Google Scholar 

  3. Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020)

  4. Bombarda, D., Vitetta, G.M., Ferrante, G.: Rail diagnostics based on ultrasonic guided waves: an overview. Appl. Sci. 11(3), 1071 (2021)

    Article  Google Scholar 

  5. Chen, Y., Li, W., Sakaridis, C., Dai, D., Van Gool, L.: Domain adaptive Faster R-CNN for object detection in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3339–3348 (2018)

    Google Scholar 

  6. Chen, Z., Xuan, J., Wang, P., Wang, H., Tian, G.: Simulation on high speed rail magnetic flux leakage inspection. In: IEEE International Instrumentation and Measurement Technology Conference, pp. 1–5. IEEE (2011)

    Google Scholar 

  7. Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015)

    Google Scholar 

  8. Ghifary, M., Kleijn, W.B., Zhang, M.: Domain adaptive neural networks for object recognition. In: Pham, D.-N., Park, S.-B. (eds.) PRICAI 2014. LNCS (LNAI), vol. 8862, pp. 898–904. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-13560-1_76

    Chapter  Google Scholar 

  9. Guo, Q., Liu, Y., Yin, H., Li, Y., Li, C.: Multi-scale dense object detection in remote sensing imagery based on keypoints. In: Peng, Y., et al. (eds.) PRCV 2020. LNCS, vol. 12305, pp. 104–116. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60633-6_9

    Chapter  Google Scholar 

  10. Hajizadeh, S., Núnez, A., Tax, D.M.: Semi-supervised rail defect detection from imbalanced image data. IFAC-PapersOnLine 49(3), 78–83 (2016)

    Article  Google Scholar 

  11. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  12. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  13. Li, Q., Ren, S.: A real-time visual inspection system for discrete surface defects of rail heads. IEEE Trans. Instrum. Measure. 61(8), 2189–2199 (2012)

    Article  Google Scholar 

  14. Li, Q., Ren, S.: A visual detection system for rail surface defects. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 42(6), 1531–1542 (2012)

    Google Scholar 

  15. Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2

    Chapter  Google Scholar 

  16. Long, M., Cao, Y., Wang, J., Jordan, M.: Learning transferable features with deep adaptation networks. In: International Conference on Machine Learning, pp. 97–105. PMLR (2015)

    Google Scholar 

  17. Luo, Q., Fang, X., Liu, L., Yang, C., Sun, Y.: Automated visual defect detection for flat steel surface: a survey. IEEE Trans. Instrum. Measure. 69(3), 626–644 (2020)

    Article  Google Scholar 

  18. Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)

    Article  Google Scholar 

  19. Papaelias, M.P., Lugg, M., Roberts, C., Davis, C.: High-speed inspection of rails using ACFM techniques. NDT & E Int. 42(4), 328–335 (2009)

    Article  Google Scholar 

  20. Pei, Z., Cao, Z., Long, M., Wang, J.: Multi-adversarial domain adaptation. In: AAAI Conference on Artificial Intelligence, vol. 32 (2018)

    Google Scholar 

  21. Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)

  22. Tao, F., Zhang, H., Liu, A., Nee, A.Y.: Digital twin in industry: state-of-the-art. IEEE Trans. Ind. Inform. 15(4), 2405–2415 (2018)

    Article  Google Scholar 

  23. Tzeng, E., Hoffman, J., Saenko, K., Darrell, T.: Adversarial discriminative domain adaptation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 7167–7176 (2017)

    Google Scholar 

  24. Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., Darrell, T.: Deep domain confusion: maximizing for domain invariance. arXiv preprint arXiv:1412.3474 (2014)

  25. Wei, X., Wei, D., Suo, D., Jia, L., Li, Y.: Multi-target defect identification for railway track line based on image processing and improved YOLOv3 model. IEEE Access 8, 61973–61988 (2020)

    Article  Google Scholar 

  26. Yanan, S., Hui, Z., Li, L., Hang, Z.: Rail surface defect detection method based on YOLOv3 deep learning networks. In: 2018 Chinese Automation Congress (CAC), pp. 1563–1568. IEEE (2018)

    Google Scholar 

  27. Yu, H., et al.: A coarse-to-fine model for rail surface defect detection. IEEE Trans. Instrum. Measure. 68(3), 656–666 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qingyong Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cui, W. et al. (2021). From Digital Model to Reality Application: A Domain Adaptation Method for Rail Defect Detection. In: Ma, H., et al. Pattern Recognition and Computer Vision. PRCV 2021. Lecture Notes in Computer Science(), vol 13020. Springer, Cham. https://doi.org/10.1007/978-3-030-88007-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-88007-1_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-88006-4

  • Online ISBN: 978-3-030-88007-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics