Skip to main content

Advertisement

Log in

A BiFPN-SECA detection network for foreign objects on top of railway freight vehicles

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Foreign object detection on top of railway freight vehicles is critical to ensuring the safety and efficiency railway transportation. However, this task is mainly carried out manually, facing major challenges such as low accuracy and false positives and false negatives. To address the above problems, this paper proposes a novel BiFPN-SECA Network, Bidirectional Feature Pyramid Network with Squeeze-and-Excitation Channel Attention, which integrates an attention mechanism combining contextual features and coordinate information. This innovative approach improves detection performance by effectively capturing and emphasizing key features. The ordinary convolutional layers in the coordinate attention mechanism are improved in SEnet to increase the attention to the regions of interest. Second, an improved coordinate attention mechanism module is embedded before the BiFPN sampling layer and after the backbone output layer to enhance key feature extraction. In addition, a dataset of foreign objects in railway freight vehicles was established, including bag, stone and torn. Experimental results verify that the BiFPN-SECA Network is able to improve detection accuracy, with an accuracy of 94.57\(\%\), demonstrating its potential to significantly enhance the safety and reliability of railway freight.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Availability of data and materials

The information related to the railway freight scenario is confidential information, and there is no public data set in practice, so the data set used in this article cannot be used publicly.

Code Availability

The code is publicly available.

References

  1. Asharf, J., Moustafa, N., Khurshid, H., Debie, E., Haider, W., Wahab, A.: A review of intrusion detection systems using machine and deep learning in internet of things: challenges, solutions and future directions. Electronics 9(7), 1177 (2020)

    Article  Google Scholar 

  2. Lan, Z., Chen, Y., Lan, X.: A method for detecting foreign objects on railway freight vehicles based on k-means. Mech. Electr. Eng. Technol. 52(04), 25–29 (2023)

    Google Scholar 

  3. Wang, X., Zhang, X., Zhou, N.: Improved yolov5 with bifpn on pcb defect detection. In: 2021 2nd International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 196–199 (2021). IEEE

  4. Chen, Y., Xia, R., Yang, K., Zou, K.: Mffn: image super-resolution via multi-level features fusion network. Vis. Comput. 40(2), 489–504 (2024)

    Article  Google Scholar 

  5. Song, T., Zhang, X., Yang, D., Ye, Y., Liu, C., Zhou, J., Song, Y.: Lightweight detection network based on receptive-field feature enhancement convolution and three dimensions attention for images captured by uavs. Image Vis. Comput. 140, 104855 (2023)

    Article  Google Scholar 

  6. Bi, G., Chunping, D.: Detection and extraction algorithm of foreign object in railway clearance based on inter frame difference accumulation. Railw. Stand. Des. 63(9), 6 (2019)

    Google Scholar 

  7. Yatao, W.: Research on early warning and detection for railway foreign body based on unmanned aerial vehicle (2019)

  8. Wen, Z., Tianyun, S., Ping, L., Xiaoning, M.: Research on early warning and detection for railway foreign body based on unmanned aerial vehicle. J. Transp. Inf. Saf. 37(6), 8 (2019)

    Google Scholar 

  9. JingBO, W.: Study on the model ofdeep learning yolov3 and its application in the detection of foreign bodies in trains (2020)

  10. Jiayi: Vision-based foreign objects detection for high speed railway catenary (2021)

  11. Gao, D., Kang, Y., Wang, Y.: Faster r-cnn railway foreign body detection algorithm combined with attention between channels. In: International Conference on Signal Processing and Communication Technology (SPCT 2021), vol. 12178, pp. 480–487 (2022). SPIE

  12. Wang, S., Wang, Y., Chang, Y., Zhao, R., She, Y.: Ebse-yolo: high precision recognition algorithm for small target foreign object detection. IEEE Access (2023)

  13. Wang, J., Liu, M., Su, Y., Yao, J., Du, Y., Zhao, M., Lu, D.: Small target detection algorithm based on attention mechanism and data augmentation. Signal Image Video Process. 18(4), 3837–3853 (2024)

    Article  Google Scholar 

  14. Sarker, I.H.: Deep learning: a comprehensive overview on techniques, taxonomy, applications and research directions. SN Comput. Sci. 2(6), 420 (2021)

    Article  Google Scholar 

  15. Cheewaprakobkit, P., Lin, C.-Y., Lin, K.-H., Shih, T.K.: Robust signboard detection and recognition in real environments. IEEE Trans. Consum. Electron. 69(3), 421–430 (2023)

    Article  Google Scholar 

  16. You, Q., Jin, H., Wang, Z., Fang, C., Luo, J.: Image captioning with semantic attention. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4651–4659 (2016)

  17. Deng, C., Wang, M., Liu, L., Liu, Y., Jiang, Y.: Extended feature pyramid network for small object detection. IEEE Trans. Multimedia 24, 1968–1979 (2021)

    Article  Google Scholar 

  18. Yang, Y., Liu, C., Chang, F., Lu, Y., Liu, H.: Driver gaze zone estimation via head pose fusion assisted supervision and eye region weighted encoding. IEEE Trans. Consum. Electron. 67(4), 275–284 (2021)

    Article  Google Scholar 

  19. Li, H., Ma, H., Che, Y., Yang, Z.: A two-way dense feature pyramid networks for object detection of remote sensing images. Knowl. Inf. Syst. 65(11), 4847–4871 (2023)

    Article  Google Scholar 

  20. Dong, Z., Lin, B.: BMF-CNN: an object detection method based on multi-scale feature fusion in VHR remote sensing images. Remote Sens. Lett. 11(3), 215–224 (2020)

    Article  Google Scholar 

  21. Min, K., Lee, G.-H., Lee, S.-W.: Attentional feature pyramid network for small object detection. Neural Netw. 155, 439–450 (2022)

    Article  Google Scholar 

  22. Li, Z., Lang, C., Liew, J.H., Li, Y., Hou, Q., Feng, J.: Cross-layer feature pyramid network for salient object detection. IEEE Trans. Image Process. 30, 4587–4598 (2021)

    Article  Google Scholar 

  23. Shawky, O.A., Hagag, A., El-Dahshan, E.-S.A., Ismail, M.A.: A very high-resolution scene classification model using transfer deep CNNS based on saliency features. SIViP 15(4), 817–825 (2021)

  24. Zhang, K., Wang, W., Lv, Z., Fan, Y., Song, Y.: Computer vision detection of foreign objects in coal processing using attention CNN. Eng. Appl. Artif. Intell. 102, 104242 (2021)

  25. Zeng, S., Yang, W., Jiao, Y., Geng, L., Chen, X.: Sca-yolo: a new small object detection model for UAV images. Vis. Comput. 40(3), 1787–1803 (2024)

    Article  Google Scholar 

  26. Hou, Q., Zhou, D., Feng, J.: Coordinate attention for efficient mobile network design (2021)

  27. Zhang, Y., Li, B., Shang, J., Huang, X., Zhai, P., Geng, C.: Dsa-net: An attention-guided network for real-time defect detection of transmission line dampers applied to uav inspections. In: IEEE Transactions on Instrumentation and Measurement (2023)

  28. Fu, J., Liu, J., Jiang, J., Li, Y., Bao, Y., Lu, H.: Scene segmentation with dual relation-aware attention network. AIEEE Trans. Neural Netw. Learn. Syst. 32(6), 2547–2560 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

This work is part of the National Key Research and Development Program 2022YFB2602205, in part by Science and Technology Program in Xi’an city under Grant 21XJZZ0055, in part by Natural Science Foundation of Shaanxi Provincial Department of Education under Grant 22JK0474.

Funding

Science and Technology Program in Xi’an city under Grant 21XJZZ0055, Natural Science Foundation of Shaanxi Provincial Department of Education under Grant 22JK0474.

Author information

Authors and Affiliations

Authors

Contributions

Sheng Liu & Ting Cao: Preparation of manuscripts and presentation of methodology. Yiqing Yang & Yi Zhu: Data collection, charting, and coding.

Corresponding author

Correspondence to Ting Cao.

Ethics declarations

Conflict of interest

The authors declare no Conflict of interest.

Ethics approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Yang, Y., Cao, T. et al. A BiFPN-SECA detection network for foreign objects on top of railway freight vehicles. SIViP 18, 9027–9035 (2024). https://doi.org/10.1007/s11760-024-03527-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-024-03527-0

Keywords