Skip to main content
SpringerLink
Log in

A vision-based abnormal trajectory detection framework for online traffic incident alert on freeways

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Abnormal trajectory detection from surveillance cameras is a highly desirable but challenging task, especially for online traffic incident alert on freeways. Existing methods are mainly customized for offline alert and easily suffer from false alerts when applying them to online alert. To fill this gap, an anomaly trajectory detection framework is proposed for online traffic incident alert on freeways. Based on a LSTM autoencoder, this framework introduces an adversarial learner (AL) for offline training and an abnormal trajectory discriminator (ATD) for online alert. The adversarial learner uses an additional adversarial loss to enable the autoencoder to learn a better normal trajectory pattern that is beneficial for reducing false alerts, while an abnormal trajectory discriminator is established and trained to detect small mean shift and filter out instantaneous false alerts. The experimental results show that our proposed framework effectively filters out false alerts and obtains a state-of-art performance (AUC = 0.97) compared to existing methods. Moreover, our framework could timely alert traffic incidents within 0.25 s, which is significant for timely preventing the occurrence of traffic crashes and improving the response speed of incident management on freeways.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. https://github.com/ultralytics/yolov5.

References

  1. Chen Z, Wu C, Huang Z, Lyu N, Hu Z, Zhong M, Cheng Y, Ran B (2017) Dangerous driving behavior detection using video-extracted vehicle trajectory histograms. J Intell Transp Syst 21(5):409–421. https://doi.org/10.1080/15472450.2017.1305271

    Article  Google Scholar 

  2. Mehboob F, Abbas M, Jiang R, Rauf A, Khan SA, Rehman S (2018) Trajectory based vehicle counting and anomalous event visualization in smart cities. Cluster Comput 21(1):443–452. https://doi.org/10.1007/s10586-017-0885-5

    Article  Google Scholar 

  3. Shi J, Pan Z, Fang J, Chao P (2021) Rutod: real-time urban traffic outlier detection on streaming trajectory. Neur Comput Appl. https://doi.org/10.1007/s00521-021-06294-y

    Article  Google Scholar 

  4. Pramanik A, Sarkar S, Maiti J (2021) A real-time video surveillance system for traffic pre-events detection. Accid Anal & Prevent. https://doi.org/10.1016/j.aap.2021.106019

    Article  Google Scholar 

  5. Wang Y, Wang Q, Suo D, Wang T (2021) Intelligent traffic monitoring and traffic diagnosis analysis based on neural network algorithm. Neur Comput Appl 33(14):8107–8117. https://doi.org/10.1007/s00521-020-04899-3

    Article  Google Scholar 

  6. Wang J, Luo T, Fu T (2019) Crash prediction based on traffic platoon characteristics using floating car trajectory data and the machine learning approach. Accid Anal & Prevent. https://doi.org/10.1016/j.aap.2019.105320

    Article  Google Scholar 

  7. Yu R, Han L, Zhang H (2021) Trajectory data based freeway high-risk events prediction and its influencing factors analyses. Accid Anal & Prevent. https://doi.org/10.1016/j.aap.2021.106085

    Article  Google Scholar 

  8. Mercader P, Haddad J (2020) Automatic incident detection on freeways based on bluetooth traffic monitoring. Accid Anal & Prevent. https://doi.org/10.1016/j.aap.2020.105703

    Article  Google Scholar 

  9. Lin Y, Li R (2020) Real-time traffic accidents post-impact prediction: based on crowdsourcing data. Accid Anal & Prevent. https://doi.org/10.1016/j.aap.2020.105696

    Article  Google Scholar 

  10. Ki Y-K, Lee D-Y (2007) A traffic accident recording and reporting model at intersections. IEEE Transact Intell Transport Sys 8(2):188–194. https://doi.org/10.1109/tits.2006.890070

    Article  Google Scholar 

  11. Lee KB, Shin HS (2019) An application of a deep learning algorithm for automatic detection of unexpected accidents under bad CCTV monitoring conditions in tunnels. IEEE

  12. Ijjina EP, Chand D, Gupta S, Goutham K (2019) Computer Vision-based Accident Detection in Traffic Surveillance. In: 2019 10th International conference on computing, communication and networking technologies (ICCCNT), pp. 1–6. https://doi.org/10.1109/icccnt45670.2019.8944469

  13. Fu Z, Hu W, Tan T (2005) Similarity based vehicle trajectory clustering and anomaly detection. In: IEEE International conference on image processing vol. 2, p. 602. https://doi.org/10.1109/icip.2005.1530127

  14. Piciarelli C, Micheloni C, Foresti GL (2008) Trajectory-based anomalous event detection. IEEE Transact Circ Sys Video Tech 18(11):1544–1554. https://doi.org/10.1109/tcsvt.2008.2005599

    Article  Google Scholar 

  15. Wan Y, Yang T-I, Keathly D, Buckles B (2014) Dynamic scene modelling and anomaly detection based on trajectory analysis. IET Intell Trans Sys 8(6):526–533. https://doi.org/10.1049/iet-its.2012.0119

    Article  Google Scholar 

  16. Ji Y, Wang L, Wu W, Shao H, Feng Y (2020) A method for LSTM-based trajectory modeling and abnormal trajectory detection. IEEE Access 8:104063–104073. https://doi.org/10.1109/access.2020.2997967

    Article  Google Scholar 

  17. Kumaran SK, Dogra DP, Roy PP, Mitra A (2018) Video trajectory classification and anomaly detection using hybrid CNN-VAE. arXiv:1812.07203 [cs]

  18. Cai Y, Wang H, Chen X, Jiang H (2015) Trajectory-based anomalous behaviour detection for intelligent traffic surveillance. IET Intell Trans Sys 9(8):810–816. https://doi.org/10.1049/iet-its.2014.0238

    Article  Google Scholar 

  19. Athanesious JJ, Chakkaravarthy SS, Vasuhi S, Vaidehi V (2019) Trajectory based abnormal event detection in video traffic surveillance using general potential data field with spectral clustering. Multimed Tools Appl 78(14):19877–19903. https://doi.org/10.1007/s11042-019-7332-y

    Article  Google Scholar 

  20. Aksan N, Sager L, Hacker S, Lester B, Dawson J, Rizzo M (2016) Benefits from heads-up lane departure warnings predicts safety in the real-world. Technical report, SAE Technical Paper

  21. Jamson AH, Lai FC, Carsten OM (2008) Potential benefits of an adaptive forward collision warning system. Transport Res Part C: Emerg Tech 16(4):471–484

    Article  Google Scholar 

  22. Chen Y, Quddus M, Wang X (2018) Impact of combined alignments on lane departure: a simulator study for mountainous freeways. Transport Resear Part C: Emerg Tech 86:346–359

    Article  Google Scholar 

  23. Sun W, Aguirre M, Jin JJ, Feng F, Rajab S, Saigusa S, Dsa J, Bao S (2021) Online distraction detection for naturalistic driving dataset using kinematic motion models and a multiple model algorithm. Transport Resear Part C: Emerg Tech 130:103317–103317

    Article  Google Scholar 

  24. Wang X, Xu R, Zhang S, Zhuang Y, Wang Y (2022) Driver distraction detection based on vehicle dynamics using naturalistic driving data. Transport Resear Part C: Emerg Tech 136:103561–103561

    Article  Google Scholar 

  25. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neur Comput, 9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735

  26. Mtibaa F, Nguyen K-K, Azam M, Papachristou A, Venne J-S, Cheriet M (2020) Lstm-based indoor air temperature prediction framework for HVAC systems in smart buildings. Neur Comput Appl 32(23):17569–17585. https://doi.org/10.1007/s00521-020-04926-3

    Article  Google Scholar 

  27. Deng J, Schuller B, Eyben F, Schuller D, Zhang Z, Francois H, Oh E (2020) Exploiting time-frequency patterns with LSTM-RNNS for low-bitrate audio restoration. Neur Comput Appl 32(4):1095–1107. https://doi.org/10.1007/s00521-019-04158-0

    Article  Google Scholar 

  28. Chen Y, Nascimento MA, Ooi BC, Tung AKH (2007) SpADe: On Shape-based Pattern Detection in Streaming Time Series. In: 2007 IEEE 23rd International conference on data engineering, pp. 786–795. https://doi.org/10.1109/icde.2007.367924

  29. Nakamura T, Taki K, Nomiya H, Seki K, Uehara K (2013) A shape-based similarity measure for time series data with ensemble learning. Patt Anal Applic 16(4):535–548. https://doi.org/10.1007/s10044-011-0262-6

    Article  MathSciNet  Google Scholar 

  30. Doshi K, Yilmaz Y (2021) Online anomaly detection in surveillance videos with asymptotic bound on false alarm rate. Patt Recognit. https://doi.org/10.1016/j.patcog.2021.107865

    Article  Google Scholar 

  31. Saeedi Emadi H, Mazinani SM (2018) A novel anomaly detection algorithm using DBSCAN and SVM in wireless sensor networks. Wireless Pers Commun 98(2):2025–2035. https://doi.org/10.1007/s11277-017-4961-1

    Article  Google Scholar 

  32. Zhang K, Hutter M, Jin H (2009) A new local distance-based outlier detection approach for scattered real-world data. In: Theeramunkong T, Kijsirikul B, Cercone N, Ho T-B (Eds.) Advances in knowledge discovery and data mining. Lecture Notes in Computer Science, pp. 813–822. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01307-2_84

  33. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Advances in neural information processing systems 30:

  34. Breunig MM, Kriegel H-P, Ng RT, Sander J (1999) Optics-of: Identifying local outliers. In: European conference on principles of data mining and knowledge discovery, pp. 262–270. Springer, Berlin

  35. Breunig MM, Kriegel H-P, Ng RT, Sander J (2000) Lof: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD international conference on management of Data, pp. 93–104

  36. Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. In: 2017 IEEE international conference on image processing (ICIP), pp. 3645–3649. https://doi.org/10.1109/icip.2017.8296962

  37. Santhosh KK, Dogra DP, Roy PP, Mitra A (2021) Vehicular trajectory classification and traffic anomaly detection in videos using a hybrid CNN-VAE Architecture. IEEE Trans Intell Transport Sys. https://doi.org/10.1109/tits.2021.3108504

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the National Key R&D Program of China (2018YFE0102700) and the National Natural and Science Foundation of China (71971061).

Author information

Authors and Affiliations

  1. School of Transportation, Southeast University, Nanjing, 211198, Jiangsu, China

    Wei Zhou, Yunhong Yu, Yunfei Zhan & Chen Wang

  2. Purple Mountain Laboratories, Nanjing, 211111, Jiangsu, China

    Wei Zhou & Chen Wang

Authors
  1. Wei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yunhong Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunfei Zhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chen Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chen Wang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, W., Yu, Y., Zhan, Y. et al. A vision-based abnormal trajectory detection framework for online traffic incident alert on freeways. Neural Comput & Applic 34, 14945–14958 (2022). https://doi.org/10.1007/s00521-022-07335-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07335-w

Keywords

Search

Navigation