Skip to main content
SpringerLink
Log in

Cognitive Traffic Anomaly Prediction from GPS Trajectories Using Visible Outlier Indexes and Meshed Spatiotemporal Neighborhoods

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

The advancement of cognitive computing for traffic status understanding, powered by machine learning and data analytics, enables prediction of traffic anomalies from continuously generated big GPS trajectory data. Existing methods generally use traffic indicators such as traffic flows and speeds to detect anomalies, but they may over-identify anomalies while missing the critical ones. For example, they use historical anomalies to train the prediction model, but past anomalies may not be a perfect indication of future anomalies since anomalies are often rare. In this paper, we propose a novel cognitive approach, a Visible Outlier Indexes and Meshed Spatiotemporal Neighborhoods (VOI-MSN) method, to predict traffic anomalies from GPS trajectories. In the VOI-MSN method, two cognitive techniques are provided. The first is VOI, which measures the abnormal scores using overall samples and can be intuitively understood by humans. The second is MSN, which learns the dynamic impact range (i.e., spatiotemporal neighborhood) from historical trajectory data and provides a complete and exact analysis of the local traffic situation. It emulates human cognitive processing to adaptively judge the impact range by experience. The effectiveness of the proposed method is demonstrated using a massive trajectory dataset with 2.5 billion location records for 27,266 taxis, and it achieves higher precision and recall in predicting traffic anomalies than the counterpart methods. The VOI-MSN method achieves high accuracy and recall for predicting traffic anomalies. It outperforms traffic indicator–based (speed and traffic flow) methods, the fixed-size spatial neighborhood method and the causal network method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Five Questions to Ask When Choosing an Anomaly Detection and Prediction Strategy. https://www.progress.com/campaigns/datarpm/checklist-5-questions-to-ask-when-choosing-an-anomaly-detection-and-prediction-strategy (2019).

  2. Kuang W, An S, Jiang H. 2015. Detecting traffic anomalies in urban areas using taxi gps data. Math Probl Eng, pp 1–13.

  3. Fay D, Thakur GS, Hui P, Helmy A. Knowledge discovery and causality in urban city traffic: a study using planet scale vehicular imagery data. Proceedings of the sixth ACM SIGSPATIAL international workshop on computational transportation science; 2013.

  4. Kumar K, Parida M, Katiyar VK. Short term traffic flow prediction in heterogeneous condition using artificial neural network. Transport 2015;30(4):397–405.

    Article  Google Scholar 

  5. Chen D. Research on traffic flow prediction in the big data environment based on the improved rbf neural network. IEEE Trans Industrial Inform 2017;13(4):2000–2008.

    Article  Google Scholar 

  6. Tian Y, Li P. Predicting short-term traffic flow by long short-term memory recurrent neural network. IEEE international conference on Smart City/SocialCom/SustainCom (SmartCity) 2015; 2015. p. 153–158.

  7. Vlahogianni EI, Karlaftis MG, Golias JC. Short-term traffic forecasting: where we are and where were going. Transportation Research Part C: Emerging Technologies 2014;43(1):3–19.

    Article  Google Scholar 

  8. Raiyn J, Toledo T. Real-time road traffic anomaly detection. Journal of Transportation Technologies 2014;4(03):256–266.

    Article  Google Scholar 

  9. Jiang B, Fei Y. Traffic and vehicle speed prediction with neural network and hidden markov model in vehicular networks. IEEE intelligent vehicles symposium 2015; 2015. p. 1082–1087.

  10. Huang G-L, Ji Y, Liu S, Zarei R. Discovering traffic anomaly propagation in urban space using traffic change peaks. International conference on data science. Singapore: Springer; 2019. p. 67–76.

  11. Anantharam P, Thirunarayan K, Marupudi S, Sheth AP, Banerjee T. Understanding city traffic dynamics utilizing sensor and textual observations. AAAI’2016; 2016. p. 3793–3799.

  12. Huang G, He J, Zhou W, Huang G-L, Guo L, Zhou X, Tang F. Discovery of stop regions for understanding repeat travel behaviors of moving objects. J Comput Syst Sci 2016;82(4):582–593.

    Article  MathSciNet  Google Scholar 

  13. Loon RV. 2018. How industrial IOT is influenced by cognitive anomaly detection. https://www.thedigitaltransformationpeople.com/channels/enabling-technologies/how-industrial-iot-is-influenced-by-cognitive-anomaly-detection/.

  14. Shi A, Weiming K. Prediction of urban traffic abnormity based on causal network. 2015 sixth international conference on intelligent systems design and engineering applications (ISDEA). IEEE; 2015. p. 574–577.

  15. Chen Q, Song X, Yamada H, Shibasaki R. Learning deep representation from big and heterogeneous data for traffic accident inference. AAAI 2016; 2016. p. 338–344.

  16. Lan J, Long C, Wong RC-W, Chen Y, Fu Y, Guo D, Liu S, Ge Y, Zhou Y, Li J. A new framework for traffic anomaly detection. Proceedings of the 2014 SIAM international conference on data mining (SDM’2014); 2014. p. 875–883.

  17. Xiao Y. A fast algorithm for two-dimensional Kolmogorov-Smirnov two sample tests. Computational Statistics and Data Analysis 2017;105:53–58.

    Article  MathSciNet  Google Scholar 

  18. Ling X, Feng X, Chen Z, Xu Y, Zheng H. Short-term traffic flow prediction with optimized multi-kernel support vector machine. 2017 IEEE congress on evolutionary computation (CEC). IEEE; 2017. p. 294–300.

  19. Basso F, Basso LJ, Bravo F, Pezoa R. Real-time crash prediction in an urban expressway using disaggregated data. Transportation Research Part C: Emerging Technologies 2018;86:202–219.

    Article  Google Scholar 

  20. Djenouri Y, Belhadi A, Lin JCW, Cano A. Adapted k-nearest neighbors for detecting anomalies on spatio-temporal traffic flow. IEEE Access 2019;7:10015–10027.

    Article  Google Scholar 

  21. Ranaweera M, Seneviratne A, Rey D, Saberi M, Dixit VV. Anomalous data detection in vehicular networks using traffic flow theory. 2019 IEEE 90th vehicular technology conference (VTC2019-Fall). IEEE; 2019. p. 1–5.

  22. Chawla S, Zheng Y, Hu J. Inferring the root cause in road traffic anomalies. IEEE 12th international conference on data mining (ICDM’12); 2012. p. 141–150.

  23. Liu W, Zheng SCY, Yuan J, Xing X. Discovering spatiotemporal causal interactions in traffic data streams. Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining (SIGKDD’11); 2011. p. 1010–1018.

  24. Barria J, Thajchayapong S. Detection and classification of traffic anomalies using microscopic traffic variables. IEEE Trans Intell Transp Syst 2011;12(3):695–704.

    Article  Google Scholar 

  25. Ma MX, Ngan HY, Liu W. Density-based outlier detection by local outlier factor on largescale traffic data. Electronic Imaging 2016;2016(14):1–4.

    Article  Google Scholar 

  26. Liu C, Qin K, Kang C. Exploring time-dependent traffic congestion patterns from taxi trajectory data. The 2nd IEEE international conference on spatial data mining and geographical knowledge services (ICSDM’2015); 2015. p. 39–44.

  27. Huang G-L, Deng K, Ren Y, Li J. Root cause analysis of traffic anomalies using uneven diffusion model. IEEE Access 2019;7:16206–16216.

    Article  Google Scholar 

  28. Xing L, Wang W, Xue G, Yu H, Chi X, Dai W. Discovering traffic outlier causal relationship based on anomalous dag. International conference in swarm intelligence. Springer; 2015 . p. 71–80.

  29. Pang LX, Chawla S, Liu W, Zheng Y. On detection of emerging anomalous traffic patterns using gps data. Data and Knowledge Engineering 2013;87:357–373.

    Article  Google Scholar 

  30. Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, Altman DG. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. European Journal of Epidemiology 2016;31(4):337–350.

    Article  Google Scholar 

  31. Li J, Yang M, Liu N, Wang Z, Yu L. A trajectory data clustering method based on dynamic grid density. International Journal of Grid Distribution Computing 2015;8(2):1–8.

    Article  Google Scholar 

  32. Ding Y, Li Y, Deng K, Tan H, Yuan M, Ni LM. Detecting and analyzing urban regions with high impact of weather change on transport. IEEE Transactions on Big Data 2017;3(2):126– 139.

    Article  Google Scholar 

Download references

Funding

This work was partially supported by Australian Research Council (ARC) Discovery Project (DP160102114).

Author information

Authors and Affiliations

  1. School of Science, RMIT University, Melbourne, Australia

    Guang-Li Huang & Ke Deng

  2. School of Software and Electrical Engineering, Swinburne University of Technology, Hawthorn, Australia

    Jing He

Authors
  1. Guang-Li Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ke Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jing He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guang-Li Huang.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interests.

Additional information

Human and Animal Rights

This article does not contain any studies with human or animal subjects performed by the any of the authors.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, GL., Deng, K. & He, J. Cognitive Traffic Anomaly Prediction from GPS Trajectories Using Visible Outlier Indexes and Meshed Spatiotemporal Neighborhoods. Cogn Comput 12, 967–978 (2020). https://doi.org/10.1007/s12559-020-09735-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-020-09735-3

Keywords

Search

Navigation