Skip to main content
SpringerLink
Log in

Deep spatio-temporal neural network based on interactive attention for traffic flow prediction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Traffic flow forecasting is of great significance to urban traffic control and public safety applications. The key challenge of traffic flow forecasting is how to capture the complex correlation of different time levels and learn time dependence. Some external information is closely related to traffic flow, such as accidental traffic accidents, weather, and Point of Interests (PoI) information. This paper proposes a deep learning-based model, called AttDeepSTN+, which is used to predict the inflow and outflow of each area of the entire city. Specifically, AttDeepSTN+ uses the structure of interactive attention and convolution to model the temporal closeness, trend, and periodicity of crowd flow, in the interactive attention layer, learn the importance of closeness to periodicity and trend respectively to model the long-term dependence of time, and then use feature fusion to capture complex correlations at different levels, thereby reducing model prediction accuracy. In addition, PoI information are combined with time factors to express the influence of location attributes on crowd flow, to learn prior knowledge of crowd flow. Finally, a new fusion mechanism is used to fuse the attention layer modules and PoI information and other information together into the module to capture the complex correlation between different levels of features, to predict the final crowd flow in each area, and further improve the prediction accuracy of the model. The New York City crowd flow experiment shows that the model is better than the current state-of-the-art baseline.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Abbasimehr H, Shabani M, Yousefi M (2020) An optimized model using lstm network for demand forecasting. Comput Ind Eng 143:106435

    Article  Google Scholar 

  2. Chang Z, Zhang Y, Chen W (2019) Electricity price prediction based on hybrid model of adam optimized lstm neural network and wavelet transform. Energy 187:115804

    Article  Google Scholar 

  3. Chang YS, Chiao HT, Abimannan S, Huang Y, Tsai YT, Lin KM (2020) An lstm-based aggregated model for air pollution forecasting. Atmos Pollut Res 11:1451–1463

    Article  Google Scholar 

  4. Chen Y (2020) Voltage’s prediction algorithm based on lstm recurrent neural network. Optik 220:164869

    Article  Google Scholar 

  5. Chu KF, Lam AYS, Li V (2020) Deep multi-scale convolutional Istm network for travel demand and origin-destination predictions. IEEE Trans Intell Transp Syst 21:3219–3232

    Article  Google Scholar 

  6. Cui Z, Ke R, Wang Y (2018) Deep bidirectional and unidirectional lstm recurrent neural network for network-wide traffic speed prediction. ArXiv abs/1801.02143

  7. Cui Z, Henrickson KC, Ke R, Wang Y (2020) Traffic graph convolutional recurrent neural network: A deep learning framework for network-scale traffic learning and forecasting. IEEE Trans Intell Transp Syst 21:4883–4894

    Article  Google Scholar 

  8. Ding Y, Zhu Y, Feng J, Zhang P, Cheng Z (2020) Interpretable spatio-temporal attention lstm model for flood forecasting. Neurocomputing 403:348–359

    Article  Google Scholar 

  9. Kuang, L., Zheng, J., Li, K., & Gao, H. (2021). Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities. ACM Transactions on Internet Technology (TOIT), 21, 1 - 24

  10. Du S, Li T, Gong X, Yang Y, Horng S (2017) Traffic flow forecasting based on hybrid deep learning framework. 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE) pp 1-6

  11. Du B, Hu X, Sun L, Liu J, Qiao Y, Lv W (2021) Traffic demand prediction based on dynamic transition convolutional neural network. IEEE Trans Intell Transp Syst 22:1237–1247

    Article  Google Scholar 

  12. Gao, H., Huang, W., & Yang, X. (2019). Applying Probabilistic Model Checking to Path Planning in an Intelligent Transportation System Using Mobility Trajectories and Their Statistical Data. Intelligent Automation and Soft Computing. 25, 547-559

  13. Gao H, Liu C, Li Y, Yang X (2021) V2vr: Reliable hybrid-network-oriented v2v data transmission and routing considering rsus and connectivity probability. IEEE Trans Intell Transp Syst 22:3533–3546

    Article  Google Scholar 

  14. Guo S, Lin Y, Feng N (2019) Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. Proceedings of the AAAI Conference on Artificial Intelligence 33:922-929

  15. Geurts, M.D., Box, G.E., & Jenkins, G.M. (1976). Time Series Analysis: Forecasting and Control. Journal of Marketing Research, 14, 269

  16. Hoque J, Erhardt GD, Schmitt D, Chen M, Wachs M (2021) Estimating the uncertainty of traffic forecasts from their historical accuracy. Transp Res Part A-Policy Pract 147:339–349

    Article  Google Scholar 

  17. Hu J, Li B (2020) A deep learning framework based on spatio-temporal attention mechanism for traffic prediction. 2020 IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), pp 750-757

  18. Ji J, Wang J, Jiang Z, Ma J, Zhang H (2020) Interpretable spatiotemporal deep learning model for traffic flow prediction based on potential energy fields. 2020 IEEE International Conference on Data Mining (ICDM), pp 1076-1081

  19. Jin W, Lin Y, Wu Z, Wan H (2018) Spatio-temporal recurrent convolutional networks for citywide short-term crowd flows prediction. In: ICCDA, 2018

  20. Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980

  21. Kuang, L., Hua, C., Wu, J., Yin, Y., & Gao, H. (2020). Traffic Volume Prediction Based on Multi-Sources GPS Trajectory Data by Temporal Convolutional Network. Mobile Networks and Applications, 25,1-13

  22. Li X, Pan G, Wu Z, Qi G, Li S, Zhang D, Zhang W, Wang Z (2011) Prediction of urban human mobility using large-scale taxi traces and its applications. Front Comp Sci 6:111–121

    MathSciNet  Google Scholar 

  23. Li Y, Yu R, Shahabi C, Liu Y (2018) Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. Learning, arXiv

  24. Li T, Zhang J, Bao K, Liang Y, Li Y, Zheng Y (2020) Autost: Efficient neural architecture search for spatio-temporal prediction. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining

  25. Li P, Wang X, Gao H, Xu X, Iqbal M, Dahal K (2021) A dynamic and scalable user-centric route planning algorithm based on polychromatic sets theory. IEEE Transactions on Intelligent Transportation Systems, pp 1–11

  26. Liebig T, Piatkowski N, Bockermann C (2017) Dynamic route planning with real-time traffic predictions. Inf Syst 64:258–265

    Article  Google Scholar 

  27. Lin, Z., Feng, J., Lu, Z., Li, Y., & Jin, D. (2019). Deepstn+: context-aware spatial-temporal neural network for crowd flow prediction in metropolis. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 1020–1027

  28. Lin K, Xu X, Gao H (2021) Tscrnn: A novel classification scheme of encrypted traffic based on flow spatiotemporal features for efficient management of iiot. Comput Netw 190:107974

    Article  Google Scholar 

  29. Lippi M, Bertini M, Frasconi P (2013) Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning. IEEE Trans Intell Transp Syst 14:871–882

    Article  Google Scholar 

  30. Luo H, Huang M, Zhou Z (2019) A dual-tree complex wavelet enhanced convolutional lstm neural network for structural health monitoring of automotive suspension. Measurement 137:14–27

    Article  Google Scholar 

  31. Ma, X., Zhuang, D., He, Z., Ma, J., & Wang, Y. (2017). Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction. Sensors, 17(4), 818.

  32. Moreno SR, da Silva RG, Mariani V, Coelho L (2020) Multi-step wind speed forecasting based on hybrid multi-stage decomposition model and long short-term memory neural network. Energy Convers Manag 213:112869

    Article  Google Scholar 

  33. Ribeiro, M.H., & Coelho, L.D. (2020). Ensemble approach based on bagging, boosting and stacking for short-term prediction in agribusiness time series. Appl. Soft Comput., 105837,86.

  34. Ribeiro GT, Mariani V, Coelho L (2019) Enhanced ensemble structures using wavelet neural networks applied to short-term load forecasting. Eng Appl Artif Intell 82:272–281

    Article  Google Scholar 

  35. Rong L, Cheng H, Wang J (2017) Taxi call prediction for online taxicab platforms. In: APWeb/WAIM Workshops

  36. Shi X, Chen Z, Wang H, Yeung D, Wong W, Woo W (2015) Convolutional lstm network: A machine learning approach for precipitation nowcasting. In: NIPS

  37. Srivastava N, Hinton GE, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958

    MathSciNet  MATH  Google Scholar 

  38. Tian C, Chan WK (2021) Spatial-temporal attention wavenet: A deep learning framework for traffic prediction considering spatial-temporal dependencies. IET Intell Transp Syst 15:549–561

    Article  Google Scholar 

  39. Wang F, Xuan Z, Zhen Z, Li K, Wang T, Shi M (2020) A day-ahead pv power forecasting method based on lstm-rnn model and time correlation modification under partial daily pattern prediction framework. Energy Convers Manag 212:112766

    Article  Google Scholar 

  40. Wang J, Zhu W, Sun Y, Tian C (2020b) An effective dynamic spatiotemporal framework with multi-source information for traffic prediction. ArXiv abs/2005.05128

  41. Wu W, Xia Y, Jin W (2021) Predicting bus passenger flow and prioritizing influential factors using multi-source data: Scaled stacking gradient boosting decision trees. IEEE Trans Intell Transp Syst 22:2510–2523

    Article  Google Scholar 

  42. XiaoMing S, Qi H, Shen Y, Wu G, Yin B (2020) A spatial-temporal attention approach for traffic prediction. IEEE Transactions on Intelligent Transportation Systems pp 1–10

  43. Yang H, Li X, Qiang W, Zhao Y, Zhang W, Tang C (2021) A network traffic forecasting method based on sa optimized arima-bp neural network. Comput Netw 193:108102

    Article  Google Scholar 

  44. Yao H, Wu F, Ke J, Tang X, Jia Y, Lu S, Gong P, Ye J, Li Z (2018) Deep multi-view spatial-temporal network for taxi demand prediction. In: AAAI

  45. Yao H, Tang X, Wei H, Zheng G, Li Z (2019) Revisiting spatial-temporal similarity: A deep learning framework for traffic prediction. In: AAAI

  46. Young P, Shellswell S (1972) Time series analysis, forecasting and control. IEEE Trans Autom Control 17:281–283

    Article  Google Scholar 

  47. Yu R, Li Y, Shahabi C, Demiryurek U, Liu Y (2017) Deep learning: A generic approach for extreme condition traffic forecasting. In: SDM

  48. Zhang J, Zheng Y, Qi D, Li R, Yi X (2016) Dnn-based prediction model for spatio-temporal data. Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems

  49. Zhang J, Zheng Y, Qi D (2017) Deep spatio-temporal residual networks for citywide crowd flows prediction. In: AAAI

  50. Zhang J, Zheng Y, Sun J, Qi D (2020) Flow prediction in spatio-temporal networks based on multitask deep learning. IEEE Trans Knowl Data Eng 32:468–478

    Article  Google Scholar 

  51. Zhang J, Chen F, Guo Y (2020) Multi-graph convolutional network for shortterm passenger flow forecasting in urban rail transit. Physics and Society, arXiv

  52. Zhang S, Chen Y, Zhang W (2021) Spatiotemporal fuzzy-graph convolutional network model with dynamic feature encoding for traffic forecasting. Knowl-Based Syst 231:107403

    Article  Google Scholar 

  53. Zhao L, Song Y, Zhang C, Liu Y, Wang P, Lin T, Deng M, Li H (2020) T- gcn: A temporal graph convolutional network for traffic prediction. IEEE Trans Intell Transp Syst 21:3848–3858

    Article  Google Scholar 

  54. Zheng C, Fan X, Wang C, Qi J (2020) Gman: A graph multi-attention network for traffic prediction. In: AAAI

  55. Zonoozi A, Kim J, Li X, Cong G (2018) Periodic-crn: A convolutional recurrent model for crowd density prediction with recurring periodic patterns. In: IJCAI

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China(No.62062033) and the Science and Technology Research Project of the Education Department of Jiangxi Province (200604) and the Natural Science Foundation of Jiangxi Province under Grant No.20192ACBL21006 and the Key Research & Development Plan of Jiangxi Province No.20203BBE53034.

Author information

Authors and Affiliations

  1. School of Information Engineering Department, East China Jiaotong University, Nanchang, 330013, China

    Hui Zeng, Zhiying Peng, XiaoHui Huang, Yixue Yang & Rong Hu

Authors
  1. Hui Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiying Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. XiaoHui Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yixue Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rong Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiying Peng.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zeng, H., Peng, Z., Huang, X. et al. Deep spatio-temporal neural network based on interactive attention for traffic flow prediction. Appl Intell 52, 10285–10296 (2022). https://doi.org/10.1007/s10489-021-02879-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02879-1

Keywords

Search

Navigation