Skip to main content
Springer Nature Link
Log in

Attentive graph structure learning embedded in deep spatial-temporal graph neural network for traffic forecasting

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

A smooth traffic flow is very crucial for an intelligent traffic system. Consequently, traffic forecasting is critical in achieving unwrinkled traffic flow. However, due to its spatial and temporal interdependence, traffic forecasting might be more difficult. Graph neural networks (GNN) are widely used to obtain traffic forecasting due to their capability to operate in non-Euclidean data. The topological connection of the traffic network plays a crucial role in graph structure learning. Therefore, the importance of the adjacency matrix in graph construction might be significant for effective traffic forecasting. As a result, for efficient graph construction, a Deep Spatial-Temporal Graph Neural Network (DSTGNN) is proposed for the construction of the weighted adjacency matrix and traffic speed prediction accurately by recording topological and temporal information. Three different weighted adjacency matrices are suggested depending on three different proposed algorithms for different variations of traffic’s spatial condition. The new adjacency matrix is used in a novel DSTGNN for predicting the traffic state. The novel model comprised multiple layers with skip connections to adequately extract the variation of temporal and spatial information. DSTGNN outperforms the standard and other graph neural network models on four traffic speed datasets, SZ-taxi, Los-loop, PeMSD7, and METR-LA.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Algorithm 2
Fig. 5
Algorithm 3
Fig. 6
Fig. 7
Fig. 8
Algorithm 4
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

All data included in this study are available in the https://github.com/pritamBikram/Traffic_Dataset.

References

  1. Wang M, Wu L, Li M, Wu D, Shi X, Ma C (2022) Meta-learning based spatial-temporal graph attention network for traffic signal control. Knowl-Based Syst 250:109166

    Google Scholar 

  2. Liu P, Hendalianpour A, Feylizadeh M, Pedrycz W (2022) Mathematical modeling of vehicle routing problem in omni-channel retailing. Appl Soft Comput 131:109791

    Google Scholar 

  3. Kumar A, Sato Y, Oishi T, Ono S, Ikeuchi K (2014) Improving gps position accuracy by identification of reflected gps signals using range data for modeling of urban structures. Seisan Kenkyu 66(2):101–107

    Google Scholar 

  4. Kumar A, Banno A, Ono S, Oishi T, Ikeuchi K (2013) Global coordinate adjustment of the 3d survey models under unstable gps condition. Seisan Kenkyu 65(2):91–95

    Google Scholar 

  5. Zhang W, Zhu K, Zhang S, Chen Q, Xu J (2022) Dynamic graph convolutional networks based on spatiotemporal data embedding for traffic flow forecasting. Knowl-Based Syst 250:109028

    Google Scholar 

  6. Park D, Rilett LR (1999) Forecasting freeway link travel times with a multilayer feedforward neural network. Comput Aided Civ Infrastruct Eng 14(5):357–367

    Google Scholar 

  7. Vlahogianni EI, Karlaftis MG, Golias JC (2014) Short-term traffic forecasting: where we are and where we’re going. Transp Res Part C Emerg Technol 43:3–19

    Google Scholar 

  8. Ma X, Tao Z, Wang Y, Yu H, Wang Y (2015) Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transp Res Part C Emerg Technol 54:187–197

    Google Scholar 

  9. Ma X, Dai Z, He Z, Ma J, Wang Y, Wang Y (2017) Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction. Sensors 17(4):818

    PubMed  PubMed Central  ADS  Google Scholar 

  10. Khaled A, Elsir AMT, Shen Y (2022) Tfgan: traffic forecasting using generative adversarial network with multi-graph convolutional network. Knowl-Based Syst 249:108990

    Google Scholar 

  11. Smola AJ, Schölkopf B (2004) A tutorial on support vector regression. Stat Comput 14(3):199–222

    MathSciNet  Google Scholar 

  12. Han X, Zhu X, Pedrycz W, Li Z (2023) A three-way classification with fuzzy decision trees. Appl Soft Comput 132:109788

    Google Scholar 

  13. Hamed MM, Al-Masaeid HR, Said ZMB (1995) Short-term prediction of traffic volume in urban arterials. J Transp Eng 121(3):249–254

    Google Scholar 

  14. Lv Y, Duan Y, Kang W, Li Z, Wang F-Y (2014) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16(2):865–873

    Google Scholar 

  15. Huang W, Song G, Hong H, Xie K (2014) Deep architecture for traffic flow prediction: deep belief networks with multitask learning. IEEE Trans Intell Transp Syst 15(5):2191–2201

    Google Scholar 

  16. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780

    CAS  PubMed  Google Scholar 

  17. Chen T, Xu R, He Y, Xia Y, Wang X (2016) Learning user and product distributed representations using a sequence model for sentiment analysis. IEEE Comput Intell Mag 11(3):34–44

    CAS  Google Scholar 

  18. Yu H, Wu Z, Wang S, Wang Y, Ma X (2017) Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 17(7):1501

    PubMed  PubMed Central  ADS  Google Scholar 

  19. Cui Z, Henrickson K, Ke R, Wang Y (2019) Traffic graph convolutional recurrent neural network: a deep learning framework for network-scale traffic learning and forecasting. IEEE Trans Intell Transp Syst 21(11):4883–4894

    Google Scholar 

  20. Zhao L, Song Y, Zhang C, Liu Y, Wang P, Lin T, Deng M, Li H (2019) T-gcn: a temporal graph convolutional network for traffic prediction. IEEE Trans Intell Transp Syst 21(9):3848–3858

    Google Scholar 

  21. Han Y, Zhao S, Deng H, Jia W (2023) Principal graph embedding convolutional recurrent network for traffic flow prediction. Appl Intell, 1–15

  22. Cui Z, Ke R, Pu Z, Ma X, Wang Y (2020) Learning traffic as a graph: a gated graph wavelet recurrent neural network for network-scale traffic prediction. Transp Res Part C Emerg Technol 115:102620

    Google Scholar 

  23. Liang J, Tang J, Gao F, Wang Z, Huang H (2023) On region-level travel demand forecasting using multi-task adaptive graph attention network. Inf Sci 622:161–177

    Google Scholar 

  24. Polson NG, Sokolov VO (2017) Deep learning for short-term traffic flow prediction. Transp Res Part C Emerg Technol 79:1–17

    Google Scholar 

  25. Kong F, Li J, Jiang B, Song H (2019) Short-term traffic flow prediction in smart multimedia system for internet of vehicles based on deep belief network. Futur Gener Comput Syst 93:460–472

    Google Scholar 

  26. Ma X, Tao Z, Wang Y, Yu H, Wang Y (2015) Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transp Res Part C Emerg Technol 54:187–197

    Google Scholar 

  27. Rajeh TM, Li T, Li C, Javed MH, Luo Z, Alhaek F (2023) Modeling multi-regional temporal correlation with gated recurrent unit and multiple linear regression for urban traffic flow prediction. Knowl-Based Syst 262:110237

    Google Scholar 

  28. Pham P, Nguyen LT, Nguyen N-T, Pedrycz W, Yun U, Lin JC-W, Vo B (2023) An approach to semantic-aware heterogeneous network embedding for recommender systems. IEEE Trans Cybern

  29. He R, Liu Y, Xiao Y, Lu X, Zhang S (2022) Deep spatio-temporal 3d densenet with multiscale convlstm-resnet network for citywide traffic flow forecasting. Knowl-Based Syst 250:109054

    Google Scholar 

  30. Shepelev V, Slobodin I, Almetova Z, Nevolin D, Shvecov A (2023) A hybrid traffic forecasting model for urban environments based on convolutional and recurrent neural networks. Transp Res Procedia 68:441–446

    Google Scholar 

  31. Liu Z, Li D, Ge SS, Tian F (2020) Small traffic sign detection from large image. Appl Intell 50:1–13

    CAS  Google Scholar 

  32. He Y, Li L, Zhu X, Tsui KL (2022) Multi-graph convolutional-recurrent neural network (mgc-rnn) for short-term forecasting of transit passenger flow. IEEE Trans Intell Transp Syst 23(10):18155–18174

    Google Scholar 

  33. Cao S, Wu L, Wu J, Wu D, Li Q (2022) A spatio-temporal sequence-to-sequence network for traffic flow prediction. Inf Sci 610:185–203

    Google Scholar 

  34. Li Z, Zhang Y, Guo D, Zhou X, Wang X, Zhu L (2023) Long-term traffic forecasting based on adaptive graph cross strided convolution network. Appl Intell 53(4):3672–3686

    Google Scholar 

  35. Li H, Yang S, Song Y, Luo Y, Li J, Zhou T (2022) Spatial dynamic graph convolutional network for traffic flow forecasting. Appl Intell, 1–13

  36. Kong X, Wei X, Zhang J, Xing W, Lu W (2022) Jointgraph: joint pre-training framework for traffic forecasting with spatial-temporal gating diffusion graph attention network. Appl Intell, 1–18

  37. Zhao C, Chang X, Xie T, Fujita H, Wu J (2023) Unsupervised anomaly detection based method of risk evaluation for road traffic accident. Appl Intell 53(1):369–384

    Google Scholar 

  38. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv:1609.02907

  39. Bui K-HN, Cho J, Yi H (2022) Spatial-temporal graph neural network for traffic forecasting: an overview and open research issues. Appl Intell 52(3):2763–2774

    Google Scholar 

  40. Liu J, Kang Y, Li H, Wang H, Yang X (2022) Stghtn: Spatial-temporal gated hybrid transformer network for traffic flow forecasting. Appl Intell, 1–17

  41. Wang X, Wang Y, Peng J, Zhang Z, Tang X (2022) A hybrid framework for multivariate long-sequence time series forecasting. Appl Intell, 1–20

  42. Zhang Y, Yang Y, Zhou W, Wang H, Ouyang X (2021) Multi-city traffic flow forecasting via multi-task learning. Appl Intell, 1–19

  43. Xu Y, Cai X, Wang E, Liu W, Yang Y, Yang F (2023) Dynamic traffic correlations based spatio-temporal graph convolutional network for urban traffic prediction. Inf Sci 621:580–595

    Google Scholar 

  44. Qiu Z, Zhu T, Jin Y, Sun L, Du B (2023) A graph attention fusion network for event-driven traffic speed prediction. Inf Sci 622:405–423

    Google Scholar 

  45. Kong X, Zhang J, Wei X, Xing W, Lu W (2022) Adaptive spatial-temporal graph attention networks for traffic flow forecasting. Appl Intell, 1–17

  46. Huisman M, Van Rijn JN, Plaat A (2021) A survey of deep meta-learning. Artif Intell Rev 54(6):4483–4541

    Google Scholar 

  47. Zhang C-Y, Cai H-C, Chen CP, Lin Y-N, Fang W-P (2023) Graph representation learning with adaptive metric. IEEE Trans Netw Sci Eng

  48. Zhang X, Song D, Tao D (2023) Ricci curvature-based graph sparsification for continual graph representation learning. IEEE Trans Neural Netw Learn Syst

  49. Yuan J, Cao M, Cheng H, Yu H, Xie J, Wang C (2022) A unified structure learning framework for graph attention networks. Neurocomputing 495:194–204

    Google Scholar 

  50. Guo T, Hou F, Pang Y, Jia X, Wang Z, Wang R (2023) Learning and integration of adaptive hybrid graph structures for multivariate time series forecasting. Inf Sci 119560

  51. Peng C, Hou X, Chen Y, Kang Z, Chen C, Cheng Q (2023) Global and local similarity learning in multi-kernel space for nonnegative matrix factorization. Knowl-Based Syst 110946

  52. Ta X, Liu Z, Hu X, Yu L, Sun L, Du B (2022) Adaptive spatio-temporal graph neural network for traffic forecasting. Knowl-Based Syst 242:108199

    Google Scholar 

  53. Gama F, Bruna J, Ribeiro A (2020) Stability properties of graph neural networks. Trans Signal Process 68:5680–5695

  54. Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. Adv Neural Inf Process 29

  55. Tariq M, Ali M, Naeem F, Poor HV (2020) Vulnerability assessment of 6g-enabled smart grid cyber-physical systems. IEEE Internet Things J 8(7):5468–5475

    Google Scholar 

  56. Ali M, Adnan M, Tariq M, Poor HV (2020) Load forecasting through estimated parametrized based fuzzy inference system in smart grids. IEEE Trans Fuzzy Syst 29(1):156–165

    Google Scholar 

  57. Wang A, Ye Y, Song X, Zhang S, James J (2023) Traffic prediction with missing data: a multi-task learning approach. IEEE Trans Intell Transp Syst 24(4):4189–4202

    Google Scholar 

  58. Chauhan S, Singh M, Aggarwal AK (2023) Investigative analysis of different mutation on diversity-driven multi-parent evolutionary algorithm and its application in area coverage optimization of wsn. Soft Comput 1–27

  59. Chauhan S, Singh M, Aggarwal AK (2023) Designing of optimal digital iir filter in the multi-objective framework using an evolutionary algorithm. Eng Appl Artif Intell 119:105803

    Google Scholar 

  60. Liu J, Guan W (2004) A summary of traffic flow forecasting methods. J Highway Transp Res Dev 21(3):82–85

    MathSciNet  Google Scholar 

  61. Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. Adv Neural Inf Process 27

  62. Wei Z, Zhao H, Li Z, Bu X, Chen Y, Zhang X, Lv Y, Wang F-Y (2023) Stgsa: a novel spatial-temporal graph synchronous aggregation model for traffic prediction. IEEE/CAA J Autom Sin 10(1):226–238

    Google Scholar 

  63. Kumar R, Mendes Moreira J, Chandra J (2023) Dygcn-lstm: a dynamic gcn-lstm based encoder-decoder framework for multistep traffic prediction. Appl Intell 1–24

  64. Liu S, Feng X, Ren Y, Jiang H, Yu H (2023) Dcenet: A dynamic correlation evolve network for short-term traffic prediction. Phys A Stat Mech Appl 614:128525

    Google Scholar 

  65. Zhu J, Wang Q, Tao C, Deng H, Zhao L, Li H (2021) Ast-gcn: Attribute-augmented spatiotemporal graph convolutional network for traffic forecasting. IEEE Access 9:35973–35983

    Google Scholar 

  66. Huang J, Luo K, Cao L, Wen Y, Zhong S (2022) Learning multiaspect traffic couplings by multirelational graph attention networks for traffic prediction. IEEE Trans Intell Transp Syst 23(11):20681–20695

    Google Scholar 

  67. Li Z, Xiong G, Tian Y, Lv Y, Chen Y, Hui P, Su X (2020) A multi-stream feature fusion approach for traffic prediction. EEE Trans Intell Transp Syst 23(2):1456–1466

    Google Scholar 

  68. Bai L, Yao L, Li C, Wang X, Wang C (2020) Adaptive graph convolutional recurrent network for traffic forecasting. Adv Neural Inf Process 33:17804–17815

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, Indian Institute of Engineering Science and Technology, Shibpur, Botanic Garden, Howrah, 711103, West Bengal, India

    Pritam Bikram, Shubhajyoti Das & Arindam Biswas

Authors
  1. Pritam Bikram
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Shubhajyoti Das
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Arindam Biswas
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Pritam Bikram and Shubhajyoti Das contributed to the idea of this paper; Pritam Bikram performed the experiments; All authors analyzed data; Pritam Bikram wrote the manuscript; Shubhajyoti Das and Arindam Biswas contributed to the revision of this paper.

Corresponding author

Correspondence to Pritam Bikram.

Ethics declarations

Ethics standard

This article does not contain any studies with human participants or animals performed by any of the authors.

Conflict of Interests

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bikram, P., Das, S. & Biswas, A. Attentive graph structure learning embedded in deep spatial-temporal graph neural network for traffic forecasting. Appl Intell 54, 2716–2749 (2024). https://doi.org/10.1007/s10489-024-05291-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05291-7

Keywords