Abstract
Traffic flow forecasting is a typical multivariate time series problem that has applications in intelligent transportation systems. It requires the modeling of complicated spatial-temporal dependencies and essential uncertainty regarding a road network and traffic conditions. Recently, some studies have improved their models without prespecified graphs by constructing adaptive matrices or learnable node embedding dictionaries; however, they omitted the semantic correlations among distant regions. In this paper, we propose an adaptive generalized PageRank graph neural network (AGP-GNN) for traffic flow forecasting, which jointly models spatial, temporal, and semantic correlations to adaptively generate hidden graph structures. Specifically, the AGP-GNN mainly includes two key components: 1) an adaptive generalized PageRank (AGP) layer, which dynamically assigns different edge weights to reflect the different correlations between the pairwise nodes; and 2) a relative position-based temporal attention (RPTA) layer, which models the complex correlations among different time steps. Moreover, we design a distance and temporal encoding (DTE) approach to incorporate geographic and temporal information. Experimental results obtained on two real-world datasets demonstrate the effectiveness of the AGP-GNN.
Graphical abstract








Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets generated during and/or analysed during the current study are available in the agp-gnn (public github repository), https://github.com/guoxiaoyuatbjtu/agp-gnn.
References
Ma X, Tao Z, Wang Y, Yu H, Wang Y (2015) Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transp Res Part C Emerg Technol 54:187–197. https://doi.org/10.1016/j.trc.2015.03.014
Zhang J, Zheng Y, Qi D (2017) Deep spatio-temporal residual networks for citywide crowd flows prediction 31(1). https://doi.org/10.1609/aaai.v31i1.10735
Wang S, Cao J, Yu PS (2022) Deep learning for spatio-temporal data mining: a survey. IEEE Trans Knowl Data Eng 34(8):3681–3700. https://doi.org/10.1109/TKDE.2020.3025580
Salinas D, Flunkert V, Gasthaus J, Januschowski T (2020) Deepar: probabilistic forecasting with autoregressive recurrent networks. Int J Forecast 36(3):1181–1191. https://doi.org/10.1016/j.ijforecast.2019.07.001
Wu Z, Pan S, Long G, Jiang J, Zhang C (2019) Graph wavenet for deep spatial-temporal graph modeling. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI-19, pp 1907–1913. https://doi.org/10.24963/ijcai.2019/264
Yu B, Yin H, Zhu Z (2018) Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI-18, pp 3634–3640. https://doi.org/10.24963/ijcai.2018/505
Zheng Z, Zhang Z, Wang L, Luo X (2022) Denoising temporal convolutional recurrent autoencoders for time series classification. Inf Sci 588:159–173. https://doi.org/10.1016/j.ins.2021.12.061
Zheng C, Fan X, Wang C, Qi J (2020) Gman: a graph multi-attention network for traffic prediction. Proc AAAI Conf Artif Intell 34(01):1234–1241. https://doi.org/10.1609/aaai.v34i01.5477
Geng X, Li Y, Wang L, Zhang L, Yang Q, Ye J, Liu Y (2019) Spatiotemporal multi-graph convolution network for ride-hailing demand forecasting. Proc AAAI Conf Artif Intell 33(01):3656–3663. https://doi.org/10.1609/aaai.v33i01.33013656
Oreshkin BN, Amini A, Coyle L, Coates M (2021) Fc-gaga: fully connected gated graph architecture for spatio-temporal traffic forecasting. Proc AAAI Conf Artif Intell 35:9233–9241. https://doi.org/10.1609/aaai.v35i10.17114
Bai L, Yao L, Kanhere SS, Wang X, Sheng QZ (2019) Stg2seq: spatial-temporal graph to sequence model for multi-step passenger demand forecasting. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI-19, pp 1981–1987. https://doi.org/10.24963/ijcai.2019/274
Bai L, Yao L, Li C, Wang X, Wang C (2020) Adaptive graph convolutional recurrent network for traffic forecasting. Adv Neural Inf Process Syst 33:17804–17815
Kumar A, Jain DK, Mallik A, Kumar S (2024) Modified node2vec and attention based fusion framework for next poi recommendation. Inf Fusion 101:101998. https://doi.org/10.1016/j.inffus.2023.101998
Ribeiro LFR, Saverese PHP, Figueiredo DR (2017) struc2vec: learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, Halifax, NS, Canada, August 13 - 17, 2017, pp 385–394. https://doi.org/10.1145/3097983.3098061
Chien E, Peng J, Li P, Milenkovic O (2021) Adaptive universal generalized pagerank graph neural network. In: International conference on learning representations
Gao H, Xiao J, Yin Y, Liu T, Shi J (2022) A mutually supervised graph attention network for few-shot segmentation: the perspective of fully utilizing limited samples. IEEE Trans Neural Netw Learn Syst, pp 1–13. https://doi.org/10.1109/TNNLS.2022.3155486
Sperduti A, Starita A (1997) Supervised neural networks for the classification of structures. IEEE Trans Neural Netw 8(3):714–735. https://doi.org/10.1109/72.572108
Gao H, Qiu B, Duran Barroso RJ, Hussain W, Xu Y, Wang X (2022) Tsmae: a novel anomaly detection approach for internet of things time series data using memory-augmented autoencoder. IEEE Trans Netw Sci Eng 1–1. https://doi.org/10.1109/TNSE.2022.3163144
Yu JJQ, Gu J (2019) Real-time traffic speed estimation with graph convolutional generative autoencoder. IEEE Trans Intell Trans Syst 20(10):3940–3951. https://doi.org/10.1109/TITS.2019.2910560
Li Y, Yu R, Shahabi C, Liu Y (2018) Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In: International conference on learning representations
Kong X, Xing W, Wei X, Bao P, Zhang J, Lu W (2020) Stgat: spatial-temporal graph attention networks for traffic flow forecasting. IEEE Access 8:134363–134372. https://doi.org/10.1109/ACCESS.2020.3011186
Guo G, Yuan W (2020) Short-term traffic speed forecasting based on graph attention temporal convolutional networks. Neurocomputing 410:387–393. https://doi.org/10.1016/j.neucom.2020.06.001
Kamarianakis Y, Prastacos P (2003) Forecasting traffic flow conditions in an urban network: comparison of multivariate and univariate approaches. Transp Res Rec 1857(1):74–84. https://doi.org/10.3141/1857-09
Min W, Wynter L (2011) Real-time road traffic prediction with spatio-temporal correlations. Transp Res Part C Emerg Technol 19(4):606–616. https://doi.org/10.1016/j.trc.2010.10.002
Zhang J, Shi X, Xie J, Ma H, King I, Yeung D (2018) Gaan: gated attention networks for learning on large and spatiotemporal graphs. In: Proceedings of the thirty-fourth conference on uncertainty in artificial intelligence, UAI 2018, Monterey, California, USA, August 6-10, 2018, pp 339–349
Guo S, Lin Y, Feng N, Song C, Wan H (2019) Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. Proc AAAI Conf Artif Intell 33(01):922–929. https://doi.org/10.1609/aaai.v33i01.3301922
Chen W, Chen L, Xie Y, Cao W, Gao Y, Feng X (2020) Multi-range attentive bicomponent graph convolutional network for traffic forecasting. Proc AAAI Conf Artif Intell 34(04):3529–3536. https://doi.org/10.1609/aaai.v34i04.5758
Park C, Lee C, Bahng H, Tae Y, Jin S, Kim K, Ko S, Choo J (2020) St-grat: a novel spatio-temporal graph attention networks for accurately forecasting dynamically changing road speed. In: Proceedings of the 29th ACM international conference on information & knowledge management. CIKM ’20. Association for Computing Machinery, New York, pp 1215–1224. https://doi.org/10.1145/3340531.3411940
Li M, Zhu Z (2021) Spatial-temporal fusion graph neural networks for traffic flow forecasting. Proc AAAI Conf Artif Intell 35(5):4189–4196. https://doi.org/10.1609/aaai.v35i5.16542
Wu Z, Pan S, Long G, Jiang J, Chang X, Zhang C (2020) Connecting the dots: multivariate time series forecasting with graph neural networks. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. KDD ’20. Association for Computing Machinery, New York, pp 753–763. https://doi.org/10.1145/3394486.3403118
Diao Z, Wang X, Zhang D, Liu Y, Xie K, He S (2019) Dynamic spatial-temporal graph convolutional neural networks for traffic forecasting. Proc AAAI Conf Artif Intell 33(01):890–897. https://doi.org/10.1609/aaai.v33i01.3301890
Li P, Wang Y, Wang H, Leskovec J (2020) Distance encoding: design provably more powerful neural networks for graph representation learning. Adv Neural Inf Process Syst 33:4465–4478
Boeing G (2017) Osmnx: new methods for acquiring, constructing, analyzing, and visualizing complex street networks. Comput Environ Urban Syst 65:126–139. https://doi.org/10.1016/j.compenvurbsys.2017.05.004
Haklay M, Weber P (2008) Openstreetmap: user-generated street maps. IEEE Pervasive Comput 7(4):12–18. https://doi.org/10.1109/MPRV.2008.80
Ahmed S, Nielsen IE, Tripathi A, Siddiqui S, Ramachandran RP, Rasool G (2023) Transformers in time-series analysis: a tutorial. Circuits Syst Signal Process 1–34. https://doi.org/10.1007/s00034-023-02454-8
Gao H, Wu , Xu Y, Li R, Jiang Z (2023) Neural collaborative learning for user preference discovery from biased behavior sequences. IEEE Trans Comput Soc Syst 1–11. https://doi.org/10.1109/TCSS.2023.3268682
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Lu, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, vol 30
Shaw P, Uszkoreit J, Vaswani A (2018) Self-attention with relative position representations. In: Proceedings of the 2018 conference of the north american chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, New Orleans, vol 2 (Short Papers), pp 464–468. https://doi.org/10.18653/v1/N18-2074
Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Advances in neural information processing systems, vol 27
Pan Z, Liang Y, Wang W, Yu Y, Zheng Y, Zhang J (2019) Urban traffic prediction from spatio-temporal data using deep meta learning. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. KDD ’19. Association for Computing Machinery, New York, pp 1720–1730. https://doi.org/10.1145/3292500.3330884
Deng J, Chen X, Jiang R, Song X, Tsang IW (2021) St-norm: spatial and temporal normalization for multi-variate time series forecasting. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining. KDD ’21. Association for Computing Machinery, New York, pp 269–278. https://doi.org/10.1145/3447548.3467330
Li H, Yang S, Song Y, Luo Y, Li J, Zhou T (2022) Spatial dynamic graph convolutional network for traffic flow forecasting. Appl Intell 53(12):14986–14998. https://doi.org/10.1007/s10489-022-04271-z
Shao Z, Zhang Z, Wang F, Wei W, Xu Y (2022) Spatial-temporal identity: a simple yet effective baseline for multivariate time series forecasting. In: Proceedings of the 31st ACM international conference on information & knowledge management. CIKM ’22. Association for Computing Machinery, New York, pp 4454–4458. https://doi.org/10.1145/3511808.3557702
Acknowledgements
The authors would like to thank the National Natural Science Foundation of China (61876018, 61906014, and 61876017) for their support in this research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Guo, X., Kong, X., Xing, W. et al. Adaptive graph generation based on generalized pagerank graph neural network for traffic flow forecasting. Appl Intell 53, 30971–30986 (2023). https://doi.org/10.1007/s10489-023-05137-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-023-05137-8