Abstract
Traffic forecasting plays an important role of modern Intelligent Transportation Systems (ITS). With the recent rapid advancement in deep learning, graph neural networks (GNNs) have become an emerging research issue for improving the traffic forecasting problem. Specifically, one of the main types of GNNs is the spatial-temporal GNN (ST-GNN), which has been applied to various time-series forecasting applications. This study aims to provide an overview of recent ST-GNN models for traffic forecasting. Particularly, we propose a new taxonomy of ST-GNN by dividing existing models into four approaches such as graph convolutional recurrent neural network, fully graph convolutional network, graph multi-attention network, and self-learning graph structure. Sequentially, we present experimental results based on the reconstruction of representative models using selected benchmark datasets to evaluate the main contributions of the key components in each type of ST-GNN. Finally, we discuss several open research issues for further investigations.
Similar content being viewed by others
References
Atwood J, Towsley D (2016) Diffusion-convolutional neural networks. In: Proceedings of the 29th annual conference on neural information processing systems (NeurIPS), pp 1993– 2001
Bronstein MM, Bruna J, LeCun Y, Szlam A, Vandergheynst P (2017) Geometric deep learning: Going beyond euclidean data. IEEE Signal Process Mag 34(4):18–42. https://doi.org/10.1109/MSP.2017.2693418
Bui KHN, Yi H, Cho J (2021) Uvds: a new dataset for traffic forecasting with spatial-temporal correlation. In: Proceedings of the 13th asian conference on intelligent information and database system (ACIIDS). Springer, pp 66–77
Bui KN, Jung JE, Camacho D (2017) Game theoretic approach on real-time decision making for iot-based traffic light control. Concurr Comput Pract Exp 29(11):e4077. https://doi.org/10.1002/cpe.4077
Bui KN, Oh H, Yi H (2020) Traffic density classification using sound datasets: an empirical study on traffic flow at asymmetric roads. IEEE Access 8:125,671–125,679. https://doi.org/10.1109/ACCESS.2020.3007917
Cao D, Wang Y, Duan J, Zhang C, Zhu X, Huang C, Tong Y, Xu B, Bai J, Tong J, Zhang Q (2020) Spectral temporal graph neural network formultivariate time-series forecasting. In: Proceedings of the 33rd annual conference on neural information processing systems (NeurIPS)
Cui Z, Henrickson K, Ke R, Wang Y (2020) Traffic graph convolutional recurrent neural network: A deep learning framework for network-scale traffic learning and forecasting. IEEE Trans Intell Trans Syst 21 (11):4883–4894. https://doi.org/10.1109/TITS.2019.2950416
Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: Proceedings of the 29th annual conference on neural information processing systems (NeurIPS), pp 3837–3845
Essien A, Giannetti C (2020) A deep learning model for smart manufacturing using convolutional LSTM neural network autoencoders. IEEE Trans Ind Inform 16(9):6069–6078. https://doi.org/10.1109/TII.2020.2967556
Feng D, Wu Z, Zhang J, Wu Z (2020) Dynamic global-local spatial-temporal network for traffic speed prediction. IEEE Access 8:209,296–209,307. https://doi.org/10.1109/ACCESS.2020.3038380
Guo S, Lin Y, Feng N, Song C, Wan H (2019) Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI). AAAI Press, pp 922–929
Hamilton WL, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Proceedings of the 30th annual conference on neural information processing systems (NeurIPS), pp 1024–1034
Khodabandelou G, Kheriji W, Hadj-selem F (2021) Link traffic speed forecasting using convolutional attention-based gated recurrent unit. Appl Intell 51(4):2331–2352. https://doi.org/10.1007/s10489-020-02020-8
Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th international conference on learning representation (ICLR). OpenReview.net
Li Y, Tarlow D, Brockschmidt M, Zemel RS (2016) Gated graph sequence neural networks. In: Proceedings of the 4th international conference on learning representation (ICLR). OpenReview.net
Li Y, Yu R, Shahabi C, Liu Y (2018) Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. In: Proceedings of the 6th international conference on learning representation (ICLR). OpenReview.net
Ma X, Dai Z, He Z, Ma J, Wang Y, Wang Y (2017) Learning traffic as images: A deep convolutional neural network for large-scale transportation network speed prediction. Sensors 17(4):818. https://doi.org/10.3390/s17040818
Merity S, Xiong C, Bradbury J, Socher R (2017) Pointer sentinel mixture models. In: Proceedings of the 5th international conference on learning representation (ICLR). OpenReview.net. https://openreview.net/forum?id=Byj72udxe
Oord AVD, Dieleman S, Zen H, Simonyan K, Vinyals O, Graves A, Kalchbrenner N, Senior AW, Kavukcuoglu K (2016) Wavenet: a generative model for raw audio. In: Proceedings of the 9th ISCA speech synthesis workshop(SSW), vol 125. ISCA
Pan Z, Zhang W, Liang Y, Zhang W, Yu Y, Zhang J, Zheng Y (2020) Spatio-temporal meta learning for urban traffic prediction. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2020.2995855. (Early Access)
Park C, Lee C, Bahng H, Tae Y, Jin S, Kim K, Ko S, Choo J (2020) ST-GRAT: A novel spatio-temporal graph attention networks for accurately forecasting dynamically changing road speed. In: Proceedings of the 29th ACM international conference on information and knowledge management (CIKM). ACM, pp 1215–1224
Shih S, Sun F, Lee H (2019) Temporal pattern attention for multivariate time series forecasting. Mach Learn 108(8-9):1421–1441. https://doi.org/10.1007/s10994-019-05815-0
Tanwi M, Prasanna B, Eric R, Jane M (2020) Graph-partitioning-based diffusion convolutional recurrent neural network for large-scale traffic forecasting. Transp Res Rec 2674(9):473–488
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Proceedings of the 30th annual conference on neural information processing systems (NeurIPS), pp 5998–6008
Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. In: Proceedings of the 6th international conference on learning representation (ICLR). OpenReview.net
Wang J, Zhu W, Sun Y, Tian C (2020) An effective dynamic spatiotemporal framework with external features information for traffic prediction. Appl Intell 1–15. https://doi.org/10.1007/s10489-020-02043-1
Wu F, Fan A, Baevski A, Dauphin YN, Auli M (2019) Pay less attention with lightweight and dynamic convolutions. In: Proceedings of the 7th international conference on learning representations (ICLR). OpenReview.net. https://openreview.net/forum?id=SkVhlh09tX
Wu Z, Pan S, Chen F, Long G, Zhang C, Yu PS (2021) A comprehensive survey on graph neural networks. IEEE Trans Neural Netw Learn Syst 32(1):4–24. https://doi.org/10.1109/TNNLS.2020.2978386
Wu Z, Pan S, Long G, Jiang J, Chang X, Zhang C (2020) Connecting the dots: Multivariate time series forecasting with graph neural networks. In: Proceedings of the 26th international conference on knowledge discovery & data mining (KDD). ACM, pp 753–763
Wu Z, Pan S, Long G, Jiang J, Zhang C (2019) Graph wavenet for deep spatial-temporal graph modeling. In: Proceedings of the 28th international joint conference on artificial intelligence (IJCAI), pp 1907–1913. ijcai.org
Yao H, Tang X, Wei H, Zheng G, Li Z (2019) Revisiting spatial-temporal similarity: A deep learning framework for traffic prediction. In: Proceedings of the 33rd AAAI conference on artificial intelligence (AAAI). AAAI Press, pp 5668–5675
Yi H, Bui KHN (2020) An automated hyperparameter search-based deep learning model for highway traffic prediction. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2020.2987614. (Early Access)
Yin X, Wu G, Wei J, Shen Y, Qi H, Yin B (2021) Deep learning on traffic prediction: Methods, analysis and future directions. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2021.3054840. (Early Access)
Yu B, Yin H, Zhu Z (2018) Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. In: Proceedings of the 27th international joint conference on artificial intelligence (IJCAI), pp 3634–364. ijcai.org0
Zhang C, Yu JJQ, Li Y (2019) Spatial-temporal graph attention networks: A deep learning approach for traffic forecasting. IEEE Access 7:166,246–166,256. https://doi.org/10.1109/ACCESS.2019.2953888
Zhang S, Tong H, Xu J, Maciejewski R (2019) Graph convolutional networks: A comprehensive review. Comput Soc Netw 6(11):1–23. https://doi.org/10.1186/s40649-019-0069-y
Zhao L, Zhou Y, Lu H, Fujita H (2019) Parallel computing method of deep belief networks and its application to traffic flow prediction. Knowl Based Syst 163:972–987. https://doi.org/10.1016/j.knosys.2018.10.025
Zheng C, Fan X, Wang C, Qi J (2020) GMAN: A graph multi-attention network for traffic prediction. In: Proceedings of the 34th AAAI conference on artificial intelligence (AAAI). AAAI Press, pp 1234–1241
Zhou J, Cui G, Zhang Z, Yang C, Liu Z, Sun M (2020) Graph neural networks: A review of methods and applications. AI Open 1:57–81. https://doi.org/10.1016/j.aiopen.2021.01.001
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was partly supported by Institute for Information & communications Technology Promotion(IITP) grant funded by the Korean Ministry of Science and ICT (MSIT) (No. 2018-0-00494, Development of deep learning-based urban traffic congestion prediction and signal control solution system) and Korea Institute of Science and Technology Information(KISTI) grant funded by the Korean Ministry of Science and ICT (MSIT) K-20-L02-C09-S01). Corresponding Author: Hongsuk Yi.
Rights and permissions
About this article
Cite this article
Bui, KH.N., Cho, J. & Yi, H. Spatial-temporal graph neural network for traffic forecasting: An overview and open research issues. Appl Intell 52, 2763–2774 (2022). https://doi.org/10.1007/s10489-021-02587-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02587-w