Abstract
Accurate traffic forecasting is pivotal for an efficient data-driven transportation system. The intricate nature of spatial-temporal dependencies and non-linearity present in traffic data has posed a significant challenge to the modeling of accurate traffic forecasting systems. Lately, there has been a significant effort to develop complex Spatial-Temporal Graph Neural Networks (STGNN) that predominantly utilize various Graph Neural Networks (GNN) and attention-based encoder-decoder architectures due to their ability to capture non-linear dependencies in spatial and temporal domains effectively. However, conventional GNNs limit explicit propagation of past information among nodes, while attention-based models such as transformers do not support finer-grained attention score distribution. In this study, we address the aforementioned issues and introduce a novel STGNN namely, Spatio-Temporal Bipartite Graph Attention Network (STBGAT) that allows explicit modeling of past information propagation among nodes. Further, we present a heterogeneous cross-attention mechanism in a transformer to compute finer-grained feature-wise attention distribution enabling the model to capture richer and more expressive temporal dependencies. Our experiments reveal that the proposed architecture outperforms the state-of-the-art approaches proposed in recent literature.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bai, L., Yao, L., Kanhere, S.S., Wang, X., Liu, W., Yang, Z.: Spatio-temporal graph convolutional and recurrent networks for citywide passenger demand prediction. In: Proceedings of the 28th ACM CIKM, pp. 2293–2296 (2019)
Chen, C., Petty, K., Skabardonis, A., Varaiya, P., Jia, Z.: Freeway performance measurement system: mining loop detector data. TRR 1748(1), 96–102 (2001)
Giorgino, T.: Computing and visualizing dynamic time warping alignments in r: the dtw package. J. Stat. Softw. 31, 1–24 (2009)
Guo, S., Lin, Y., Wan, H., Li, X., Cong, G.: Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE TKDE 34(11), 5415–5428 (2021)
He, H., Ye, K., Xu, C.Z.: Multi-feature urban traffic prediction based on unconstrained graph attention network. In: 2021 IEEE BigData, pp. 1409–1417 (2021)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Huang, R., Huang, C., Liu, Y., Dai, G., Kong, W.: Lsgcn: Long short-term traffic prediction with graph convolutional networks. In: IJCAI, vol. 7, pp. 2355–2361 (2020)
Jagadish, H.V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J.M., Ramakrishnan, R., Shahabi, C.: Big data and its technical challenges. Commun. ACM 57(7), 86–94 (2014)
Jiang, J., Han, C., Zhao, W.X., Wang, J.: Pdformer: propagation delay-aware dynamic long-range transformer for traffic flow prediction. arXiv preprint arXiv:2301.07945 (2023)
Johnson, D.B.: A note on dijkstra’s shortest path algorithm. JACM 20(3), 385–388 (1973)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Kong, X., Xing, W., Wei, X., Bao, P., Zhang, J., Lu, W.: Stgat: spatial-temporal graph attention networks for traffic flow forecasting. IEEE Access 8, 134363–134372 (2020)
Lablack, M., Shen, Y.: Spatio-temporal graph mixformer for traffic forecasting. Expert Syst. Appl. 228, 120281 (2023)
Li, W., Wang, X., Zhang, Y., Wu, Q.: Traffic flow prediction over muti-sensor data correlation with graph convolution network. Neurocomputing 427, 50–63 (2021)
Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 (2017)
Li, Y., Moura, J.M.: Forecaster: a graph transformer for forecasting spatial and time-dependent data. In: ECAI 2020, pp. 1293–1300. IOS Press (2020)
Lu, Z., Lv, W., Cao, Y., Xie, Z., Peng, H., Du, B.: Lstm variants meet graph neural networks for road speed prediction. Neurocomputing 400, 34–45 (2020)
Lütkepohl, H.: Vector autoregressive models. Handbook of research methods and applications in empirical macroeconomics 30 (2013)
Roy, A., Roy, K.K., Ali, A.A., Amin, M.A., Rahman, A.M.: Unified spatio-temporal modeling for traffic forecasting using graph neural network. In: 2021 IJCNN, pp. 1–8. IEEE (2021)
Shao, Z., Zhang, Z., Wang, F., Xu, Y.: Pre-training enhanced spatial-temporal graph neural network for multivariate time series forecasting. In: Proc. 28th ACM SIGKDD Conf. Know. Disc. Data Min., pp. 1567–1577 (2022)
Tian, Y., Zhang, K., Li, J., Lin, X., Yang, B.: Lstm-based traffic flow prediction with missing data. Neurocomputing 318, 297–305 (2018)
Vaswani, A., et al.: Attention is all you need. Adv. NIPS 30 (2017)
Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y., et al.: Graph attention networks. Stat 1050(20), 10–48550 (2017)
Wang, X., et al.: Traffic flow prediction via spatial temporal graph neural network. In: Proc. web conf. 2020, pp. 1082–1092 (2020)
Williams, B.M., Hoel, L.A.: Modeling and forecasting vehicular traffic flow as a seasonal arima process: theoretical basis and empirical results. J. Trans. Eng. 129(6), 664–672 (2003)
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks. IEEE TNNLS 32(1), 4–24 (2020)
Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting
Yu, H., Wu, Z., Wang, S., Wang, Y., Ma, X.: Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 17(7), 1501 (2017)
Zheng, C., Fan, X., Wang, C., Qi, J.: Gman: a graph multi-attention network for traffic prediction. In: Proc. of the AAAI Conf. on Art. Intell., vol. 34, pp. 1234–1241 (2020)
Acknowledgements
This research was supported by The University of Melbourne’s Research Computing Services and the Petascale Campus Initiative.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lakmal, D., Perera, K., Borovica-Gajic, R., Karunasekera, S. (2024). Spatial-Temporal Bipartite Graph Attention Network for Traffic Forecasting. In: Yang, DN., Xie, X., Tseng, V.S., Pei, J., Huang, JW., Lin, J.CW. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2024. Lecture Notes in Computer Science(), vol 14646. Springer, Singapore. https://doi.org/10.1007/978-981-97-2253-2_6
Download citation
DOI: https://doi.org/10.1007/978-981-97-2253-2_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2252-5
Online ISBN: 978-981-97-2253-2
eBook Packages: Computer ScienceComputer Science (R0)