Abstract
Spatio-temporal graph data can be analyzed by effectively mining for realizing spatio-temporal graph data prediction. It is of great significance to predict spatio-temporal graph attribute features of future moments under different scenarios. However, the current research represent the spatio-temporal graph as a fixed graph structure in the learning process and cannot describe real dependencies in spatial feature learning, which has great limitations and cannot effectively capture the dynamic dependence of spatio-temporal graph data. Therefore, this paper proposes a Deep Spatio-Temporal Graph Node Attribute Prediction Model Based on Weighted Graph Diffusion Convolution Network, named DST-WDCN. Firstly, the graph adjacency matrix is defined based on both the explicit graph structure and the hidden semantic relationships. Secondly, a dynamic weighting learning method is introduced to dynamically weight the graph structure, which is incorporated into the gated diffusion convolution for dynamic spatial correlation extraction. Thirdly, a gated dilated causal convolution is proposed to extract temporal features to fully model temporal nonlinear dependencies. Finally, the spatio-temporal convolution blocks are stacked to effectively capture the spatio-temporal dynamic correlation and realize the attribute prediction of the spatio-temporal graph in the future time. Extensive experiments over three real-world data sets have shown our proposed model is superior to the benchmark model in terms of MAE, RMSE and MAPE. The effectiveness of each component of the model has been verified through ablation experiments, and the adaptability of the dynamic weighting method has been demonstrated through learning cases.
Similar content being viewed by others
Availability of data and materials
The METR-LA and PEMS-BAY datasets released by Li(https://github.com/liyaguang/DCRNN). The JINAN dataset released by Guo(https://github.com/guokan987/HGCN)that obtained from DiDi(https://gaia.didichuxing.com).The AIR_BJ dataset released by Zheng(http://research.microsoft.com/apps/pubs/?id=246398).The HYSK datasets is protected by privacy
References
Abuhasel, K.A., Khadr, M., Alquraish, M.M.: Analyzing and forecasting COVID-19 pandemic in the kingdom of saudi arabia using ARIMA and SIR models. Comput. Intell. 38(3), 770–783 (2022)
Alaee, S., Mercer, R., Kamgar, K., Keogh, E.J.: Time series motifs discovery under DTW allows more robust discovery of conserved structure. Data Min. Knowl. Discov. 35(3), 863–910 (2021)
Atwood, J., Towsley, D.: Diffusion-convolutional neural networks. In: Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems(NIPS), pp. 1993–2001 (2016)
Bai, S., Kolter, J.Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. CoRR arXiv:1803.01271 (2018)
Beck, D., Haffari, G., Cohn, T.: Graph-to-sequence learning using gated graph neural networks. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(ACL), pp. 273–283 (2018)
Chai, S., Liu, J., Jain, R.K., Tateyama, T., Iwamoto, Y., Lin, L., Chen, Y.: A multi-head pseudo nodes based spatial-temporal graph convolutional network for emotion perception from GAIT. Neurocomputing 511, 437–447 (2022)
Cho, K., van Merrienboer, B., Gülçehre, Ç., Bahdanau, D., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing(EMNLP), pp. 1724–1734 (2014)
Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems(NIPS), pp. 3837–3845 (2016)
Denton, S.M., Salleb-Aouissi, A.: A weighted solution to SVM actionability and interpretability CoRR arXiv:2012.03372 (2020)
Ding, C., Wen, S., Ding, W., Liu, K., Belyaev, E.: Temporal segment graph convolutional networks for skeleton-based action recognition. Eng. Appl. Artif. Intell. 110,(2022) 104675
Dogan, O., Öztaysi, B.: Genders prediction from indoor customer paths by levenshtein-based fuzzy knn. Expert Syst. Appl. 136, 42–49 (2019)
Fan, W., Ma, Y., Li, Q., He, Y., Zhao, Y.E., Tang, J., Yin, D.: Graph neural networks for social recommendation. In: The World Wide Web Conference(WWW), pp. 417–426 (2019)
Gopinath, K., Desrosiers, C., Lombaert, H.: Adaptive graph convolution pooling for brain surface analysis. In: Information Processing in Medical Imaging - 26th International Conference(IPMI), vol. 11492, pp. 86–98 (2019)
Graves, A., Graves, A.: Long short-term memory. Supervised sequence labelling with recurrent neural networks pp. 37–45 (2012)
Guo, K., Hu, Y., Qian, Z.S., Sun, Y., Gao, J., Yin, B.: Dynamic graph convolution network for traffic forecasting based on latent network of laplace matrix estimation. IEEE Trans. Intell. Transp. Syst. 23(2), 1009–1018 (2022)
Guo, K., Hu, Y., Sun, Y., Qian, S., Gao, J., Yin, B.: Hierarchical graph convolution network for traffic forecasting. In: Thirty-Fifth AAAI Conference on Artificial Intelligence(AAAI), pp. 151–159 (2021)
Guo, S., Lin, Y., Feng, N., Song, C., Wan, H.: Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: The Thirty-Third AAAI Conference on Artificial Intelligence(AAAI), pp. 922–929 (2019)
Hamilton, W.L., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems(NIPS), pp. 1024–1034 (2017)
Jia, Y., Gu, Z., Jiang, Z., Gao, C., Yang, J.: Persistent graph stream summarization for real-time graph analytics. World Wide Web pp. 1–21 (2023)
Jia, Y., Lin, M., Wang, Y., Li, J., Chen, K.: Extrapolation over temporal knowledge graph via hyperbolic embedding. CAAI transaction on Intelligence Technology (2023)
ia, Z., Lin, Y., Wang, J., Zhou, R., Ning, X., He, Y., Zhao, Y.: Graphsleepnet: Adaptive spatial-temporal graph convolutional networks for sleep stage classification. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence(IJCAI), pp. 1324–1330 (2020)
Kim, Y., Gao, C.: Bayesian model selection with graph structured sparsity. J. Mach. Learn. Res. 21, 109:1–109:61 (2020)
ipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: 5th International Conference on Learning Representations(ICLR) (2017)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Commun. 60(6), 84–90 (2017)
Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. In: 6th International Conference on Learning Representations(ICLR) (2018)
Liang, Y., Ke, S., Zhang, J., Yi, X., Zheng, Y.: Geoman: Multi-level attention networks for geo-sensory time series prediction. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence(IJCAI), pp. 3428–3434 (2018)
Lin, X., Quan, Z., Wang, Z., Ma, T., Zeng, X.: KGNN: knowledge graph neural network for drug-drug interaction prediction. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence(IJCAI), pp. 2739–2745 (2020)
Liu, J., Chen, Y., Huang, X., Li, J., Min, G.: Gnn-based long and short term preference modeling for next-location prediction. Inf. Sci. 629, 1–14 (2023)
Liu, S., Wang, Y., Sun, J., Mao, T.: An efficient spatial-temporal model based on gated linear units for trajectory prediction. Neurocomputing 492, 593–600 (2022)
Malki, Z., Atlam, E., Ewis, A., Dagnew, G., Alzighaibi, A.R., Ghada, E., Elhosseini, M.A., Hassanien, A.E., Gad, I.: ARIMA models for predicting the end of COVID-19 pandemic and the risk of second rebound. Neural Comput. Appl. 33(7), 2929–2948 (2021)
Medsker, L.R., Jain, L.: Recurrent neural networks. Design and Applications 5, 64–67 (2001)
Mittal, S., Chauhan, A.: A rnn-lstm-based predictive modelling framework for stock market prediction using technical indicators. Int. J. Rough Sets Data Anal. 7(1), 1–13 (2021)
Ogata, K.: A generic approach on how to formally specify and model check path finding algorithms: Dijkstra, a* and LPA. Int. J. Softw. Eng. Knowl. Eng. 30(10), 1481–1523 (2020)
Patel, Z., Boje, E.: A hybrid, coupled approach to the continuous-discrete kalman filter. IEEE Control. Syst. Lett. 5(3), 827–832 (2021)
Singh, H.V.P., Mahmoud, Q.H.: Evaluation of ARIMA models for human-machine interface state sequence prediction. Mach. Learn. Knowl. Extr. 1(1), 287–311 (2019)
Song, Y., Mao, H., Li, H.: Spatio-temporal modeling for air quality prediction based on spectral graph convolutional network and attention mechanism. In: International Joint Conference on Neural Networks(IJCNN), pp. 1–9 (2022)
Sun, Y., Ding, S., Zhang, Z., Jia, W.: An improved grid search algorithm to optimize SVR for prediction. Soft Comput. 25(7), 5633–5644 (2021)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems(NIPS), pp. 3104–3112 (2014)
Ta, X., Liu, Z., Hu, X., Yu, L., Sun, L., Du, B.: Adaptive spatio-temporal graph neural network for traffic forecasting. Knowl. Based Syst. 242, 108199 (2022)
Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. CoRR arXiv:1710.10903 (2017)
Wang, L., Huang, C., Ma, W., Liu, R., Vosoughi, S.: Hyperbolic node embedding for temporal networks. Data Min. Knowl. Discov. 35(5), 1906–1940 (2021)
Wang, Q., Guo, Y., Yu, L., Li, P.: Earthquake prediction based on spatio-temporal data mining: An LSTM network approach. IEEE Trans. Emerg. Top. Comput. 8(1), 148–158 (2020). https://doi.org/10.1109/TETC.2017.2699169
Wu, C., Xiang, L., Yan, J., Zhang, Y.: Spatio-temporal neural network for taxi demand prediction using multisource urban data. Trans. GIS 26(5), 2166–2187 (2022)
u, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph wavenet for deep spatial-temporal graph modeling. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence(IJCAI), pp. 1907–1913 (2019)
Xu, C., Zhao, W., Zhao, J., Guan, Z., Song, X., Li, J.: Uncertainty-aware multi-view deep learning for internet of things applications. IEEE Transactions on Industrial Informatics 19(2), 1456–1466 (2022)
Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence(IJCAI), pp. 3634–3640 (2018)
Yuan, W., Gao, K.: Eadam optimizer: How \(\epsilon \) impact adam. CoRR arXiv:2011.02150 (2020)
Zhao, L., Song, Y., Zhang, C., Liu, Y., Wang, P., Lin, T., Deng, M., Li, H.: T-GCN: A temporal graph convolutional network for traffic prediction. IEEE Trans. Intell. Transp. Syst. 21(9), 3848–3858 (2020)
Funding
This study was funded by the National Key Research and Development Program of China (No.2022YFC3004603); National Natural Science Foundation of China (No.62072220); Natural Science Foundation of Liaoning Province (2022-KF-13-06)
Author information
Authors and Affiliations
Contributions
Linlin Ding: Analysis, Funding acquisition, Supervision. Haiyou Yu: Writing original draft, Methodology, Software, Validation, Experiment, Investigation. Chenli Zhu: Data support, Review. Ji Ma: Experiment, Software. Yue Zhao: Experiment, Proofreading.
Corresponding author
Ethics declarations
Competing interests
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors
Informed consent
As this article does not contain any studies with human participants or animals performed by any of the authors, the informed consent is not applicable
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article belongs to the Topical Collection: Special Issue on Fairness-driven User Behavioral Modelling and Analysis for Online Recommendation
Guest Editors: Jianxin Li, Guandong Xu, Xiang Ren, and Qing Li.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ding, L., Yu, H., Zhu, C. et al. Attribute prediction of spatio-temporal graph nodes based on weighted graph diffusion convolution network. World Wide Web 26, 3655–3690 (2023). https://doi.org/10.1007/s11280-023-01198-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-023-01198-4