skip to main content
10.1145/3580305.3599463acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Pattern Expansion and Consolidation on Evolving Graphs for Continual Traffic Prediction

Published: 04 August 2023 Publication History

Abstract

Recently, spatiotemporal graph convolutional networks are becoming popular in the field of traffic flow prediction and significantly improve prediction accuracy. However, the majority of existing traffic flow prediction models are tailored to static traffic networks and fail to model the continuous evolution and expansion of traffic networks. In this work, we move to investigate the challenge of traffic flow prediction on an expanding traffic network. And we propose an efficient and effective continual learning framework to achieve continuous traffic flow prediction without the access to historical graph data, namely Pattern Expansion and Consolidation based on Pattern Matching based (PECPM). Specifically, we first design a pattern bank based on pattern matching to store representative patterns of the road network. With the expansion of the road network, the model configured with such a bank module can achieve continuous traffic prediction by effectively managing patterns stored in the bank. The core idea is to continuously update new patterns while consolidating learned ones. Specifically, we design a pattern expansion mechanism that can detect evolved and new patterns from the updated network, then these unknown patterns are expanded into the pattern bank to adapt to the updated road network. Additionally, we propose a pattern consolidation mechanism that includes both a bank preservation mechanism and a pattern traceability mechanism. This can effectively consolidate the learned patterns in the bank without requiring access to detailed historical graph data. We construct experiments on real-world traffic datasets to demonstrate the competitive performance, superior efficiency, and strong generalization ability of PECPM.

Supplementary Material

MP4 File (rtfp0244-2min-promo.mp4)
Presentation video - short version
MP4 File (rtfp0244-2min-promo.mp4)
Presentation video - short version
MP4 File (rtfp0244-2min-promo.mp4)
Presentation video - short version

References

[1]
Lei Bai, Lina Yao, Can Li, Xianzhi Wang, and Can Wang. 2020. Adaptive graph convolutional recurrent network for traffic forecasting. Advances in Neural Information Processing Systems 33 (2020), 17804--17815.
[2]
Arslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny, Thalaiyasingam Ajanthan, Puneet K Dokania, Philip HS Torr, and M Ranzato. 2019. Continual learning with tiny episodic memories. (2019).
[3]
Xu Chen, Junshan Wang, and Kunqing Xie. 2021. TrafficStream: A Streaming Traffic Flow Forecasting Framework Based on Graph Neural Networks and Continual Learning. arXiv preprint arXiv:2106.06273 (2021).
[4]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
[5]
Zhengyan Cui, Junjun Zhang, Giseop Noh, and Hyun Jun Park. 2022. MFDGCN: Multi-Stage Spatio-Temporal Fusion Diffusion Graph Convolutional Network for Traffic Prediction. Applied Sciences 12, 5 (2022), 2688.
[6]
Liangzhe Han, Bowen Du, Leilei Sun, Yanjie Fu, Yisheng Lv, and Hui Xiong. 2021. Dynamic and multi-faceted spatio-temporal deep learning for traffic speed forecasting. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining. 547--555.
[7]
Liangzhe Han, Xiaojian Ma, Leilei Sun, Bowen Du, Yanjie Fu, Weifeng Lv, and Hui Xiong. 2022. Continuous-Time and Multi-Level Graph Representation Learning for Origin-Destination Demand Prediction. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 516--524.
[8]
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences 114, 13 (2017), 3521--3526.
[9]
Jianlei Kong, Xiaomeng Fan, Xuebo Jin, Sen Lin, and Min Zuo. 2023. A Variational Bayesian Inference-Based En-Decoder Framework for Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems (2023).
[10]
Shiyong Lan, Yitong Ma, Weikang Huang, Wenwu Wang, Hongyu Yang, and Pyang Li. 2022. Dstagnn: Dynamic spatial-temporal aware graph neural network for traffic flow forecasting. In International Conference on Machine Learning. PMLR, 11906--11917.
[11]
Hyunwook Lee, Seungmin Jin, Hyeshin Chu, Hongkyu Lim, and Sungahn Ko. 2021. Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecasting. arXiv preprint arXiv:2110.10380 (2021).
[12]
Mengzhang Li and Zhanxing Zhu. 2021. Spatial-temporal fusion graph neural networks for traffic flow forecasting. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35. 4189--4196.
[13]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2017. Diffusion convolu- tional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 (2017).
[14]
Zhizhong Li and Derek Hoiem. 2017. Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence 40, 12 (2017), 2935--2947.
[15]
Chenxi Liu, Zhu Xiao, Dong Wang, Minhao Cheng, Hongyang Chen, and Jiawei Cai. 2022. Foreseeing private car transfer between urban regions with multiple graph-based generative adversarial networks. World Wide Web 25, 6 (2022), 2515--2534.
[16]
Chenxi Liu, Zhu Xiao, Dong Wang, Lei Wang, Hongbo Jiang, Hongyang Chen, and Jiangxia Yu. 2021. Exploiting Spatiotemporal Correlations of Arrive-Stay-Leave Behaviors for Private Car Flow Prediction. IEEE Transactions on Network Science and Engineering 9, 2 (2021), 834--847.
[17]
Chi Harold Liu, Chengzhe Piao, Xiaoxin Ma, Ye Yuan, Jian Tang, Guoren Wang, and Kin K Leung. 2021. Modeling Citywide Crowd Flows using Attentive Convolutional LSTM. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). IEEE, 217--228.
[18]
David Lopez-Paz and Marc'Aurelio Ranzato. 2017. Gradient episodic memory for continual learning. Advances in neural information processing systems 30 (2017).
[19]
Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017).
[20]
Chuishi Meng, Yanhua Li, Yu Zheng, Jieping Ye, Qiang Yang, Philip S Yu, and Ouri Wolfson. 2022. The 11th International Workshop on Urban Computing. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 4886--4887.
[21]
Huiling Qin, Xianyuan Zhan, Yuanxun Li, Xiaodu Yang, and Yu Zheng. 2021. Network-wide traffic states imputation using self-interested coalitional learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 1370--1378.
[22]
Amal Rannen, Rahaf Aljundi, Matthew B Blaschko, and Tinne Tuytelaars. 2017. Encoder based lifelong learning. In Proceedings of the IEEE International Conference on Computer Vision. 1320--1328.
[23]
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. 2017. icarl: Incremental classifier and representation learning. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition. 2001--2010.
[24]
Konstantin Shmelkov, Cordelia Schmid, and Karteek Alahari. 2017. Incremental learning of object detectors without catastrophic forgetting. In Proceedings of the IEEE international conference on computer vision.
[25]
Chao Song, Youfang Lin, Shengnan Guo, and Huaiyu Wan. 2020. Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 914--921.
[26]
Yongxin Tong, Yuqiang Chen, Zimu Zhou, Lei Chen, Jie Wang, Qiang Yang, Jieping Ye, and Weifeng Lv. 2017. The simpler the better: a unified approach to predicting original taxi demands based on large-scale online platforms. In Pro- ceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 1653--1662.
[27]
Chen Wang, Yuheng Qiu, Dasong Gao, and Sebastian Scherer. 2022. Lifelong graph learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 13719--13728.
[28]
Junshan Wang, Guojie Song, Yi Wu, and Liang Wang. 2020. Streaming graph neural networks via continual learning. In Proceedings of the 29th ACM international conference on information & knowledge management. 1515--1524.
[29]
Junshan Wang, Wenhao Zhu, Guojie Song, and Liang Wang. 2022. Streaming Graph Neural Networks with Generative Replay. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1878--1888.
[30]
Yuandong Wang, Hongzhi Yin, Tong Chen, Chunyang Liu, Ben Wang, Tianyu Wo, and Jie Xu. 2021. Gallat: A spatiotemporal graph attention network for passenger demand prediction. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). IEEE, 2129--2134.
[31]
Junchen Ye, Leilei Sun, Bowen Du, Yanjie Fu, Xinran Tong, and Hui Xiong. 2019. Co-prediction of multiple transportation demands based on deep spatio-temporal neural network. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 305--313.
[32]
Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2017. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv preprint arXiv:1709.04875 (2017).
[33]
Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2018. Spatio-temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI).
[34]
Peiyan Zhang, Yuchen Yan, Chaozhuo Li, Senzhang Wang, Xing Xie, Guojie Song, and Sunghun Kim. 2023. Continual Learning on Dynamic Graphs via Parameter Isolation. arXiv preprint arXiv:2305.13825 (2023).
[35]
Yunchao Zhang, Yanjie Fu, Pengyang Wang, Xiaolin Li, and Yu Zheng. 2019. Unifying inter-region autocorrelation and intra-region structures for spatial embedding via collective adversarial learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1700--1708.
[36]
Yudong Zhang, Binwu Wang, Ziyang Shan, Zhengyang Zhou, and Yang Wang. 2022. CMT-Net: A mutual transition aware framework for taxicab pick-ups and drop-offs co-prediction. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1406--1414.
[37]
Liang Zhao, Min Gao, and Zongwei Wang. 2022. ST-GSP: Spatial-Temporal Global Semantic Representation Learning for Urban Flow Prediction. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1443--1451.
[38]
Ling Zhao, Yujiao Song, Chao Zhang, Yu Liu, Pu Wang, Tao Lin, Min Deng, and Haifeng Li. 2019. T-gcn: A temporal graph convolutional network for traffic prediction. IEEE transactions on intelligent transportation systems 21, 9 (2019), 3848--3858.
[39]
Fan Zhou and Chengtai Cao. 2021. Overcoming catastrophic forgetting in graph neural networks with experience replay. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4714--4722.
[40]
Zhengyang Zhou, Yang Wang, Xike Xie, Lianliang Chen, and Hengchang Liu. 2020. RiskOracle: a minute-level citywide traffic accident forecasting framework. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 1258--1265.
[41]
Zhengyang Zhou, Yang Wang, Xike Xie, Lianliang Chen, and Chaochao Zhu. 2020. Foresee urban sparse traffic accidents: A spatiotemporal multi-granularity perspective. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3786--3799

Cited By

View all
  • (2024)Building trust for traffic flow forecasting components in intelligent transportation systems via interpretable ensemble learningDigital Transportation and Safety10.48130/dts-0024-00123:3(126-143)Online publication date: 2024
  • (2024)LeRetProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/460(4165-4173)Online publication date: 3-Aug-2024
  • (2024)Make bricks with a little strawProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/264(2388-2396)Online publication date: 3-Aug-2024
  • Show More Cited By

Index Terms

  1. Pattern Expansion and Consolidation on Evolving Graphs for Continual Traffic Prediction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      KDD '23: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
      August 2023
      5996 pages
      ISBN:9798400701030
      DOI:10.1145/3580305
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 August 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. continuous spatiotemporal learning.
      2. spatiotemporal data mining
      3. traffic network

      Qualifiers

      • Research-article

      Funding Sources

      • Academic Leaders Cultivation Program, USTC
      • the National Natural Science Foundation of China
      • the Project of Stable Support for Youth Team in Basic Research Field, CAS

      Conference

      KDD '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

      Upcoming Conference

      KDD '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)592
      • Downloads (Last 6 weeks)50
      Reflects downloads up to 02 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Building trust for traffic flow forecasting components in intelligent transportation systems via interpretable ensemble learningDigital Transportation and Safety10.48130/dts-0024-00123:3(126-143)Online publication date: 2024
      • (2024)LeRetProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/460(4165-4173)Online publication date: 3-Aug-2024
      • (2024)Make bricks with a little strawProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/264(2388-2396)Online publication date: 3-Aug-2024
      • (2024)TCGC: Temporal Collaboration-Aware Graph Co-Evolution Learning for Dynamic RecommendationACM Transactions on Information Systems10.1145/368747043:1(1-27)Online publication date: 26-Nov-2024
      • (2024)STONE: A Spatio-temporal OOD Learning Framework Kills Both Spatial and Temporal ShiftsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671680(2948-2959)Online publication date: 25-Aug-2024
      • (2024)Multi-Behavior Collaborative Filtering with Partial Order Graph Convolutional NetworksProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671569(6257-6268)Online publication date: 25-Aug-2024
      • (2024)DSLR: Diversity Enhancement and Structure Learning for Rehearsal-based Graph Continual LearningProceedings of the ACM Web Conference 202410.1145/3589334.3645561(733-744)Online publication date: 13-May-2024
      • (2024)M$^{2}$STL: Multi-Range Multi-Level Spatial-Temporal Learning Model for Network Traffic PredictionIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.341737111:5(4315-4329)Online publication date: Sep-2024
      • (2024)Modeling Spatio-Temporal Mobility Across Data Silos via Personalized Federated LearningIEEE Transactions on Mobile Computing10.1109/TMC.2024.345365723:12(15289-15306)Online publication date: Dec-2024
      • (2024)Adaptive and Interactive Multi-Level Spatio-Temporal Network for Traffic ForecastingIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.339297525:10(14070-14086)Online publication date: Oct-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media