skip to main content
research-article

Citywide Traffic Flow Prediction Based on Multiple Gated Spatio-temporal Convolutional Neural Networks

Published: 30 May 2020 Publication History

Abstract

Traffic flow prediction is crucial for public safety and traffic management, and remains a big challenge because of many complicated factors, e.g., multiple spatio-temporal dependencies, holidays, and weather. Some work leveraged 2D convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) to explore spatial relations and temporal relations, respectively, which outperformed the classical approaches. However, it is hard for these work to model spatio-temporal relations jointly. To tackle this, some studies utilized LSTMs to connect high-level layers of CNNs, but left the spatio-temporal correlations not fully exploited in low-level layers. In this work, we propose novel spatio-temporal CNNs to extract spatio-temporal features simultaneously from low-level to high-level layers, and propose a novel gated scheme to control the spatio-temporal features that should be propagated through the hierarchy of layers. Based on these, we propose an end-to-end framework, multiple gated spatio-temporal CNNs (MGSTC), for citywide traffic flow prediction. MGSTC can explore multiple spatio-temporal dependencies through multiple gated spatio-temporal CNN branches, and combine the spatio-temporal features with external factors dynamically. Extensive experiments on two real traffic datasets demonstrates that MGSTC outperforms other state-of-the-art baselines.

References

[1]
Afshin Abadi, Tooraj Rajabioun, and Petros A. Ioannou. 2015. Traffic flow prediction for road transportation networks with limited traffic data. IEEE Transactions on Intelligent Transportation Systems 16, 2 (2015), 653--662.
[2]
Florent Altché and Arnaud De La Fortelle. 2017. An LSTM network for highway trajectory prediction. In Proceedings of the IEEE 20th International Conference on Intelligent Transportation Systems. 353--359.
[3]
Muhammad Tayyab Asif, Justin Dauwels, Chong Yang Goh, Ali Oran, Esmail Fathi, Muye Xu, Menoth Mohan Dhanya, Nikola Mitrovic, and Patrick Jaillet. 2014. Spatiotemporal patterns in large-scale traffic speed prediction. IEEE Transactions on Intelligent Transportation Systems 15, 2 (2014), 794–804.
[4]
Léon Bottou. 2010. Large-scale machine learning with stochastic gradient descent. In Proceedings of the 19th International Conference on Computational Statistics. Paris France, August 22–27, 2010 Keynote, Invited and Contributed Papers. Springer Science 8 Business Media, 177.
[5]
George E. P. Box and David A. Pierce. 1970. Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association 65, 332 (1970), 1509--1526.
[6]
Cen Chen, Kenli Li, Aijia Ouyang, Zhuo Tang, and Keqin Li. 2017. Gpu-accelerated parallel hierarchical extreme learning machine on flink for big data. IEEE Transactions on Systems, Man, and Cybernetics: Systems 47, 10 (2017), 2740--2753.
[7]
Cen Chen, Kenli Li, Sin G. Teo, Guizi Chen, Xiaofeng Zou, Xulei Yang, Ramaseshan C. Vijay, Jiashi Feng, and Zeng Zeng. 2018. Exploiting spatio-temporal correlations with multiple 3D convolutional neural networks for citywide vehicle flow prediction. In Proceedings of the 2018 IEEE International Conference on Data Mining (ICDM’18). IEEE, 893--898.
[8]
Cen Chen, Kenli Li, Sin G. Teo, Xiaofeng Zou, Kang Wang, Jie Wang, and Zeng Zeng. 2019. Gated residual recurrent graph neural networks for traffic prediction. In Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 33. 485--492.
[9]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 785--794.
[10]
Weihong Chen, Jiyao An, Renfa Li, Li Fu, Guoqi Xie, Md Zakirul Alam Bhuiyan, and Keqin Li. 2018. A novel fuzzy deep-learning approach to traffic flow prediction with uncertain spatial–temporal data features. Future Generation Computer Systems 89 (2018), 78–88.
[11]
Yann N. Dauphin, Angela Fan, Michael Auli, and David Grangier. 2017. Language modeling with gated convolutional networks. In Proceedings of the International Conference on Machine Learning. 933--941.
[12]
Gary A. Davis and Nancy L. Nihan. 1991. Nonparametric regression and short-term freeway traffic forecasting.Journal of Transportation Engineering 117, 2 (1991), 178–188.
[13]
Edouard Delasalles, Ali Ziat, Ludovic Denoyer, and Patrick Gallinari. 2019. Spatio-temporal neural networks for space-time data modeling and relation discovery. Knowledge and Information Systems 61, 3 (2019), 1--27.
[14]
Dingxiong Deng, Cyrus Shahabi, Ugur Demiryurek, and Linhong Zhu. 2017. Situation aware multi-task learning for traffic prediction. In Proceedings of the 2017 IEEE International Conference on Data Mining (ICDM’17). 81--90.
[15]
Shengdong Du, Tianrui Li, Xun Gong, Zeng Yu, and Shi-Jinn Horng. 2018. A hybrid method for traffic flow forecasting using multimodal deep learning. In arXiv preprint arXiv:1803.02099.
[16]
Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N Dauphin. 2017. Convolutional sequence to sequence learning. In Proceedings of the International Conference on Machine Learning. 1243--1252.
[17]
Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton. 2013. Speech recognition with deep recurrent neural networks. In Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. 6645--6649.
[18]
Simon Haykin. 1994. Neural Networks: A Comprehensive Foundation. Prentice Hall PTR.
[19]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 770--778.
[20]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Identity mappings in deep residual networks. In Proceedings of the European Conference on Computer Vision. Springer, 630--645.
[21]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735--1780.
[22]
Wei-Chiang Hong. 2011. Traffic flow forecasting by seasonal SVR with chaotic simulated annealing algorithm. Neurocomputing 74, 12–13 (2011), 2096–2107.
[23]
Mohammad Reza Jabbarpour, Houman Zarrabi, Rashid Hafeez Khokhar, Shahaboddin Shamshirband, and Kim-Kwang Raymond Choo. 2018. Applications of computational intelligence in vehicle traffic congestion problem: A survey. Soft Computing 22, 7 (2018), 2299--2320.
[24]
Ashesh Jain, Amir R. Zamir, Silvio Savarese, and Ashutosh Saxena. 2016. Structural-RNN: Deep learning on spatio-temporal graphs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5308--5317.
[25]
Jintao Ke, Hongyu Zheng, Hai Yang, and Xiqun Michael Chen. 2017. Short-term forecasting of passenger demand under on-demand ride services: A spatio-temporal deep learning approach. Transportation Research Part C: Emerging Technologies 85 (2017), 591--608.
[26]
Seon Ho Kim, Junyuan Shi, Abdullah Alfarrarjeh, Daru Xu, Yuwei Tan, and Cyrus Shahabi. 2013. Real-time traffic video analysis using intel viewmont coprocessor. In Proceedings of the International Workshop on Databases in Networked Information Systems. 150--160.
[27]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Proceedings of the Conference and Workshop on Neural Information Processing Systems. 1097--1105.
[28]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436–444.
[29]
Yuxuan Liang, Songyu Ke, Junbo Zhang, Xiuwen Yi, and Yu Zheng. 2018. GeoMAN: Multi-level attention networks for Geo-sensory time series prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 3428--3434.
[30]
Marco Lippi, Matteo Bertini, and Paolo Frasconi. 2013. Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning. IEEE Transactions on Intelligent Transportation Systems 14, 2 (2013), 871--882.
[31]
Xutong Liu, Feng Chen, Yen-Cheng Lu, and Chang-Tien Lu. 2017. Spatial prediction for multivariate non-gaussian data. ACM Transactions on Knowledge Discovery from Data 11, 3 (2017), 36.
[32]
Xiaolei Ma, Zhuang Dai, Zhengbing He, Jihui Ma, Yong Wang, and Yunpeng Wang. 2017. Learning traffic as images: A deep convolutional neural network for large-scale transportation network speed prediction. Sensors 14, 4 (2017), 818.
[33]
Zhaofan Qiu, Ting Yao, and Tao Mei. 2017. Learning spatio-temporal representation with pseudo-3d residual networks. In Proceedings of the 2017 IEEE International Conference on Computer Vision. 5534--5542.
[34]
Doyen Sahoo, Steven C.H. Hoi, and Bin Li. 2019. Large scale online multiple kernel regression with application to time-series prediction. ACM Transactions on Knowledge Discovery from Data 13, 1 (2019), 9.
[35]
Shiliang Sun, Changshui Zhang, and Guoqiang Yu. 2006. A Bayesian network approach to traffic flow forecasting. IEEE Transactions on Intelligent Transportation Systems 7, 1 (2006), 124–132.
[36]
Yongxin Tong, Yuqiang Chen, Zimu Zhou, Lei Chen, Jie Wang, Qiang Yang, Jieping Ye, and Weifeng Lv. 2017. The simpler the better: A unified approach to predicting original taxi demands based on large-scale online platforms. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1653–1662.
[37]
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, and Manohar Paluri. 2015. Learning spatiotemporal features with 3d convolutional networks. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV’15). 4489--4497.
[38]
Quang Thanh Tran, Zhihua Ma, Hengchao Li, Li Hao, and Quang Khai Trinh. 2015. A multiplicative seasonal ARIMA/GARCH model in EVN traffic prediction. International Journal of Communications, Network and System Sciences 8, 4 (2015), 43--49.
[39]
DESA Un. 2018. World urbanization prospects: The 2017 revision. In United Nations Department of Economics and Social Affairs, Population Division: New York, NY.
[40]
Mascha Van Der Voort, Mark Dougherty, and Susan Watson. 1996. Combining Kohonen maps with ARIMA time series models to forecast traffic flow. Transportation Research Part C: Emerging Technologies 4, 5 (1996), 307–318.
[41]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’15). 1235--1244.
[42]
Kang Wang, Kenli Li, Liqian Zhou, Yikun Hu, Zhongyao Cheng, Jing Liu, and Cen Chen. 2019. Multiple convolutional neural networks for multivariate time series prediction. Neurocomputing 360 (2019), 107--119.
[43]
Yunbo Wang, Mingsheng Long, Jianmin Wang, Zhifeng Gao, and S. Yu Philip. 2017. Predrnn: Recurrent neural networks for predictive learning using spatiotemporal lstms. In Proceedings of the Advances in Neural Information Processing Systems. 879--888.
[44]
Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD’14). 25--34.
[45]
Hua Wei, Yuandong Wang, Tianyu Wo, Yaxiao Liu, and Jie Xu. 2016. ZEST: A hybrid model on predicting passenger demand for chauffeured car service. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM’16). 2203--2208.
[46]
Billy M. Williams and Lester A. Hoel. 2003. Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: Theoretical basis and empirical results. Journal of Transportation Engineering 129, 6 (2003), 664–672.
[47]
Chun-Hsin Wu, Jan-Ming Ho, and Der-Tsai Lee. 2004. Travel-time prediction with support vector regression. IEEE Transactions on Intelligent Transportation Systems 5, 4 (2004), 276–281.
[48]
Dawen Xia, Binfeng Wang, Huaqing Li, Yantao Li, and Zili Zhang. 2016. A distributed spatial–temporal weighted model on MapReduce for short-term traffic flow forecasting. Neurocomputing 179, C (2016), 246--263.
[49]
Kun Xie, Can Peng, Xin Wang, Gaogang Xie, Jigang Wen, Jiannong Cao, Dafang Zhang, and Zheng Qin. 2018. Accurate recovery of Internet traffic data under variable rate measurements. IEEE/ACM Transactions on Networking 26, 3 (2018), 1137--1150.
[50]
S. H. I. Xingjian, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In Proceedings of the 28th International Conference on Neural Information Processing Systems (NIPS’15). 802--810.
[51]
Huaxiu Yao, Xianfeng Tang, Hua Wei, Guanjie Zheng, Yanwei Yu, and Zhenhui Li. 2018. Modeling spatial-temporal dynamics for traffic prediction. In arXiv preprint arXiv:1803.01254.
[52]
Huaxiu Yao, Fei Wu, Jintao Ke, Xianfeng Tang, Yitian Jia, Siyu Lu, Pinghua Gong, and Jieping Ye. 2018. Deep multi-view spatial-temporal network for taxi demand prediction. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence.
[53]
Haiyang Yu, Zhihai Wu, Shuqin Wang, Yunpeng Wang, and Xiaolei Ma. 2017. Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 27, 17 (2017), 1501.
[54]
Rose Yu, Yaguang Li, Cyrus Shahabi, Ugur Demiryurek, and Yan Liu. 2017. Deep learning: A generic approach for extreme condition traffic forecasting. In Proceedings of the 2017 SIAM International Conference on Data Mining.
[55]
Zeng Zeng, Xulei Yang, Yu Qiyun, Yao Meng, and Zhang Le. 2019. SeSe-Net: Self-supervised deep learning for segmentation. Pattern Recognition Letters 128 (8 2019), 23–29.
[56]
Junbo Zhang, Yu Zheng, and Dekang Qi. 2017. Deep spatio-temporal residual networks for citywide crowd flows prediction. In Proceedings of the 31st AAAI Conference on Artificial Intelligence. 1655--1661.
[57]
Junbo Zhang, Yu Zheng, Dekang Qi, Ruiyuan Li, Xiuwen Yi, and Tianrui Li. 2018. Predicting citywide crowd flows using deep spatio-temporal residual networks artificial intelligence. 259 (2018), 147--166.
[58]
Le Zhang, Zenglin Shi, Ming-Ming Cheng, Yun Liu, Jia-Wang Bian, Joey Tianyi Zhou, Guoyan Zheng, and Zeng Zeng. 2019. Nonlinear regression via deep negative correlation learning. IEEE Transactions on Pattern Analysis and Machine Intelligence.
[59]
Le Zhang, Zenglin Shi, Joey Tianyi Zhou, Ming-Ming Cheng, Yun Liu, Jia-Wang Bian, Zeng Zeng, and Chunhua Shen. 2020. Ordered or orderless: A revisit for video based person re-identification. IEEE Transactions on Pattern Analysis and Machine Intelligence.
[60]
Yu Zheng, Licia Capra, Ouri Wolfson, and Hai Yang. 2014. Urban computing: Concepts, methodologies, and applications. ACM Transactions on Intelligent Systems and Technology 5, 3 (2014), 38.

Cited By

View all
  • (2025)IBing: An Efficient Interleaved Bidirectional Ring All-Reduce Algorithm for Gradient SynchronizationACM Transactions on Architecture and Code Optimization10.1145/3711818Online publication date: 8-Jan-2025
  • (2025)Online Analytic Exemplar-Free Continual Learning With Large Models for Imbalanced Autonomous Driving TaskIEEE Transactions on Vehicular Technology10.1109/TVT.2024.348355774:2(1949-1958)Online publication date: Feb-2025
  • (2025)Adversarial Transformer-Based Anomaly Detection for Multivariate Time SeriesIEEE Transactions on Industrial Informatics10.1109/TII.2024.350721121:3(2471-2480)Online publication date: Mar-2025
  • Show More Cited By

Index Terms

  1. Citywide Traffic Flow Prediction Based on Multiple Gated Spatio-temporal Convolutional Neural Networks

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Knowledge Discovery from Data
    ACM Transactions on Knowledge Discovery from Data  Volume 14, Issue 4
    August 2020
    316 pages
    ISSN:1556-4681
    EISSN:1556-472X
    DOI:10.1145/3403605
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 30 May 2020
    Online AM: 07 May 2020
    Accepted: 01 February 2020
    Revised: 01 January 2020
    Received: 01 July 2019
    Published in TKDD Volume 14, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. CNNs
    2. Traffic prediction
    3. spatio-temporal analysis
    4. traffic flow prediction

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • International (Regional) Cooperation and Exchange Program of National Natural Science Foundation of China
    • National Natural Science Foundation of China
    • Postdoctoral Science Foundation of China
    • National Key R8D Program of China
    • National Outstanding Youth Science Program of National Natural Science Foundation of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)228
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)IBing: An Efficient Interleaved Bidirectional Ring All-Reduce Algorithm for Gradient SynchronizationACM Transactions on Architecture and Code Optimization10.1145/3711818Online publication date: 8-Jan-2025
    • (2025)Online Analytic Exemplar-Free Continual Learning With Large Models for Imbalanced Autonomous Driving TaskIEEE Transactions on Vehicular Technology10.1109/TVT.2024.348355774:2(1949-1958)Online publication date: Feb-2025
    • (2025)Adversarial Transformer-Based Anomaly Detection for Multivariate Time SeriesIEEE Transactions on Industrial Informatics10.1109/TII.2024.350721121:3(2471-2480)Online publication date: Mar-2025
    • (2025)A Distributed Generative Adversarial Network for Data Augmentation Under Vertical Federated LearningIEEE Transactions on Big Data10.1109/TBDATA.2024.337515011:1(74-85)Online publication date: Feb-2025
    • (2025)The multi-module joint modeling approach: Predicting urban crowd flow by integrating spatial–temporal patterns and dynamic periodic relationshipEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109721141(109721)Online publication date: Feb-2025
    • (2025)Intelligent Traffic Flow Prediction Using Deep Learning Techniques: A Comparative StudySN Computer Science10.1007/s42979-024-03552-36:1Online publication date: 3-Jan-2025
    • (2025)Active Object Detection Based on PPO Learning Algorithm with Decision Knowledge GuidanceMachine Intelligence Research10.1007/s11633-024-1500-xOnline publication date: 7-Jan-2025
    • (2025)A novel shilling attack on black-box recommendation systems for multiple targetsNeural Computing and Applications10.1007/s00521-024-10798-837:5(3399-3417)Online publication date: 1-Feb-2025
    • (2025)Multi-Mode Inflow Prediction for Urban Transportation SystemsFrontier Computing: Volume 210.1007/978-981-96-2395-2_28(161-166)Online publication date: 25-Feb-2025
    • (2024)Optimizing multimodal feature selection using binary reinforced cuckoo search algorithm for improved classification performancePeerJ Computer Science10.7717/peerj-cs.181610(e1816)Online publication date: 29-Jan-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media