skip to main content
10.1145/3580305.3599842acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

iETA: A Robust and Scalable Incremental Learning Framework for Time-of-Arrival Estimation

Published: 04 August 2023 Publication History

Abstract

Time-of-arrival estimation or Estimated Time of Arrival (ETA) has become an indispensable building block of modern intelligent transportation systems. While many efforts have been made for time-of-arrival estimation, most of them have scalability and robustness issues when dealing with real-world large-scale ETA scenarios, where billions of vehicle trajectories and ETA requests have been continuously generating every day. To this end, in this paper, we propose a robust and scalable incremental ETA learning framework, iETA, to continuously exploit spatio-temporal traffic patterns from massive floating-car data and thus achieve better estimation performances. Specifically, we first build an incremental travel time predictor that can be incrementally updated based on newly generated traffic data. The incremental travel time predictor not only reduces the overall learning overhead but also improves the model's robustness toward urban traffic distribution shifts. Then, we propose a historical traffic knowledge consolidation module to preserve critical spatio-temporal knowledge from previous ETA predictors under the incremental learning setting. Moreover, to reduce interference induced by low-quality traffic data, we propose an adversarial training module to improve the learning robustness by proactively mitigating and resisting traffic noise perturbations. Finally, extensive experiments demonstrate the effectiveness and efficiency of the proposed system against state-of-the-art baselines in large-scale ETA scenarios. Most importantly, iETA has been deployed on the Didi Chuxing platform, handling real-time billions of ETA queries every day, and substantially improves the prediction accuracy.

Supplementary Material

MP4 File (adfp569-2min-promo.mp4)
A robust and scalable incremental learning framework for time-of-arrival estimation.

References

[1]
Mart'in Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. TensorFlow: a system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). 265--283.
[2]
Gert Cauwenberghs and Tomaso Poggio. 2000. Incremental and decremental support vector machine learning. Advances in Neural Information Processing Systems, Vol. 13 (2000), 388--394.
[3]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 785--794.
[4]
Xu Chen, Junshan Wang, and Kunqing Xie. 2021. TrafficStream: A Streaming Traffic Flow Forecasting Framework Based on Graph Neural Networks and Continual Learning. Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (2021), 3620--3626.
[5]
Zebin Chen, Xiaolin Xiao, Yue-Jiao Gong, Jun Fang, Nan Ma, Hua Chai, and Zhiguang Cao. 2022. Interpreting trajectories from multiple views: A hierarchical self-attention network for estimating the time of arrival. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2771--2779.
[6]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide and deep learning for recommender systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 7--10.
[7]
Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Alevs Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. 2021. A continual learning survey: Defying forgetting in classification tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, 7 (2021), 3366--3385.
[8]
Austin Derrow-Pinion, Jennifer She, David Wong, Oliver Lange, Todd Hester, Luis Perez, Marc Nunkesser, Seongjae Lee, Xueying Guo, Brett Wiltshire, et al. 2021. Eta prediction with graph neural networks in google maps. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 3767--3776.
[9]
Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, and Tie-Yan Liu. 2022. DEPTS: deep expansion learning for periodic time series forecasting. arXiv preprint arXiv:2203.07681 (2022).
[10]
Xiaomin Fang, Jizhou Huang, Fan Wang, Lingke Zeng, Haijin Liang, and Haifeng Wang. 2020. Constgat: Contextual spatial-temporal graph attention network for travel time estimation at baidu maps. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2697--2705.
[11]
Kun Fu, Fanlin Meng, Jieping Ye, and Zheng Wang. 2020. Compacteta: A fast inference system for travel time prediction. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 3337--3345.
[12]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, 249--256.
[13]
Jianping Gou, Baosheng Yu, Stephen J Maybank, and Dacheng Tao. 2021. Knowledge distillation: A survey. International Journal of Computer Vision, Vol. 129, 6 (2021), 1789--1819.
[14]
Jiangpeng He, Runyu Mao, Zeman Shao, and Fengqing Zhu. 2020. Incremental learning in online scenario. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13926--13935.
[15]
Geoffrey Hinton, Oriol Vinyals, Jeff Dean, et al. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, Vol. 2, 7 (2015).
[16]
Kyungyul Kim, ByeongMoon Ji, Doyoung Yoon, and Sangheum Hwang. 2021. Self-knowledge distillation with progressive refinement of targets. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 6567--6576.
[17]
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, Vol. 114, 13 (2017), 3521--3526.
[18]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature, Vol. 521, 7553 (2015), 436--444.
[19]
Yaguang Li, Kun Fu, Zheng Wang, Cyrus Shahabi, Jieping Ye, and Yan Liu. 2018. Multi-task representation learning for travel time estimation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1695--1704.
[20]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2017. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv Preprint arXiv:1707.01926 (2017).
[21]
Zhizhong Li and Derek Hoiem. 2017. Learning without forgetting. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, 12 (2017), 2935--2947.
[22]
Hao Liu, Jindong Han, Yanjie Fu, Jingbo Zhou, Xinjiang Lu, and Hui Xiong. 2020a. Multi-modal transportation recommendation with unified route representation learning. Proceedings of the VLDB Endowment, Vol. 14, 3 (2020), 342--350.
[23]
Hao Liu, Ying Li, Yanjie Fu, Huaibo Mei, Jingbo Zhou, Xu Ma, and Hui Xiong. 2020b. Polestar: An intelligent, efficient and national-wide public transportation routing engine. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2321--2329.
[24]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems, Vol. 26 (2013), 3111--3119.
[25]
Takeru Miyato, Andrew M Dai, and Ian Goodfellow. 2016. Adversarial training methods for semi-supervised text classification. arXiv Preprint arXiv:1605.07725 (2016).
[26]
German I Parisi, Ronald Kemker, Jose L Part, Christopher Kanan, and Stefan Wermter. 2019. Continual lifelong learning with neural networks: A review. Neural Networks, Vol. 113 (2019), 54--71.
[27]
Rohan Ramanath, Konstantin Salomatin, Jeffrey D Gee, Kirill Talanine, Onkar Dalal, Gungor Polatkan, Sara Smoot, and Deepak Kumar. 2021. Lambda Learner: Fast Incremental Learning on Data Streams. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 3492--3502.
[28]
Amir Rosenfeld and John K Tsotsos. 2018. Incremental learning through deep adaptation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 42, 3 (2018), 651--663.
[29]
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. 2017. Continual learning with deep generative replay. Advances in Neural Information Processing Systems, Vol. 30 (2017), 2994--3003.
[30]
Xiaocheng Tang, Zhiwei Qin, Fan Zhang, Zhaodong Wang, Zhe Xu, Yintai Ma, Hongtu Zhu, and Jieping Ye. 2019. A deep value-network based approach for multi-driver order dispatching. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1780--1790.
[31]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems, Vol. 30 (2017), 6000--6010.
[32]
Hongjian Wang, Xianfeng Tang, Yu-Hsuan Kuo, Daniel Kifer, and Zhenhui Li. 2019. A simple baseline for travel time estimation using large-scale trip data. ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 10, 2 (2019), 1--22.
[33]
Junshan Wang, Wenhao Zhu, Guojie Song, and Liang Wang. 2022. Streaming Graph Neural Networks with Generative Replay. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1878--1888.
[34]
Leye Wang, Di Chai, Xuanzhe Liu, Liyue Chen, and Kai Chen. 2021a. Exploring the generalizability of spatio-temporal traffic prediction: meta-modeling and an analytic framework. IEEE Transactions on Knowledge and Data Engineering (2021).
[35]
Yuening Wang, Yingxue Zhang, and Mark Coates. 2021b. Graph Structure Aware Contrastive Knowledge Distillation for Incremental Learning in Recommender Systems. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 3518--3522.
[36]
Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 25--34.
[37]
Zheng Wang, Kun Fu, and Jieping Ye. 2018. Learning to estimate the travel time. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 858--866.
[38]
Jianhua Xiao, Zhu Xiao, Dong Wang, Jing Bai, Vincent Havyarimana, and Fanzi Zeng. 2019. Short-term traffic volume prediction by ensemble learning in concept drifting environments. Knowledge-Based Systems, Vol. 164 (2019), 213--225.
[39]
Chiwei Yan, Helin Zhu, Nikita Korolko, and Dawn Woodard. 2020. Dynamic pricing and matching in ride-hailing platforms. Naval Research Logistics (NRL), Vol. 67, 8 (2020), 705--724.
[40]
Yang Yang, Da-Wei Zhou, De-Chuan Zhan, Hui Xiong, and Yuan Jiang. 2019. Adaptive Deep Models for Incremental Learning: Considering Capacity Scalability and Sustainability. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Anchorage, AK, 74--82.
[41]
Haitao Yuan, Guoliang Li, Zhifeng Bao, and Ling Feng. 2020. Effective travel time estimation: When historical trajectories over road networks matter. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. 2135--2149.
[42]
Desheng Zhang, Ye Li, Fan Zhang, Mingming Lu, Yunhuai Liu, and Tian He. 2013. coRide: Carpool service with a win-win fare model for large-scale taxicab networks. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. 1--14.
[43]
Qi Zhang, Hengshu Zhu, Qi Liu, Enhong Chen, and Hui Xiong. 2021. Exploiting Real-time Search Engine Queries for Earthquake Detection: A Summary of Results. ACM Transactions on Information Systems (TOIS), Vol. 39, 3 (2021), 1--32.
[44]
Wen Zhang, Yang Wang, Xike Xie, Chuancai Ge, and Hengchang Liu. 2020. Real-time travel time estimation with sparse reliable surveillance information. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 4, 1 (2020), 1--23.
[45]
Yu Zheng. 2015. Trajectory data mining: an overview. ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 6, 3 (2015), 1--41. io

Cited By

View all
  • (2025)RLER-TTE: An Efficient and Effective Framework for En Route Travel Time Estimation with Reinforcement LearningProceedings of the ACM on Management of Data10.1145/37097213:1(1-26)Online publication date: 11-Feb-2025
  • (2025)Spatial Meta Learning With Comprehensive Prior Knowledge Injection for Service Time PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.351258237:2(936-950)Online publication date: Feb-2025
  • (2024)Granularity Optimization of Travel Trajectory Based on Node2vec: A Case Study on Urban Travel Time PredictionISPRS International Journal of Geo-Information10.3390/ijgi1312043513:12(435)Online publication date: 2-Dec-2024
  • Show More Cited By

Index Terms

  1. iETA: A Robust and Scalable Incremental Learning Framework for Time-of-Arrival Estimation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      KDD '23: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
      August 2023
      5996 pages
      ISBN:9798400701030
      DOI:10.1145/3580305
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 August 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. adversarial training
      2. attention
      3. knowledge distillation
      4. time-of-arrival estimation
      5. traffic prediction

      Qualifiers

      • Research-article

      Funding Sources

      • Guangzhou Science and Technology Plan Guangzhou-HKUST(GZ) Joint Project
      • Foshan HKUST Projects
      • National Natural Science Foundation of China

      Conference

      KDD '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

      Upcoming Conference

      KDD '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)363
      • Downloads (Last 6 weeks)22
      Reflects downloads up to 17 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)RLER-TTE: An Efficient and Effective Framework for En Route Travel Time Estimation with Reinforcement LearningProceedings of the ACM on Management of Data10.1145/37097213:1(1-26)Online publication date: 11-Feb-2025
      • (2025)Spatial Meta Learning With Comprehensive Prior Knowledge Injection for Service Time PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.351258237:2(936-950)Online publication date: Feb-2025
      • (2024)Granularity Optimization of Travel Trajectory Based on Node2vec: A Case Study on Urban Travel Time PredictionISPRS International Journal of Geo-Information10.3390/ijgi1312043513:12(435)Online publication date: 2-Dec-2024
      • (2024)Artificial Intelligence-Enabled Metaverse for Sustainable Smart Cities: Technologies, Applications, Challenges, and Future DirectionsElectronics10.3390/electronics1324487413:24(4874)Online publication date: 10-Dec-2024
      • (2024)Bayesian Modeling of Travel Times on the Example of Food Delivery: Part 2—Model Creation and Handling UncertaintyElectronics10.3390/electronics1317341813:17(3418)Online publication date: 28-Aug-2024
      • (2024)Learning to Estimate Package Delivery Time in Mixed Imbalanced Delivery and Pickup Logistics ServicesProceedings of the 32nd ACM International Conference on Advances in Geographic Information Systems10.1145/3678717.3691266(432-443)Online publication date: 29-Oct-2024
      • (2024)Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion PredictionProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671507(5206-5217)Online publication date: 25-Aug-2024
      • (2024)DSLR: Diversity Enhancement and Structure Learning for Rehearsal-based Graph Continual LearningProceedings of the ACM Web Conference 202410.1145/3589334.3645561(733-744)Online publication date: 13-May-2024
      • (2024)Continual Learning for Smart City: A SurveyIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.344712336:12(7805-7824)Online publication date: Dec-2024
      • (2024)A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and ProspectsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.344130936:12(7516-7535)Online publication date: Dec-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media