Zongyu Lin
ABSTRACT
A large-scale system for obtaining fine-grained vehicle trajectories is becoming increasingly important because it lays a solid foundation for a wide range of downstream applications, such as urban traffic optimization, road network profiling, route planning, etc. Traditional methods recover the trajectories from GPS data from apps or coarse-grained traces collected from base stations, which are costly and, more importantly, only cover limited vehicles on the road. Thus, they are not applicable to downstream tasks. To fill this gap, we explore the possibility of recovering vehicle trajectories from the video data recorded by widely deployed traffic cameras. The major challenges lie in the quality of the captured image, low sampling rate, and unbalanced temporal and spatial distribution. To address these challenges, we propose a general system to recover vehicle trajectories at the level of the road intersection, where a novel iterative framework is developed to combine both vehicle clustering and trajectory recovery tasks, which improve their performance simultaneously. The key motivation is that vehicle clustering based on visual features can provide essential discrete points for trajectory recovery, while the recovered routes can introduce spatial-temporal constraints to the initial vehicle clusters for de-noising the false results and complement the missing results. To prove the feasibility of our framework, we collect and plan to release a city-scale traffic camera dataset consisting of 24 hours of videos from 673 cameras across 1,106 intersections. To the best of our knowledge, this benchmark is the first to contain the ground truth of vehicle trajectories with a wide range of spatial and temporal coverage in an urban environment. We conduct extensive experiments and analysis on datasets of different scales to demonstrate the robustness of our framework. Last but not least, we have already deployed the whole system in the business applications of SenseTime, China, including traffic signal control and traffic flow analysis. We highly expect this dataset to further facilitate the research in this field and contribute more to traffic optimization systems in the real world.
- Prithu Banerjee, Sayan Ranu, and Sriram Raghavan. 2014. Inferring uncertain trajectories from partial observations. In 2014 IEEE International Conference on Data Mining. IEEE, 30--39.Google Scholar
Digital Library
- Geoff Boeing. 2017. OSMnx: New methods for acquiring, constructing, analyzing, and visualizing complex street networks. Computers, Environment and Urban Systems 65 (2017), 126--139.Google ScholarCross Ref
- Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 855--864.Google ScholarDigital Library
- Bing He, Jia Li, Yifan Zhao, and Yonghong Tian. 2019. Part-regularized near-duplicate vehicle re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3997--4005.Google ScholarCross Ref
- Zhiqun He, Yu Lei, Shuai Bai, and Wei Wu. 2019. Multi-Camera Vehicle Tracking with Powerful Visual Features and Spatial-Temporal Cue.. In CVPR Workshops. 203--212.Google Scholar
- Sahar Hoteit, Stefano Secci, Stanislav Sobolevsky, Carlo Ratti, and Guy Pujolle. 2014. Estimating human trajectories and hotspots through mobile phone data. Computer Networks 64 (2014), 296--307.Google ScholarDigital Library
- Shruti Kapil and Meenu Chawla. 2016. Performance evaluation of K-means clustering algorithm with various distance metrics. In 2016 IEEE 1st International Conference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES). IEEE, 1--4.Google ScholarCross Ref
- Xinchen Liu, Wu Liu, Tao Mei, and Huadong Ma. 2016. A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In European conference on computer vision. Springer, 869--884.Google ScholarCross Ref
- Zheng Lu, Yunhe Feng, Wenjun Zhou, Xiaolin Li, and Qing Cao. 2018. Inferring correlation between user mobility and app usage in massive coarse-grained data traces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1--21.Google ScholarDigital Library
- Hao Luo, Wei Jiang, Youzhi Gu, Fuxu Liu, Xingyu Liao, Shenqi Lai, and Jianyang Gu. 2019. A strong baseline and batch normalization neck for deep person re-identification. IEEE Transactions on Multimedia 22, 10 (2019), 2597--2609.Google ScholarCross Ref
- Dechao Meng, Liang Li, Xuejing Liu, Yadong Li, Shijie Yang, Zheng-Jun Zha, Xingyu Gao, Shuhui Wang, and Qingming Huang. 2020. Parsing-based viewaware embedding network for vehicle re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7103--7112.Google ScholarCross Ref
- Paul Newson and John Krumm. 2009. Hidden Markov map matching through noise and sparseness. In Proceedings of the 17th ACM SIGSPATIAL international conference on advances in geographic information systems. 336--343.Google ScholarDigital Library
- Mahmood Rahmani and Haris N Koutsopoulos. 2013. Path inference from sparse floating car data for urban networks. Transportation Research Part C: Emerging Technologies 30 (2013), 41--54.Google ScholarCross Ref
- Eric Sven Ristad and Peter N Yianilos. 1998. Learning string-edit distance. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 5 (1998), 522--532.Google ScholarDigital Library
- Yantao Shen, Tong Xiao, Hongsheng Li, Shuai Yi, and Xiaogang Wang. 2017. Learning deep neural networks for vehicle re-id with visual-spatio-temporal path proposals. In Proceedings of the IEEE International Conference on Computer Vision. 1900--1909.Google ScholarCross Ref
- Marina Sokolova and Guy Lapalme. 2009. A systematic analysis of performance measures for classiication tasks. Information processing & management 45, 4 (2009), 427--437.Google Scholar
- Xiao Tan, Zhigang Wang, Minyue Jiang, Xipeng Yang, Jian Wang, Yuan Gao, Xiangbo Su, Xiaoqing Ye, Yuchen Yuan, Dongliang He, et al. 2019. Multi-camera vehicle tracking and re-identification based on visual and spatial-temporal features.. In CVPR Workshops. 275--284.Google Scholar
- Zheng Tang, Milind Naphade, Ming-Yu Liu, Xiaodong Yang, Stan Birchield, Shuo Wang, Ratnesh Kumar, David Anastasiu, and Jenq-Neng Hwang. 2019. Cityflow: A city-scale benchmark for multi-target multi-camera vehicle tracking and re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8797--8806.Google ScholarCross Ref
- Guangcong Wang, Jianhuang Lai, Peigen Huang, and Xiaohua Xie. 2019. Spatial-temporal person re-identification. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 8933--8940.Google ScholarDigital Library
- Jingyuan Wang, Ning Wu, Xinxi Lu, Xin Zhao, and Kai Feng. 2019. Deep trajectory recovery with fine-grained calibration using Kalman filter. IEEE Transactions on Knowledge and Data Engineering (2019).Google ScholarCross Ref
- Ling-Yin Wei, Yu Zheng, and Wen-Chih Peng. 2012. Constructing popular routes from uncertain trajectories. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. 195--203.Google ScholarDigital Library
- Hao Wu, Jiangyun Mao, Weiwei Sun, Baihua Zheng, Hanyuan Zhang, Ziyang Chen, and Wei Wang. 2016. Probabilistic robust route recovery with spatiotemporal dynamics. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1915--1924.Google ScholarDigital Library
- Ke Yan, Yonghong Tian, Yaowei Wang, Wei Zeng, and Tiejun Huang. 2017. Exploiting multi-grain ranking constraints for precisely searching visually-similar vehicles. In Proceedings of the IEEE international conference on computer vision. 562--570.Google ScholarCross Ref
- F Benjamin Zhan and Charles E Noon. 1998. Shortest path algorithms: an evaluation using real road networks. Transportation science 32, 1 (1998), 65--73.Google Scholar
- Yu Zheng and Xiaofang Zhou. 2011. Computing with spatial trajectories. Springer Science & Business Media.Google ScholarDigital Library
- Yi Zhou and Ling Shao. 2018. Aware attentive multi-view inference for vehicle re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6489--6498.Google ScholarCross Ref
Index Terms
- Vehicle Trajectory Recovery on Road Network Based on Traffic Camera Video Data
Recommendations
Spatio-Temporal Vehicle Trajectory Recovery on Road Network Based on Traffic Camera Video Data
KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data MiningLarge-scale vehicle trajectories bring great benefits in understanding urban mobility, and can be used to promote a wide range of applications in building intelligent transportation systems. Traditional approaches cannot recover the trajectories of all ...
On-Road Vehicle Trajectory Collection and Scene-Based Lane Change Analysis: Part II
This two-part paper aims to study lane change behaviors at the tactical level from an on-road perspective. Compared with longitudinal driving tasks, a lane change is more complicated because this task has more interactions with surrounding vehicles; ...
Characteristics of Urban Road Non-recurrent Traffic Congestion Based on Floating Car Data
EITCE '20: Proceedings of the 2020 4th International Conference on Electronic Information Technology and Computer EngineeringNon-recurrent traffic congestion caused by traffic accidents is one of the most important factors that affect the operational efficiency of urban road networks. In this paper, the floating car data (FCD) and the traffic accident data in Wuhan were ...
Comments