Abstract
Predicting the future trajectories of surrounding vehicles plays a vital role in ensuring the safety of autonomous driving. It is extremely challenging for the pure imitation method due to the high degree of multimodality and uncertainty in the future. In fact, when driving in most traffic scenarios, vehicles should obey some traffic rules such as “vehicles follow the lane and do not collide with each other”. Inspired by this, this paper proposes a goal-aware prediction (GAP) framework to predict the multimodal trajectories, where goals are chosen in the lanes with hierarchical interactive representation and a multi-task loss. Based on the graph-based vectorized input, a novel hierarchical interactive representation module is first designed to obtain the fine-grained goal features, which progressively models interactions between goal-to-goal, goal-to-lane, and lane-to-agent, corresponding to the individual, local and global levels, respectively. Then, an auxiliary collision loss is developed to take into account learning from demonstration and injecting common sense of collision avoidance, and is served as a part of the multi-task loss to guide the generation of multimodal plausible trajectories. In the end, the proposed method is verified on the Baidu In-house Cut-in dataset, which includes more than 370K interactive scenarios collected in the real road testing. The comparative results demonstrate the superior performance of our proposed GAP model than the mainstream prediction methods.
This work was supported by the National Natural Science Foundation of China (NSFC) under Grants No. 62173325, and also was supported by the Beijing Municipal Natural Science Foundation under Grants L191002.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, J., Zhang, Q., Zhao, D., Chen, Y.: Lane change decision-making through deep reinforcement learning with rule-based constraints. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–6 (2019)
Li, H., Zhang, Q., Zhao, D.: Deep reinforcement learning-based automatic exploration for navigation in unknown environment. IEEE Trans. Neural Netw. Learn. Syst. 31(6), 2064–2076 (2020)
Chang, M.-F., Lambert, J., Sangkloy, P., et al.: Argoverse: 3d tracking and forecasting with rich maps. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8740–8749 (2019)
Gao, J., Sun, C., Zhao, H., et al.: VectorNet: encoding HD maps and agent dynamics from vectorized representation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11525–11533 (2020)
Phan-Minh, T., Grigore, E.C., Boulton, F.A., et al.: CoverNet: multimodal behavior prediction using trajectory sets. In: 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14074–14083 (2020)
Chai, Y., Sapp, B., Bansal, M., Anguelov, D.: MultiPath: multiple probabilistic anchor trajectory hypotheses for behavior prediction. In: Conference on Robot Learning (CoRL) (2019)
Song, H., Luan, D., Ding, W., et al.: Learning to predict vehicle trajectories with model-based planning. In: Conference on Robot Learning (CoRL) (2021)
Zhao, H., Gao, J., Lan, T., et al.: TNT: Target-driveN trajectory prediction. In: Conference on Robot Learning (CoRL) (2020)
Suo, S., Regalado, S., Casas, S., Urtasun, R.: Trafficsim: learning to simulate realistic multi-agent behaviors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10400–10409 (2021)
Suo, S., Regalado, S., Casas, S., Urtasun, R.: TrafficSim: learning to simulate realistic multi-agent behaviors. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10400–10409 (2021)
Liu, Y., Zhang, J., Fang, L., et al.: multimodal motion prediction with stacked transformers. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7577–7586 (2021)
Chaochen, Z., Zhang, Q., Li, D., et al.: Vehicle trajectory prediction based on graph attention network. In: 2021 International Conference on Cognitive Systems and Information Processing (ICCSIP) (2021)
Bansal, M., Krizhevsky, A., Ogale, A.: ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst. arXiv preprint arXiv:1812.03079 (2018)
Cui, H., Radosavljevic, V., Chou, F.-C., et al.: Multimodal trajectory predictions for autonomous driving using deep convolutional networks. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 2090–2096 (2019)
Khandelwal, S., Qi, W., Singh, J., Hartnett, A., Ramanan, D.: What-if motion prediction for autonomous driving. arXiv preprint arXiv:2008.10587 (2020)
Ngiam, J., Caine, B., Vasudevan, V., et al.: Scene Transformer: A unified architecture for predicting multiple agent trajectories. arXiv preprint arXiv:2106.08417 (2021)
Wang, J., Zhang, Q., Zhao, D.: Highway lane change decision-making via attention-based deep reinforcement learning. IEEE/CAA J. Autom. Sinica. 9, 1–7 (2022)
Lei Ba, J., Kiros, J.R., Hinton, G.E.: Layer Normalization. arXiv e-prints. arXiv:1607.06450, July 2016
Williams, R.J., Zipser, D.: A learning algorithm for continually running fully recurrent neural networks. Neural Comput. 1(2), 270–280 (1989)
Kingma, D.P., Ba, J.: Adam: a method for Stochastic Optimization. In: 3rd International Conference for Learning Representations (ICLR) (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, D., Zhang, Q., Lu, S., Pan, Y., Zhao, D. (2022). GAP: Goal-Aware Prediction with Hierarchical Interactive Representation for Vehicle Trajectory. In: Tan, Y., Shi, Y. (eds) Data Mining and Big Data. DMBD 2022. Communications in Computer and Information Science, vol 1744. Springer, Singapore. https://doi.org/10.1007/978-981-19-9297-1_22
Download citation
DOI: https://doi.org/10.1007/978-981-19-9297-1_22
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-9296-4
Online ISBN: 978-981-19-9297-1
eBook Packages: Computer ScienceComputer Science (R0)