Abstract
Simulation now plays an important role in the development of autonomous driving algorithms as it can significantly reduce the economical cost and ethical risk of real-world testing. However, building a high-quality driving simulator is not trivial as it calls for realistic interactive behaviors of road agents. Recently, several simulators employ interactive trajectory prediction models learnt in a data-driven manner. While they are successful in generating short-term interactive scenarios, the simulator quickly breaks down when the time horizon gets longer. We identify the reason behind: existing interactive trajectory predictors suffer from the out-of-domain (OOD) problem when recursively feeding predictions as the input back to the model. To this end, we propose to introduce a tailored model predictive control (MPC) module as a rescue into the state-of-the art interactive trajectory prediction model M2I, forming a new simulator named M\(^2\)Sim. Notably, M\(^2\)Sim can effectively address the OOD problem of long-term simulation by enforcing a flexible regularization that admits the replayed data, while still enjoying the diversity of data-driven predictions. We demonstrate the superiority of M\(^2\)Sim using both quantitative results and visualizations and release our data, code and models: https://github.com/0nhc/m2sim.
Sponsored by Baidu Inc. through Apollo-AIR Joint Research Center.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ngiam, J., et al.: Scene transformer: a unified architecture for predicting future trajectories of multiple agents. In: International Conference on Learning Representations (2022)
Sun, Q., Huang, X., Gu, J., Williams, B.C., Zhao, H.: M2I: from factored marginal trajectory prediction to interactive prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6543–6552 (2022)
Liu, X., Wang, Y., Jiang, K., Zhou, Z., Nam, K., Yin, C.: Interactive trajectory prediction using a driving risk map-integrated deep learning method for surrounding vehicles on highways. IEEE Trans. Intell. Transp. Syst. 23(10), 19076–19087 (2022)
Zhang, K., Zhao, L., Dong, C., Wu, L., Zheng, L.: AI-TP: attention-based interaction-aware trajectory prediction for autonomous driving. IEEE Trans. Intell. Veh. 8, 73–83 (2022)
Shen, Z., et al.: Towards out-of-distribution generalization: a survey. arXiv preprint arXiv:2108.13624 (2021)
Filos, A., Tigkas, P., McAllister, R., Rhinehart, N., Levine, S., Gal, Y.: Can autonomous vehicles identify, recover from, and adapt to distribution shifts? In: International Conference on Machine Learning, pp. 3145–3153. PMLR (2020)
Kerrigan, E.C.: Predictive control for linear and hybrid systems [bookshelf]. IEEE Control Syst. Mag. 38(2), 94–96 (2018)
Falcone, P., et al.: Nonlinear model predictive control for autonomous vehicles (2007)
Carvalho, A., Gao, Y., Gray, A., Tseng, H.E., Borrelli, F.: Predictive control of an autonomous ground vehicle using an iterative linearization approach. In: 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), pp 2335–2340. IEEE (2013)
Gao, Y., Lin, T., Borrelli, F., Tseng, E., Hrovat, D.: Predictive control of autonomous ground vehicles with obstacle avoidance on slippery roads. In: Dynamic Systems and Control Conference, vol. 44175, pp. 265–272 (2010)
Beal, C.E., Gerdes, J.C.: Model predictive control for vehicle stabilization at the limits of handling. IEEE Trans. Control Syst. Technol. 21(4), 1258–1269 (2012)
Levinson, J., et al.: Towards fully autonomous driving: systems and algorithms. In: 2011 IEEE Intelligent Vehicles Symposium (IV), pp. 163–168. IEEE (2011)
Ettinger, S., et al.: Large scale interactive motion forecasting for autonomous driving: the waymo open motion dataset. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9710–9719 (2021)
Kong, J., Pfeiffer, M., Schildbach, G., Borrelli, F.: Kinematic and dynamic vehicle models for autonomous driving control design. In: 2015 IEEE Intelligent Vehicles Symposium (IV), pp. 1094–1099. IEEE (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Han, Z. et al. (2024). M\(^2\)Sim: A Long-Term Interactive Driving Simulator. In: Fang, L., Pei, J., Zhai, G., Wang, R. (eds) Artificial Intelligence. CICAI 2023. Lecture Notes in Computer Science(), vol 14474. Springer, Singapore. https://doi.org/10.1007/978-981-99-9119-8_16
Download citation
DOI: https://doi.org/10.1007/978-981-99-9119-8_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-9118-1
Online ISBN: 978-981-99-9119-8
eBook Packages: Computer ScienceComputer Science (R0)