Abstract
Interacting Dynamic Systems refer to a group of agents which interact with others in a complex and dynamic way. Modeling Interacting Dynamic Systems is a crucial topic with numerous applications, such as in time series forecasting and physical simulations. To accurately model these systems, it is necessary to learn the temporal and relational dimensions jointly. However, previous methods have struggled to learn the temporal dimension explicitly because they often overlook the physical properties of the system. Furthermore, they often ignore the distance information in the relational dimensions. To address these limitations, we propose a Dynamic Data Driven Application Systems (DDDAS) approach called Interacting System Ordinary Differential Equations (ISODE). Our approach leverages the latent space of Neural ODEs to model the temporal dimensions explicitly and incorporates the distance information in the relational dimensions. Moreover, we demonstrate how our approach can dynamically update an agent’s trajectory when obstacles are introduced, without requiring retraining. Our experimental studies reveal that our ISODE DDDAS approach outperforms existing methods in prediction accuracy. We also illustrate that our approach can dynamically adapt to changes in the environment by showing our agent can dynamically avoid obstacles. Overall, our approach provides a promising solution to modeling Interacting Dynamic Systems that can capture the temporal and relational dimensions accurately.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., Savarese, S.: Social LSTM: Human trajectory prediction in crowded spaces. In: Proceedings of the IEEE Conference On Computer Vision And Pattern Recognition, pp. 961–971 (2016)
Bock, J., Krajewski, R., Moers, T., Runde, S., Vater, L., Eckstein, L.: The IND dataset: A drone dataset of naturalistic road user trajectories at german intersections. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 1929–1934 (2020). https://doi.org/10.1109/IV47402.2020.9304839
Chen, R.T., Rubanova, Y., Bettencourt, J., Duvenaud, D.K.: Neural ordinary differential equations. In: Advances in Neural Information Processing Systems, vol. 31 (2018)
De Brouwer, E., Simm, J., Arany, A., Moreau, Y.: Gru-ode-bayes: continuous modeling of sporadically-observed time series. In: Advances in Neural Information Processing Systems 32 (2019)
Dupont, E., Doucet, A., Teh, Y.W.: Augmented neural odes. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Durkan, C., Bekasov, A., Murray, I., Papamakarios, G.: Neural spline flows. Advances in Neural Information Processing Systems, vol. 32 (2019)
Gao, J., Sun, C., Zhao, H., Shen, Y., Anguelov, D., Li, C., Schmid, C.: Vectornet: Encoding hd maps and agent dynamics from vectorized representation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11525–11533 (2020)
Graber, C., Schwing, A.: Dynamic neural relational inference for forecasting trajectories. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 1018–1019 (2020)
Gruenbacher, S., et al.: Gotube: Scalable stochastic verification of continuous-depth models. arXiv preprint arXiv:2107.08467 (2021)
Grunbacher, S., Hasani, R., Lechner, M., Cyranka, J., Smolka, S.A., Grosu, R.: On the verification of neural odes with stochastic guarantees. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 35, pp. 11525–11535 (2021)
Gu, J., Sun, C., Zhao, H.: Densetnt: End-to-end trajectory prediction from dense goal sets. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15303–15312 (2021)
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., Alahi, A.: Social gan: socially acceptable trajectories with generative adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2255–2264 (2018)
Hasani, R., Lechner, M., Amini, A., Rus, D., Grosu, R.: Liquid time-constant networks. arXiv preprint arXiv:2006.04439 (2020)
Jia, J., Benson, A.R.: Neural jump stochastic differential equations. In: Advances in Neural Information Processing Systems, vol. 2 (2019)
Kipf, T., Fetaya, E., Wang, K.C., Welling, M., Zemel, R.: Neural relational inference for interacting systems. In: International Conference on Machine Learning, pp. 2688–2697. PMLR (2018)
Krajewski, R., Bock, J., Kloeker, L., Eckstein, L.: The highd dataset: A drone dataset of naturalistic vehicle trajectories on German highways for validation of highly automated driving systems. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 2118–2125 (2018). https://doi.org/10.1109/ITSC.2018.8569552
Krajewski, R., Moers, T., Bock, J., Vater, L., Eckstein, L.: The round dataset: a drone dataset of road user trajectories at roundabouts in Germany. In: 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6 (2020). https://doi.org/10.1109/ITSC45102.2020.9294728
Li, J., Yang, F., Tomizuka, M., Choi, C.: Evolvegraph: multi-agent trajectory prediction with dynamic relational reasoning. Adv. Neural. Inf. Process. Syst. 33, 19783–19794 (2020)
Liang, Y., Ouyang, K., Yan, H., Wang, Y., Tong, Z., Zimmermann, R.: Modeling trajectories with neural ordinary differential equations. In: IJCAI, pp. 1498–1504 (2021)
Liebenwein, L., Hasani, R., Amini, A., Rus, D.: Sparse flows: pruning continuous-depth models. In: Advances in Neural Information Processing Systems, vol. 34 (2021)
Park, S., Kim, K., Lee, J., Choo, J., Lee, J., Kim, S., Choi, E.: Vid-ode: continuous-time video generation with neural ordinary differential equation. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 35, pp. 2412–2422 (2021)
Quaglino, A., Gallieri, M., Masci, J., Koutník, J.: Snode: spectral discretization of neural odes for system identification. arXiv preprint arXiv:1906.07038 (2019)
Rubanova, Y., Chen, R.T., Duvenaud, D.K.: Latent ordinary differential equations for irregularly-sampled time series. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Salzmann, T., Ivanovic, B., Chakravarty, P., Pavone, M.: Trajectron++: dynamically-feasible trajectory forecasting with heterogeneous data. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) Computer Vision – ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII, pp. 683–700. Springer International Publishing, Cham (2020). https://doi.org/10.1007/978-3-030-58523-5_40
Shi, R., Morris, Q.: Segmenting hybrid trajectories using latent odes. In: International Conference on Machine Learning, pp. 9569–9579. PMLR (2021)
Sun, C., Karlsson, P., Wu, J., Tenenbaum, J.B., Murphy, K.: Stochastic prediction of multi-agent interactions from partial observations. arXiv preprint arXiv:1902.09641 (2019)
Vorbach, C., Hasani, R., Amini, A., Lechner, M., Rus, D.: Causal navigation by continuous-time neural networks. In: Advances in Neural Information Processing Systems, vol. 34 (2021)
Yan, H., Du, J., Tan, V.Y., Feng, J.: On robustness of neural ordinary differential equations. arXiv preprint arXiv:1910.05513 (2019)
Yildiz, C., Heinonen, M., Lahdesmaki, H.: Ode2vae: Deep generative second order odes with bayesian neural networks. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Yuan, Y., Weng, X., Ou, Y., Kitani, K.M.: Agentformer: agent-aware transformers for socio-temporal multi-agent forecasting. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9813–9823 (2021)
Acknowledgements
Research partially funded by research grants to Metaxas from NSF: 1951890, 2003874, 1703883, 1763523 and ARO MURI SCAN.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wen, S., Wang, H., Metaxas, D. (2024). Learning Interacting Dynamic Systems with Neural Ordinary Differential Equations. In: Blasch, E., Darema, F., Aved, A. (eds) Dynamic Data Driven Applications Systems. DDDAS 2022. Lecture Notes in Computer Science, vol 13984. Springer, Cham. https://doi.org/10.1007/978-3-031-52670-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-52670-1_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-52669-5
Online ISBN: 978-3-031-52670-1
eBook Packages: Computer ScienceComputer Science (R0)