Skip to main content

Discovery of Differential Equations Using Probabilistic Grammars

  • Conference paper
  • First Online:
Discovery Science (DS 2022)

Abstract

Ordinary differential equations (ODEs) are a widely used formalism for mathematical modeling of dynamical systems, a task omnipresent in many scientific domains. The paper introduces a novel method for inferring ODEs from data. It extends ProGED, a method for equation discovery that employs probabilistic context-free grammars for constraining the space of candidate equations. The proposed method can discover ODEs from partial observations of dynamical systems, where only a subset of state variables can be observed. The new method’s empirical evaluation shows it can reconstruct the ODEs of the well-known Van der Pol oscillator from synthetic simulation data. In terms of reconstruction performance, improved ProGED compares favorably to state-of-the-art methods for inferring ODEs from data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Appendix: http://kt.ijs.si/ ljupco/ed/ds-2022/appendix.pdf.

References

  1. Brence, J., Todorovski, L., Džeroski, S.: Probabilistic grammars for equation discovery. Knowl.-Based Syst. 224, 107077 (2021)

    Google Scholar 

  2. Brunton, S.L., Proctor, J.L., Kutz, J.N.: Discovering governing equations from data by sparse identification of nonlinear dynamical systems. In: Proceedings of the National Academy of Sciences, vol. 113, no. 15, pp. 3932–3937 (2016)

    Google Scholar 

  3. Čerepnalkoski, D.: Process-based models of dynamical systems: representation and induction. Ph.D. thesis, Jožef Stefan International Postgraduate School, Ljubljana, Slovenia (2013)

    Google Scholar 

  4. Guimerà, J., et al.: A Bayesian machine scientist to aid in the solution of challenging scientific problems. Sci. Adv. 6(5), eaav6971 (2020)

    Article  Google Scholar 

  5. Hindmarsh, A.C., et al.: SUNDIALS: suite of nonlinear and differential/algebraic equation solvers. ACM Trans. Math. Softw. (TOMS) 31(3), 363–396 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  6. Lukšič, Ž, Tanevski, J., Džeroski, S., Todorovski, L.: Meta-model framework for surrogate-based parameter estimation in dynamical systems. IEEE Access 7, 181829–181841 (2019)

    Article  Google Scholar 

  7. Mangiarotti, S., Coudret, R., Drapeau, L., Jarlan, L.: Polynomial search and global modeling: two algorithms for modeling chaos. Phys. Rev. E 86, 046205 (2012)

    Article  Google Scholar 

  8. Ramm, A.G., Smirnova, A.B.: On stable numerical differentiation. Math. Comput. 70, 1131–1153 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  9. Somacal, A., et al.: Uncovering differential equations from data with hidden variables. Phys. Rev. E 105, 054209 (2022)

    Article  MathSciNet  Google Scholar 

  10. Stolle, Reinhard, Bradley, Elizabeth: Communicable knowledge in automated system identification. In: Džeroski, Sašo, Todorovski, Ljupčo (eds.) Computational Discovery of Scientific Knowledge. LNCS (LNAI), vol. 4660, pp. 17–43. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73920-3_2

  11. Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  12. Todorovski, L., Džeroski, S.: Declarative bias in equation discovery. In: Proceedings of the 14th International Conference on Machine Learning, pp. 376–384 (1997)

    Google Scholar 

Download references

Acknowledgements

The authors acknowledge the financial support of the Slovenian Research Agency via the research core funding No. P2-0103 and project No. N2-0128.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Boštjan Gec .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gec, B., Omejc, N., Brence, J., Džeroski, S., Todorovski, L. (2022). Discovery of Differential Equations Using Probabilistic Grammars. In: Pascal, P., Ienco, D. (eds) Discovery Science. DS 2022. Lecture Notes in Computer Science(), vol 13601. Springer, Cham. https://doi.org/10.1007/978-3-031-18840-4_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-18840-4_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-18839-8

  • Online ISBN: 978-3-031-18840-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics