Abstract
Devising a model of a dynamical system from raw observations of its states and evolution requires characterising its phase space, which includes identifying its dimension and state variables. Recently, Boyuan Chen and his colleagues proposed a technique that uses intrinsic dimension estimators to discover the hidden variables in experimental data. The method uses estimators of the intrinsic dimension of the manifold of observations. We present the results of a comparative empirical performance evaluation of various candidate estimators. We expand the repertoire of estimators proposed by Chen et al. and find that several estimators not initially suggested by the authors outperforms the others.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The code to reproduce the results presented in this paper is available at: https://github.com/fchavelli/id_estimation/tree/main.
- 2.
The package is available at https://scikit-dimension.readthedocs.io.
References
Amsaleg, L., et al.: Extreme-value-theoretic estimation of local intrinsic dimensionality. Data Min. Knowl. Disc. 32(6), 1768–1805 (2018)
Bac, J., Mirkes, E.M., Gorban, A.N., Tyukin, I., Zinovyev, A.: Scikit-dimension: a python package for intrinsic dimension estimation. Entropy 23(10), 1368 (2021)
Bellman, R.E.: Adaptive Control Processes. Princeton University Press, Princeton (1961)
Bennett, R.S.: Representation and analysis of signals part xxi. the intrinsic dimensionality of signal collections (1965)
Brito, M., Quiroz, A., Yukich, J.: Intrinsic dimension identification via graph-theoretic methods. J. Multivar. Anal. 116, 263–277 (2013)
Campadelli, P., Casiraghi, E., Ceruti, C., Rozza, A.: Intrinsic dimension estimation: relevant techniques and a benchmark framework. Math. Probl. Eng. 2015, 1–21 (2015)
Chen, B., Huang, K., Raghupathi, S., Chandratreya, I., Du, Q., Lipson, H.: Automated discovery of fundamental variables hidden in experimental data. Nat. Comput. Sci. 2, 433–442 (2022)
Costa, J., Girotra, A., Hero, A.: Estimating local intrinsic dimension with k-nearest neighbor graphs. In: IEEE/SP 13th Workshop on Statistical Signal Processing, 2005, pp. 417–422 (2005)
Costa, J., Hero, A.: Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Trans. Signal Process. 52(8), 2210–2221 (2004)
Costa, J.A., Hero, A.O.: Determining Intrinsic Dimension and Entropy of High-Dimensional Shape Spaces, pp. 231–252. Birkhäuser Boston, Boston, MA (2006)
Facco, E., d’Errico, M., Rodriguez, A., Laio, A.: Estimating the intrinsic dimension of datasets by a minimal neighborhood information. Sci. Rep. 7(1), 12140 (2017)
Farahmand, A.M., Szepesvári, C., Audibert, J.Y.: Manifold-adaptive dimension estimation. In: Proceedings of the 24th International Conference on Machine Learning, pp. 265–272. ICML 2007, Association for Computing Machinery, New York, NY, USA (2007)
Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Physica D 9(1), 189–208 (1983)
Haro, G., Randall, G., Sapiro, G.: Translated poisson mixture model for stratification learning. Int. J. Comput. Vis. 80, 358–374 (2008)
Hein, M., Audibert, J.Y.: Intrinsic dimensionality estimation of submanifolds in \({R}^d\), pp. 289–296 (01 2005)
Jolliffe, I.T.: Principal component analysis and factor analysis. In: Principal Component Analysis. Springer Series in Statistics, pp. 115–128. Springer, New York (1986). https://doi.org/10.1007/978-1-4757-1904-8_7
Kuwamura, M.: The hamiltonian formalism in reaction-diffusion systems. Asymptotic Anal. Singularities-Elliptic Parabolic PDEs Relat. Prob. 47, 635–646 (2007)
Levina, E., Bickel, P.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems, vol. 17 (2004)
Lombardi, G.: Intrinsic dimensionality estimation techniques (2023). https://www.mathworks.com/matlabcentral/fileexchange/40112-intrinsic-dimensionality-estimation-techniques
Rozza, A., Lombardi, G., Ceruti, C., Casiraghi, E., Campadelli, P.: Novel high intrinsic dimensionality estimators. Mach. Learn. 89(1), 37–65 (2012)
Stewart, D.E., Dewar, R.L.: Non-linear Dynamics, pp. 167–248. Cambridge University Press, Cambridge (2000)
Acknowledgements
This research is supported by Singapore Ministry of Education, grant MOE-T2EP50120-0019, and by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise (CREATE) programme as part of the programme Descartes.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chavelli, F., Zi-Yu, K., Low, J.S.C., Bressan, S. (2023). Assessing the Effectiveness of Intrinsic Dimension Estimators for Uncovering the Phase Space Dimensionality of Dynamical Systems from State Observations. In: Strauss, C., Amagasa, T., Kotsis, G., Tjoa, A.M., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2023. Lecture Notes in Computer Science, vol 14146. Springer, Cham. https://doi.org/10.1007/978-3-031-39847-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-39847-6_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-39846-9
Online ISBN: 978-3-031-39847-6
eBook Packages: Computer ScienceComputer Science (R0)