Abstract
Switching linear dynamic systems can monitor systems that operate in different regimes. In this article we introduce a class of multiscale switching linear dynamical systems that are particularly suited if such regimes form a hierarchy. The setup consists of a specific switching linear dynamical system for every level of coarseness. Jeffrey’s rule of conditioning is used to coordinate the models at the different levels. When the models are appropriately constrained, inference at finer levels can be performed independently for every subtree. This makes it possible to determine the required degree of detail on-line. The refinements of very improbable regimes need not be explored.
The computational complexity of exact inference in both the standard and the multi-class switching linear dynamical system is exponential in the number of observations. We describe an appropriate approximate inference algorithm based on expectation propagation and relate it to a variant of the Bethe free energy.
O. Zoeter is supported by the Dutch Competence Centre Paper and Board
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
M. Ferreira, M. West, H. Lee, and D. Higdon. A class of multi-scale time series models. Unpublished.
T. Heskes and O. Zoeter. Expectation propagation for approximate inference in dynamic Bayesian networks. In UAI-2002, pages 216–223, 2002.
F. Kschischang, B. Frey, and H. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2):498–519, 2001.
T. Minka. Expectation propagation for approximate Bayesian inference. In Proceedings of UAI-2001, pages 362–369, 2001.
Y. Teh and M. Welling. The unified propagation and scaling algorithm. In Advances in Neural Information Processing Systems 14, page (in press). MIT Press, 2002.
J. Yedidia, W. Freeman, and Y. Weiss. Generalized belief propagation. In NIPS 13, pages 689–695, 2001.
O. Zoeter and T. Heskes. Hierarchical visualization of time-series data using switching linear dynamical systems. Submitted.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zoeter, O., Heskes, T. (2003). Multi-scale Switching Linear Dynamical Systems. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_67
Download citation
DOI: https://doi.org/10.1007/3-540-44989-2_67
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40408-8
Online ISBN: 978-3-540-44989-8
eBook Packages: Springer Book Archive