Skip to main content

Multi-scale Switching Linear Dynamical Systems

  • Conference paper
  • First Online:
Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003 (ICANN 2003, ICONIP 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2714))

  • 1381 Accesses

Abstract

Switching linear dynamic systems can monitor systems that operate in different regimes. In this article we introduce a class of multiscale switching linear dynamical systems that are particularly suited if such regimes form a hierarchy. The setup consists of a specific switching linear dynamical system for every level of coarseness. Jeffrey’s rule of conditioning is used to coordinate the models at the different levels. When the models are appropriately constrained, inference at finer levels can be performed independently for every subtree. This makes it possible to determine the required degree of detail on-line. The refinements of very improbable regimes need not be explored.

The computational complexity of exact inference in both the standard and the multi-class switching linear dynamical system is exponential in the number of observations. We describe an appropriate approximate inference algorithm based on expectation propagation and relate it to a variant of the Bethe free energy.

O. Zoeter is supported by the Dutch Competence Centre Paper and Board

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. M. Ferreira, M. West, H. Lee, and D. Higdon. A class of multi-scale time series models. Unpublished.

    Google Scholar 

  2. T. Heskes and O. Zoeter. Expectation propagation for approximate inference in dynamic Bayesian networks. In UAI-2002, pages 216–223, 2002.

    Google Scholar 

  3. F. Kschischang, B. Frey, and H. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2):498–519, 2001.

    Article  MATH  MathSciNet  Google Scholar 

  4. T. Minka. Expectation propagation for approximate Bayesian inference. In Proceedings of UAI-2001, pages 362–369, 2001.

    Google Scholar 

  5. Y. Teh and M. Welling. The unified propagation and scaling algorithm. In Advances in Neural Information Processing Systems 14, page (in press). MIT Press, 2002.

    Google Scholar 

  6. J. Yedidia, W. Freeman, and Y. Weiss. Generalized belief propagation. In NIPS 13, pages 689–695, 2001.

    Google Scholar 

  7. O. Zoeter and T. Heskes. Hierarchical visualization of time-series data using switching linear dynamical systems. Submitted.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zoeter, O., Heskes, T. (2003). Multi-scale Switching Linear Dynamical Systems. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_67

Download citation

  • DOI: https://doi.org/10.1007/3-540-44989-2_67

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40408-8

  • Online ISBN: 978-3-540-44989-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics