Skip to main content

Online Identification of Gaussian-Process State-Space Model with Missing Observations

  • Conference paper
  • First Online:
  • 857 Accesses

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1712))

Abstract

When the state-space model is black-box, it is difficult to identify the system based on the input and observation. In predictive control and other fields, the state and model need to be updated in real time, and online identification becomes very important. However, compared with offline learning, online learning of black-box model is more difficult. This paper proposes an online Bayesian inference and learning method for state-space models with missing observations. When the state-space model is black-box, we expressed it as basis function expansions. Through the connection to the Gaussian processes (GPs), the state and basis function coefficients are updated online. The problems of missing observations caused by the sensor failure are often encountered in practical engineering and are taken into consideration in this paper. In order to keep the online algorithm from being interrupted by missing observations, we update the states and unknown parameters according to whether the observation is missing at the current time. This conservative strategy makes the online learning continuous when the observation is missing, and makes full use of the available statistics in the past. Numerical examples show that the proposed method is robust to missing data and can make full use of the available observations.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Sinha, N.K.: System identification—theory for the user: Lennart Ljung. Automatica 25(3), 475–476 (1989)

    Article  Google Scholar 

  2. Sjöberg J., et al.: Nonlinear black-box modeling in system identification: a unified overview. Automatica 31(12), 1725–1750 (1995)

    Google Scholar 

  3. Moon, T.K.: The expectation-maximization algorithm. Signal Process. Mag. IEEE 13(6), 47–60 (1996)

    Article  Google Scholar 

  4. Matarazzo, T.: STRIDE for structural identification using expectation maximization: iterative output-only method for modal identification. J. Eng. Mech. 142(4) (2015)

    Google Scholar 

  5. Ghahramani, Z., Hinton, G.E.: Variational learning for switching state-space models. Neural Comput. 12(4), 831–864 (2000)

    Article  Google Scholar 

  6. Blei, D.M., Jordan, M.I.: Variational inference for Dirichlet process mixtures. J. Bayesian Anal. 1(1), 121–143 (2006)

    MathSciNet  MATH  Google Scholar 

  7. Jacobs, W.R., et al.: Sparse Bayesian nonlinear system identification using variational inference. IEEE Trans. Autom. Control. 63, 4172 (2018)

    Google Scholar 

  8. Kullberg, A., Skog, I., Hendeby, G.: Online joint state inference and learning of partially unknown state-space models. IEEE Trans. Signal Process. 69, 4149–4161 (2021)

    Article  MathSciNet  MATH  Google Scholar 

  9. Tobar, F., Djuric, P.M., Mandic, D.P.: Unsupervised state-space modeling using reproducing kernels. IEEE Trans. Signal Process. 63(19), 5210–5221 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  10. Svensson, A., Schön, T.B.: A flexible state space model for learning nonlinear dynamical systems. Automatica 80, 189–199 (2017)

    Google Scholar 

  11. Solin, A., Särkkä, S.: Hilbert space methods for reduced-rank Gaussian process regression. arXiv (2014)

    Google Scholar 

  12. Berntorp, K.: Online Bayesian inference and learning of Gaussian-process state–space models. Automatica 129, 109613 (2021)

    Google Scholar 

  13. Gopaluni, R.B., et al.: Particle filter approach to nonlinear system identification under missing observations with a real application. In: Ifac Proceedings Volumes (2009)

    Google Scholar 

  14. Gopaluni, R.B.: Nonlinear system identification under missing observations: the case of unknown model structure. J. Process Control 20(3), 314–324 (2010)

    Article  Google Scholar 

  15. Lindsten, F., Jordan, M.I., Schn, T.B.: Particle Gibbs with ancestor sampling. J. Mach. Learn. Res. 15(15), 2145–2184 (2014)

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Chao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, X., Ma, P., Chao, T., Yang, M. (2022). Online Identification of Gaussian-Process State-Space Model with Missing Observations. In: Fan, W., Zhang, L., Li, N., Song, X. (eds) Methods and Applications for Modeling and Simulation of Complex Systems. AsiaSim 2022. Communications in Computer and Information Science, vol 1712. Springer, Singapore. https://doi.org/10.1007/978-981-19-9198-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-9198-1_8

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-9197-4

  • Online ISBN: 978-981-19-9198-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics