Skip to main content
Log in

Robust Linear Filter with Parameter Estimation Under Student-t Measurement Distribution

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

In this paper, we propose an approximate Kalman filter of measurements following Student’s t-distribution by using the variational Bayes approach. This approach can decompose the estimation of multivariate parameters into a univariate estimation. The recursive formula for the approximate posterior densities of parameters and states is derived in detail. Then, the asymptotic Bayesian Cramer–Rao lower bounds are derived for the proposed filter. Numerical simulations verify both the performance of the proposed filter and the variance lower bounds under time-varying noise. The efficiency of the proposed filter is also demonstrated in a real application, namely an integrated strapdown inertial navigation system/Doppler velocity log shipborne test for navigation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. G. Agamennoni, J.I. Nieto, E.M. Nebot, Approximate inference in state-space models with heavy-tailed noise. IEEE Trans. Signal Process. 60(10), 5024–5037 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  2. J. Ala-Luhtala, S. Särkkä, R. Piché, Gaussian filtering and variational approximations for Bayesian smoothing in continuous-discrete stochastic dynamic systems. Signal Process. 111, 124–136 (2015)

    Article  Google Scholar 

  3. T. Baldacchino, E.J. Cross, K. Worden, J. Rowson, Variational Bayesian mixture of experts models and sensitivity analysis for nonlinear dynamical systems. Mech. Syst. Signal Process. 66, 178–200 (2016)

    Article  Google Scholar 

  4. J.M. Bernardo, M.J. Bayarri, J.O. Berger, A.P. Dawid, D. Heckerman, A.F.M. Smith, M. West, The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures. Bayesian Stat. 7, 453–464 (2003)

    MathSciNet  Google Scholar 

  5. D.S. Bernstein, Matrix Mathematics (Princeton University Press, Princeton, 2009)

    Book  MATH  Google Scholar 

  6. C.M. Bishop, Pattern Recognition and Machine Learning, 2nd edn. (Springer, Berlin, 2007)

    MATH  Google Scholar 

  7. W. Gao, J.C. Li, G.T. Zhou, Q. Li, Adaptive Kalman filtering with recursive noise estimator for integrated SINS/DVL systems. J. Navig. 68(1), 142–161 (2015)

    Article  Google Scholar 

  8. Y.L. Huang, Y.G. Zhang, Robust Student’s t-based stochastic cubature filter for nonlinear systems with heavy-tailed process and measurement noises. IEEE Access 5, 7964–7974 (2017)

    Article  Google Scholar 

  9. Y.L. Huang, Y.G. Zhang, N. Li, Z. Shi, Design of Gaussian approximate filter and smoother for nonlinear systems with correlated noises at one epoch apart. Circuits Syst. Signal Process. 35(11), 3981–4008 (2016)

    Article  MATH  Google Scholar 

  10. Y.L. Huang, Y.G. Zhang, N. Li, S.M. Naqvi, J.A. Chambers, A robust and efficient system identification method for a state-space model with heavy-tailed process and measurement noises, in 19th International Conference on Information Fusion (Heidelberg, 2016), pp. 441–448

  11. Y.L. Huang, Y.G. Zhang, N. Li, Z.M. Wu, J.A. Chambers, A novel robust Student’s t-based Kalman filter. IEEE Trans. Aerosp. Electron. Syst. 53(3), 1545–1554 (2017)

    Article  Google Scholar 

  12. E.G. Larsson, E.K. Larsson, The Cramér–Rao bound for continuous-time autoregressive parameter estimation with irregular sampling. Circuits Syst. Signal Process. 21(6), 581–601 (2002)

    Article  MATH  Google Scholar 

  13. N. Nasios, A.G. Bors, Variational learning for Gaussian mixture models. IEEE Trans. Syst. Man Cybern. B Cybern. 36(4), 849–862 (2006)

    Article  Google Scholar 

  14. E. Özkan, V. Smidl, S. Saha, C. Lundquist, F. Gustafsson, Marginalized adaptive particle filtering for nonlinear models with unknown time-varying noise parameters. Automatica 49(6), 1566–1575 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  15. M. Roth, E. Özkan, F. Gustafsson, A Student’s filter for heavy-tailed process and measurement noise, in Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (2013), pp. 5770–5774

  16. S. Särkkä, J. Hartikainen, Variational Bayesian adaptation of noise covariance in nonlinear Kalman filtering, in Proceedings of International Workshop on Machine Learning for Signal Processing (Southampton, 2013), pp. 1–6

  17. S. Särkkä, A. Nummenmaa, Recursive noise adaptive Kalman filtering by variational Bayesian approximations. IEEE Trans. Autom. Control 54(3), 596–600 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  18. I.C. Schick, S.K. Mitter, Robust recursive estimation in the presence of heavy-tailed observation noise. Ann. Stat. 2, 1045–1080 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  19. A. Solin, S. Särkkä, State space methods for efficient inference in Student-t process regression, in Proceedings of the 18th International Conference on Artificial Intelligence and Statistics (AISTATS) (San Diego, 2015), pp. 885–893

  20. P. Tichavský, C.H. Muravchik, A. Nehorai, Posterior Cramér–Rao bounds for discrete-time nonlinear filtering. IEEE Trans. Signal Process. 46(5), 1386–1396 (1998)

    Article  Google Scholar 

  21. D.G. Tzikas, A.C. Likas, N.P. Galatsanos, The variational approximation for Bayesian inference. IEEE Signal Process. Mag. 25(6), 131–146 (2008)

    Article  Google Scholar 

  22. S.Y. Wang, C. Yin, S.K. Duan, L.D. Wang, A modified variational Bayesian noise adaptive Kalman filter. Circuits Syst. Signal Process. 36(10), 4260–4277 (2017)

    Article  MATH  Google Scholar 

  23. X. Wei, C. Li, The infinite Student’s t-mixture for robust modeling. Signal Process. 92(1), 224–234 (2012)

    Article  Google Scholar 

  24. H. Zhu, H. Leung, Z. He, A variational Bayesian approach to robust sensor fusion based on Student-t distribution. Inf. Sci. 221, 201–214 (2013)

    Article  MATH  Google Scholar 

  25. H. Zhu, H. Leung, Z.S. He, State estimation in unknown non-Gaussian measurement noise using variational Bayesian technique. IEEE Trans. Aerosp. Electron. Syst. 49(4), 2601–2614 (2013)

    Article  Google Scholar 

  26. L. Zuo, R.X. Niu, P.K. Varshney, Conditional posterior Cramér–Rao lower bounds for nonlinear sequential Bayesian estimation. IEEE Trans. Signal Process. 59(1), 1–14 (2011)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grants 61773133 and the Fundamental Research Funds for the Central Universities under Grants HEUCF181110.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weidong Zhou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Z., Zhou, W. Robust Linear Filter with Parameter Estimation Under Student-t Measurement Distribution. Circuits Syst Signal Process 38, 2445–2470 (2019). https://doi.org/10.1007/s00034-018-0972-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-018-0972-8

Keywords

Navigation