Abstract
In this paper, we propose an approximate Kalman filter of measurements following Student’s t-distribution by using the variational Bayes approach. This approach can decompose the estimation of multivariate parameters into a univariate estimation. The recursive formula for the approximate posterior densities of parameters and states is derived in detail. Then, the asymptotic Bayesian Cramer–Rao lower bounds are derived for the proposed filter. Numerical simulations verify both the performance of the proposed filter and the variance lower bounds under time-varying noise. The efficiency of the proposed filter is also demonstrated in a real application, namely an integrated strapdown inertial navigation system/Doppler velocity log shipborne test for navigation.
Similar content being viewed by others
References
G. Agamennoni, J.I. Nieto, E.M. Nebot, Approximate inference in state-space models with heavy-tailed noise. IEEE Trans. Signal Process. 60(10), 5024–5037 (2012)
J. Ala-Luhtala, S. Särkkä, R. Piché, Gaussian filtering and variational approximations for Bayesian smoothing in continuous-discrete stochastic dynamic systems. Signal Process. 111, 124–136 (2015)
T. Baldacchino, E.J. Cross, K. Worden, J. Rowson, Variational Bayesian mixture of experts models and sensitivity analysis for nonlinear dynamical systems. Mech. Syst. Signal Process. 66, 178–200 (2016)
J.M. Bernardo, M.J. Bayarri, J.O. Berger, A.P. Dawid, D. Heckerman, A.F.M. Smith, M. West, The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures. Bayesian Stat. 7, 453–464 (2003)
D.S. Bernstein, Matrix Mathematics (Princeton University Press, Princeton, 2009)
C.M. Bishop, Pattern Recognition and Machine Learning, 2nd edn. (Springer, Berlin, 2007)
W. Gao, J.C. Li, G.T. Zhou, Q. Li, Adaptive Kalman filtering with recursive noise estimator for integrated SINS/DVL systems. J. Navig. 68(1), 142–161 (2015)
Y.L. Huang, Y.G. Zhang, Robust Student’s t-based stochastic cubature filter for nonlinear systems with heavy-tailed process and measurement noises. IEEE Access 5, 7964–7974 (2017)
Y.L. Huang, Y.G. Zhang, N. Li, Z. Shi, Design of Gaussian approximate filter and smoother for nonlinear systems with correlated noises at one epoch apart. Circuits Syst. Signal Process. 35(11), 3981–4008 (2016)
Y.L. Huang, Y.G. Zhang, N. Li, S.M. Naqvi, J.A. Chambers, A robust and efficient system identification method for a state-space model with heavy-tailed process and measurement noises, in 19th International Conference on Information Fusion (Heidelberg, 2016), pp. 441–448
Y.L. Huang, Y.G. Zhang, N. Li, Z.M. Wu, J.A. Chambers, A novel robust Student’s t-based Kalman filter. IEEE Trans. Aerosp. Electron. Syst. 53(3), 1545–1554 (2017)
E.G. Larsson, E.K. Larsson, The Cramér–Rao bound for continuous-time autoregressive parameter estimation with irregular sampling. Circuits Syst. Signal Process. 21(6), 581–601 (2002)
N. Nasios, A.G. Bors, Variational learning for Gaussian mixture models. IEEE Trans. Syst. Man Cybern. B Cybern. 36(4), 849–862 (2006)
E. Özkan, V. Smidl, S. Saha, C. Lundquist, F. Gustafsson, Marginalized adaptive particle filtering for nonlinear models with unknown time-varying noise parameters. Automatica 49(6), 1566–1575 (2013)
M. Roth, E. Özkan, F. Gustafsson, A Student’s filter for heavy-tailed process and measurement noise, in Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (2013), pp. 5770–5774
S. Särkkä, J. Hartikainen, Variational Bayesian adaptation of noise covariance in nonlinear Kalman filtering, in Proceedings of International Workshop on Machine Learning for Signal Processing (Southampton, 2013), pp. 1–6
S. Särkkä, A. Nummenmaa, Recursive noise adaptive Kalman filtering by variational Bayesian approximations. IEEE Trans. Autom. Control 54(3), 596–600 (2009)
I.C. Schick, S.K. Mitter, Robust recursive estimation in the presence of heavy-tailed observation noise. Ann. Stat. 2, 1045–1080 (1994)
A. Solin, S. Särkkä, State space methods for efficient inference in Student-t process regression, in Proceedings of the 18th International Conference on Artificial Intelligence and Statistics (AISTATS) (San Diego, 2015), pp. 885–893
P. Tichavský, C.H. Muravchik, A. Nehorai, Posterior Cramér–Rao bounds for discrete-time nonlinear filtering. IEEE Trans. Signal Process. 46(5), 1386–1396 (1998)
D.G. Tzikas, A.C. Likas, N.P. Galatsanos, The variational approximation for Bayesian inference. IEEE Signal Process. Mag. 25(6), 131–146 (2008)
S.Y. Wang, C. Yin, S.K. Duan, L.D. Wang, A modified variational Bayesian noise adaptive Kalman filter. Circuits Syst. Signal Process. 36(10), 4260–4277 (2017)
X. Wei, C. Li, The infinite Student’s t-mixture for robust modeling. Signal Process. 92(1), 224–234 (2012)
H. Zhu, H. Leung, Z. He, A variational Bayesian approach to robust sensor fusion based on Student-t distribution. Inf. Sci. 221, 201–214 (2013)
H. Zhu, H. Leung, Z.S. He, State estimation in unknown non-Gaussian measurement noise using variational Bayesian technique. IEEE Trans. Aerosp. Electron. Syst. 49(4), 2601–2614 (2013)
L. Zuo, R.X. Niu, P.K. Varshney, Conditional posterior Cramér–Rao lower bounds for nonlinear sequential Bayesian estimation. IEEE Trans. Signal Process. 59(1), 1–14 (2011)
Acknowledgements
This work is supported by the National Natural Science Foundation of China under Grants 61773133 and the Fundamental Research Funds for the Central Universities under Grants HEUCF181110.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Z., Zhou, W. Robust Linear Filter with Parameter Estimation Under Student-t Measurement Distribution. Circuits Syst Signal Process 38, 2445–2470 (2019). https://doi.org/10.1007/s00034-018-0972-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-018-0972-8