Abstract
The optimally weighted least squares estimate and the linear minimum variance estimate are two of the most popular estimation methods for a linear model. In this paper, the authors make a comprehensive discussion about the relationship between the two estimates. Firstly, the authors consider the classical linear model in which the coefficient matrix of the linear model is deterministic, and the necessary and sufficient condition for equivalence of the two estimates is derived. Moreover, under certain conditions on variance matrix invertibility, the two estimates can be identical provided that they use the same a priori information of the parameter being estimated. Secondly, the authors consider the linear model with random coefficient matrix which is called the extended linear model; under certain conditions on variance matrix invertibility, it is proved that the former outperforms the latter when using the same a priori information of the parameter.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
C. R. Rao, Linear Statistical Inference and Its Applications (2nd Edition), John Willy & Sons, New York, 1973.
S. Haykin, Adaptive Filter Theory, Prentice-Hall, Englewood Cliffs, NJ, 1996.
L. Ljung, System Identification: Theory for the User, Englewood Cliffs, NJ, Prentice Hall, 1987.
R. G. Brown, Introduction to Random Signal Analysis and Kalman Filtering, John Wiley & Sons, New York, 1983.
C. K. Chui and G. Chen, Kalman Filtering with Real-Time Applications, Springer-Verlag, New York, 1987.
Y. M. Zhu, Efficient recursive state estimator for dynamic systems without knowledge of noise covariances, IEEE Trans. Aerospace and Electronic Systems, 1999, 35(1): 102–114.
H. W. Sorenson, Least-Squares estimation: From Gauss to Kalman, IEEE Spectrum, Vol.7, 1970, 63–68.
Probability Group of Institute of Mathematics, Chinese Academy of Science, Mathmatical Methods in Discrete Time System Filtering, Defense Industry Press (in Chinese), Beijing, 1975.
C. Y. Chong, K. C. Chang, and S. Mori, Distributed tracking in distributed sensor networks, in Proceedings of the 1986 American Control Conference, Seatlle, WA, June, 1986.
Y. M. Zhu, J. Zhao, and X. R Li, The performance comparison of optimally weighted LS and linear minimum variance estimation of linear model with random input, in Proceedings of the 41st IEEE Conference on Decision and Control, Las Vegas, USA, 2002, 4258–4263.
A. Ben-Israel and T. N. E. Greville, Generalized Inverses: Theory and Applications (2nd edition), John Wiley & Sons, New York, 2002.
H. R. Hashemipour, S. Roy, and A. J Laub, Decentralized structures for parallel Kalman filtering, IEEE Trans. Automatic Control, 1988, 33(1): 88–94.
Y. M. Zhu and X. R. Li, Best linear unbiased estimation fusion, in Proceedings of 1999 International Information Fusion Conference, Sunnyvale, CA, July, 1999.
X. R. Li, Y. M. Zhu, and C. Z. Han, Unified optimal linear estimation fusion, in Proceedings of 2000 International Information Fusion Conference, Paris, 2000, 10–13.
Y. M. Zhu, Multisensor Decision and Estimation Fusion, Kluwer Academic Publishers, Norwell, MA, USA, 2003.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research is supported in part by the National Natural Science Foundation of China under Grant Nos. 60232010, 60574032, and the Project 863 under Grant No. 2006AA12A104.
Rights and permissions
About this article
Cite this article
Zhao, J., Zhu, Y. New results about the relationship between optimally weighted least squares estimate and linear minimum variance estimate. J Syst Sci Complex 22, 137–149 (2009). https://doi.org/10.1007/s11424-009-9152-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-009-9152-z