Abstract
We consider the problem of reconstruction of a sparse vector observed against a background of white Gaussian noise. The sparsity is assumed to be unknown. Two approaches to statistical estimation in this case are discussed, namely, the model selection method and threshold estimators. We propose a method of selecting a threshold estimator based on the principle of empirical complexity minimization with minimal conservative penalization.
Similar content being viewed by others
REFERENCES
Härdle, W., Kerkyacharian, G., Picard, D., and Tsybakov, A., Wavelets, Approximation, and Statistical Applications, New York: Springer, 1998.
Donoho, D.L. and Johnstone, I.M., Ideal Spatial Adaptation via Wavelet Shrinkage, Biometrika, 1994, vol. 81, pp. 425-455.
Ruderman, D.L., The Statistics of Natural Images, Network: Computation in Neural Systems, 1994, vol. 5, pp. 517-548.
Abramovich, F., Benjamini, Y., Donoho, D., and Johstone, I., Adapting to Unknown Sparsity by Controlling False Discovery Rate, to appear in Ann. Statist..
Kneip, A., Ordered Linear Smoothers, Ann. Statist., 1994, vol. 22, pp. 835-866.
Barron, A., Birgé, L., and Massart, P., Risk Bounds for Model Selection via Penalization, Probab. Theory Related Fields, 1999, vol. 113, pp. 301-413.
Akaike, H., Information Theory and an Extension of the Maximum Likelihood Principle, Proc. 2nd Int. Symp. on Information Theory, Tsahkadsor, Armenia, USSR, 1971, Petrov, P.N. and Csaki, F., Eds., Budapest: Akad. Kiado, 1973, pp. 267-281.
Mallows, C.V., Some Comments on C p, Technometrics, 1973, vol. 15, pp. 661-675.
Golubev, G.K. and Nussbaum, M., Adaptive Spline Estimates in a Nonparametric Regression Model, Teor. Veroyatn. Primen., 1992, vol. 37, no. 3, pp. 554-561.
Golubev, G.K., Nonparametric Estimation of Smooth Probability Densities in L 2, Probl. Peredachi Inf., 1992, vol. 28, no. 1, pp. 52-62 [Probl. Inf. Trans. (Engl. Transl.), 1992, vol. 28, no. 1, pp. 44-54].
Golubev, G.K., Nonparametric Estimation of Smooth Spectral Densities of Gaussian Stationary Sequences, Teor. Veroyatn. Primen., 1993, vol. 38, no. 4, pp. 775-786.
Fano, R.M., (Transmission of Information; a Statistical Theory of Communications), New York: M.I.T. Press, 1961. Translated under the title Peredacha informatsii. Statisticheskaya teoriya svyazi, Moscow: Mir, 1965.
Leadbetter, M.R., Lindgren, G., and Rootzén, H., Extremes and Related Properties of Random Sequences and Processes, New York: Springer, 1983. Translated under the title Ekstremumy sluchainykh posledovatel'nostei i protsessov, Moscow: Mir, 1989.
Nemirovskii, A., Topics in Nonparametric Statistics, Lect. Notes d'Ecole d'été probabilités de St. Flour, 1998.
Rights and permissions
About this article
Cite this article
Golubev, G.K. Reconstruction of Sparse Vectors in White Gaussian Noise. Problems of Information Transmission 38, 65–79 (2002). https://doi.org/10.1023/A:1020098307781
Issue Date:
DOI: https://doi.org/10.1023/A:1020098307781