Skip to main content
SpringerLink
Log in

Adaptive thresholding of sequences with locally variable strength

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

This paper addresses, via thresholding, the estimation of a possibly sparse signal observed subject to Gaussian noise. Conceptually, the optimal threshold for such problems depends upon the strength of the underlying signal. We propose two new methods that aim to adapt to potential local variation in this signal strength and select a variable threshold accordingly. Our methods are based upon an empirical Bayes approach with a smoothly variable mixing weight chosen via either spline or kernel based marginal maximum likelihood regression. We demonstrate the excellent performance of our methods in both one and two-dimensional estimation when compared to various alternative techniques. In addition, we consider the application to wavelet denoising where reconstruction quality is significantly improved with local adaptivity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abramovich, F., Benjamini, Y., Donoho, D.L., Johnstone, I.M.: Adapting to unknown sparsity by controlling the false discovery rate. Ann. Stat. 34, 584–653 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  • Baraud, Y., Giraud, C., Huet, S.: Gaussian model selection with an unknown variance. Ann. Stat. (2008, to appear)

  • Beran, R.: Hybrid shrinkage estimators using penalty bases for the ordinal one-way layout. Ann. Stat. 32, 2532–2558 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth, Belmont (1984)

    MATH  Google Scholar 

  • Broyden, C.G.: A new double rank minimization algorithm. Not. Am. Math. Soc. 16, 670 (1969)

    Google Scholar 

  • Burman, P.: A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76, 503–514 (1989)

    MATH  MathSciNet  Google Scholar 

  • Cai, T.T.: On block thresholding in wavelet regression: Adaptivity, block size, and threshold level. Stat. Sin. 12, 1241–1273 (2002)

    MATH  Google Scholar 

  • Cai, T.T., Silverman, B.W.: Incorporating information on neighbouring coefficients into wavelet estimation. Sankhyā Ser. B 63, 127–148 (2001)

    MathSciNet  Google Scholar 

  • De Boor, C.: A Practical Guide to Splines. Springer, New York (1994)

    Google Scholar 

  • Donoho, D.L., Johnstone, I.M.: Ideal spatial adaptation by wavelet shrinkage. Biometrika 81, 425–455 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  • Donoho, D.L., Johnstone, I.M.: Adapting to unknown smoothness via wavelet shrinkage. J. Am. Stat. Assoc. 90, 1200–1224 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  • Fletcher, R.: A new approach to variable metric algorithms. Int. Bibliogr. Inf. Doc. 13, 317–322 (1970)

    MATH  Google Scholar 

  • Goldfarb, D.: A family of variable metric methods derived by variational means. Math. Comp. 24, 23–26 (1970)

    Article  MATH  MathSciNet  Google Scholar 

  • Green, P.J., Silverman, B.W.: Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach. Chapman and Hall, London (1994)

    MATH  Google Scholar 

  • Heaton, T.: Wavelets and accompanying applications. Ph.D. thesis, University of Bristol (2005)

  • Johnstone, I.M., Silverman, B.W.: Needles and straw in haystacks: Empirical Bayes estimates of possible sparse sequences. Ann. Stat. 32, 1594–1649 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Johnstone, I.M., Silverman, B.W.: Ebayesthresh: R programs for empirical Bayes thresholding. J. Stat. Softw. 12, 1–38 (2005a)

    Google Scholar 

  • Johnstone, I.M., Silverman, B.W.: Empirical Bayes selection of wavelet thresholds. Ann. Stat. 33, 1700–1752 (2005b)

    Article  MATH  MathSciNet  Google Scholar 

  • Mallat, S.G.: Multiresolution approximations and wavelet orthonormal bases of l 2(ℝ). Trans. Am. Math. Soc. 315, 69–87 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  • Midcourse Space Experiment: (1996–1997) NASA/IPAC infrared science archive. http://irsa.ipac.caltech.edu/index.html

  • Nason, G.P.: Wavelet shrinkage using cross-validation. J. R. Stat. Soc. B 58, 463–479 (1996)

    MATH  MathSciNet  Google Scholar 

  • Shanno, D.F.: Conditioning of quasi-newton methods for function minimization. Math. Comp. 24, 647–656 (1970)

    Article  MathSciNet  Google Scholar 

  • Stone, M.: Cross-validatory choice and assessment of statistical predictions (with discussion). J. R. Stat. Soc. B 36, 114–147 (1974)

    Google Scholar 

  • Wand, M.P., Jones, M.C.: Kernel Smoothing. Chapman and Hall, London (1995)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics, University of Oxford, 1 South Parks Road, Oxford, OX1 3TG, UK

    T. J. Heaton

Authors
  1. T. J. Heaton
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T. J. Heaton.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Heaton, T.J. Adaptive thresholding of sequences with locally variable strength. Stat Comput 19, 57–71 (2009). https://doi.org/10.1007/s11222-008-9071-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11222-008-9071-1

Keywords

Search

Navigation