Skip to main content
SpringerLink
Log in
Book cover

International Encyclopedia of Statistical Science pp 169–174Cite as

Bootstrap Methods

  • Reference work entry
  • First Online:

Introduction

Use of the bootstrap idea goes back at least to Simon (1969) who used it as a tool to teach statistics. But the properties of the bootstrap and its connection to the jackknife and other resampling methods, was not realized until Efron (1979). Similar resampling methods such as the jackknife and subsampling go back to the late 1940s and 1960s respectively (Quenouille (1949) for the jackknife and Hartigan (1969) and McCarthy (1969) for subsampling). In 1979 the impact that the bootstrap would have was not really appreciated and the motivation for Efron’s paper was to better understand the jackknife and its properties. But over the past 30 years it has had a major impact on both theoretical and applied statistics with the applications sometimes leading the theory and vice versa. The impact of Efron’s work has been so great that he was awarded with the President’s Medal of Science by former President George W. Bush and Kotz (1992) included the 1979 Annals of Statistics paper...

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   1,100.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References and Further Reading

  • Andrews D (2000) Inconsistency of the bootstrap when a parameter is on the boundary of the parameter space. Econometrica 68:399–405

    MATH  MathSciNet  Google Scholar 

  • Athreya KB (1987) Bootstrap estimation of the mean in the infinite variance case. Annals of Statistics 15:724–731

    MATH  MathSciNet  Google Scholar 

  • Beran R (1997) Diagnosing bootstrap success. Ann Inst Stat Math 49:1–24

    MATH  MathSciNet  Google Scholar 

  • Bickel PJ, Freedman DA (1981) Some asymptotic theory for the bootstrap. Ann Stat 6:1196–1217

    MathSciNet  Google Scholar 

  • Bickel PJ, Gotze F, van Zwet WR (1997) Resampling fewer than n observations: gains, loses, and remedies for losses. Statistica Sinica 7:1–32

    MATH  MathSciNet  Google Scholar 

  • Bickel PJ, Ren JJ (1996) The m out of n bootstrap and goodness of fit tests with doubly censored data. In: Huber PJ, Rieter H (eds) Robust statistics, data analysis, and computer-intensive methods. Lecture Notes in statistics, vol. 109. Springer–verlag, New York, pp 35–48

    Google Scholar 

  • Bühlman P (1997) Sieve bootstrap for time series. Bernoulli 3:123–148

    MathSciNet  Google Scholar 

  • Bühlman P (2002) Bootstrap for time series. Stat Sci 17:52–72

    Google Scholar 

  • Cao R (1993) Bootstrapping the mean integrated squared error. J Multivariate Anal 45:137–160

    MATH  MathSciNet  Google Scholar 

  • Cao R (1999) An overview of bootstrap methods for estimating and predicting in time series. Test 8:95–116

    MATH  MathSciNet  Google Scholar 

  • Cao R, Gonzälez-Manteiga W (1993) Bootstrap methods in ion smoothing. J Nonparametric Stat 2:379–388

    MATH  Google Scholar 

  • Chernick MR (1999) Bootstrap methods: a practitioners guide. Wiley, New York

    Google Scholar 

  • Chernick MR (2007) Bootstrap methods: a guide for practitioners and researchers, 2nd edn. Wiley, Hoboken

    Google Scholar 

  • Chernick MR, LaBudde R (2010) Revisiting qualms about bootstrap confidence intervals. Am J Math Manage Sci, To appear

    Google Scholar 

  • Davison AC, Hinkley DV (1997) Bootstrap methods and their applications. Cambridge University Press, Cambridge

    Google Scholar 

  • Diaconis P, Efron B (1983) Computer-intensive methods in statistics. Sci Am 248:116–130

    Google Scholar 

  • Dudewicz EJ (1992) The generalized bootstrap. In: Jockel K-H, Rothe G, Sendler W (eds) Bootstrapping and related techniques, Proceedings Trier FRG. Lecture Notes in Economics and Mathematical Systems, vol. 376. Springer, Berlin, pp 31–37

    Google Scholar 

  • Dumanjug C, Barrios E, Lansangan J (2010) Bootstrap procedures in a spatial-temporal model. J Stat Comput Sim 80:809–822

    MATH  MathSciNet  Google Scholar 

  • Efron B (1979) Bootstrap methods. Another look at the jackniffe. Ann Stat 7:1–26

    MATH  MathSciNet  Google Scholar 

  • Efron B (1981) Censored data and the Bootstrap. J Am Stat Assoc 374:312–319

    MathSciNet  Google Scholar 

  • Efron B (1982) The jacknife, the bootstrap and other resampling plans. SIAM, Philadelphia

    Google Scholar 

  • Efron B (1983) Estimating the error rate of a prediction rule: improvements on cross-validation. J Am Stat Assoc 78:316–331

    MATH  MathSciNet  Google Scholar 

  • Efron B (1987) Better bootstrap confidence intervals (with discussion). J Am StatAssoc 82:316–331

    MathSciNet  Google Scholar 

  • Efron B (1994) Missing data, imputation and the bootstrap. J Am Stat Assoc 89:463–479

    MATH  MathSciNet  Google Scholar 

  • Efron B (2000) The bootstrap and modern statistics. J Am Stat Assoc 95:1293–1296

    MATH  MathSciNet  Google Scholar 

  • Efron B, Tibshirani R (1986) Bootstrap methods for standard errors, confidence intervals and other measures of statistical accuracy. Stat Sci 1:54–77

    MathSciNet  Google Scholar 

  • Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman and Hall, London

    MATH  Google Scholar 

  • Ferraty F, Van Keilegom I, Vieu P (2010) On the validity of the bootstrap in nonparametric functional regression. Scand J Stat 37:286–306

    MATH  MathSciNet  Google Scholar 

  • Freedman DA (1981) Bootstrapping regression models. Ann Stat 6:1218–1228

    Google Scholar 

  • Fukuchi JI (1994) Bootstrapping extremes of random variables. PhD dissertation. Iowa State University, Ames

    Google Scholar 

  • González-Manteiga W, Cao R (1993) Testing the hypothesis of a general linear model using nonparametric regression estimation. Test 2:223–249

    Google Scholar 

  • González-Manteiga W, Crujeiras RM (2008) A review on goodness-of-fit tests for regression models. Pyrenees Int Workshop Stat Probab Oper Res: SPO 2007:21–59

    Google Scholar 

  • Good P (1998) Resampling methods: a practical guide to data analysis. Birkhauser, Boston

    Google Scholar 

  • Good P (2004) Permutation, parametric, and bootstrap tests of hypotheses, 3rd edn. Springer, New York

    Google Scholar 

  • Hall P (1988) Theoretical comparison of bootstrap confidence intervals. Ann Stat 16:927–953

    MATH  Google Scholar 

  • Hall P (1992) The bootstrap and Edgeworth expansion. Springer, Berlin

    Google Scholar 

  • Hall P, Maiti T (2006) On parametric bootstrap methods for small area prediction. J R Stat Soc, Series B Stat Method 68:221–238

    MATH  MathSciNet  Google Scholar 

  • Hall P, Lee ER, Park BU (2009) Bootstrap-based penalty choice for the Lasso achieving oracle performance. Statistica Sinica 19:449–471

    MATH  MathSciNet  Google Scholar 

  • Härdle W, Mammen E (1993) Comparing nonparametric versus parametric regression fits. Ann Stat 21:1926–1947

    MATH  Google Scholar 

  • Hartigan JA (1969) Using subsample values as typical values. J Am Stat Assoc 64:1303–1317

    MathSciNet  Google Scholar 

  • Kotz S, Johnson NL (1992) Breakthroughs in statistics vol. II: methodology and distribution. Springer, New York

    Google Scholar 

  • Lahiri P (2003a) On the impact of bootstrap in survey sampling and small-area estimation. Stat Sci – Rev J Inst Math Stat 18: 199–210

    Google Scholar 

  • Lahiri SN (2003b) Resampling methods for dependent data. Springer Series in Statistics, Springer, New York

    MATH  Google Scholar 

  • Lahiri SN (2006) Bootstrap methods: a review. In: Fan J, Koul HL (eds) Frontiers in statistics. Imperial College Press, London, pp 231–265

    Google Scholar 

  • LePage R, Billard L (eds) (1992) Exploring the limits of bootstrap. Wiley, New York

    MATH  Google Scholar 

  • Lunneborg CE (2000) Data analysis by resampling: concepts and applications. Brooks/Cole, Pacific Grove

    Google Scholar 

  • Mammen E (1992) When does the bootstrap work? Asymptotic results and simulations. Springer, Heidelberg

    Google Scholar 

  • Manly BFJ (1997) Randomization, bootstrap and Monte Carlo methods in biology, 2nd edn. Chapman and Hall, London

    MATH  Google Scholar 

  • McCarthy PJ (1969) Pseudo-replication: half-samples. Int Stat Rev 37:239–263

    MATH  Google Scholar 

  • Paparoditis E, Politis D (2005) Bootstrap hypothesis testing in regression models. Stat Probab Lett 74:356–365

    MATH  MathSciNet  Google Scholar 

  • Politis DN, Romano JP (1994a) The stationary bootstrap. J Am Stat Assoc 89:1303–1313

    MATH  MathSciNet  Google Scholar 

  • Politis DN, Romano J (1994b) Limit theorems for weakly dependent Hilbert Space valued random variables with application to the stationary bootstrap. Statistica Sinica 4:461–476

    MATH  MathSciNet  Google Scholar 

  • Politis DN, Romano JP, Wolf M (1999) Subsampling. Springer, New York

    MATH  Google Scholar 

  • Quenouille MH (1949) Appraximate tests of correlation in time series. J R Stat Soc B 11:18–84

    MathSciNet  Google Scholar 

  • Schenker N (1985) Qualms about bootstrap confidence intervals. J Am Stat Assoc 80:360–361

    MathSciNet  Google Scholar 

  • Schimek MG (2000) Smoothing and regression. Wiley series in probability and statistics: applied probability and statistics, Wiley, New York

    Google Scholar 

  • Shao J, Tu DS (1995) The jackknife and bootstrap. Springer Series in Statistics, Springer, New York

    MATH  Google Scholar 

  • Silverman BW, Young GA (1987) The bootstrap: smooth or not to smooth? Biometrika 74:469–479

    MATH  MathSciNet  Google Scholar 

  • Simon JL (1969) Basic research methods in social science. Random House, New York

    Google Scholar 

  • Simon JL, Bruce P (1991) Resampling: a tool for everyday statistical work. Chance 4:22–32

    Google Scholar 

  • Smith AFM, Roberts GO (1993) Bayesian computation via the Gibbs sampler and related Markov Chain Monte Carlo methods. J R Stat Soc B Methodol 55:3–23

    MATH  MathSciNet  Google Scholar 

  • Stute W, Gonzlez-Manteiga W, Presedo-Quindimil MA (1998) Bootstrap approximations in model checks for regression. J Am Stat Asoc 93:141–149

    MATH  Google Scholar 

  • Tukey JW (1958) Bias and confidence in not quite large samples (abstract). Ann Math Stat 29:614

    Google Scholar 

  • Westerland J, Edgerton D (2007) A panel bootstrap cointegration test. Econ Lett 97:185–190

    Google Scholar 

  • Westfall P, Young SS (1993) Resampling-based multiple testing: examples and methods for p-value adjustment. Wiley, New York

    Google Scholar 

  • Xu K (2008) Bootstrapping autoregression under nonstationary volatility. Econ J 11:1–26

    Google Scholar 

  • Zelterman D (1993) A semiparametric bootstrap technique for simulating extreme order statistics. J Am Stat Assoc 88:477–485

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lankenau Institute for Medical Research, Wynnewood, PA, USA

    Michael R. Chernick (Professor and Dean)

  2. University of Santiago de Compostela, Santiago de Compostela, Spain

    Wenceslao González-Manteiga

  3. University of Santiago de Compostela, Santiago de Compostela, Spain

    Rosa M. Crujeiras

  4. University of the Philippines, Quezon City, Philippines

    Erniel B. Barrios

Authors
  1. Michael R. Chernick
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenceslao González-Manteiga
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rosa M. Crujeiras
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Erniel B. Barrios
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Statistics and Informatics, Faculty of Economics, University of Kragujevac, City of Kragujevac, Serbia

    Miodrag Lovric

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this entry

Cite this entry

Chernick, M.R., González-Manteiga, W., Crujeiras, R.M., Barrios, E.B. (2011). Bootstrap Methods. In: Lovric, M. (eds) International Encyclopedia of Statistical Science. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04898-2_150

Download citation

Publish with us

Policies and ethics

Search

Navigation