Skip to main content
SpringerLink
Log in

Influence on Smoothness in Penalized Likelihood Regression for Binary Data

  • Published:
Computational Statistics Aims and scope Submit manuscript

Summary

Penalized likelihood is a nonparametric regression technique which can be used to estimate a mean function for binary data. We wish to measure the sensitivity of the smoothing parameter to gross changes in the data when the optimal value of the smoothing parameter is selected using generalized cross-validation. Since penalized likelihood curve fitting requires both a grid search to determine the optimal value of the smoothing parameter and iterative solution for each grid point, naive calculations to determine the change in the optimal value of the smoothing parameter when each data value is modified are computationally intensive and time-consuming. We have developed techniques based on mathematical and numerical approximations for measuring sensitivity in penalized likelihood regression with binary data. These techniques have been applied to selected data sets to compute change in the smoothing parameter resulting from changes in individual data values.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6

Similar content being viewed by others

References

  • Bumpus, H. (1899), “The elimination of the unfit as illustrated by the introduced sparrow, Passer domesticus”, Biological lectures of Woods Hole Marine Biology Station 6, 209–226.

    Google Scholar 

  • Cox, D. O’Sullivan, F. (1990), “Asymptotic analysis of penalized likelihood and related estimators”, The Annals of Statistics 18(4), 1676–1695.

    Article  MathSciNet  Google Scholar 

  • Culver, D., Jernigan, R., O’Connell J. Kane, T. (1993) “The geometry of natural selection in cave and spring populations of the amphipod Gammarus minus”, Biological Journal of the Linnean Society 52, 49–67.

    Article  Google Scholar 

  • Draper, N. Smith, H. (1981), Applied Regression Analysis, 2nd ed., Wiley, NY Gu, C. Wahba, G. (1992), “Smoothing splines and analysis of variance in function spaces”, Technical Report No. 898, Department of Statistics, University of Wisconsin.

  • Hastie, T. Tibshirani, R. (1990), Generalized Additive Models, Chapman and Hall.

  • Hocking, R. (1985), The Analysis of Linear Models, Brooks-Cole, Monterey, CA.

    MATH  Google Scholar 

  • McCullagh, P. Nelder, J., FRS (1989), Generalized Linear Models, Chapman Hall.

  • Nychka, D. (1991), “Choosing a range for the amount of smoothing in nonparametric regression”, Journal of the American Statistical Association 86(415), 653–664.

    Article  MathSciNet  Google Scholar 

  • O’Sullivan, F., Yandell, B. Raynor, W. (1986), “Automatic smoothing of regression functions in generalized linear models”, Journal of the American Statistical Association 81(393), 96–103.

    Article  MathSciNet  Google Scholar 

  • Tapia, J. Thompson, R. (1990), Nonparametric Function Estimation, Modeling, and Simulation, SIAM, Philadelphia.

    MATH  Google Scholar 

  • Thomas, W. (1991), “Influence diagnostics for the cross-validated smoothing parameter in spline smoothing”, Journal of the American Statistical Association 86(415) 693–698.

    Article  MathSciNet  Google Scholar 

  • Wahba, G. (1990), Spline Models in Statistics, SIAM.

  • Xiang, D. and Wahba, G. (1993) “Generalized approximate cross validation for generalized smoothing spline”, Department of Statistics, University of Wisconsin.

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Statistics, American University, 4400 Massachusetts Avenue, Washington, D.C., USA

    Robert Jernigan & Julie O’Connell

Authors
  1. Robert Jernigan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julie O’Connell
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jernigan, R., O’Connell, J. Influence on Smoothness in Penalized Likelihood Regression for Binary Data. Computational Statistics 16, 481–504 (2001). https://doi.org/10.1007/s180-001-8326-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s180-001-8326-z

Keywords

Search

Navigation