Summary
In this paper a comparison between Penalized Quasi Likelihood (PQL) and estimation by numerical integration is made for the analysis of two-level experimental binary data with two treatment conditions. The comparison between the estimation methods is made for three situations: randomization to treatment conditions at the cluster level, randomization at the person level with treatment by cluster interaction, and without such interaction. Criteria for comparison are convergence of the estimation process and improper estimates (i.e. unrealistic high point estimates), criteria concerning the point estimation (bias, variance, and mean squared error) and testing (bias of the point estimates and of the variances as reported by the software) of the treatment effect. The results show that non-convergence occurs more often when estimation is done by numerical integration. This method may also lead to improper estimates. First order PQL performs best in terms of point estimation of the treatment effect, but should not be used for testing. For the latter purpose second order PQL is more applicable.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bryk, A. S., Raudenbush, S. W., & Congdon, R. T, Jr. (1996). HLM: Hierarchical Linear and Nonlinear Modeling with the HLM/2L and HLM/3L Programs. Scientific Software International-Chicago.
Gibbons, R. D., & Hedeker, D. (1997). Random effects probit and logistic regression models for three-level data. Biometrics, 53, 1527–1537.
Goldstein, H. (1986). Multilevel mixed linear model analysis using iterative generalized least squares. Biometrika, 73, 43–56.
Goldstein, H. (1989). Restricted unbiased iterative generalized least squares estimation. Biometrika, 76, 622–623.
Goldstein, H. (1991). Nonlinear multilevel models, with an application to discrete response data. Biometrika, 78, 45–51.
Goldstein, H. (1995). Multilevel statistical models, 2nd edn., Edward Arnold-London.
Goldstein, H., & Rasbash, J. (1996). Improved approximations for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A, 159, 505–513.
Goldstein, H, Rasbash, J, Plewis, I, Draper, D., Browne, W., Yang, M., Woodhouse, G., & Healy, M. (1998). A user’s guide to MLwiN. Institute of Education-London.
Hedeker, D., & Gibbons, R. D. (1994). A random-effects ordinal regression model for multilevel analysis. Biometrics, 50, 933–944.
Hedeker, D., & Gibbons, R. D. (1996). MIXOR: a computer program for mixed-effects ordinal regression analysis. Computer Methods and Programs in Biomedicine, 49, 157–176.
Lindstrom, M. J., & Bates, D. M. (1990). Nonlinear mixed effects models for repeated measures data. Biometrics, 46, 673–687.
Moerbeek, M., Van Breukelen, G. J. P, & Berger, M. P. F. (2001). Optimal experimental designs for multilevel logistic models. The Statistician, 50, 17–30.
Pinheiro, J. C., & Bates, D.M. (2000). Mixed-effects models in S and S-PLUS, 1st. edn., Springer-Verlag, New York.
Rodríguez, G., & Goldman, N. (1995). An assessment of estimation procedures for multilevel models with binary data. Journal of the Royal Statistical Society, Series A, 158, 73–89.
Rodríguez, G., & Goldman, N. (2001). Improved estimation procedures for multilevel models with binary response: a case-study. Journal of the Royal Statistical Society, Series A, 164, 339–355.
Zhou, X.-H., Perkins, A. K., & Hui, S. L. (1999). Comparisons of software packages for generalized linear multilevel models. The American Statistician, 53, 3.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Moerbeek, M., Van Breukelen, G.J.P. & Berger, M.P.F. A Comparison of Estimation Methods for Multilevel Logistic Models. Computational Statistics 18, 19–37 (2003). https://doi.org/10.1007/s001800300130
Published:
Issue Date:
DOI: https://doi.org/10.1007/s001800300130