Abstract
We develop Metropolis-Hastings algorithms for exact conditional inference, including goodness-of-fit tests, confidence intervals and residual analysis, for binomial and multinomial logistic regression models. We present examples where the exact results, obtained by enumeration, are available for comparison. We also present examples where Monte Carlo methods provide the only feasible approach for exact inference.
Similar content being viewed by others
References
Agresti A. 1992. A survey of exact inference for contingency tables (with discussion). Statistical Science 7: 131–177.
Bedrick E.J. and Hill J.R. 1990. Outlier tests for logistic regression: A conditional approach. Biometrika 77: 815–827.
Bedrick E.J. and Hill J.R. 1991. Model checking for logistic regression: A conditional approach. In: Keramidas E.M. (Ed.), Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface. Fairfax Station: Interface Foundation, pp. 208–214.
Bedrick E.J. and Hill J.R. 1996. Assessing the fit of the logistic regression model to individual matched sets of case-control data. Biometrics 52: 1–9.
Besag J. and Clifford P. 1989. Generalized Monte Carlo significance tests. Biometrika 76: 633–642.
Diaconis P., Graham R.L., and Sturmfels B. 1996. Primitive partition identities. Combinatorics. Paul Erdös is Eighty 2: 173–192.
Diaconis P. and Sturmfels B. 1998. Algebraic algorithms for sampling from conditional distributions. The Annals of Statistics 26: 363–397.
Forster J.J., McDonald J.W., and Smith P.W.F. 1996. Monte Carlo exact conditional tests for log-linear and logistic models. Journal of the Royal Statistical Society Series B 58: 445–453.
Geyer C.J. 1992. Practical Markov chain Monte Carlo (with discussion). Statistical Science 7: 473–511.
Hastings W.K. 1970. Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57: 97–109.
Hirji K.F. 1992. Computing exact distributions for polytomous response data. Journal of the American Statistical Association 87: 487–492.
Lasker G.W. and Kaplan B. 1974. Graying of the hair and mortality. Social Biology 21: 290–295.
McCullagh P. and Nelder J.A. 1989. Generalized Linear Models (2nd edn.). Chapman and Hall, London.
Mehta C.R., Patel N.R., and Senchaudhuri P. 2000. Efficient Monte Carlo methods for conditional logistic regression. Journal of the American Statistical Association 95: 99–108.
Michaelides D.T. 1997. Exact tests via complete enumeration: A distributed computing approach. Unpublished Ph.D. Thesis, Department of Social Statistics, University of Southampton, UK.
Schull W.J. 1958. Empirical risks in consanguineous marriages: Sex ratio, malformation and viability. American Journal of Human Genetics 10: 294–343.
Smith A.F.M. and Roberts G.O. 1993. Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods (with discussion). Journal of the Royal Statistical Society Series B 55: 3–23.
Takken A.R. 1999. Monte Carlo goodness-of-fit tests for discrete data. Unpublished Ph.D. Dissertation, Department of Statistics, Stanford University.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Forster, J.J., McDonald, J.W. & Smith, P.W.F. Markov chain Monte Carlo exact inference for binomial and multinomial logistic regression models. Statistics and Computing 13, 169–177 (2003). https://doi.org/10.1023/A:1023212726863
Issue Date:
DOI: https://doi.org/10.1023/A:1023212726863