Abstract
In this paper we consider generalized linear models for binary data subject to inequality constraints on the regression coefficients, and propose a simple and efficient Bayesian method for parameter estimation and model selection by using Markov chain Monte Carlo (MCMC). In implementing MCMC, we introduce appropriate latent variables and use a simple approximation of a link function, to resolve computational difficulties and obtain convenient forms for full conditional posterior densities of elements of parameters. Bayes factors are computed via the Savage-Dickey density ratios and the method of Oh (Comput. Stat. Data Anal. 29:411–427, 1999), for which posterior samples from the full model with no degenerate parameter and the full conditional posterior densities of elements are needed. Since it uses one set of posterior samples from the full model for any model in consideration, it performs simultaneous comparison of all possible models and is very efficient compared with other model selection methods which require one to fit all candidate models.
A simulation study shows that significant improvements can be made by taking the constraints into account. Real data on purchase intention of a product subject to order constraints is analyzed by using the proposed method. The analysis results show that there exist some price changes which significantly affect the consumer behavior. The results also show the importance of simultaneous comparison of models rather than separate pairwise comparisons of models since the latter may yield misleading results from ignoring possible correlations between parameters.
Similar content being viewed by others
References
Agresti, A., Coull, B.A.: The analysis of contingency tables under inequality constraints. J. Stat. Plan. Inference 107, 45–73 (2002)
Dickey, J.: The weighted likelihood ratio, linear hypotheses on normal location parameters. Ann. Stat. 42, 204–223 (1971)
Dickey, J.: Approximate posterior distributions. J. Am. Stat. Assoc. 71, 680–689 (1976)
Dickey, J., Lientz, B.P.: The weighted likelihood ratio, Sharp hypotheses about chances, the order of a Markov chain. Ann. Math. Stat. 41, 214–226 (1970)
Dunson, D.B., Neelon, B.: Bayesian inference on order-constrained parameters in generalized linear models. Biometrics 59, 286–295 (2003)
Galindo-Garre, F., Vermunt, J.K.: The order-restricted association model: two estimation algorithms and issues in testing. Psychometrika 69, 641–654 (2004)
Hayter, A.J.: A one-sided studentized range test for testing against a simple ordered alternative. J. Am. Stat. Assoc. 85, 778–785 (1990)
Kass, R.E., Wasserman, L.A.: A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J. Am. Stat. Assoc. 90, 928–934 (1995)
Liu, L.: Simultaneous statistical inference for monotone dose-response means. Doctoral dissertation, Memorial University of Newfoundland, St. John’s, Canada (2001)
Oh, M.-S.: Estimation of posterior density functions from a posterior sample. Comput. Stat. Data Anal. 29, 411–427 (1999)
Oh, M.-S., Choi, J.W., Kim, D.-G.: Bayesian inference and model selection in latent class logit models with parameter constraints: an application to market segmentation. J. Appl. Stat. 30, 191–204 (2003)
Oh, M.-S., Shin, D.W.: A unified Bayesian inference on treatment means with order constraints. Comput. Stat. Data Anal. 55, 924–934 (2011)
Robertson, T., Wright, F.T., Dykstra, R.L.: Order Restricted Statistical Inference. Wiley, New York (1988)
Shang, J., Cavanaugh, J.E., Wright, F.T.: A Bayesian multiple comparison procedure for order-restricted mixed models. Int. Stat. Rev. 76, 268–284 (2008)
Shayamall, D.P., Dunson, D.B.: Estimation of order-restricted means from correlated data. Biometrika 92, 703–715 (2005)
Verdinelli, I., Wasserman, L.: Computing Bayes factors using a generalization of the Savage-Dickey density ratio. J. Am. Stat. Assoc. 90, 614–618 (1995)
Acknowledgements
The author is grateful to the two reviewers for their valuable comments. This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2010-0010285).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Oh, MS. Bayesian multiple comparison of models for binary data with inequality constraints. Stat Comput 23, 481–490 (2013). https://doi.org/10.1007/s11222-012-9324-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-012-9324-x