Skip to main content
Log in

Optimal design for the Bradley–Terry paired comparison model

  • Original Article
  • Published:
Statistical Methods and Applications Aims and scope Submit manuscript

Abstract

Paired comparisons are a popular tool for questionnaires in psychological marketing research. The quality of the statistical analysis of the responses heavily depends on the design, i.e. the choice of the alternatives in the comparisons. In this paper we show that the structure of locally optimal designs changes substantially with the parameters in the underlying utility. This fact is illustrated by elementary examples, where the optimal designs can be completely characterized. As an alternative maximin efficient designs are proposed which perform well for all parameter settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Atkinson AC, Haines LM (1996) Designs for nonlinear and generalized linear models. In: Ghosh S, Rao CR (eds) Design and analysis of experiments. Handbook of statistics, vol 13. North-Holland, Amsterdam, pp 437–475

    Google Scholar 

  • van Berkum EEM (1987) Optimal paired comparison designs for factorial experiments, CWI Tract 31. Centrum for Wiskunde en Informatica, Amsterdam

  • Bradley RA, Terry ME (1952) Rank analysis of incomplete block designs, I. The method of paired comparisons. Biometrika 39:324–345

    MathSciNet  MATH  Google Scholar 

  • Burgess L, Street DJ (2005) Optimal designs for choice experiments with asymmetric attributes. J Stat Plan Inference 134:288–301

    Article  MathSciNet  MATH  Google Scholar 

  • Dette H (1997) Designing experiments with respect to ‘standardized’ optimality criteria. J R Stat Soc Series B 59:97–110

    Article  MathSciNet  MATH  Google Scholar 

  • Graßhoff U, Schwabe R (2006) Optimal designs for the Bradley–Terry paired comparison model. Otto-von-Guericke-Universität Magdeburg, Fakultät für Mathematik Preprint Nr. 16:2006

  • Graßhoff U, Großmann H, Holling H, Schwabe R (2004) Optimal designs for main effects in linear paired comparison models. J Stat Plan Inference 126:361–376

    Article  MATH  Google Scholar 

  • Graßhoff U, Großmann H, Holling H, Schwabe R (2005) Design optimality in multi-factor generalized linear models in the presence of an unrestricted quantitative factor, Otto-von-Guericke-Universität Magdeburg, Fakultät für Mathematik. Preprint Nr. 38:2005

    Google Scholar 

  • Green P (1974) On the design of choice experiments involving multifactor alternatives. J Consum Res 1:61–68

    Article  Google Scholar 

  • Großmann H, Holling H, Graßhoff U, Schwabe R (2005) On the empirical relevance of optimal designs for the measurement of preferences. In: Berger MPF, Wong WK (eds) Applied optimal designs. Wiley, Chichester, pp 45–65

    Chapter  Google Scholar 

  • Kanninen B (2002) Optimal design for multinomial choice experiments. J Mark Res 39:214–227

    Article  Google Scholar 

  • Kiefer J, Wolfowitz J (1959) Optimum designs in regression problems, II. Ann Math Stat 32:271–294

    Article  MathSciNet  Google Scholar 

  • Louviere JJ, Hensher DA, Swait JD (2000) Stated choice methods. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  • Luce D (1959) Individual choice behavior. Wiley, New York

    MATH  Google Scholar 

  • McCullagh P, Nelder JA (1989) Generalized linear models, 2nd edn. Chapman & Hall, London

    MATH  Google Scholar 

  • McFadden D (1974) Conditional logit analysis of qualitative choice behavior. In: Zarembka P (ed) Frontiers in econometrics. Academic, New York, pp 105–142

    Google Scholar 

  • Müller CH, Pázman A (1998) Applications of necessary and sufficient conditions for maximin efficient designs. Metrika 48:1–19

    MathSciNet  MATH  Google Scholar 

  • Pukelsheim F (1993) Optimal Design of Experiments. (Wiley, New York 1993)

  • Schwabe R (1996) Optimum designs for multi-factor models. Springer, New York

    MATH  Google Scholar 

  • Schwabe R, Graßhoff U, Großmann H, Holling H (2005) Utility balance and design optimality in logistic models with one unrestricted quantitative factor. In: Ermakov SM, Melas VB, Pepelyshev AN (eds) Proceedings of the 5th St. Petersburg workshop on simulation. St. Petersburg, pp 605–610

  • Silvapulle MJ (1981) On the existence of maximum likelihood estimators for the binomial response models. J R Stat Soc Series 43:310–313

    MathSciNet  MATH  Google Scholar 

  • Silvey D (1980) Optimal design. Chapman & Hall, London

    MATH  Google Scholar 

  • Sitter RR, Torsney B (1995) D-optimal designs for generalized linear models. In: Kitsos CP, Müller WG (eds) MODA 4—advances in model-oriented data analysis physica. Heidelberg, pp 87–102

  • Train KE (2003) Discrete choice methods with simulation. Cambridge University Press, Cambridge

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rainer Schwabe.

Additional information

Research supported by grant Ho 1286 of the German Research Council (Deutsche Forschungsgemeinschaft).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Graßhoff, U., Schwabe, R. Optimal design for the Bradley–Terry paired comparison model. Stat Meth Appl 17, 275–289 (2008). https://doi.org/10.1007/s10260-007-0058-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10260-007-0058-4

Keywords

Navigation