An extension of the Williams trend test to general unbalanced linear models

https://doi.org/10.1016/j.csda.2005.02.005Get rights and content

Abstract

The trend test of Williams is one of the most common approaches to test for monotone dose-response relationships. It has originally been introduced for one-way layouts. Applications of the Williams test beyond balanced block designs have not been described yet, what severely restricts its use in practice. An extension of Williams’ test to general unbalanced linear models is presented which allows the inclusion of covariates and/or factorial treatment structures. The test statistic of Williams is rewritten as the maximum of a finite number of standardized linear combinations of the means. The associated distribution function is seen to be available in closed form. Accordingly, p-values/critical values and power/sample sizes can be computed thoroughly. The methods are also applied to a modified version of Williams’ test. Data examples and numerical comparisons suggest a good performance of both extended approaches when compared to current competing methods.

Introduction

Dose-response studies play an important role in many areas of applications. Particularly in the context of pharmaceutical drug development the assessment of a dose related effect and the subsequent estimation of a target dose is of central importance. Clinical dose response studies are designed to investigate the effect of a certain drug at several doses, possibly in comparison with a placebo group. Current clinical practice typically aims at two major goals when performing a dose-response study. First, one is interested in assessing an overall dose related trend. The goal is thus to ensure that with increasing dose the effect to increase (or decrease) as well. Once such an overall trend has been established, the second goal is to estimate a target dose of interest. One common target dose is the minimum effective dose, i.e., the smallest dose revealing a statistically significant and clinically relevant effect (Ruberg, 1995).

Both the problem of testing on an overall dose related effect as well as the estimation of a target dose may require the application of trend tests. The likelihood ratio test of Bartholomew (1961) is a common and powerful approach, although the numerical tractability of its distribution function reduces its application to balanced one-way layouts and other simple designs (Robertson et al., 1988). Single contrast tests are a popular alternative (Ruberg, 1989, Tamhane et al., 1996). However, these tests are potentially less powerful than competing methods if the true dose-response shape deviates substantially from the vector of contrast coefficients (Stewart and Ruberg, 2000, Hothorn et al., 1997). Another widely used test on trend in the one-way layout is due to Williams (1971). The Williams test compares the highest dose group with the placebo group in a two-sample t-test fashion by replacing the usual arithmetic mean of the highest dose group with the corresponding maximum likelihood estimate (MLE) under the given order restriction. This approach has been generalized to a variety of situations, including non-parametric rank-based methods (Shirley, 1977, Williams, 1986), applications to binomial data (Williams, 1988) and robustifying approaches (Hothorn, 1989, Tsai and Chen, 2000). Williams (1971) also considered a modification by additionally replacing the arithmetic mean of the placebo group with the corresponding MLE. Marcus (1976) investigated this test in detail and concluded from a simulation study that the modified Williams test is more powerful for many parameter constellations. Both the Williams and the modified Williams tests are restricted in their applications, however, since the distribution functions of their test statistics are difficult to handle. The PROBMC function in SAS, for example, provides the Williams test only for balanced one-way layouts. Kuriki et al. (2002) described an approach to compute the distribution function of the modified Williams test, again restricted to one-way layouts. Thus, both tests remain unavailable for unbalanced designs taking covariates and/or factorial treatment structures into account.

This paper aims at bridging this gap. It presents an extension of both tests to general unbalanced linear models allowing the inclusion of covariates and factorial treatment structures. To simplify the representation, the paper first focuses on the Williams test. To this end, Williams’ test is rewritten as a maximum of several, individually standardized test statistics. This representation allows a deeper insight into the behavior of the test. In particular, we will show that the regular t-tests used by Williams can be improved by applying a complete studentization. We use recent numerical results to compute accurately the joint distribution of the resulting individual test statistics for generally correlated means, thus allowing the application of Williams’ test in general linear models. Moreover, sample size determination can be performed prior to a designed experiment at pre-specified type I and type II error rates. We also apply the previous methods to the modified Williams test, thus extending it in a similar way to unbalanced designs in general linear models. The methods are illustrated with data examples and the resulting approaches are compared with each other in a power study.

Section snippets

Notation

To simplify the representation, we start considering the Williams test in the unbalanced one-way layout. Extensions to general linear models including a discussion on the numerical computations are given later. LetYij=μi+εij,denote the jth observation at dose level i,j=1,,ni, i=1,,k, k>2. In the present one-way layout the treatment effects are denoted by μi (later in the context of general linear models we will denote the treatment effects by βi to maintain the respective standard notation

Food consumption example

To illustrate the ideas in the one-way layout (1) consider the data provided by Banno and Yamagami (1989) as an example. They studied the conversion efficiency of ingested food (E.C.I.) of the wood-feeding insect Eupromus ruber at five larva stages (third to seventh instar) and an adult stage. The endpoint was calculated as E.C.I=100×dryweightofalarvaoranadultdryweightofwoodconsumedfor each individual larva and adult. Table 1 summarizes the main statistical quantities. Here, the groups 2,,6

Power study

We give now some selected results of a power study to investigate the power for the extended and the original approaches of Williams and Marcus. We included the likelihood ratio test (LRT) under order restriction (Bartholomew, 1961) for comparison purposes. The LRT is known to be one of the most powerful tests for trend throughout the restricted alternative region HA. Extensive numerical details can be found in Robertson et al. (1988). For simplicity we restricted the mathematical study to the

Conclusions

In this paper we extended the trend tests of Williams and Marcus in several ways: (i) application to general unbalanced linear models allowing for covariates and factorial treatment structures, (ii) calculation of power, thus enabling sample size determination at the design phase of a clinical study, and (iii) exact computation of the distribution function using recent results on multidimensional integration. We propose to express the denominator of the original test statistics in an

Acknowledgements

We thank two anonymous referees for their useful suggestions, which helped improving the presentation of this article.

References (27)

  • S. Kuriki et al.

    On the isotonic range statistic for testing against an ordered alternative

    J. Statist. Plann. Inference

    (2002)
  • H. Banno et al.

    Food consumption and conversion efficiency of the larvae of Eupromus ruber (Dalman) (Coleoptera: Cerambycidae)

    Appl. Entomol. Zool.

    (1989)
  • D.J. Bartholomew

    Ordered tests in the analysis of variance

    Biometrika

    (1961)
  • F. Bretz et al.

    Asymptotic power and sample size determination for contrast tests with binomial data

    Statist. Med.

    (2002)
  • F. Bretz et al.

    SAS/IML programs for exact calculations of orthant probabilities for arbitrary dimensions

    Comput. Statist. Data Anal.

    (2000)
  • D.R. Cox

    The role of significance tests

    Scand. J. Statist.

    (1977)
  • A. Genz et al.

    Methods for the computation of multivariate t-probabilities

    J. Comput. Graph. Statist.

    (2002)
  • L.A. Hothorn

    Robustness study on Williams and Shirley procedure, with application in toxicology

    Biometrical J.

    (1989)
  • L.A. Hothorn et al.

    Evaluation of animal carcinogenicity studies: Cochran– Armitage trend test vs. multiple contrast tests

    Biometrical J.

    (2000)
  • L.A. Hothorn et al.

    Analysis of randomized dose-finding-studies: closure test modifications based on multiple contrast tests

    Biometrical J.

    (1997)
  • S. Kotz et al.

    Multivariate t Distributions and their Applications

    (2004)
  • R. Marcus

    The power of some tests of the equality of normal means against an ordered alternative

    Biometrika

    (1976)
  • T. Robertson et al.

    Order Restricted Statistical Inference

    (1988)
  • Cited by (49)

    • Statistical analysis of the hen's egg test for micronucleus induction (HET-MN assay)

      2013, Mutation Research - Genetic Toxicology and Environmental Mutagenesis
      Citation Excerpt :

      The contrast coefficients cqi are the elements of the contrast matrix, which defines how the treatments (Di) are compared to the negative control. The contrast matrix can be simplified for a balanced design with three doses (D1, D2 and D3) as multiple contrast (Ca, Cb and Cc) for Dunnett procedure [25] and for the Williams procedure [26]: Both contrast matrices contain sum-to-zero contrasts which means that the coefficients in each row must sum up to zero.

    • Testing against ordered alternatives in one-way ANOVA model with exponential errors

      2024, Annals of the Institute of Statistical Mathematics
    View all citing articles on Scopus
    View full text