FIM for Arnold and Strauss's bivariate gamma distribution

https://doi.org/10.1016/j.csda.2006.05.009Get rights and content

Abstract

The Fisher information matrix (FIM) as well as tools for its numerical computation is derived for Arnold and Strauss’ [1988. Bivariate distributions with exponential conditionals, J. Amer. Statist. Assoc. 83 (1988) 522–527] bivariate gamma distribution. Numerical tabulations of the matrix are also provided for practical purposes.

Introduction

Arnold and Strauss’ (1988) bivariate gamma distribution is specified by the joint probability density function (pdf):f(x,y;a,b,c,α,β)=Kxα-1yβ-1exp{-(ax+by+cxy)}for x>0, y>0, α>0, β>0, a>0, b>0, and c>0, where K=K(a,b,c,α,β) denotes the normalizing constant. This is also known as the conditionally specified bivariate gamma distribution (see Kotz et al., 2000). It has received applications in areas such as cross-over trials, flood frequency analysis, life testing, and precipitation modeling. Using the definition of the Kummer functionΨ(a,b,z)=1Γ(a)0ta-1(1+t)b-a-1exp(-zt)dt,one can show that1K=bα-βc-αΓ(α)Γ(β)Ψα,α-β+1,abc.The aim of this note is to calculate the Fisher information matrix (FIM) corresponding to (1) and to provide useful numerical tabulations of the FIM. For a given observation (x,y), the FIM is defined by Ijk=E-logL(θ)θjlogL(θ)θkfor j=1,2,,p and k=1,2,,p, where L(θ)=f(x,y) and θ=θ1,θ2,,θp are the parameters of the pdf f. It has the meaning “information about the parameters θ contained in the observation x.” It is related to the covariance matrix of the estimate of θ (being its inverse under certain conditions). The FIM plays a significant role in statistics and many other areas of science. Some recent references on applications of the FIM include:

  • The FIM plays a key role in the analysis and applications of statistical image reconstruction methods based on Poisson data models. The elements of the FIM are a function of the reciprocal of the mean values of sinogram elements (see, for example, Li et al., 2004).

  • The calculation of the FIM is of central importance in many practical systems which can be described as the output of a multidimensional linear separable-denominator system with Gaussian measurement noise, e.g. nuclear magnetic resonance (NMR) spectroscopy (see Ober et al., 2003).

  • Retout et al. (2002) address the problem of the choice and the evaluation of designs in population pharmacokinetic studies that use non-linear mixed-effect models. Criteria, based on the FIM, are developed to optimize designs and adapted to such models.

  • Sanchez-Montanes and Pearce (2001) discuss how the FIM may be used as part of an optimization procedure for selecting odor sensors within a population so as to maximize the accuracy with which the overall sensory system may estimate the stimulus.

  • Johnson et al. (2000) use the FIM for the analysis of passive-ranging systems based on wave-front coding.

  • Versyck et al. (1997) and Emery and Nenarokomov (1998) describethe application of the FIM in optimal experiment designs (the definition of the conditions under which an experiment is to be conducted in order to maximize the accuracy with which the results are obtained).

  • Barrett et al. (1995) describe applications of the FIM to objective assessment of image quality.

  • Penny et al. (1994) use the FIM to examine the problem of choosing an optimum, or near-optimum, set of measurement locations for experimental modal testing.

For details on the theory of the FIM, see Cox and Hinkley (1974).

The exact form of the FIM is derived in Section 2. The calculations use properties of the Kummer function (see, for example, Gradshteyn and Ryzhik, 2000). Some tools for the numerical computation of the FIM are developed in Section 3. Finally, Section 4 provides some tabulations of the FIM.

Section snippets

Explicit form of the FIM

If (x,y) is a single observation from (1) then the log-likelihood function can be written aslnL(a,b,c,α,β)=lnK+(α-1)lnx+(β-1)lny-ax-by-cxy.The first-order derivatives of (4) arelnLa=1KKa-x,lnLb=1KKb-y,lnLc=1KKc-xy,lnLα=1KKα+lnx,and lnLβ=1KKβ+lny.The maximum likelihood estimates (mles) of (a,b,c,α,β) are obtained by simultaneously solving the equations which arise by setting the above derivatives to zero. Using (3) and properties of the Kummer function, one can show that the

Numerical computation of the FIM

The numerical computation of the FIM in Section 2 entails computation of the Kummer function and its derivatives. Many of the computer algebra packages have routines that compute the Kummer function, e.g. KummerU in Maple. One can also compute the Kummer function by simply computing the integral in (2), which can be performed in most computer packages, including hand calculators. The required derivatives of the Kummer function can also be computed in this manner because simple algebra shows that

Tables of the FIM

Here, we provide an illustration of the tools developed in Section 3 by giving some numerical tabulations of the FIM derived in Section 2. We assume that the shape parameters α and β are known while the scale parameters a and b are fixed to take the standard value a=b=1. The dependence parameter c is set to take the values determined by Corr(X,Y)=ρ for ρ=0.1,0.2,,0.9. The tables displayed below give the numerical values of the elements E1=E-2lnLa2,E2=E-2lnLab,E3=E-2lnLacand E4=E-2lnLb

Acknowledgments

The author would like to thank the Editor-in-Chief and the referee for carefully reading the paper and for their help in improving the paper.

References (13)

  • M.A. Sanchez-Montanes et al.

    Fisher information and optimal odor sensors

    Neurocomputing

    (2001)
  • B.C. Arnold et al.

    Bivariate distributions with exponential conditionals

    J. Amer. Statist. Assoc.

    (1988)
  • H.H. Barrett et al.

    Objective assessment of image quality. 2. Fisher information, Fourier crosstalk, and figures of merit for task-performance

    J. Opt. Soc. Amer. A

    (1995)
  • D.R. Cox et al.

    Theoretical Statistics

    (1974)
  • A.F. Emery et al.

    Optimal experiment design

    Measurement Sci. & Technology

    (1998)
  • I.S. Gradshteyn et al.

    Table of Integrals, Series, and Products

    (2000)
There are more references available in the full text version of this article.

Cited by (3)

View full text