Abstract
We consider an efficient Bayesian approach to estimating integration-based posterior summaries from a separate Bayesian application. In Bayesian quadrature we model an intractable posterior density function f(·) as a Gaussian process, using an approximating function g(·), and find a posterior distribution for the integral of f(·), conditional on a few evaluations of f (·) at selected design points. Bayesian quadrature using normal g (·) is called Bayes-Hermite quadrature. We extend this theory by allowing g(·) to be chosen from two wider classes of functions. One is a family of skew densities and the other is the family of finite mixtures of normal densities. For the family of skew densities we describe an iterative updating procedure to select the most suitable approximation and apply the method to two simulated posterior density functions.
Similar content being viewed by others
References
Azzalini, A. (1985) A class of distributions which includes the normal ones. Scandinavian Journal of Statistics, 12, 171–178.
Cressie, N. A. C. (1991) Statistics for Spatial Data. Wiley, New York.
Currin, C., Mitchell, T., Morris, M. and Ylvisaker, D. (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. Journal of the American Statistical Association, 86, 953–963.
Dalal, S. R. and Hall, W. J. (1983) Approximating priors by mixtures of natural conjugate priors. Journal of the Royal Statistical Society B, 45, 278–286.
Diaconis, P. and Ylvisaker, D. (1985) Quantifying prior opinion, in Bayesian Statistics 2, Bernado, J. M., DeGroot, M. H., Lindley, D. V. and Smith, A. F. M. (eds), North-Holland, Amsterdam pp. 133–156.
Kennedy, M. C. and O'Hagan, A. (1996) Iterative rescaling for Bayesian quadrature, in Bayesian Statistics 5, Bernardo, J. M., Berger, J. O., David, A. P. and Smith, A. F. M. (eds). Oxford University Press, Oxford, pp. 639–646.
O'Hagan, A. (1978) Curve fitting and optimal design for prediction. Journal of the Royal Statistical Society B, 40, 1–42, (with discussion).
O'Hagan, A. (1989) Integrating posterior densities by Bayesian quadrature. Warwick Statistics Research Report 177, University of Warwick, Coventry, UK.
O'Hagan, A. (1991) Bayes-Hermite quadrature. Journal of Statistical Planning and Inference, 29, 245–260.
O'Hagan, A. and Leonard, T. (1976) Bayes estimation subject to uncertainty about parameter constraints. Biometrika, 62, 607–614.
Omre, H. (1987) Bayesian Kriging-merging observations and qualified guesses in Kriging. Mathematical Geology, 19, 25–39.
Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P. (1989) Design and analysis of computer experiments. Statistical Science, 4, 409–435.
Tallis, G. M. (1961) The moment generating function of the truncated multi-normal distribution. Journal of the Royal Statistical Society B, 23(1), 223–229.
West, M. (1993) Approximating posterior distributions by mixtures. Journal of the Royal Statistical Society B, 55, 409–422.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
KENNEDY, M. Bayesian quadrature with non-normal approximating functions. Statistics and Computing 8, 365–375 (1998). https://doi.org/10.1023/A:1008832824006
Issue Date:
DOI: https://doi.org/10.1023/A:1008832824006