Abstract
In this paper we consider a nonparametric regression model in which the conditional variance function is assumed to vary smoothly with the predictor. We offer an easily implemented and fully Bayesian approach that involves the Markov chain Monte Carlo sampling of standard distributions. This method is based on a technique utilized by Kim, Shephard, and Chib (in Rev. Econ. Stud. 65:361–393, 1998) for the stochastic volatility model. Although the (parametric or nonparametric) heteroscedastic regression and stochastic volatility models are quite different, they share the same structure as far as the estimation of the conditional variance function is concerned, a point that has been previously overlooked. Our method can be employed in the frequentist context and in Bayesian models more general than those considered in this paper. Illustrations of the method are provided.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Carlin, B.P., Chib, S.: Bayesian model choice via Markov chain Monte Carlo methods. J. R. Stat. Soc. B 57, 473–484 (1995)
Chan, D., Kohn, R., Nott, D., Kirby, C.: Locally adaptive semiparametric estimation of the mean and variance functions in regression models. J. Comput. Graph. Stat. 15(4), 915–936 (2006)
Chib, S.: Marginal likelihood from the Gibbs output. J. Am. Stat. Assoc. 90(432), 1313–1321 (1995)
Chib, S., Greenberg, E.: Additive cubic spline regression with Dirichlet process mixture errors. J. Econom. 156, 322–336 (2010)
Congdon, P.: Bayesian Statistical Modelling, 2nd edn. Wiley Series in Probability and Statistics. Wiley, Chichester (2007)
Denison, D.G.T., Holmes, C.C., Mallick, B.K., Smith, A.F.M.: Bayesian Methods for Nonlinear Classification and Regression. Wiley Series in Probability and Statistics. John Wiley, Chichester (2002)
Green, P., Silverman, B.W.: Nonparameteric Regression and Generalized Linear Models: A Roughness Penalty Approach. Chapman & Hall, London (1994)
Green, P.J.: Reversible jump MCMC computation and Bayesian model determination. Biometrika 82(4), 711–732 (1995)
Kim, S., Shephard, N., Chib, S.: Stochastic volatility: Likelihood inference and comparison with ARCH models. Rev. Econ. Stud. 65, 361–393 (1998)
Lancaster, P., Šalkauskas, K.: Curve and Surface Fitting: An Introduction. Academic Press, San Diego (1986)
Leslie, D.S., Kohn, R., Nott, D.J.: A general approach to heteroscedastic linear regression. Stat. Comput. 17(2), 131–146 (2007)
Omori, Y., Chib, S., Shephard, N., Nakajima, J.: Stochastic volatility with leverage: Fast and efficient likelihood inference. J. Econom. 140, 425–449 (2007)
Ruppert, D., Wand, M.P., Carroll, R.J.: Semiparametric Regression. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, New York (2003)
Wasserman, L.: All of Nonparametric Statistics. Springer Texts in Statistics. Springer, New York (2006)
Yu, K., Jones, M.C.: Likelihood-based local linear estimation of the conditional variance function. J. Am. Stat. Assoc. 99(465), 139–144 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chib, S., Greenberg, E. On conditional variance estimation in nonparametric regression. Stat Comput 23, 261–270 (2013). https://doi.org/10.1007/s11222-011-9307-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-011-9307-3