Abstract
This paper proposes the Nonnegative Garrote (NG) estimator for linear model with heteroscedastic errors. On the other hand, under some regularity conditions, the authors show the asymptotic optimality of the NG estimator by referring to the idea of the asymptotic optimality of the model average estimator. Simulation results and a real data analysis are reported for testing the results obtained previously. These results provide a stronger theoretical basis for the use of NG estimator by strengthening existing findings.
Similar content being viewed by others
References
Breiman L, Better subset regression using the Nonnegative Garrote, Technometrics, 1995, 37: 373–384.
Tibshirani R, Regression shrinkage and selection via the Lasso: A retrospective, Journal of the Royal Statistical Society, Series B, 1996, 58(1): 267–288.
Zou H and Hastie T, Regularization and variable selection via the elastic net, Journal of the Royal Statistical Society, Series B, 2005, 67(2): 301–320.
Zhang Z Z and Wang D R, Simultaneous variable selection for heteroscedastic regression models, Science China Mathematics, 2011, 54(3): 515–530.
Wu L C, Zhang Z Z, and Xu D K, Variable selection in joint location and scale models of the skew-normal distribution, Journal of Statistical Computation and Simulation, 2013, 83(7): 1266–1278.
Li H Q, Wu L C, and Ma T, Variable selection in joint location, scale and skewness models of the skew-normal distribution, Journal of Systems Science and Complexity, 2017, 30(3): 694–709.
Xu D K, Zhang Z Z, and Wu L C, Variable selection in high-dimensional double generalized linear models, Statistical Papers, 2014, 55(2): 327–347.
Breiman L, Heuristics of instability and stabilization in model selection, The Annals of Statistics, 1996, 24: 2350–2383.
Yuan M and Lin Y, Model selection and estimation in regression with grouped variables, Journal of the Royal Statistical Society, Series B, 2006, 68(1): 49–68.
Golub G H, Heath M, and Wahba G, Generalized cross-validation as a method for choosing a good ridge parameter, Technometrics, 1979, 21: 215–223.
Akaike H, Maximum likelihood identification of Gaussian autoregressive moving average models, Biometrika, 1973, 60: 255–265.
Schwarz G, Estimating the dimension of a model, The Annals of Statistics, 1978, 6(2): 461–464.
Xiong S F, Some notes on the nonnegative garrote, Technometrics, 2010, 52(3): 349–361.
Mallows C L, Some comments on CP, Technometrics, 1973, 15(4): 661–675.
Chen X P, Cai G H, and Gao Y, Asymptotic optimality of NG estimator for linear regression model based on mallows criterion, Journal of Systems Science and Mathematical Sciences, 2017, 37(11): 2260–2270.
Hoeting J A, Madigan D, Raftery A E, et al., Bayesian model averaging: A tutorial, Statistical Science, 1999, 14(4): 382–401.
Hansen B E, Least squares model averaging, Econometrica, 2007, 75(4): 1175–1189.
Hansen B E, Least-squares forecast averaging, Journal of Econometrics, 2008, 146(2): 342–350.
Wan A T K, Zhang X Y, and Zou G H, Least squares model averaging by mallows criterion, Journal of Econometrics, 2010, 156(2): 277–283.
Liang H, Zou G H, Wan A T K, et al., Optimal weight choice for frequentist model average estimators, Journal of the American Statistical Association, 2011, 106(495): 1053–1066.
Hansen B E and Racine J S, Jackknife model averaging, Journal of Econometrics, 2012, 167(1): 38–46.
Zhang X Y, Wan A T K, and Zou G H, Model averaging by Jackknife criterion in models with dependent data, Journal of Econometrics, 2013, 174(2): 82–94.
Liu Q F and Okui R, Heteroscedasticity-robust Cp model averaging, The Econometrics Journal, 2013, 16(3): 463–472.
Zhang X Y, Zou G H, and Carroll R J, Model averaging based on kullback-leibler distance, Statistica Sinica, 2015, 25(4): 1583–1598.
Gao Y, Zhang X Y, Wang S Y, et al., Model averaging based on leave-subject-out cross-validation, Journal of Econometrics, 2016, 192(1): 139–151.
Li K C, Asymptotic optimality for Cp, CL, cross-validation and generalized cross-validations: Discrete index set, Annals of Statistics, 1987, 15(3): 958–975.
Andrews D W K, Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors, Journal of Econometrics, 1991, 47(2): 359–377.
Weisberg S, Applied Linear Regression, 3rd Edition, John Wiley, Hoboken NJ, 2005.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the National Natural Science Foundation of China under Grant No. 61501331, the Natural Science Foundation of Zhejiang Province under Grant No. LY14F010002.
This paper was recommended for publication by Editor LI Qizhai.
Rights and permissions
About this article
Cite this article
Chen, X., Cai, G., Gao, Y. et al. Asymptotic Optimality of the Nonnegative Garrote Estimator Under Heteroscedastic Errors. J Syst Sci Complex 33, 545–562 (2020). https://doi.org/10.1007/s11424-020-8270-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-020-8270-5