Abstract
Sufficient dimension reduction methodologies in regressions of Y on a p-variate X aim at obtaining a reduction \(R(X) \in {\mathbb R}^{d}, d \le p\), that retains all the regression information of Y in X. When the predictors fall naturally into a number of known groups or domains, it has been established that exploiting the grouping information often leads to more effective sufficient dimension reduction of the predictors. In this article, we consider group-wise sufficient dimension reduction based on principal fitted components, when the grouping information is unknown. Principal fitted components methodology is coupled with an agglomerative clustering procedure to identify a suitable grouping structure. Simulations and real data analysis demonstrate that the group-wise principal fitted components sufficient dimension reduction is superior to the standard principal fitted components and to general sufficient dimension reduction methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adragni KP (2015) Independent screening in high-dimensional exponential family predictors’ space. J Appl Stat 42(2):347–359
Adragni KP, Cook RD (2009) Sufficient dimension reduction and prediction in regression. Philos Trans R Soc Ser A 367:4385–4405
Adragni KP, Raim A (2014a) An R software package for likelihood-based sufficient dimension reduction. J Stat Softw, 61(3). http://www.jstatsoft.org/v61/i03
Adragni KP, Raim A (2014b) ldr: methods for likelihood-based dimension reduction in regression. http://cran.r-project.org/web/packages/ldr/index.html. R package version 1.3
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B 57(1):289–300
Boos D (2014) Boos-stefanski variable selection home. http://www4.stat.ncsu.edu/~boos/var.select/
Cook RD (1998) Regression graphics. Wiley, Hoboken
Cook RD (2007) Fisher lecture—dimension reduction in regression (with discussion). Stat Sci 22(1):1–26
Cook RD, Forzani L (2008) Principal fitted components for dimension reduction in regression. Stat Sci 23(4):486–501
Cook RD, Forzani L (2009) Likelihood-based sufficient dimension reduction. J Am Stat Assoc 104(485):197–208
Cook RD, Weisberg S (1991) Discussion of sliced inverse regression by KC Li. J Am Stat Assoc 86:328–332
Cornish KM, Li L, Kogan CS, Jacquemont S, Turk J, Dalton A, Hagerman RJ, Hagerman PJ (2008) Age-dependent cognitive changes in carriers of the fragile x syndrome. Cortex 44:628–636
Efron B (2010) Large-scale inference empirical bayes methods for estimation, testing, and prediction. Cambridge University Press, Cambridge
Efron B, Hastie T, Johnstone I, Tibshirani R (2004) Least angle regression. Ann Stat 32(2):407–499
Enz R (1991) Prices and earnings around the globe: a comparison of purchasing power in 48 cities. Union Bank of Switzerland, Economic Research Dept., Zurich
Friedman J, Hastie T, Tibshirani R (2007) Sparse inverse covariance estimation with the graphical lasso. Biostatistics 9:432–441
Guo Z, Li L, Lu W, Li B (2014) Groupwise dimension reduction via envelope method. J Am Stat Assoc. http://dx.doi.org/10.1080/01621459.2014.970687
Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning: data mining, inference and prediction. Springer, New York
Li B, Wang S (2007) On directional regression for dimension reduction. J Am Stat Assoc 102:997–1008
Li KC (1991) Sliced inverse regression for dimension reduction (with discussion). J Am Stat Assoc 86:316–342
Li L (2009) Exploiting predictor domain information in sufficient dimension reduction. Comput Stat Data Anal 53(7):2665–2672
Li L, Li B, Zhu L (2010) Groupwise dimension reduction. J Am Stat Assoc 105(491):1188–1201
Maechler M, Rousseeuw P, Struyf A, Hubert M, Hornik K (2015) Cluster: cluster analysis basics and extensions, R package version 2.0.3
McDonald G, Schwing R (1973) Instabilities of regression estimates relating air pollution to mortality. Technometrics 15:463–481
R Core Team (2015) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org/
Weisberg S (2002) Dimension reduction regression in R. J Stat Softw 7(1):1–22. http://www.jstatsoft.org/v07/i01
Xia Y, Tong H, Li WK, Zhu L (2002) An adaptive estimation of dimension reduction space. J R Stat Soc Ser B 64(3):363–410
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Adragni, K.P., Al-Najjar, E., Martin, S. et al. Group-wise sufficient dimension reduction with principal fitted components. Comput Stat 31, 923–941 (2016). https://doi.org/10.1007/s00180-015-0611-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00180-015-0611-9