Skip to main content

Adaptive Elastic-Net for General Single-Index Regression Models

  • Conference paper
  • 1893 Accesses

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 100))

Abstract

In this article, we study a general single-index model with diverging number of predictors by using the adaptive Elastic-Net inverse regression method. The proposed method not only can estimate the direction of index and select important variables simultaneously, but also can avoid to estimate the unknown link function through nonparametric method. Under some regularity conditions, we show that the proposed estimators enjoy the so-called oracle property.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cook, R.D.: Regression graphics: Ideas for Studying Regressions through Graphics. Wiley & Sons, New York (1998)

    MATH  Google Scholar 

  2. Cook, R.D., Ni, L.: Sufficient dimension reduction via. J. Amer. Statist. Assoc. 100, 410–428 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  3. Cook, R.D., Weisberg, S.: Discussion to “Sliced inverse regression for dimension reduction”. J. Amer. Statist. Assoc.  86, 316–342 (1991)

    Article  MathSciNet  Google Scholar 

  4. Donoho, D.L.: High-dimensional data analysis: The curses and blessings of diemsnionality. In: Aide-Memoire of a Lecture at AMS Conference on Math Challenges of the 21st Century (2000)

    Google Scholar 

  5. Fan, J.Q., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96, 1348–1360 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  6. Fan, J.Q., Peng, H.: Nonconcave penalized likelihood with a diverging number of parameters. Ann. Statist. 32, 928–961 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  7. Ghosh, S.: Adaptive Elastic Net: an improvement of Elastic Net to achieve oracle properties. Indiana Univ.–Purdue Univ. Tech. report (2007

    Google Scholar 

  8. Hall, P., Li, K.C.: On almost linearity of low dimensional projection from high dimensional data. Ann. Statist. 21, 867–889 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  9. Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55–67 (1970)

    Article  MATH  Google Scholar 

  10. Li, B., Zha, H., Chiaromonte, F.: Contour regression: A general approach to dimension reduction. Ann. Statist. 33, 1580–1616 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  11. Li, G.R., Peng, H., Zhu, L.X.: Nonconcave penalized M-estimation with diverging number of parameters. Statistica Sinica 21, 391–419 (2011)

    MathSciNet  MATH  Google Scholar 

  12. Li, K.C.: Sliced inverse regression for dimension reduction (with discussion). J. Amer. Statist. Assoc. 86, 316–342 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  13. Li, K.C., Duan, N.H.: Regression analysis under link violation. Ann. Statist. 17, 1009–1052 (1989)

    Google Scholar 

  14. Tibshirani, R.: Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. B. 58(1), 267–288 (1996)

    Google Scholar 

  15. Zhu, L.P., Zhu, L.X.: Nonconcave penalized inverse regression in single-index models with high dimensional predictors. J. Multivariate Anal. 100, 862–875 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  16. Zou, H.: The adaptive Lasso and its oracle properties. J. Amer. Statist. Assoc. 101(476), 1418–1429 (2006)

    Google Scholar 

  17. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. B 67, 301–320 (2005)

    Google Scholar 

  18. Zou, H., Zhang, H.H.: On the adaptive elastic-net with a diverging number of parameters. Ann. Statist. 37(4), 1733–1751 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Li, X., Li, G., Yang, S. (2011). Adaptive Elastic-Net for General Single-Index Regression Models. In: Li, S., Wang, X., Okazaki, Y., Kawabe, J., Murofushi, T., Guan, L. (eds) Nonlinear Mathematics for Uncertainty and its Applications. Advances in Intelligent and Soft Computing, vol 100. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22833-9_62

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-22833-9_62

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-22832-2

  • Online ISBN: 978-3-642-22833-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics