Skip to main content
Log in

Influence function analysis applied to partial least squares

  • Original Paper
  • Published:
Computational Statistics Aims and scope Submit manuscript

Abstract

In this work we present the empirical influence functions for the covariances (eigenvalues) and directions (eigenvectors) of partial least squares under the constraint of uncorrelated components. We apply the results to several data sets and provide advice for using these tools in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Campbell NA (1978). The influence function as an aid in outlier detection in discriminant analysis. Appl Stat 27:251–258

    Article  MATH  Google Scholar 

  • Critchley F (1981). Influence in principal components analysis. Biometrika 72:627–636

    Article  MathSciNet  Google Scholar 

  • El Tayar NE, Tsai R-S, Carrupt P-A, Testa B (1992). Octan-1-ol-water partition coefficients of zwitterionic a-amion acids, Determination by centrifugal partition chromatography and factorization into steric/hydrophobic and polar components. J Chem Soc Perkin Trans 2:79–84

    Google Scholar 

  • Fernandez Pierna JA, Jin L, Daszykowski M, Wahl F, Massart DL (2003). A methodology to detect outliers/inliers in prediction with PLS. Chemometrics Intell Lab Syst 68:17–28

    Article  Google Scholar 

  • Frank I, Friedman J (1993). A Statistical view of chemometric regression tools. Technometrics 35:109–135

    Article  MATH  Google Scholar 

  • Geladi P, Kowalski B (1986). Partial least squares regression: a tutorial. Anal Chem Acta 185:1–17

    Article  Google Scholar 

  • Gonzalez J, Pena D, Romera R (2005) A new robust PLS regression method. In: PLS and related methods: proceedings of the PLS’05 international symposium, pp 403–414

  • Gottfries J, Blennow K, Wallin A, Gottfries CG (1995). Diagnosis of dementias using partial least squares discriminant analysis. Dementia 6:83–88

    Google Scholar 

  • Hampel FR (1968). Contributions to the theory of robust estimation. PhD thesis, University of California, Berkeley

    Google Scholar 

  • Hampel FR (1974). The influence curve and its role in robust estimation. J Am Stat Assoc 69:383–393

    Article  MATH  MathSciNet  Google Scholar 

  • Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA (1986). Robust Statistics: the approach based on influence functions. Wiley, New York

    MATH  Google Scholar 

  • Helland IS (1988). On the structure of partial least squares regression. Commun Stat Ser B Simul Comput 17:581–607

    MATH  MathSciNet  Google Scholar 

  • Hoskuldsson A (1988). PLS regression method. J Chemometrics 2:211–228

    Article  Google Scholar 

  • Johnson K, Rayens WS (2006). Influence function analysis for partial least squares with uncorrelated components. Statistics 40(1):65–93

    MATH  MathSciNet  Google Scholar 

  • Kettaneh-Wold N (1992). Analysis of mixture data with partial least squares. Chemometrics Intell Lab Syst 14:57–69

    Article  Google Scholar 

  • McIntosh AR, Bookstein FL, Haxby JV, Grandy CL (1996). Spatial pattern analysis of functional brain images using partial least squares. Neuroimage 3:143–157

    Article  Google Scholar 

  • Naes T, Martens M (1985). Comparison of prediction methods for multicollinear data. Commun Stat B Simul Comput 14:545–576

    MATH  Google Scholar 

  • Pena D, Yohai V (2006). A Dirichlet random coefficient regression model for quality indicators. J Stat Planning Inference 136(3):942–961

    Article  MATH  MathSciNet  Google Scholar 

  • Radhakrishnan R, Kshisagar AM (1981). Influence functions for certain parameters in multivariate analysis. Commun Stat Ser A 10:515–529

    Google Scholar 

  • Stone M, Brooks RJ (1990). Continuum regression: cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares, and principal component regression. J R Stat Soc Ser B 52:237–269

    MATH  MathSciNet  Google Scholar 

  • Tanaka T (1988). Sensitivity analysis in principal component analysis: influence on the subspace spanned by principal components. Commun Stat Ser A 17:3157–3175

    Article  MATH  Google Scholar 

  • Wold H (1966). Estimation of principal components and related models by iterative least squares. Multivariate analysis. Academic, New York

    Google Scholar 

  • Wold H (1981). Soft modeling: the basic design and some extensions Systems under indirect observation Causality-structure-prediction. North Holland, Amsterdam

    Google Scholar 

  • Wold S (1995). PLS for multivariate linear modeling. In: van de Waterbeemd H (ed) Chemometric methods in molecular design. Weinheim-VCH, Germany, pp 195–218

    Google Scholar 

  • Wold S, Sjostrom M, Eriksson L (2001). PLS-regression: a basic tool of chemometrics. Chemometrics Intell Lab Syst 58:109–130

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kjell Johnson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Johnson, K., Rayens, W. Influence function analysis applied to partial least squares. Computational Statistics 22, 293–306 (2007). https://doi.org/10.1007/s00180-007-0037-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00180-007-0037-0

Keywords

Navigation