Abstract
This chapter introduces Direct Kernel Partial Least Squares (DK-PLS) and feature selection via sensitivity analysis for DK-PLS. The overall feature selection strategy for the five data sets used in the NIPS competition is outlined as well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
K.P. Bennett and M.J. Embrechts. An optimization perspective on kernel partial least squares regression. In Advances in learning theory; methods, models and applications, pages 227–250. IOS Press, Amsterdam, 2003.
J. Bi and K.P. Bennett. Regression error characteristic curves. In Proceedings of the 20th International Conference on Machine Learning (ICML 2003), Washington DC, 2003.
B.E. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. In Fifth Annual Workshop on Computational Learning Theory, pages 144–152. ACM, 1992.
L. Breiman. Bagging predictors. Machine Learning, 22(2):123–140, 1996.
N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-Based Methods. Cambridge University Press, 2000.
M.J. Embrechts and K.P. Bennett. Sparse-kernel pls for molecular drug design. In Y. Bengio, editor, Proceedings of the Learning Workshop, Snowbird, Utah, 2002.
V. Froelicher, K. Shetler, and E. Ashley. Better decisions through science: exercise testing scores. Progress in Cardiovascular Diseases, 44(5):385–414, 2002.
L. Gao and S. Ren. Simultaneous spectrometric determination of manganese, zinc and cobalt by kernel partial least-squares method. Journal of Automatic Chemistry, 20(6):179–183, 1998.
L. Gao and S. Ren. Simultaneous spectrophotometric determination of four metals by the kernel partial least squares method. Chemometrics and Intelligent Laboratory Systems, 45:87–93, 1999.
A. Golbraikh and A. Tropsha. Beware of q2! Journal of Molecular Graphics and Modelling, 20:269–276, 2002.
A.E. Hoerl and R.W. Kennard. Ridge regression: biased estimation for nonorthogonal problems. Technometrics, 12:69–82, 1970.
J. Hulland. Use of partial least squares (PLS) in strategic management research: a review of four recent studies. Strategic Management Journal, 20:195–204, 1999.
I.C.F. Ipsen and C.D. Meyer. The idea behind krylov methods. American Mathematical Monthly, 105:889–899, 1998.
R.A. Johnson and D.A. Wichern. Applied multivariate statistical analysis (second edition). Prentice Hall, 2000.
S.S. Keerthi and S.K. Shevade. SMO algorithm for least squares SVM formulations. Neural Computation, 15:487–507, 2003.
R.H. Kewley and M.J. Embrechts. Data strip mining for the virtual design of pharmaceuticals with neural networks. IEEE Transactions on Neural Networks, 11(3):668–679, 2000.
F. Lindgren, P. Geladi, and S. Wold. The kernel algorithm for pls. Journal of Chemometrics, 7:45–59, 1993.
S. Ren and L. Gao. Simultaneous spectrophotometric determination of copper (II), lead (II) and cadmium (II). Journal of Automatic Chemistry, 17(3):115–118, 1995.
R. Rosipal and L. T. Trejo. Kernel partial least squares regression in reproducing kernel hilbert space. Journal of Machine Learning Research, 2:97–123, 2001.
B. Schölkopf and A. Smola. Learning with kernels: Support Vector Machines, regularization, optimization and beyond. MIT Press, 2001.
J.A.K. Suykens, T. Van Gestel, J. de Brabanter, B. De Moor, and J. Vandewalle. Least squares support vector machines. World Scientific Publishing Company, Singapore, 2003.
J.A.K. Suykens and J. Vandewalle. Least-squares support vector machine classifiers. Neural Processing Letters, 9(3):293–300, 1999.
J.A. Swets, R.M. Dawes, and J. Monahan. Better decisions through science. Scientific American, 283:82–87, 2000.
H. Wold. Estimation of principal components and related models by iterative least squares. In P.R. Krishnaiah, editor, Multivariate analysis, pages 391–420. Academic Press, New York, 1966.
H. Wold. Path models with latent variables: the NIPALS approach. In H.M. Balock, editor, Quantitative sociology: International perspectives on mathematical and statistical model building, pages 307–357. Academic Press, New York, 1975.
S. Wold. Personal memories of the early PLS development. Chemometrics and Intelligent Laboratory Systems, 58:83–84, 2001.
S. Wold, M. Sjölström, and M.L. Erikson. PLS-regression: a basic tool of chemometrics. Chemometrics and Intelligent Laboratory Systems, 58:109–130, 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Embrechts, M.J., Bress, R.A., Kewley, R.H. (2006). Feature Selection via Sensitivity Analysis with Direct Kernel PLS. In: Guyon, I., Nikravesh, M., Gunn, S., Zadeh, L.A. (eds) Feature Extraction. Studies in Fuzziness and Soft Computing, vol 207. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-35488-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-35488-8_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35487-1
Online ISBN: 978-3-540-35488-8
eBook Packages: EngineeringEngineering (R0)