Abstract
In this paper, we develop a fast algorithm for a smoothing spline estimator in multivariate regression. To accomplish this, we employ general concepts associated with roughness penalty methods in conjunction with the theory of radial basis functions and reproducing kernel Hilbert spaces. It is shown that through the use of compactly supported radial basis functions it becomes possible to recover the band structured matrix feature of univariate spline smoothing and thereby obtain a fast computational algorithm. Given n data points in R 2, the new algorithm has complexity O(n 2) compared to O(n 3), the order for the thin plate multivariate smoothing splines.
Similar content being viewed by others
References
Ahlberg JH, Nilson EN, Walsh JL (1967) The theory of splines and their applications. Academic Press, New York
Anselone PM, Laurent PJ (1968) A general method for the construction of interpolating or smoothing spline functions. Numerische Mathematik 12: 66–82
Baxter BJC, Sivakumar N, Ward JD (1994) Regarding the p-norms of radial basis interpolation matrices. Constr Approx 10: 451–468
Berlinet A, Thomas-Agnan C (2004) Reproducing kernel Hilbert spaces in probability and statistics. Kluwer, New York
Buhmann MD (1998) Radial functions on compact support. Proc Edinb Math Soc 41: 33–46
Buhmann MD (2000) A new class of radial functions with compact support. Math Comput 70: 307–318
Chui CK (1988) Multivariate splines. Society for Industrial and Applied Mathematics, Philadelphia
Craven P, Wahba G (1979) Smoothing noisy data with spline function: estimating the correct degree of smoothing by the method of cross-validation. Numerische Mathematik 3: 377–403
Cressie N (1993) Statistics for spatial data. Wiley, Hoboken
De Boor C (1978) A practical guide to splines. Springer, New York
Duchon J (1977) Splines minimizing rotation-invariant semi-norms in sobolev spaces. Constr Theory Funct Several Var 1: 85–100
Eubank RL (1988) Spline smoothing and nonparametric regression. Marcel Dekker, New York
Gibbs NE, Poole WG, Stockmeyer PK (1976) An algorithm for reducing the bandwidth and profile of a sparse matrix. SIAM J Numer Anal 13: 236–250
Green PJ, Silverman BW (1994) Nonparametric regression and generalized linear models. Chapman & Hall, London
Gu C (2002) Smoothing spline anova models. Springer, New York
Hickernell FJ, Hon YC (1999) Radial basis function approximations as smoothing splines. Appl Math Comput 102: 1–24
Hutchinson MF, deHoog FR (1985) Smoothing noisy data with spline functions. Numerische Mathematik 47: 99–106
Lyche T, Schumaker LL (1973) Computation of smoothing and interpolating natural splines via local bases. SIAM J Numer Anal 10: 1027–1038
Reinsch CH (1971) Smoothing by spline functions. II. Numerische Mathematik 16: 451–454
Schoenberg IJ (1938) Metric spaces and completely monotone functions. Ann Math 39: 811–841
Thomas-Agnan C (1991) Spline functions and stochastic filtering. Ann Stat 19: 1512–1527
Villalobos MA, Wahba G (1983) Multivariate thin plate spline estimates for the posterior probabilities in the classification problem. Commun Stat Theory Methods 12: 1449–1479
Villalobos MA, Wahba G (1987) Inequality-constrained multivariate smoothing splines with application to the estimation of posterior probabilities. J Am Stat Assoc 82: 239–248
Wahba G (1981) Spline interpolation and smoothing on the sphere. SIAM J Sci Stat Comput 2: 5–16
Wahba G (1990) Spline models for observational data. Society for Industrial and Applied Mathematics, Pennsylvania
Wahba G, Wendelberger J (1980) Some new mathematical methods for variational objective analysis using splines and cross validation. Mon Weather Rev 108: 1122–1143
Wendland H (1995) Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree. Adv Comput Math 4: 389–396
Wendland H (2002) Scattered data modelling by radial and related functions. Habilitation Thesis, Mathematics, University of Gottingen, Göttingen, Germany
Whittaker ET (1923) On a new method of graduation. Proc Edinb Math Soc 41: 63–75
Wu Z (1995) Compactly supported positive definite radial functions. Adv Comput Math 4: 283–292
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, G. Smoothing splines using compactly supported, positive definite, radial basis functions. Comput Stat 27, 573–584 (2012). https://doi.org/10.1007/s00180-011-0277-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00180-011-0277-x