Skip to main content

Tractability of Function Approximation with Product Kernels

  • Conference paper
  • First Online:
Book cover Monte Carlo and Quasi-Monte Carlo Methods

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 163))

  • 2530 Accesses

Abstract

This article studies the problem of approximating functions belonging to a Hilbert space \({\mathscr {H}}_d\) with a reproducing kernel of the form

$${\widetilde{K}}_d({\varvec{x}},{\varvec{t}}):=\prod _{\ell =1}^d \left( 1-\alpha _\ell ^2+\alpha _\ell ^2K_{\gamma _\ell }(x_\ell ,t_\ell )\right) \ \ \ \text{ for } \text{ all } \ \ \ {\varvec{x}},{\varvec{t}}\in {\mathbb {R}}^d.$$

The \(\alpha _\ell \in [0,1]\) are scale parameters, and the \(\gamma _\ell >0\) are sometimes called shape parameters. The reproducing kernel \(K_{\gamma }\) corresponds to some Hilbert space of functions defined on \({\mathbb {R}}\). The kernel \({\widetilde{K}}_d\) generalizes the anisotropic Gaussian reproducing kernel, whose tractability properties have been established in the literature. We present sufficient conditions on \(\{\alpha _\ell \gamma _\ell \}_{\ell =1}^{\infty }\) under which function approximation problems on \({\mathscr {H}}_d\) are polynomially tractable. The exponent of strong polynomial tractability arises from bounds on the eigenvalues of positive definite linear operators.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Berlinet, A., Thomas-Agnan, C.: Reproducing Kernel Hilbert Spaces in Probability and Statistics. Kluwer Academic, Boston (2004)

    Book  MATH  Google Scholar 

  2. Bernstein, D.S.: Matrix Mathematics. Princeton University, New Jersey (2008)

    Google Scholar 

  3. Buhmann, M.D.: Radial Basis Functions. Cambridge Monographs on Applied and Computational Mathematics. Cambridge University Press, Cambridge (2003)

    Book  MATH  Google Scholar 

  4. Cucker, F., Zhou, D.X.: Learning Theory: An Approximation Theory Viewpoint. Cambridge Monographs on Applied and Computational Mathematics. Cambridge University Press, Cambridge (2007)

    Book  MATH  Google Scholar 

  5. Fasshauer, G.E.: Meshfree Approximation Methods with Matlab, Interdisciplinary Mathematical Sciences, vol. 6. World Scientific Publishing Co., Singapore (2007)

    Book  MATH  Google Scholar 

  6. Fasshauer, G.E., Hickernell, F.J., Woźniakowski, H.: On dimension-independent rates of convergence for function approximation with Gaussian kernels. SIAM J. Numer. Anal. 50, 247–271 (2012). doi:10.1137/10080138X

    Article  MathSciNet  MATH  Google Scholar 

  7. Hastie, T., Tibshirani, R., Friedman, J.: Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics, 2nd edn. Springer Science+Business Media Inc, New York (2009)

    Book  MATH  Google Scholar 

  8. Knutson, A., Tao, T.: Honeycombs and sums of Hermitian matrices. Not. AMS 48–2, 175–186 (2001)

    MathSciNet  MATH  Google Scholar 

  9. Kuo, F.Y., Wasilkowski, G.W., Woźniakowski, H.: On the power of standard information for multivariate approximation in the worst case setting. J. Approx. Theory 158, 97–125 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  10. Novak, E., Woźniakowski, H.: Tractability of Multivariate Problems Volume I: Linear Information. EMS Tracts in Mathematics, vol. 6. European Mathematical Society, Zürich (2008)

    Book  MATH  Google Scholar 

  11. Pietsch, A.: Operator Ideals. North-Holland Publishing Co., Amsterdam (1980)

    MATH  Google Scholar 

  12. Rasmussen, C.E., Williams, C.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006). http://www.gaussianprocess.org/gpml/

  13. Schaback, R., Wendland, H.: Kernel techniques: from machine learning to meshless methods. Acta Numer. 15, 543–639 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  14. Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2002)

    Google Scholar 

  15. Stein, M.L.: Interpolation of Spatial Data: Some theory for Kriging. Springer, New York (1999)

    Book  MATH  Google Scholar 

  16. Steinwart, I., Christmann, A.: Support Vector Machines. Springer Science+Business Media, Inc., New York (2008)

    MATH  Google Scholar 

  17. Wahba, G.: Spline Models for Observational Data, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 59. SIAM, Philadelphia (1990)

    Google Scholar 

  18. Wendland, H.: Scattered Data Approximation. Cambridge Monographs on Applied and Computational Mathematics, vol. 17. Cambridge University Press, Cambridge (2005)

    MATH  Google Scholar 

Download references

Acknowledgments

We are grateful for many fruitful discussions with Peter Mathé and several other colleagues. This work was partially supported by US National Science Foundation grants DMS-1115392 and DMS-1357690.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xuan Zhou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhou, X., Hickernell, F.J. (2016). Tractability of Function Approximation with Product Kernels. In: Cools, R., Nuyens, D. (eds) Monte Carlo and Quasi-Monte Carlo Methods. Springer Proceedings in Mathematics & Statistics, vol 163. Springer, Cham. https://doi.org/10.1007/978-3-319-33507-0_32

Download citation

Publish with us

Policies and ethics