Skip to main content

Learning Relatively Small Classes

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2111))

Abstract

We study the sample complexity of proper and improper learning problems with respect to different L q loss functions. We improve the known estimates for classes which have relatively small covering numbers (log-covering numbers which are polynomial with exponent p < 2) with respect to the L q norm for q = 2.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Anthony, P.L. Bartlett: Neural Network Learning: Theoretical Foundations, Cambridge University Press, 1999.

    Google Scholar 

  2. B. Beauzamy: Introduction to Banach spaces and their Geometry, Math. Studies, vol 86, North-Holland, 1982

    Google Scholar 

  3. O. Hanner: On the uniform convexity of L p and l p, Ark. Math. 3, 239–244, 1956.

    Article  MATH  MathSciNet  Google Scholar 

  4. P. Habala, P. Haĵek, V. Zizler: Introduction to Banach spaces vol I and II, matfyzpress, Univ. Karlovy, Prague, 1996.

    Google Scholar 

  5. W.S. Lee: Agnostic learning and single hidden layer neural network, Ph.D. thesis, The Australian National University, 1996.

    Google Scholar 

  6. W.S. Lee, P.L. Bartlett, R.C. Williamson: The Importance of Convexity in Learning with SquaredLoss, IEEE Transactions on Information Theory 445, 1974–1980, 1998.

    Article  MATH  MathSciNet  Google Scholar 

  7. S. Mendelson: Rademacher averages and phase transitions in Glivenko-Cantelli classes, preprint.

    Google Scholar 

  8. S. Mendelson: Geometric methods in the analysis of Glivenko-Cantelli classes, this volume.

    Google Scholar 

  9. M. Talagrand: Sharper bounds for Gaussian and empirical processes, Annals of Probability, 22(1), 28–76, 1994.

    Article  MATH  MathSciNet  Google Scholar 

  10. A.W. Van-der-Vaart, J.A. Wellner: Weak convergence and Empirical Processes, Springer-Verlag, 1996.

    Google Scholar 

  11. R.C. Williamson, A.J. Smola, B. Schölkopf: Generalization performance of regularization networks andsupp ort vectors machines via entropy numbers of compact operators, to appear in IEEE transactions on Information Theory.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mendelson, S. (2001). Learning Relatively Small Classes. In: Helmbold, D., Williamson, B. (eds) Computational Learning Theory. COLT 2001. Lecture Notes in Computer Science(), vol 2111. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44581-1_18

Download citation

  • DOI: https://doi.org/10.1007/3-540-44581-1_18

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42343-0

  • Online ISBN: 978-3-540-44581-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics