Abstract
We introduce a new method of approximating volume (and integrals) for a vast number of geometric bodies defined by boolean combinations of Pfaffian conditions. The method depends on the VC Dimension of the underlying classes of bodies. The resulting approximation algorithms are quite different in spirit from previously known methods, and give randomized solutions even for such seemingly intractable problems of statistical physics as computing the volume of sets defined by the systems of exponential (or more generally Pfaffian) inequalities.
Research partially supported by the DFG Grant KA 673/4-1, and by ESPRIT BR Grants 7097 and EC-US 030.
Research supported in part by a Senior Research Fellowship of the SERC.
Preview
Unable to display preview. Download preview PDF.
References
M. Anthony and N. Biggs, Computational Learning Theory: An Introduction, Cambridge University Press, 1992.
M. Anthony and J. Shawe-Taylor, A Result of Vapnik with Applications, Discrete Applied Math. 47 (1993), pp. 207–217.
A. Blumer, A. Ehrenfeucht, D. Haussler and M. Warmuth, Learnability and the Vapnik-Chervonenkis Dimension, J. ACM 36 (1990), pp. 929–965.
A. Borodin, P. Tiwari, On the Decidability of Sparse Univariate Polynomial Interpolation, Proc. 22nd ACM STOC (1990), pp. 535–545.
F. Delon, Définissabilité avec Paramètres Extérieurs dans Qinp et R, Proc. AMS 106 (1989), pp. 193–198.
J. Denef, The Rationality of the Poincare Series associated to the p-adic Points on a Variety, Invent. Math. 77 (1984), pp. 1–23.
J. Denef and L.P.D. van den Dries, p-adic and real subanalytic Sets, Annals of Mathematics 128 (1988), 79–138.
L. van den Dries, Tame Topology and o-Minimal Structures, preprint, University of Illinois, Urbana, 1992; to appear as a book.
L. van den Dries, D. Haskell, H.D. Macpherson, On Dimensional p-adic Subanalytic Sets, to appear.
L. van den Dries, A. Macintyre and D. Marker, The Elementary Theory of Restricted Analytic Fields with Exponentation, Annals of Mathematics 140 (1994), pp 183–205.
L. van den Dries, C. Miller, Geometric Categories and o-Minimal Theories, Duke Journal 84 (1996), 497–540.
M. E. Dyer and M. Frieze, On the Complexity of Computing the Volume of a Polyhedron, SIAM J. Comput. 17 (1988), pp. 967–974.
M. Dyer, A. Frieze and R. Kannan, A Random Polynomial-Time Algorithm for Approximating the Volume of Convex Bodies, J. ACM 83 (1991), pp. 1–17.
P. Goldberg and M. Jerrum, Bounding the Vapnik Chervonenkis Dimension of Concept Classes Parametrized by Real Numbers. Machine Learning, 1995. A preliminary version appeared in Proc. 6th ACM Workshop on Computational Learning Theory, pp. 361–369, 1993.
P. Halmos, Measure Theory, Chelsey-New York, 1950.
G. H. Hardy, Properties of Logarithmic-Exponential Functions, Proc. London Math. Soc. 10 (1912), pp. 54–90.
D. Haussler, Decision Theoretic Generalizations of the PAC Model for Neural Net and other Learning Applications, Information and Computation 100, (1992), pp. 78–150.
J. Hertz, A. Krogh and R. G. Palmer, Introduction to the Theory of Neural Computation, Addison-Wesley, 1991.
M. W. Hirsch, Differential Topology, Springer-Verlag, 1976.
M. Karpinski and A. Macintyre, Bounding VC Dimension for Neural Networks: Progress and Prospects (Invited Lecture), Proc. EuroCOLT'95, Lecture Notes in Artificial Intelligence Vol. 904, Springer-Verlag, 1995, pp. 337–341.
M. Karpinski and A. Macintyre, Polynomial Bounds for VC Dimension of Sigmoidal Neural Networks, Proc. 27th ACM STOC (1995), pp. 200–208.
M. Karpinski and A. Macintyre, Polynomial Bounds for VC Dimension of Sigmoidal and General Pfaffian Neural Networks, J. Comput. Syst. Sci. 54 (1997), to appear.
M. Karpinski, A. Macintyre, Approximating Volumes and Integrals in o-Minimal and p-Minimal Theories, manuscript in preparation.
M. Karpinski and T. Werther, VC Dimension and Uniform Learnability of Sparse Polynomials and Rational Functions, SIAM J. Computing 22 (1993), pp 1276–1285.
A. G. Khovanski, Fewnomials, American Mathematical Society, Providence, R.I., 1991.
J. Knight, A. Pillay and C. Steinhorn, Definable Sets and Ordered Structures II, Trans. American Mathematical Society 295 (1986), pp. 593–605.
P. Koiran, Approximating the Volume of Definable Sets, Proc. 36th IEEE FOCS (1995), pp. 258–265.
P. Koiran and E. D. Sontag, Neural Networks with Quadratic VC Dimension to appear in Advances in Neural Information Processing Systems (NIPS '95), 1995.
M. C. Laskowski, Vapnik-Chervonenkis Classes of Definable Sets, J. London Math. Society 45 (1992), pp 377–384.
L. Lovasz and M. Simonovits, The Mixing Rate of Markov Chains, an Isoperimetric Inequality, and Computing the Volume, Proc. 31 IEEE FOCS (1990), pp. 346–355.
W. Maass, Perspectives of Current Research about the Complexity of Learning on Neural Nets, in: Theoretical Advances in Neural Computation and Learning, V. P. Roychowdhury, K. Y. Siu, A. Orlitsky (Editors), Kluwer Academic Publishers, 1994, pp. 295–336.
W. Maass, Bounds for the Computational Power and Learning Complexity of Analog Neural Nets, Proc. 25th ACM STOC (1993), pp. 335–344.
W. Maass, G. Schnitger and E. D. Sontag, On the Computational Power of Sigmoidal versus Boolean Threshold Circuits, Proc. 32nd IEEE FOCS (1991), pp. 767–776.
A. J. Macintyre and E. D. Sontag, Finiteness results for Sigmoidal Neural Networks, Proc. 25th ACM STOC (1993), pp. 325–334.
J. Milnor, On the Betti Numbers of Real Varieties, Proc. of the American Mathematical Society 15 (1964), pp 275–280.
J. Milnor, Topology from the Differentiable Viewpoint, Univ.Press, Virginia, 1965.
B. Pouzat, Groupes stables, avec types géneriques réguliers, J. S. L. 48 (1983), pp. 339–355.
J. Renegar, On the Computational Complexity and Geometry of the First-Order Theory of the Reals, Parts I, II, III, J. of Symb. Comput. 3 (1992), pp. 255–352.
A. Sard, The Measure of the Critical Points of Differentiable Maps, Bull. Amer. Math. Soc. 48 (1942), pp. 883–890.
J. Shawe-Taylor, Sample Sizes for Sigmoidal Neural Networks, Preprint, University of London, 1994, to appear in Proc. ACM COLT, 1995.
E. D. Sontag, Feedforward Nets for Interpolation and Classification, J. Comp. Syst. Sci. 45 (1992), pp. 20–48.
V. Vapnik, Estimation of Dependencies Based on Empirical Data, Springer Series in Statistics, 1982.
H. E. Warren, Lower Bounds for Approximation by Non-linear Manifolds, Trans. of the AMS 133 (1968), pp. 167–178.
A. J. Wilkie, Model Completeness Results of Restricted Pfaffian Functions and the Exponential Function; to appear in Journal of the AMS, 1994.
A.J. Wilkie, Handwritten manuscript, Oxford 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Karpinski, M., Macintyre, A. (1997). Approximating the volume of general Pfaffian bodies. In: Mycielski, J., Rozenberg, G., Salomaa, A. (eds) Structures in Logic and Computer Science. Lecture Notes in Computer Science, vol 1261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63246-8_10
Download citation
DOI: https://doi.org/10.1007/3-540-63246-8_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63246-7
Online ISBN: 978-3-540-69242-3
eBook Packages: Springer Book Archive