Abstract
In this paper we study limit identification of total recursive functions in the case when “small” sets of errors are allowed. Here the notion of “small” sets we formalize in a very general way, i.e. we define a notion of measure for subsets of natural numbers, and we consider as being small those sets, which are subsets of sets with zero measure.
We study relations between classes of functions identifiable up to “small” sets for different choices of measure. In particular, we focus our attention on properties of probabilistic limit identification. We show that regardless of particular measure we always can identify a strictly larger class of functions with probability 1/(n+1) than with probability 1/n. Besides that, for computable measures we show that, if there do not exist sets with an arbitrary small non zero measure, then identifiability of a set of functions with probability larger than 1/(n+1) implies also identifiability of the same set with probability 1/n. Otherwise (in the case when there exist sets with an arbitrary small non zero measure), we always can identify a strictly larger class of functions with probability (n+1)/(2n+1) than with probability n/(2n-1), and identifiability with probability larger than (n+1)/(2n+1) implies also identifiability with probability n/(2n-1).
This work has been supported by Grant No.93-593 from Latvian Council of Science.
Preview
Unable to display preview. Download preview PDF.
References
L. Blum and M. Blum. Toward a mathematical theory of inductive inference. Information and Control, 28:125–155, 1975.
J. Case and C. Smith. Comparison of identification criteria for machine inductive inference. Theoretical Computer Science, 25:193–220, 1983.
L. Fortnov, R. Freivalds, W. Gasarch, M. Kummer, S. Kurtz, C. Smith, and F. Stephan. Measure, complexity and learning theory. Technical Report TR-95-01, University of Chicago, 1995.
R. Freivalds. Finite identification of general recursive functions by probabilistic strategies. In Proceedings of the Conference on Algebraic, Arithmetic and Categorial Methods in Computation Theory FCT'79, pages 138–145, 1979.
R. Freivalds, C. Smith, and M. Velauthapillai. Trade-off among parameters affecting inductive inference. Information and Computation, 82:323–349, 1989.
R. Freivalds and J. Vīksna. Inductive inference up to immune sets. In Proceedings of the International Workshop on Analogical and Inductive Inference AII'89, volume 397 of Lecture Notes in Computer Science, pages 138–147, 1989.
W. Gasarch, R. Sitaraman, C. Smith, and M Velauthapillai. Learning programs with an easy to calculate set of errors. In Proceedings of the International Workshop on Analogical and Inductive Inference AII'89, volume 397 of Lecture Notes in Computer Science, pages 124–137, 1989.
E. Kinber and T. Zeugmann. Inductive inference of almost everywhere correct programs by reliably working strategies. Journal of Information Processing and Cybernetics, 21:91–100, 1985.
L. Pitt. Probabilistic inductive inference. Journal of the ACM, 36:383–433, 1989.
H. Rogers. Theory of Recursive Functions and Effective Computability. MIT Press, 1987.
J. Royer. Inductive inference of approximations. Information and Computation, 70:156–178, 1986.
C. Smith and M. Velauthapillai. On the inference of programs approximately computing the desired function. In Proceedings of the International Worksop on Analogical and Inductive Inference AII'86. volume 265 of Lecture Notes in Computer Science, pages 164–176, 1986.
C. Smith and M. Velauthapillai. On the inference of approximate programs. Theoretical Computer Science, 77:249–266, 1990.
R.I. Soare. Recursively Enumerable Sets and Degrees. Springer Verlag, 1987.
J. Vīksna. Probabilistic inference of approximations. In Proceedings of the Conference of Nonmonotonic Logic and Inductive Inference, volume 659 of Lecture Notes in Computer Science, pages 323–332, 1991.
J. Vīksna. Probabilistic inference of limiting functions with bounded number of mind changes. International Journal of Foundations of Computer Science, 1995. Accepted.
J. Vīksna. Some general properties of probabilistic EX inductive inference. Technical Report LU-IMCS-TRCS-95-3, Institute of Mathematics and Computer Science, University of Latvia, 1995.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vīksna, J. (1996). Probabilistic limit identification up to “small” sets. In: Arikawa, S., Sharma, A.K. (eds) Algorithmic Learning Theory. ALT 1996. Lecture Notes in Computer Science, vol 1160. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61863-5_55
Download citation
DOI: https://doi.org/10.1007/3-540-61863-5_55
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61863-8
Online ISBN: 978-3-540-70719-6
eBook Packages: Springer Book Archive