Skip to main content

Probabilistic limit identification up to “small” sets

  • Conference paper
  • First Online:
Algorithmic Learning Theory (ALT 1996)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1160))

Included in the following conference series:

  • 159 Accesses

Abstract

In this paper we study limit identification of total recursive functions in the case when “small” sets of errors are allowed. Here the notion of “small” sets we formalize in a very general way, i.e. we define a notion of measure for subsets of natural numbers, and we consider as being small those sets, which are subsets of sets with zero measure.

We study relations between classes of functions identifiable up to “small” sets for different choices of measure. In particular, we focus our attention on properties of probabilistic limit identification. We show that regardless of particular measure we always can identify a strictly larger class of functions with probability 1/(n+1) than with probability 1/n. Besides that, for computable measures we show that, if there do not exist sets with an arbitrary small non zero measure, then identifiability of a set of functions with probability larger than 1/(n+1) implies also identifiability of the same set with probability 1/n. Otherwise (in the case when there exist sets with an arbitrary small non zero measure), we always can identify a strictly larger class of functions with probability (n+1)/(2n+1) than with probability n/(2n-1), and identifiability with probability larger than (n+1)/(2n+1) implies also identifiability with probability n/(2n-1).

This work has been supported by Grant No.93-593 from Latvian Council of Science.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. L. Blum and M. Blum. Toward a mathematical theory of inductive inference. Information and Control, 28:125–155, 1975.

    Article  Google Scholar 

  2. J. Case and C. Smith. Comparison of identification criteria for machine inductive inference. Theoretical Computer Science, 25:193–220, 1983.

    Article  Google Scholar 

  3. L. Fortnov, R. Freivalds, W. Gasarch, M. Kummer, S. Kurtz, C. Smith, and F. Stephan. Measure, complexity and learning theory. Technical Report TR-95-01, University of Chicago, 1995.

    Google Scholar 

  4. R. Freivalds. Finite identification of general recursive functions by probabilistic strategies. In Proceedings of the Conference on Algebraic, Arithmetic and Categorial Methods in Computation Theory FCT'79, pages 138–145, 1979.

    Google Scholar 

  5. R. Freivalds, C. Smith, and M. Velauthapillai. Trade-off among parameters affecting inductive inference. Information and Computation, 82:323–349, 1989.

    Article  Google Scholar 

  6. R. Freivalds and J. Vīksna. Inductive inference up to immune sets. In Proceedings of the International Workshop on Analogical and Inductive Inference AII'89, volume 397 of Lecture Notes in Computer Science, pages 138–147, 1989.

    Google Scholar 

  7. W. Gasarch, R. Sitaraman, C. Smith, and M Velauthapillai. Learning programs with an easy to calculate set of errors. In Proceedings of the International Workshop on Analogical and Inductive Inference AII'89, volume 397 of Lecture Notes in Computer Science, pages 124–137, 1989.

    Google Scholar 

  8. E. Kinber and T. Zeugmann. Inductive inference of almost everywhere correct programs by reliably working strategies. Journal of Information Processing and Cybernetics, 21:91–100, 1985.

    Google Scholar 

  9. L. Pitt. Probabilistic inductive inference. Journal of the ACM, 36:383–433, 1989.

    Article  Google Scholar 

  10. H. Rogers. Theory of Recursive Functions and Effective Computability. MIT Press, 1987.

    Google Scholar 

  11. J. Royer. Inductive inference of approximations. Information and Computation, 70:156–178, 1986.

    Google Scholar 

  12. C. Smith and M. Velauthapillai. On the inference of programs approximately computing the desired function. In Proceedings of the International Worksop on Analogical and Inductive Inference AII'86. volume 265 of Lecture Notes in Computer Science, pages 164–176, 1986.

    Google Scholar 

  13. C. Smith and M. Velauthapillai. On the inference of approximate programs. Theoretical Computer Science, 77:249–266, 1990.

    Google Scholar 

  14. R.I. Soare. Recursively Enumerable Sets and Degrees. Springer Verlag, 1987.

    Google Scholar 

  15. J. Vīksna. Probabilistic inference of approximations. In Proceedings of the Conference of Nonmonotonic Logic and Inductive Inference, volume 659 of Lecture Notes in Computer Science, pages 323–332, 1991.

    Google Scholar 

  16. J. Vīksna. Probabilistic inference of limiting functions with bounded number of mind changes. International Journal of Foundations of Computer Science, 1995. Accepted.

    Google Scholar 

  17. J. Vīksna. Some general properties of probabilistic EX inductive inference. Technical Report LU-IMCS-TRCS-95-3, Institute of Mathematics and Computer Science, University of Latvia, 1995.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Setsuo Arikawa Arun K. Sharma

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vīksna, J. (1996). Probabilistic limit identification up to “small” sets. In: Arikawa, S., Sharma, A.K. (eds) Algorithmic Learning Theory. ALT 1996. Lecture Notes in Computer Science, vol 1160. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61863-5_55

Download citation

  • DOI: https://doi.org/10.1007/3-540-61863-5_55

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-61863-8

  • Online ISBN: 978-3-540-70719-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics