Skip to main content
Log in

Total complexity and the inference of best programs

  • Published:
Mathematical systems theory Aims and scope Submit manuscript

Abstract

The problem of choosing a “best” program for a function presented by example is considered. General axioms for total complexity involving time and size measures are presented. For measures obeying the axioms, certain positive and negative results are obtained on the existence of effective algorithms for learning the best program.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Biermann, A., On the inference of Turing Machines from sample computations, CS241, Stanford Computer Science Department, October 1971.

  2. Biermann, A. andJ. Feldman, A survey of grammatical inference, in S. Watanabe (Ed.)Frontiers of Pattern Recognition.

  3. Blum, L. andM. Blum, Inductive inference: A recursion theoretic approach, 14th Annual Symposium on Switching and Automata Theory, IEEE October 1973, pp. 200–208.

  4. Blum, M., A machine-independent theory of the complexity of recursive functions,J. ACM 14 (1967), 322–336.

    Google Scholar 

  5. Blum, M., On the size of machines,Information and Control 11 (1967), 257–265.

    Google Scholar 

  6. Buchanan, B., E. Feigenbaum, andJ. Lederberg, A heuristic programming study of theory formation in science, Proc. 2nd ICJAI, London, 1971.

  7. Chaitin, G. J., A theory of program size formally identical to information theory, RC 4805, IBM T. J. Watson Research Center, April 11, 1974.

  8. Feldman, J. A., Automatic programming, CS255, Stanford University, February 1972.

  9. Feldman, J. A., Some decidability results on grammatical inference and complexity,Information and Control, 1972.

  10. Feldman, J. A., J. Gips, J. J. Horning andS. Reder, Grammatical inference and complexity, CS125, Stanford University, June 1969.

  11. Fu, K. S., On syntactic pattern recognition and stochastic languages, TR-EE71-21, Purdue University, 1971.

  12. Gold, M., Language identification in the limit,Information and Control 10 (1967), 447–474.

    Google Scholar 

  13. Gold, M., Limiting recursion,J. Symb. Logic 30 (1965), 28–48.

    Google Scholar 

  14. Hartmanis, J. andJ. Hopcroft, An overview of computational complexity,J. ACM 18 (1971), 444–475.

    Google Scholar 

  15. Hopcroft, J. E. andJ. D. Ullman,Formal Languages and Their Relation to Automata, Addison-Wesley, Reading, Mass., 1969.

    Google Scholar 

  16. Klein, S. et al., The autoling system, TR 43, Computer Science, University of Wisconsin, September 1968.

  17. Meyer, A. R. andD. M. Ritchie, The complexity of loop programs, Proc. ACM 22nd Nat. Conf., pp. 465–9.

  18. Pager, D., On the efficiency of algorithms,J. ACM 17 (1970), 708–715.

    Google Scholar 

  19. Plotkin, G. D., Automatic methods of inductive inference, Ph.D. thesis, Machine Intelligence Dept., University of Edinburgh, 1971.

  20. Rogers, H., Jr.,Recursive Functions and Effective Computability, McGraw-Hill, New York, 1967.

    Google Scholar 

  21. Simon, H., Experiments with a heuritic compiler,J. Acm 10 (1963), 482–506.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Feldman, J.A., Shields, P.C. Total complexity and the inference of best programs. Math. Systems Theory 10, 181–191 (1976). https://doi.org/10.1007/BF01683271

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01683271

Keywords

Navigation