Skip to main content
Log in

Inductive logic programming

  • Special Issue
  • Published:
New Generation Computing Aims and scope Submit manuscript

Abstract

A new research area, Inductive Logic Programming, is presently emerging. While inheriting various positive characteristics of the parent subjects of Logic Programming and Machine Learning, it is hoped that the new area will overcome many of the limitations of its forebears. The background to present developments within this area is discussed and various goals and aspirations for the increasing body of researchers are identified. Inductive Logic Programming needs to be based on sound principles from both Logic and Statistics. On the side of statistical justification of hypotheses we discuss the possible relationship between Algorithmic Complexity theory and Probably-Approximately-Correct (PAC) Learning. In terms of logic we provide a unifying framework for Muggleton and Buntine’s Inverse Resolution (IR) and Plotkin’s Relative Least General Generalisation (RLGG) by rederiving RLGG in terms of IR. This leads to a discussion of the feasibility of extending the RLGG framework to allow for the invention of new predicates, previously discussed only within the context of IR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. R.B. Banerji. Learning in the limit in a growing language. InIJCAI-87, pages 280–282, Los Angeles, CA, 1987. Kaufmann.

  2. C. Bennett. Logical depth and physical complexity. In R. Herken, editor,The Universal Turing Machine A Half Century Survey, pages 227–257. Kammerer and Unverzagt, Hamburg, 1988.

    Google Scholar 

  3. I. Bratko.Prolog for artificial intelligence. Addison-Wesley, London, 1986.

    MATH  Google Scholar 

  4. W. Buntine. Generalised subsumption and its applications to induction and redundancy.Artificial Intelligence, 36(2):149–176, 1988.

    Article  MATH  MathSciNet  Google Scholar 

  5. R. Carnap.The Continuum of Inductive Methods. Chicago University, Chicago, 1952.

    MATH  Google Scholar 

  6. G. Chaitin.Information, Randomness and Incompleteness — Papers on Algorithmic Information Theory. World Scientific Press, Singapore, 1987.

    MATH  Google Scholar 

  7. Dietterich. Limitations of inductive learning. InProceedings of the Sixth International Workshop on Machine Learning, pages 124–128, San Mateo, CA, 1989. Morgan-Kaufmann.

  8. A. Ehrenfeucht, D. Haussler, M. Kearns, and L. Valiant. A general lower bound on the number of examples needed for learning. InCOLT 88: Proceedings of the Conference on Learning, pages 110–120, Los Altos, CA, 1988. Morgan-Kaufmann.

  9. S. Feferman et al., editor.Gödel’s Collected Works. Oxford University Press, Oxford, 1980.

    Google Scholar 

  10. M.S. Fox and J. McDermott. The role of databases in knowledge-based systems. Technical Report CMU-RI-TR-86-3, Carnegie-Mellon University, Robotics Institute, Pittsburgh, PA, 1986.

    Google Scholar 

  11. A.M. Frisch and C.D. Page. On inductive generalisation with taxonomic back-ground knowledge. Technical report, University of Illinois, Urbana, 1989.

    Google Scholar 

  12. K. Gödel. Über formal unentscheidbare Sätze der Principia Mathematica und verwandter System I.Monats. Math. Phys., 32:173–198, 1931.

    Article  Google Scholar 

  13. E.M. Gold. Language identification in the limit.Information and Control, 10:447–474, 1967.

    Article  MATH  Google Scholar 

  14. D. Haussler. Quantifying inductive bias: AI learning algorithms and Valiant’s learning framework.Artificial intelligence, 36:177–221, 1988.

    Article  MATH  MathSciNet  Google Scholar 

  15. J. Hayes-Michie. News from Brainware.Pragmatica, 1:10–11, 1990.

    Google Scholar 

  16. H. Ishizaka. Learning simple deterministic languages. InComputational learning theory: proceedings of the second annual workshop, San Mateo, CA, 1989. Kaufmann.

  17. R.A. Kowalski.Logic for Problem Solving. North Holland, 1980.

  18. B. Kuipers. Qualitative simulation.Artificial Intelligence, 29:289–338, 1986.

    Article  MATH  MathSciNet  Google Scholar 

  19. X. Ling and M. Dawes Theory reduction with uncertainty: A reason for theoretical terms. Technical Report 271, University of Western Ontario, 1990.

  20. J.W. Lloyd.Foundations of Logic Programming. Springer-Verlag, Berlin, 1984.

    MATH  Google Scholar 

  21. M.J. Maher. Equivalences of logic programs. InProceedings of Third International Conference on Logic Programming, Berlin, 1986. Springer.

  22. T.M. Mitchell, R.M. Keller, and S.T. Kedar-Cabelli. Explanation-based generalization: A unifying view.Machine Learning, 1(1):47–80, 1986.

    Google Scholar 

  23. H. Mortimer.The Logic of Induction. Ellis Horwood, Chichester, England, 1988.

    MATH  Google Scholar 

  24. S.H. Muggleton. Duce, an oracle based approach to constructive induction. InIJCAI-87, pages 287–292. Kaufmann, 1987.

  25. S.H. Muggleton. Inverting the resolution principle. InMachine Intellience 12 (in press) Oxford University Press, 1988.

  26. S.H. Muggleton. A strategy for constructing new predicates in first order logic. InProceedings of the Third European Working Session on Learning, pages 123–130. Pitman, 1988.

  27. S.H. Muggleton.Inductive Acquisition of Expert Knowledge. Addision-Wesley, Wokingham, England, 1990.

    Google Scholar 

  28. S.H. Muggleton and W. Buntine. Machine invention of first-order predicates by inverting resolution. InProceedings of the Fifth International Conference on Machine Learning, pages 339–352. Kaufmann, 1988.

  29. S.H. Muggleton and C. Feng. Efficient induction of logic programs. InProceedings of the First Conference on Algorithmic Learning Theory, Tokyo, 1990. Ohmsha.

  30. T. Niblett. A study of generalisation in logic programs. InEWSL-88, London, 1988. Pitman.

  31. G.D. Plotkin.Automatic Methods of Inductive Inference. PhD thesis, Edinburgh University, August 1971.

  32. J.R. Quinlan. Discovering rules from large collections of examples: a case study. In D. Michie, editor,Expert Systems in the Micro-electronic Age, pages 168–201. Edinburgh University Press, Edinburgh, 1979.

    Google Scholar 

  33. J.R. Quinlan. Learning relations: comparison of a symbolic and a connectionist approach. Technical Report 346, University of Sydney, 1989.

  34. J.A. Robinson. A machine-oriented logic based on the resolution principle.JACM, 12(1):23–41, January 1965.

    Article  MATH  Google Scholar 

  35. C. Rouveirol and J-F Puget. A simple and general solution for inverting resolution. InEWSL-89, pages 201–210, London, 1989. Pitman.

  36. C. Sammut and R.B. Banerji. Learning concepts by asking questions. In R. Michalski, J. Carbonnel, and T. Mitchell, editors,Machine Learning: An Artificial Intelligence Approach. Vol. 2, pages 167–192. Kaufmann, Los Altos, CA, 1986.

    Google Scholar 

  37. E.Y. Shapiro.Algorithmic program debugging. MIT Press, 1983.

  38. E.H. Shortliffe and B. Buchanan. A model of inexact reasoning in medicine.Mathematical Biosciences, 23:351–379, 1975.

    Article  MathSciNet  Google Scholar 

  39. S. Slocombe, K. Moore, and M. Zelonf. Engineering expert systems applications. InProceedings of the Annual Conference of the BCS Specialist Group on Expert Systems. British Computer Society, London, 1986.

    Google Scholar 

  40. R.J. Solomonoff. A formal theory of inductive inference.J. Comput. Sys., 7:376–388, 1964.

    Google Scholar 

  41. L. Sterling and E. Shapiro.The art of Prolog: advanced programming techniques. MIT-Press, Cambridge, MA, 1986.

    MATH  Google Scholar 

  42. A. Turing. Systems of logic based on ordinals.Proceedings of the London Mathematical Society, pages 161–228, 1939.

  43. A. Turing. The automatic computing engine.Lecture to the London Mathematical Society, 1947.

  44. R. Wirth. Completing logic programs by inverse resolution. InEWSL-89, pages 239–250, London, 1989, Pitman.

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Muggleton, S. Inductive logic programming. NGCO 8, 295–318 (1991). https://doi.org/10.1007/BF03037089

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03037089

Keywords

Navigation