Abstract
Most of machine learning is concerned with learning a single concept from a sequence of examples. In repeat learning the teacher chooses a series of related concepts randomly and independently from a distribution D. A finite sequence of examples is provided for each concept in the series. The learner does not initially know D, but progressively updates a posterior estimation of D as the series progresses. This paper considers predicate invention within Inductive Logic Programming as a mechanism for updating the learner's estimation of D. A new predicate invention mechanism implemented in Progol4.4 is used in repeat learning experiments within a chess domain. The results indicate that significant performance increases can be achieved. The paper develops a Bayesian framework and demonstrates initial theoretical results for repeat learning.
Preview
Unable to display preview. Download preview PDF.
References
J. Baxter. Theoretical models of learning to learn. In T. Mitchell and S. Thrun, editors, Learning to Learn. Kluwer, Boston, 1997.
J. Goodacre. Inductive learning of chess rules using progol. Master's thesis, Oxford University, Oxford University Computing Laboratory, 1996.
C. Ling. Inventing necessary theoretical terms in scientific discovery and inductive logic programming. Technical Report 302, Dept. of Comp. Sci., Univ. of Western Ontario, 1991.
S. Muggleton. Predicate invention and utilisation. Journal of Experimental and Theoretical Artificial Intelligence, 6(1):127–130, 1994.
S. Muggleton. Inverse entailment and Progol. New Generation Computing, 13:245–286, 1995.
S. Muggleton. Learning from positive data. In Proceedings of the Sixth Workshop on Inductive Logic Programming, Stockholm, 1996.
S. Muggleton and W. Buntine. Machine invention of first-order predicates by inverting resolution. In Proceedings of the 5th International Conference on Machine Learning, pages 339–352. Kaufmann, 1988.
S. Muggleton and C. D. Page. A learnability model for Universal representations. In S. Wrobel, editor, Proceedings of the 4th International Workshop on Inductive Logic Programming, 1994.
I. Stahl. Constructive induction in inductive logic programming: an overview. Technical report, Fakuitat Informatik, Universitat Stuttgart, 1992.
I. Stahl. Predicate invention in inductive logic programming. In L. De Raedt, editor, Advances in Inductive Logic Programming, pages 34–47. IOS Press, Ohmsha, Amsterdam, 1996.
R. Wirth and P. O'Rorke. Constraints on predicate invention. In Proceedings of the 8th International Workshop on Machine Learning, pages 457–461. Kaufmann, 1991.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khan, K., Muggleton, S., Parson, R. (1998). Repeat learning using predicate invention. In: Page, D. (eds) Inductive Logic Programming. ILP 1998. Lecture Notes in Computer Science, vol 1446. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0027320
Download citation
DOI: https://doi.org/10.1007/BFb0027320
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64738-6
Online ISBN: 978-3-540-69059-7
eBook Packages: Springer Book Archive