Abstract
This paper examines the effects on a learning program of using a simple heuristic for restricting hypothesis space search and suggests the desirability of making the heuristic explicit so that it can be altered easily. The heuristic is: only consider new hypotheses that cover at least one example not covered by the current concept description. We study the use of the heuristic for three tasks: (i) restricting subsequent search after part of a concept description is learned, (ii) restricting search when partial concept descriptions are provided as initial knowledge, and (iii) restricting search when the heuristic is used as a constant bias to a higher level program that adjusts the bias of the learning program along different dimensions. We show that not only does this heuristic reduce the number of nodes searched, it also reduces the size of the resultant concept description and increases its predictive accuracy.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Breiman, L., Friedman, J., Olshen, R., & Stone, C. (1984). Classification and Regression Trees. Belmont, CA: Wadsworth International Group.
Buchanan, B., & Mitchell, T. (1978). Model-directed Learning of Production Rules. In D.A. Waterman & F. Hayes-Roth (Ed.), Pattern Directed Inference Systems (pp. 297–312). New York: Academic Press.
Clearwater, S., & Provost, F. (1990). RL4: A Tool for Knowledge-Based Induction. In Proceedings of the Second International IEEE Conference on Tools for Artificial Intelligence, (pp. 24–30). IEEE C.S. Press.
Michalski, R., Mozetic, I., Hong, J., & Lavrac, N. (1986). The Multi-purpose Incremental Learning System AQ15 and its Testing Application to Three Medical Domains. In Proceedings of the Fifth National Conference on Artificial Intelligence, (pp. 1041–1045). AAAI-Press.
Mitchell, T. (1980). The Need for Biases in Learning Generalizations (Technical Report CBM-TR-117). Department of Computer Science, Rutgers University.
Provost, F. (1991). ClimBS (Technical Report ISL-91-1). Department of Computer Science, University of Pittsburgh.
Provost, F., & Buchanan, B. (1992). Inductive Policy. To appear in Proceedings of the Tenth National Conference on Artificial Intelligence. AAAI-Press.
Provost, F. J. (1992). ClimBS: Searching the Bias Space. Submitted to The Fourth International Conference on Tools for Artificial Intelligence.
Quinlan, J. (1986). Induction of Decision Trees. Machine Learning, 1, 81–106.
Quinlan, J. (1987). Generating Production Rules from Decision Trees. In Proceedings of the Tenth International Joint Conference on Artificial Intelligence.
Rendell, L. (1986). A General Framework for Induction and a Study of Selective Induction. Machine Learning, 1, 177–226.
Schlimmer, J. (1987). Concept Acquisition Through Representational Adjustment. Ph.D. Thesis, Department of Information and Computer Science, University of California at Irvine.
Utgoff, P. (1984). Shift of Bias for Inductive Concept Learning. Ph.D. Thesis, Rutgers University.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1992 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Provost, F.J., Buchanan, B.G. (1992). Inductive strengthening: The effects of a simple heuristic for restricting hypothesis space search. In: Jantke, K.P. (eds) Analogical and Inductive Inference. AII 1992. Lecture Notes in Computer Science, vol 642. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-56004-1_20
Download citation
DOI: https://doi.org/10.1007/3-540-56004-1_20
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-56004-3
Online ISBN: 978-3-540-47339-8
eBook Packages: Springer Book Archive