Abstract
This article describes a framework for the deep and dynamic integration of learning strategies. The framework is based on the idea that each single-strategy learning method is ultimately the result of certain elementary inferences (like deduction, analogy, abduction, generalization, specialization, abstraction, concretion, etc.). Consequently, instead of integrating learning strategies at a macro level, we propose to integrate the different inference types that generate individual learning strategies. The article presents a concept-learning and theory-revision method that was developed in this framework. It allows the system to learn from one or from several (positive and/or negative) examples, and to both generalize and specialize its knowledge base. The method integrates deeply and dynamically different learning strategies, depending on the relationship between the input information and the knowledge base. It also behaves as a single-strategy learning method whenever the applicability conditions of such a method are satisfied.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Bergadano, F., & Giordana, A. (1990). Guiding induction with domain theories. In Y. Kodratoff & R.S. Michalski (Eds.),Machine learning: An artificial intelligence approach (Vol. 3), San Mateo, CA: Morgan Kaufmann.
Carbonell, J. (1986). Derivational analogy: A theory of reconstructive problem solving and expertise acquisitions. In R.S. Michalski, J.G. Carbonell, & T.M. Mitchell (Eds.),Machine learning: An artificial intelligence approach (Vol. 2). San Mateo, CA: Morgan Kaufmann.
Collins, A., & Michalski, R.S. (1989). The logic of plausible reasoning: A core theory.Cognitive Science, 13, 1–49.
Cox, M., & Ram, A. (1991). Using introspective reasoning to select learning strategies.Proceedings of the First International Workshop on Multistrategy Learning (pp. 217–230). Harpers Ferry, WV, AI Center, George Mason University.
Danyluck, A.P. (1987). The use of explanations for similarity-based learning.Proceedings of the International Joint Conference on Artificial Intelligence (pp. 274–276). Milan, Italy: Morgan Kaufmann.
Davies, T.R., & Russell, S.J. (1987). A logical approach to reasoning by analogy.Proceedings of the International Joint Conference on Artificial Intelligence (pp. 264–270). Milan, Italy: Morgan Kaufmann.
DeJong, G., & Mooney, R. (1986). Explanation-based learning: An alternative view.Machine Learning, 1, 145–176.
De Raedt, L., & Bruynooghe, M. (1991). CLINT: A multistrategy interactive concept learner and theory revision system.Proceedings of the First International Workshop on Multistrategy Learning (pp. 175–190). Harpers Ferry, WV, AI Center, George Mason University.
Flann, N., & Dietterich, T. (1989). A study of explanation-based methods for inductive learning.Machine Learning, 4, 187–266.
Genest, J., Matwin, S., & Plante, B. (1990). Explanation-based learning with incomplete theories: A three-step approach. In B. Porter & R. Mooney (Eds.),Machine Learning: Proceedings of the Eighth International Workshop. Austin, Texas: Morgan Kaufmann.
Gentner, D. (1983). Structure-mapping: A theoretical framework for analogy.Cognitive Science, 7, 155–170.
Hirsch, H. (1989). Incremental version-space merging: A general framework for concept learning. Doctoral dissertation, Department of Computer Science, Stanford University, Stanford, CA.
Josephson J. (1991). Abduction: Conceptual analysis of a fundamental pattern of inference (Technical Research Report 91-JJ). Columbus, Laboratory for Artificial Intelligence Research, The Ohio State University.
Kedar-Cabelli, S. (1990). Toward a computational model of purpose-directed analogy. In J.W. Shavlik & T. Dietterich (Eds.),Readings in machine learning. San Mateo, CA: Morgan Kaufmann.
Kodratoff, Y. (1990). Using abductive recovery of failed proofs for problem solving by analogy. In B. Porter & R. Mooney (Eds.),Machine Learning: Proceedings of the Eighth International Workshop. Texas: Morgan Kaufmann.
Kodratoff, Y., & Michalski, R.S. (Eds.). (1990).Machine learning: An artificial intelligence approach (Vol. 3). San Mateo, CA: Morgan Kaufmann.
Lebowitz, M. (1986). Integrated learning: Controlling explanation.Cognitive Science, 10, 219–240.
Mahadevan, S. (1989). Using determinations in explanation-based learning: A solution to incomplete theory problem.Proceedings of the Sixth International Workshop on Machine Learning. Ithaca, NY: Morgan Kaufmann.
Michalski, R.S. (1983). A theory and methodology of inductive learning. In R.S. Michalski, J.G. Carbonell, & T.M. Mitchell (Eds.),Machine learning: An artificial intelligence approach (Vol. 1). Palo Alto, CA: Tioga Publishing Co.
Michalski, R.S. (1990). Toward a unified theory of learning: Multistrategy task-adaptive learning.Reports of Machine Learning and Inference Laboratory (MLI 90-1). Fairfax, VA: Center for Artificial Intelligence, George Mason University.
Michalski, R.S. (1993). Inferential learning theory as a conceptual basis for multistrategy learning.Machine Learning, 11 (this issue).
Michalski, R.S. Carbonell, J.G., Mitchell, T.M. (Eds.). (1983).Machine learning: An aritficial intelligence approach (Vol. 1). Palo Alto, CA: Tioga Publishing Co.
Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (Eds.). (1986).Machine learning: An artificial intelligence approach (Vol. 2). San Mateo, CA: Morgan Kaufmann.
Minton, S., & Carbonell, J.G. (1987). Strategies for learning search control rules: An explanation-based approach.Proceedings of the International Joint Conference on Artificial Intelligence (pp. 228–235). Milan, Italy: Morgan Kaufmann.
Mitchell, T.M. (1978). Version spaces: An approach to concept learning. Doctoral dissertation, Department of Computer Science, Stanford University, Stanford, CA.
Mitchell, T.M., Keller, T., & Kedar-Cabelli, S. (1986). Explanation-based generalization: A unifying view.Machine Learning, 1, 47–80.
Mooney, R., & Bennet, S. (1986). A domain independent explanation based generalizer.Proceedings of the Fifth National Conference on Artificial Intelligence (pp. 551–555). Philadelphia: PA: Morgan Kaufmann.
Mooney, R., & Ourston, D. (1991). A multistrategy approach to theory refinement.Proceedings of the first International Workshop on Multistrategy Learning (pp. 115–130). Harpers Ferry, WV, Al Center, George Mason University.
Morik, K. (1993). Balanced cooperative modeling.Machine Learning, 11, (this issue).
Nilsson, N. (1971).Problem solving methods in artificial intelligence. New York: McGraw-Hill.
Pazzani, M.J. (1988). Integrating explanation-based and empirical learning methods in OCCAM.Proceedings of the Third European Working Session on Learning (pp. 147–166). Glasgow, Scotland: Pitman.
Porter, B., Bareiss, R., & Holte, R. (1990). Concept learning and heuristic classification in weak-theory domains. In J.W. Shavlik & T. Dietterich (Eds.),Readings in machine learning. San Mateo, CA: Morgan Kaufmann.
Reich, Y. (1991). Macro and micro perspectives of multistrategy learning.Proceedings of the First International Workshop on Multistrategy Learning (pp. 97–112). Harpers Ferry, WV.
Saitta, L. & Botta, M. (1993). Multistrategy learning and theory revision.Machine Learning, 11 (this issue).
Shavlik, J.W., & Towell, G.G. (1990). An approach to combining explanation-based and neural learning algorithms. In J.W. Shavlik & T. Dietterich (Eds.),Readings in machine learning. San Mateo, CA: Morgan Kaufmann.
Tecuci, G. (1988). DISCIPLE: A theory, methodology, and system for learning expert knowledge. Ph.D. thesis, LRI, University of Paris-South.
Tecuci, G. (1991). Steps toward automating knowledge acquisition for expert systems.Proceedings of the AAAI-91 Workshop on Knowledge Acquisition: From Science to Technology to Tools. Anaheim, California: AAAI.
Tecuci, G. (1992). Automating knowledge acquisition as extending, updating, and improving a knowledge base.IEEE Transactions on Systems, Man and Cybernetics, 22, 1444–1460.
Tecuci, G. & Kodratoff, Y. (1990). Apprenticeship learning in imperfect theory domains. In Y. Kodratoff & R.S. Michalski (Eds.),Machine learning: An artificial intelligence approach (Vol. 3). San Mateo, CA: Morgan Kaufmann.
Tecuci, G., & Michalski, R.S. (1991a). A method for multistrategy task-adaptive learning based on plausible justifications. In L. Birnbaum & G. Collins (Eds.),Machine Learning: Proceedings of the Eighth International Workshop (pp. 549–553). Chicago, IL: Morgan Kaufmann.
Tecuci, G., & Michalski, R.S. (1991b). Input understanding as a basis for multistrategy task-adaptive learning. InProceedings of the International Symposium on Methodologies for Intelligent Systems (pp. 419–428). Charlotte, NC: Springer-Verlag.
Whithall, B.L. (1990). Knowledge-based learning: Integration of deductive and inductive learning for knowledge base completion. Ph.D. Thesis, Computer Science Department, University of Illinois at Champaign-Urbana.
Widmer, G. (1989). A tight integration of deductive and inductive learning.Proceedings of the Sixth International Workshop on Machine Learning. Ithaca, NY: Morgan Kaufmann.
Widmer, G. (1991). Learning by plausible reasoning and its application to a complex musical problem.Proceedings of the First International Workshop on Multistrategy Learning (pp. 411–418). Harpers Ferry, WV, AI Center, George Mason University.
Wilkins, D.C. (1990). Knowledge base refinement as improving an incorrect and incomplete domain theory. In Y. Kodratoff & R.S. Michalski (Eds.),Machine learning: An artificial intelligence approach (Vol. 3). San Mateo, CA: Morgan Kaufmann.
Winston, P.H. (1986). Learning by augmenting rules and accumulating censors. In R.S. Michalski, J.G. Carbonell, & T.M. Mitchell (Eds.),Machine learning: An artificial intelligence approach (Vol. 2), San Mateo, CA: Morgan Kaufmann.
Wisniewski, E.J., & Medin, D.J. (1991). Is it a pocket or a purse? Tightly coupled theory and data driven learning. In L. Birnbaum & G. Collins (Eds.),Machine Learning: Proceedings of the Eighth International Workshop (pp. 564–568). Chicago, IL: Morgan Kaufmann.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Tecuci, G. Plausible justification trees: A framework for deep and dynamic integration of learning strategies. Mach Learn 11, 237–261 (1993). https://doi.org/10.1007/BF00993079
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00993079