Learning by discovering concept hierarchies

https://doi.org/10.1016/S0004-3702(99)00008-9Get rights and content
Under an Elsevier user license
open archive

Abstract

We present a new machine learning method that, given a set of training examples, induces a definition of the target concept in terms of a hierarchy of intermediate concepts and their definitions. This effectively decomposes the problem into smaller, less complex problems. The method is inspired by the Boolean function decomposition approach to the design of switching circuits. To cope with high time complexity of finding an optimal decomposition, we propose a suboptimal heuristic algorithm. The method, implemented in program HINT (Hierarchy INduction Tool), is experimentally evaluated using a set of artificial and real-world learning problems. In particular, the evaluation addresses the generalization property of decomposition and its capability to discover meaningful hierarchies. The experiments show that HINT performs well in both respects.

Keywords

Function decomposition
Machine learning
Concept hierarchies
Concept discovery
Constructive induction
Generalization

Cited by (0)