Ant colony classification mining algorithm based on pheromone attraction and exclusion

Abstract

Ant colony optimization algorithms have been applied successfully in classification rule mining. However, basic ant colony classification mining algorithms generally suffer from problems, such as premature convergence and falling into local optimum easily. Simultaneously, the classification mining algorithms use sequential covering strategy to discover rules, and the interaction between rules is less considered. In this study, a new ant colony classification mining algorithm based on pheromone attraction and exclusion (Ant-Miner$_\mathrm{PAE}$) is proposed, in which a new pheromone calculation method is designed and the search is guided by the new probability transfer formula. By contrast,the basic algorithm structure is modified, and the order of the iteration is adjusted. Thus, the problem of rule interaction is mitigated. Ant-Miner$_\mathrm{PAE}$ can balance the relation of exploration and development of constructing rules, which can make the ants in the search process initially explore and develop in the later period. Our experiments, which use 12 publicly available data sets, show that the predictive accuracy obtained by Ant-Miner$_\mathrm{PAE}$ implementing the proposed pheromone attraction and exclusion strategy is statistically significantly higher than the predictive accuracy of other rule induction classification algorithms, such as CN2, C4.5 rules, PSO/ACO2, Ant-Miner, and cAnt-Miner$_\mathrm{PB}$. Furthermore, the rules discovered by Ant-Miner$_\mathrm{PAE}$ are considerably simpler than those discovered by its counterparts.