Abstract
In this article, a novel unordered classification rule list discovery algorithm is presented based on Ant Colony Optimization (ACO). The proposed classifier is compared empirically with two other ACO-based classification techniques on 26 data sets, selected from miscellaneous domains, based on several performance measures. As opposed to its ancestors, our technique has the flexibility of generating a list of IF-THEN rules with unrestricted order. It makes the generated classification model more comprehensible and easily interpretable. The results indicate that the performance of the proposed method is statistically significantly better as compared with previous versions of AntMiner based on predictive accuracy and comprehensibility of the classification model.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Engelbrecht A P. Computational Intelligence: an Introduction. 2nd ed. John Wiley & Sons, 2007
Engelbrecht A P. Fundamentals of Computational Swarm Intelligence. John Wiley & Sons, 2005
Kennedy J, Eberhart R C, Shi Y. Swarm Intelligence. Morgan Kaufmann/Academic Press, 2001
Dorigo M, Sttzle T. Ant Colony Optimization. Cambridge: MIT Press, 2004
Dorigo M, Maniezzo V, Colorni A. Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B-Cybern, 26, 1996: 29–41
Dorigo M, Gambardella L M. Ant colony system: a cooperative learning approach to the travelling salesman problem. IEEE Trans Evol Comput, 1997: 53–66
Martens D, de Backer M, Haesen R, et al. Classification with ant colony optimization. IEEE Trans Evol Comput, 11, 2007: 651–665
Abraham A, Grosan C, Ramos V, eds. Swarm intelligence in Data Mining. Berlin/Heidelberg: Springer-Verlag, 2006
Han J, Kamber M. Data Mining: Concepts and Techniques. 2nd ed. Amsterdam: Morgan Kaufmann, 2006
Witten I H, Frank E. Data Mining: Practical Machine Learning Tools and Techniques. 2nd ed. Burlington: Morgan Kaufmann, 2005
Duda R O, Hart P E, Stork D G. Pattern Classification. Hoboken: Wiley, 2000
Parpinelli R S, Lopes H S, Freitas A A. Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput, 2002, 6: 321–332
Liu B, Abbass H A, McKay B. Density-based heuristic for rule discovery with ant-miner. In: Proceedings of 6th Australasia-Japan Joint Workshop on Intelligent and Evolutionary System, Canberra, 2002. 180–184
Liu B, Abbass H A, McKay B. Classification rule discovery with ant colony optimization. In: Proceedings of IEEE/WIC International Conference on Intelligent Agent Technology, Halifax, 2003. 83–88
Smaldon J, Freitas A A. A new version of the Ant-Miner algorithm discovering unordered rule sets. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation. New York: ACM, 2006. 43–50
Baig A R, Shahzad W. A correlation-based ant miner for classification rule discovery. Neural Comput Appl, 2012, 21: 219–235
Lindgren T. Methods for rule conflict resolution. In: Proceedings of 15th European Conference on Machine Learning, Pisa, 2004. 262–273
Kohavi R, Becker B, Sommerfield D. Improving simple bayes. In: Proceedings of 9th European Conference on Machine Learning, Prague, 1997
Khan S, Baig A R, Shahzad W. A novel ant colony optimization based single path hierarchical classification algorithm for predicting gene ontology. Appl Soft Comput, 2014, 16: 34–49
Yin X, Han J. CPAR: classification based on predictive association rules. In: Proceedings of SIAM International Conference on Data Mining, San Fransisco, 2003. 331–335
Li W, Han J, Pei J. CMAR: accurate and efficient classification based on multiple class-association rules. In: Proceedings of IEEE International Conference on Data Mining, San Jose, 2001. 369–376
Liu B, Hsu W, Ma Y M. Integrating classification and association rule mining. In: Proceedings of 4th International Conference on Knowledge Discovery and Data Mining, New York, 1998. 80–86
Rao R V, Savsani V J, Vakharia D P. Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aid Des, 2011, 43: 303–315
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Khan, S., Baig, A.R., Ali, A. et al. Unordered rule discovery using Ant Colony Optimization. Sci. China Inf. Sci. 57, 1–15 (2014). https://doi.org/10.1007/s11432-014-5133-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-014-5133-5