Abstract
In recent years, a few sequential covering algorithms for classification rule discovery based on the ant colony optimization meta-heuristic (ACO) have been proposed. This paper proposes a new ACO-based classification algorithm called AntMiner-C. Its main feature is a heuristic function based on the correlation among the attributes. Other highlights include the manner in which class labels are assigned to the rules prior to their discovery, a strategy for dynamically stopping the addition of terms in a rule’s antecedent part, and a strategy for pruning redundant rules from the rule set. We study the performance of our proposed approach for twelve commonly used data sets and compare it with the original AntMiner algorithm, decision tree builder C4.5, Ripper, logistic regression technique, and a SVM. Experimental results show that the accuracy rate obtained by AntMiner-C is better than that of the compared algorithms. However, the average number of rules and average terms per rule are higher.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Engelbrecht AP (2007) Computational intelligence, an introduction, 2nd edn. Wiley, Hoboken
Engelbrecht AP (2005) Fundamentals of computational swarm intelligence. Wiley, Hoboken
Kennedy J, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann Academic Press, Massachusetts
Dorigo M, Stützle T (2004) Ant colony optimization. MIT Press, Cambridge, MA
Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern B 26:1
Dorigo M, Gambardella LM (1997) Ant colony system: a cooperative learning approach to the travelling salesman problem. IEEE Trans Evol Comput 1:1
Abraham A, Grosan C, Ramos V (2006) Swarm intelligence in data mining, studies in computational intelligence, vol 34. Springer, Berlin
Han J, Kamber M (2006) Data mining: concepts and techniques, 2nd edn. Morgan Kaufmann Publishers, Massachusetts
Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann, Massachusetts
Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley, Hoboken
Eiben AE, Smith JE (2007) Introduction to evolutionary computing. Natural computing series, 2nd edn. Springer, Berlin
Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332
Liu B, Abbass HA, McKay B (2002) Density-based heuristic for rule discovery with ant-miner. In: Proceedings 6th Australasia-Japan joint workshop on intelligent and evolutionary systems. Canberra, Australia, pp 180–184
Liu B, Abbass HA, McKay B (2003) Classification rule discovery with ant colony optimization. In: Proceedings IEEE/WIC international conference on intelligent agent technology, pp 83–88
Liu B, Abbass HA, McKay B (2004) Classification rule discovery with ant colony optimization. IEEE Comput Intell Bull 3:1
Martens D, de Backer M, Haesen R, Vanthienen J, Snoeck M, Baesens B (2007) Classification with ant colony optimization. IEEE Trans Evol Comput 11:5
Smaldon J, Freitas AA (2006) A new version of the ant-miner algorithm discovering unordered rule sets. In: Proceedings genetic and evolutionary computation conference (GECCO-2006), pp 43–50
Holden N, Freitas AA (2007) A hybrid PSO/ACO algorithm for classification. In: Proceedings GECCO-2007 workshop on particle swarms: the second decade. ACM Press, New York
Swaminathan S (2006) Rule induction using ant colony optimization for mixed variable attributes. MSc Thesis, Texas Tech University, Lubbock
Otero F, Freitas A, Johnson C (2008) cAnt-miner: an ant colony classification algorithm to cope with continuous attributes. In: Ant colony optimization and swarm intelligence (ANTS 2008), LNCS 5217. Springer, Berlin
Chan A, Freitas A (2006) A new ant colony algorithm for multi-label classification with applications in bioinformatics. In: Proceedings genetic and evolutionary computation conference (GECCO-2006)
Boryczka U, Kozak J (2009) New Algorithms for generation decision trees—Ant-miner and its modifications. In: Foundations of computational intelligence, vol 6. Book series—Studies in computational intelligences, vol 206. Springer, New York
Hettich S, Bay SD (1996) The UCI KDD archive. Department of Information Computer Science, University California, Irvine, CA, [Online]. Available: http://kdd.ics.uci.edu
Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, Massachusetts
Quinlan JR (1987) Generating production rules from decision trees. In: Proceedings international joint conferences on artificial intelligence. San Francisco, USA
Vapnik VN (1995) The nature of statistical learning theory. Springer, New York
Martens D, de Backer M, Haesen R, Baesens B, Mues C, Vanthienen J (2006) Ant-based approach to the knowledge fusion problem. In: Ant colony optimization and swarm intelligence (ANTS 2006), LNCS 4150. Springer, Berlin
Acknowledgments
The authors would like to thank the reviewers of this paper for their valuable comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Baig, A.R., Shahzad, W. A correlation-based ant miner for classification rule discovery. Neural Comput & Applic 21, 219–235 (2012). https://doi.org/10.1007/s00521-010-0490-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-010-0490-5