Abstract
Learning automata (LA) are adaptive decision making units that can learn to choose the optimal action from a set of actions by interaction with an environment (search space). This article proposes the use of the learning automata as a new tool for data mining (namely LA-miner). The basic scheme is utilizing LA as an effective optimizer for searching the rule-set space. In fact, LA-miner searches the rule-set space to discover an effective rule-set which maximizes a predefined fitness function. The fitness function is related to the total true positives, false positives, true negatives, and false negatives. Extensive experimental results on different kinds of benchmarks with nonlinear, overlapping class boundaries and different feature space dimensions are provided to show the powerfulness of the proposed method. The comparative results illustrate that the performance of the proposed LA-miner is comparable to, sometimes better than those of the CN2 (a traditional data mining method) and similar approaches which are designed based on the swarm intelligence algorithms (ant colony optimization and particle swarm optimization) and an evolutionary algorithm (genetic algorithm).


Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
This data set is available at University of California, Irvine, via anonymous ftp http://ftp.ics.uci.edu/pub/machine-learning-databases.
This data set is available at: http://www.ics.uci.edu/~mlearn/MLRepository.html.
References
Sousa T, Silva A, Neves A (2004) Particle swarm based data mining algorithms for classification tasks. Parallel Comput 30:767–783
Sarkar R, Abbas H, Newton C (2002). Introducing data mining and knowledge discovery. In: Heuristic and optimization for knowledge discovery. Idea Group Publishing, USA, pp 1–23
Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332
Wu J, Wang S, Chung F (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J Mach Learn Cybern doi:10.1007/s13042-011-0024-1
Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Tran Fuzzy Syst 17(3):556–567
Wang X-Z, Zhai J-H, Lu S-X (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202
Oommen BJ, de St Criox EV (1996) Graph partitioning using learning automata. IEEE Trans Comput 45:195–208
Zeng X, Zhou J, Vasseur C (2000) A strategy for controlling non-linear systems using a learning automaton. Automatica 36:1517–1524
Sastry PS, Thathachar MAL (1999) Learning automata algorithms for pattern classification. Sadhana 24:261–292
Thathachar MAL, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cyber Part B Cyber 32:711–722
Zahiri SH (2008) Learning automata based classifier. Pattern Recognit Lett 29:40–48
Clark P, Niblet T (1989) The CN2 induction algorithm. Mach Learn 3(4):261–283
Narendra KS, Thathachar MAL (1974) Learning automata— a survey. IEEE Trans Syst Man Cybern 4:323–334
Papadimitriou GI, Vakali AI, Pomportsis AS (2004) A learning-automata-based controller for client/server systems. Neurocomputing 61:381–394
Eraghi AE, Torkestani JA, Meybodi MR, Fathy AH (2011) Cellular learning automata-based channel assignment algorithms for wireless mobile ad hoc networks. Int Conf Mach Learn Comput IPCSIT 3:173–177
Ozbay K, Datta A, Kachroo P (2002) Application of stochastic learning automata for modeling departure time and route choice behavior, Faculty Publications (ECE). Paper 90
Martínez Y, Van Vreckem B, Catteeuw D, Nowé A (2010) Application of learning automata for stochastic online scheduling. In: Recent advances in optimization and its applications in engineering. Springer, Berlin, pp 491–498
Alanyali M (2004) Learning automata in games with memory with application to circuit-switched routing. In: IEEE conf decision and control, vol 5, pp 4850–4855
Ünsal C, Bay JS, Kachroo P (1995) Intelligent control of vehicles: preliminary results on the application of learning automata techniques to automated highway system, Faculty Publications (ECE). Paper 77
Howell MN, Gordon TJ (2001) Continuous action reinforcement learning automata and their application to adaptive digital filter design. Eng Appl Artif Intell 14:549–561
Esnaashari M, Meybodi MR (2008) A novel clustering algorithm for wireless sensor networks using irregular cellular learning automata. In: International symposium on telecommunications, pp 330–336
Gosavi A (2005) Applications of the learning automata algorithm of Thathachar and Sastry. Technical Report SOPTL-05-02, Missouri University of Science and Technology
Abin AA, Fotouhi M, Kasaei S (2008) Skin segmentation based on cellular learning automata. In: Proceedings of the 6th international conference on advances in mobile computing and multimedia, pp 254–259
Shapiro IJ, Narendra KS (1969) Use of stochastic automata for parameter self-optimization with multi-modal performance criteria. IEEE Trans Syst Man Cybern 14:323–334
Thathachar MAL, Sastry PS (1985) A class of rapidly converging algorithms for learning automata. IEEE Trans Syst Man Cybern 15:168–175
Oommen BJ, Lanctôt JK (1990) Discretized pursuit learning automata. IEEE Trans Syst Man Cybern 20:931–938
Obaidat MS, Papadimitriou GI, Pomportsis AS (2003) Efficient fast learning automata. Inf Sci 157:121–133
Beigy H, Meybodi MR (2006) A new action-set learning automaton for function optimization. Int J Franklin Ins t 343:27–47
Zeng X, Liu Z (2005) A learning automaton based algorithm for optimization of continuous complex function. Inf Sci 174:165–175
Aghaebrahimi MR, Zahiri SH, Amiri M (2009) Data mining using learning automata. World Congress on science, engineering and technology, Dubai, vol 37, pp 308–311
Kohavi R, Sahami M (1996) Error-based and entropy-based discretization of continuous features. In: Proc. 2nd Int. conf. knowledge discovery and data mining, Menlo Park, CA, pp 114–119
Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo
Chattopadhyay S, Daneshgar F (2011) A study on suicidal risks in psychiatric adults. Int J Biomed Eng Technol 5(4):390–408
Chattopadhyay S, Acharya UR (2011) A novel mathematical approach to diagnose premenstrual syndrome. J Med Syst. doi:10.1007/s10916-011-9683-4
Vagin V, Fomina M (2011) Problem of knowledge discovery in noisy databases. Int J Mach Learn Cybern 2(3):135–145
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zahiri, SH. Classification rule discovery using learning automata. Int. J. Mach. Learn. & Cyber. 3, 205–213 (2012). https://doi.org/10.1007/s13042-011-0056-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-011-0056-6