Skip to main content

Advertisement

SpringerLink
Log in

Classification rule discovery using learning automata

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Learning automata (LA) are adaptive decision making units that can learn to choose the optimal action from a set of actions by interaction with an environment (search space). This article proposes the use of the learning automata as a new tool for data mining (namely LA-miner). The basic scheme is utilizing LA as an effective optimizer for searching the rule-set space. In fact, LA-miner searches the rule-set space to discover an effective rule-set which maximizes a predefined fitness function. The fitness function is related to the total true positives, false positives, true negatives, and false negatives. Extensive experimental results on different kinds of benchmarks with nonlinear, overlapping class boundaries and different feature space dimensions are provided to show the powerfulness of the proposed method. The comparative results illustrate that the performance of the proposed LA-miner is comparable to, sometimes better than those of the CN2 (a traditional data mining method) and similar approaches which are designed based on the swarm intelligence algorithms (ant colony optimization and particle swarm optimization) and an evolutionary algorithm (genetic algorithm).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. This data set is available at University of California, Irvine, via anonymous ftp http://ftp.ics.uci.edu/pub/machine-learning-databases.

  2. This data set is available at: http://www.ics.uci.edu/~mlearn/MLRepository.html.

References

  1. Sousa T, Silva A, Neves A (2004) Particle swarm based data mining algorithms for classification tasks. Parallel Comput 30:767–783

    Article  Google Scholar 

  2. Sarkar R, Abbas H, Newton C (2002). Introducing data mining and knowledge discovery. In: Heuristic and optimization for knowledge discovery. Idea Group Publishing, USA, pp 1–23

  3. Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332

    Article  Google Scholar 

  4. Wu J, Wang S, Chung F (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J Mach Learn Cybern doi:10.1007/s13042-011-0024-1

  5. Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Tran Fuzzy Syst 17(3):556–567

    Article  Google Scholar 

  6. Wang X-Z, Zhai J-H, Lu S-X (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202

    Article  MathSciNet  MATH  Google Scholar 

  7. Oommen BJ, de St Criox EV (1996) Graph partitioning using learning automata. IEEE Trans Comput 45:195–208

    Article  MathSciNet  MATH  Google Scholar 

  8. Zeng X, Zhou J, Vasseur C (2000) A strategy for controlling non-linear systems using a learning automaton. Automatica 36:1517–1524

    Article  MathSciNet  MATH  Google Scholar 

  9. Sastry PS, Thathachar MAL (1999) Learning automata algorithms for pattern classification. Sadhana 24:261–292

    Article  MathSciNet  MATH  Google Scholar 

  10. Thathachar MAL, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cyber Part B Cyber 32:711–722

    Article  Google Scholar 

  11. Zahiri SH (2008) Learning automata based classifier. Pattern Recognit Lett 29:40–48

    Article  Google Scholar 

  12. Clark P, Niblet T (1989) The CN2 induction algorithm. Mach Learn 3(4):261–283

    Google Scholar 

  13. Narendra KS, Thathachar MAL (1974) Learning automata— a survey. IEEE Trans Syst Man Cybern 4:323–334

    Article  MathSciNet  MATH  Google Scholar 

  14. Papadimitriou GI, Vakali AI, Pomportsis AS (2004) A learning-automata-based controller for client/server systems. Neurocomputing 61:381–394

    Article  Google Scholar 

  15. Eraghi AE, Torkestani JA, Meybodi MR, Fathy AH (2011) Cellular learning automata-based channel assignment algorithms for wireless mobile ad hoc networks. Int Conf Mach Learn Comput IPCSIT 3:173–177

    Google Scholar 

  16. Ozbay K, Datta A, Kachroo P (2002) Application of stochastic learning automata for modeling departure time and route choice behavior, Faculty Publications (ECE). Paper 90

  17. Martínez Y, Van Vreckem B, Catteeuw D, Nowé A (2010) Application of learning automata for stochastic online scheduling. In: Recent advances in optimization and its applications in engineering. Springer, Berlin, pp 491–498

  18. Alanyali M (2004) Learning automata in games with memory with application to circuit-switched routing. In: IEEE conf decision and control, vol 5, pp 4850–4855

  19. Ünsal C, Bay JS, Kachroo P (1995) Intelligent control of vehicles: preliminary results on the application of learning automata techniques to automated highway system, Faculty Publications (ECE). Paper 77

  20. Howell MN, Gordon TJ (2001) Continuous action reinforcement learning automata and their application to adaptive digital filter design. Eng Appl Artif Intell 14:549–561

    Article  Google Scholar 

  21. Esnaashari M, Meybodi MR (2008) A novel clustering algorithm for wireless sensor networks using irregular cellular learning automata. In: International symposium on telecommunications, pp 330–336

  22. Gosavi A (2005) Applications of the learning automata algorithm of Thathachar and Sastry. Technical Report SOPTL-05-02, Missouri University of Science and Technology

  23. Abin AA, Fotouhi M, Kasaei S (2008) Skin segmentation based on cellular learning automata. In: Proceedings of the 6th international conference on advances in mobile computing and multimedia, pp 254–259

  24. Shapiro IJ, Narendra KS (1969) Use of stochastic automata for parameter self-optimization with multi-modal performance criteria. IEEE Trans Syst Man Cybern 14:323–334

    Google Scholar 

  25. Thathachar MAL, Sastry PS (1985) A class of rapidly converging algorithms for learning automata. IEEE Trans Syst Man Cybern 15:168–175

    MathSciNet  MATH  Google Scholar 

  26. Oommen BJ, Lanctôt JK (1990) Discretized pursuit learning automata. IEEE Trans Syst Man Cybern 20:931–938

    Article  MATH  Google Scholar 

  27. Obaidat MS, Papadimitriou GI, Pomportsis AS (2003) Efficient fast learning automata. Inf Sci 157:121–133

    Article  MathSciNet  Google Scholar 

  28. Beigy H, Meybodi MR (2006) A new action-set learning automaton for function optimization. Int J Franklin Ins t 343:27–47

    Article  MathSciNet  MATH  Google Scholar 

  29. Zeng X, Liu Z (2005) A learning automaton based algorithm for optimization of continuous complex function. Inf Sci 174:165–175

    Article  MathSciNet  MATH  Google Scholar 

  30. Aghaebrahimi MR, Zahiri SH, Amiri M (2009) Data mining using learning automata. World Congress on science, engineering and technology, Dubai, vol 37, pp 308–311

  31. Kohavi R, Sahami M (1996) Error-based and entropy-based discretization of continuous features. In: Proc. 2nd Int. conf. knowledge discovery and data mining, Menlo Park, CA, pp 114–119

  32. Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo

    Google Scholar 

  33. Chattopadhyay S, Daneshgar F (2011) A study on suicidal risks in psychiatric adults. Int J Biomed Eng Technol 5(4):390–408

    Article  Google Scholar 

  34. Chattopadhyay S, Acharya UR (2011) A novel mathematical approach to diagnose premenstrual syndrome. J Med Syst. doi:10.1007/s10916-011-9683-4

  35. Vagin V, Fomina M (2011) Problem of knowledge discovery in noisy databases. Int J Mach Learn Cybern 2(3):135–145

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Faculty of Engineering, Birjand University, P.O. Box 97175-376, Birjand, Iran

    Seyed-Hamid Zahiri

Authors
  1. Seyed-Hamid Zahiri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyed-Hamid Zahiri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zahiri, SH. Classification rule discovery using learning automata. Int. J. Mach. Learn. & Cyber. 3, 205–213 (2012). https://doi.org/10.1007/s13042-011-0056-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-011-0056-6

Keywords

Search

Navigation