ABSTRACT
Learning Classifier Systems (LCSs) are rule-based systems that can be manipulated by a genetic algorithm. LCSs were first designed by Holland to solve classification problems and a lot of effort has been made since then, resulting in a broad number of different algorithms. One of these is called Organizational Classifier System (OCS), a LCSs that tries to organize its rule set favoring good rules to be together in the same organization. However, the proposal of OCS did not include the discovery mechanism. Recently, the OCS was applied to multi-label classification, a type of classification where one instance can have more than one associated label. The authors represented the multi-label classification problem as a default hierarchy and combined the organizational capabilities of OCS together with Smith's default hierarchy formation theory to solve a simple multi-label problem. The purpose of this paper is to extend this idea with the inclusion of a genetic algorithm for the discovery of new rules and present some initial results obtained using the new method. The preliminary results obtained show that the method is comparable to other multi-label techniques. Final discussions present the conclusions of the work and some directions for further research.
- E. Bernadó-Mansilla, X. Llorà, and I. Traus. Multiobjective Learning Classifier Systems: An Overview. Technical report, University of Illinois at Urbana Champaign, Urbana, IL, 2005.Google Scholar
- M. Boutell, J. Luo, X. Shen, and C. Brown. Learning multi-label scene classification. Pattern Recognition, 37(9):1757--1771, 2004.Google ScholarCross Ref
- M. V. Butz. Rule-based Evolutionary Online Learning Systems: Learning Bounds, Classification, and Prediction. PhD thesis, Graduate College of the University of Illinois at Urbana-Champaign, Urbana, IL, 2004. Google ScholarDigital Library
- A. Chan and A. A. Freitas. A New Ant Colony Algorithm for Multi-Label Classification with Applications in Bioinformatics. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 27--34, 2006. Google ScholarDigital Library
- U. Consortium. Universal protein resource. (Acess on 01/10/2009).Google Scholar
- K. A. De Jong. Evolutionary Computation: A Unified Approach. MIT Press, 2006.Google ScholarDigital Library
- D. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Publishing, 1989. Google ScholarDigital Library
- T. Li and M. Ogihara. Detecting emotion in music. In Proceedings of the International Symposium on Music Information Retrieval, 2008.Google Scholar
- C. Nadeau and Y. Bengio. Inference for the generalization error. Machine Learning, 52(3):239--281, 2003. Google ScholarDigital Library
- S. I. of Bioinfomatics. Prosite -- database of protein domains, families and functional sites. (Acess on 01/10/2009).Google Scholar
- R. Smith and D. Goldberg. Adaptive Default Hierarchy Formation. Applied Artificial Intelligence, 6(1):79--102, 1992. Google ScholarDigital Library
- G. Tsoumakas and I. Katakis. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3:1--13, 2007.Google ScholarCross Ref
- R. Vallim, D. Goldberg, X. Llora, T. Duque, and A. Carvalho. A new approach for multi-label classification based on default hierarchies and organizational learning. In Proceedings of the Genetic and Evolutionary Computation Conference, Workshop Session: Learning Classifier Systems, pages 2017--2022, 2003. Google ScholarDigital Library
- J. R. Wilcox. Organizational learning within a learning classifier system. Master's thesis, University of Illinois at Urbana-Champaign, 1995. Illigal Report No.95003.Google Scholar
Index Terms
- The multi-label OCS with a genetic algorithm for rule discovery: implementation and first results
Recommendations
A bi-phased multi-objective genetic algorithm based classifier
Highlights- We have proposed a Bi-Phased Multi-Objective Genetic Algorithm.
- We have done ...
AbstractThis paper presents a novel Bi-Phased Multi-Objective Genetic Algorithm (BPMOGA) based classification method. It is a Learning Classifier System (LCS) designed for supervised learning tasks. Here we have used Genetic Algorithms (GAs) ...
A grammar-guided genetic programming algorithm for multi-label classification
EuroGP'13: Proceedings of the 16th European conference on Genetic ProgrammingMulti-label classification is a challenging problem which demands new knowledge discovery methods. This paper presents a Grammar-Guided Genetic Programming algorithm for solving multi-label classification problems using IF-THEN classification rules. ...
Auto-adaptive Grammar-Guided Genetic Programming algorithm to build Ensembles of Multi-Label Classifiers
AbstractMulti-label classification has been used to solve a wide range of problems where each example in the dataset may be related either to one class (as in traditional classification problems) or to several class labels at the same time. ...
Graphical abstractDisplay Omitted
Highlights- Genetic programming method to build tree-shaped ensembles of multi-label classifiers.
Comments