Article

Learning classifier systems

Author:

Martin V. ButzAuthors Info & Claims

GECCO '07: Proceedings of the 9th annual conference companion on Genetic and evolutionary computation

Pages 3035 - 3056

https://doi.org/10.1145/1274000.1274104

Published: 07 July 2007 Publication History

Abstract

When Learning Classifier Systems (LCSs) were introduced by John H. Holland in the 1970s, the intention was the design of a highly adaptive cognitive system. Since then, LCSs came a long way. Interest strongly decreased in the late 80s and early 90s due the complex interactions of several learning mechanisms. However, since the introduction of the accuracy-based XCS classifier system by Stewart W. Wilson in 1995 and the modular analysis of several LCSs thereafter, interest re-gained momentum. Current research has shown that LCSs can effectively solve data-mining problems, reinforcement learning problems, other predictive problems, and cognitive control problems. Hereby, it was shown that performance is machine learning competitive, but learning is taking place online and is often more flexible and highly adaptive. Moreover, system knowledge can be easily extracted.The Learning Classifier System tutorial provides a gentle introduction to LCSs and their general functioning. It then surveys the current theoretical understanding of the systems and their proper application to various problem domains. Finally, we provide a suite of current successful LCS implementations and discuss the most promising areas for future research and applications.

References

[1]

Bacardit, J. (2004). Pittsburgh Genetic-Based Machine Learning in the Dame Mining Era: Representations, Generalization, and Run Time. Computer Engineering Department, University of Ramon Llull, Barcelona, Spain.

[2]

Barry, A. (2007). The Learning Classifier Systems Web. University of Bath. http://lcsweb.cs.bath.ac.uk/.

[3]

Baum, E. B. (1999). Toward a model of intelligence as an economy of agents. Machine Learning, 35, 155--185.

Digital Library

[4]

Bernadó-Mansilla, E., & Garrell-Guiu, J.M. (2003). Accuracy-based learning classifier systems: Models, analysis, and applications to classification tasks. Evolutionary Computation,11, 209--238.

Digital Library

[5]

Bernadó, E.; Llorá, X., & Garrell, J.M. (2002). XCS and GALE: A comparative study of two learning classifier systems and six other learning algorithms on classification tasks. In Lanzi, P.L., Stolzmann, W., & Wilson, S.W. (Eds.). Advances in learning classifier systems: Fourth international workshop, IWLCS 2001 (LNAI 2321) (pp. 115--132). Berlin Heidelberg: Springer-Verlag.

Digital Library

[6]

Bonarini, A. (2000). An introduction to learning fuzzy classifier systems. In Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.), Learning classifier systems: From foundations to applications (LNAI 1813) (pp. 83--104). Berlin Heidelberg: Springer-Verlag.

Digital Library

[7]

Booker, L. B. (1982). Intelligent Behavior as an Adaptation to the Task Environment. PhD thesis. The University of Michigan, Ann Arbor, MI.

Digital Library

[8]

Booker, L. B. (1985). Improving the performance of genetic algorithms in classifier systems. In Grefenstette, J. (Ed.), Proceedings of the 1st international conference on genetic algorithms and their application (ICGA-1985) (pp. 80--92). Pittsburg, PA: Lawrence Erlbaum Associates.

Digital Library

[9]

Booker, L. B. (1991). Do we really need to estimate rule utility in classifier systems? In Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.), Learning classifier systems: From foundations to applications (LNAI 1813) (pp. 125--142). Berlin Heidelberg: Springer-Verlag.

Digital Library

[10]

Booker, L. B. (2001). Classifier systems, endogenous fitness, and delayed rewards: A preliminary investigation. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2001), 921--926.

[11]

Booker, L. B., Goldberg, D. E., & Holland, J. H. (1989). Classifier systems and genetic algorithms. Artificial Intelligence, 40, 235--282.

Digital Library

[12]

Bull, L. (Ed.) (2004). Applications of learning classifier systems. Berlin Heidelberg: Springer-Verlag.

Digital Library

[13]

Bull, L, & Hurst, J. (2002): ZCS redux. Evolutionary Computation, 10, 185--205.

Digital Library

[14]

Bull, L. & Kovacs, T. (Eds.) (2005). Foundations of learning classifier systems. Berlin Heidelberg: Springer-Verlag.

[15]

Bull, L., & O'Hara, T. (2002). Accuracy-based neuro and neuro-fuzzy classifier systems. Proceedings of the Fourth Genetic and Evolutionary Computation Conference (GECCO-2002), 905--911.

Digital Library

[16]

Butz, M. V. (2002). Anticipatory learning classifier systems. Kluwer Academic Publishers, Boston, MA.

[17]

Butz, M. V. (2006). Rule-based evolutionary online learning systems: A principled approach to LCS analysis and design. Studies in Fuzziness and Soft Computing Series, Springer Verlag, Berlin Heidelberg, Germany.

[18]

Butz, M. V., Goldberg, D. E. & Lanzi, P. L. (2005). Computational complexity of the XCS classifier system. In Bull, L. & Kovacs, T. (Eds.), Foundations of learning classifier systems (pp. 91--126). Berlin Heidelberg: Springer-Verlag.

[19]

Butz, M. V., Goldberg, D. E., & Lanzi, P. L. (2005). Gradient descent methods in learning classifier systems: Improving XCS performance in multistep problems. IEEE Transactions on Evolutionary Computation, 9, 452--473.

Digital Library

[20]

Butz, M. V., Goldberg, D. E., & Stolzmann, W. (2002). The anticipatory classifier system and genetic generalization. Natural Computing, 1, 427--467.

Digital Library

[21]

Butz, M. V., Goldberg, D. E., & Tharakunnel, K. (2003). Analysis and improvement of fitness exploitation in XCS: Bounding models, tournament selection, and bilateral accuracy. Evolutionary Computation, 11, 239--277.

Digital Library

[22]

Butz, M. V., & Hoffmann, J. (2002). Anticipations control behavior: Animal behavior in an anticipatory learning classifier system. Adaptive Behavior, 10, 75--96.

Digital Library

[23]

Butz, M. V., Kovacs, T., Lanzi, P. L., & Wilson, S. W. (2004). Toward a theory of generalization and learning in XCS. IEEE Transactions on Evolutionary Computation, 8, 28--46.

Digital Library

[24]

Butz, M. V., Lanzi, P. L., & Wilson, S. W. (in press). Function Approximation with XCS: Hyperellipsoidal Conditions, Recursive Least Squares, and Compaction. IEEE Transactions on Evolutionary Computation.

[25]

Butz, M.V., & Stolzmann, W. (2002). An algorithmic description of ACS2. In Lanzi, P.L., Stolzmann, W., & Wilson, S.W. (Eds.). Advances in learning classifier systems: Fourth international workshop, IWLCS 2001 (LNAI 2321) (pp. 211--230). Berlin Heidelberg: Springer-Verlag.

Digital Library

[26]

Butz, M. V., & Wilson, S. W. (2002). An Algorithmic Description of XCS. Soft Computing, 6, 144--153.

[27]

Dixon, P. W., Corne, D. W., & Oates, M. J. (2003). A ruleset reduction algorithm for the XCS learning classifier system. In Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.), Learning classifier system: Fifth international workshop, IWLCS 2002 (LNAI 2661) (pp. 20--29). Berlin Heidelberg: Springer-Verlag.

[28]

Gérard, P., Meyer, J., & Sigaud, O. (2005). Combining latent learning and dynamic programming in MACS. European Journal of Operational Research, 160, 614--637.

[29]

Gérard, P., & Sigaud, O. (2001). Adding a generalization mechanism to YACS. Proceedings of the Third Genetic and Evolutionary Computation Conference (GECCO-2001), 951--957.

[30]

Goldberg, D. E. (1983). Computer-Aided Gas Pipeline Operation using Genetic Algorithms and Rule Learning. PhD thesis. The University of Michigan, Ann Arbor, MI.

[31]

Goldberg, D. E. (1989). Genetic algorithms in search, optimization & machine learning. Addison-Wesley.

Digital Library

[32]

Holland, J.H. (1975). Adaptation in natural and artificial systems. University of Michigan Press.

Digital Library

[33]

Holland, J.H. (1985). Properties of the bucket brigade algorithm. In Grefenstette, J. (Ed.), Proceedings of the 1st international conference on genetic algorithms and their application (ICGA-1985) (pp. 1--7). Pittsburg, PA: Lawrence Erlbaum Associates.

Digital Library

[34]

Holland, J. H., Holyoak, K. J., Nisbett, R. E., & Thagard, P. R. (1986). Induction. Processes of inference, learning, and discovery. MIT Press.

Digital Library

[35]

Holland, J. H., & Reitman, J. S. (1978). Cognitive systems based on adaptive algorithms. In Waterman, D. A., & Hayes-Roth, F. (Eds.), Pattern directed inference systems (pp. 313--329). Academic Press.

[36]

Kovacs, T. (1996). Evolving Optimal Populations with XCS Classifier Systems. Master thesis. University of Birmingham, Birmingham, UK.

[37]

Kovacs, T. (2007). A Learning Classifier System Bibliography. Department of Computer Science, University of Bristol, UK. http://www.cs.bris.ac.uk/~kovacs/lcs/search.html.

[38]

Kovacs, T. (2004). Strength of accuracy: Credit assignment in learning classifier systems. Berlin Heidelberg: Springer--Verlag.

Digital Library

[39]

Kovacs, T., Llorá, X., & Takadama, K. (in press). Advances at the frontier of LCS (LNCS 4399). Berlin Heidelberg: Springer-Verlag.

[40]

Lanzi, P. L. (1999). Extending the representation of classifier conditions. Part II: From messy coding to S-expressions. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-99), 345--352.

[41]

Lanzi, P. L. (2000). Adaptive agents with reinforcement learning and internal memory. From Animals to Animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, 333--342.

[42]

Lanzi, P. L., Loiacono, D., Wilson, S. W., & Goldberg, D.E. (2006). Classifier prediction based on tile coding. GECCO 2006: Genetic and Evolutionary Computation Conference, 1497--1504.

Digital Library

[43]

Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.) (2000). Learning classifier systems: From foundations to applications (LNAI 1813). Berlin Heidelberg: Springer-Verlag.

[44]

Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.) (2001). Advances in learning classifier systems: Third international workshop, IWLCS 2000 (LNAI 1996). Berlin Heidelberg: Springer-Verlag.

[45]

Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.) (2002). Advances in learning classifier systems: 4th international workshop, IWLCS 2001 (LNAI 2321). Berlin Heidelberg: Springer-Verlag.

Digital Library

[46]

Lanzi, P. L., Stolzmann, W., & Wilson, S. W. (Eds.) (2003). Learning classifier systems: 5th international workshop, IWLCS 2002 (LNAI 2661). Berlin Heidelberg: Springer-Verlag.

[47]

Lanzi, P. L., & Wilson, S.W. (2000). Toward optimal classifier system performance in non-Markov environments. Evolutionary Computation, 8, 393--418.

Digital Library

[48]

Llorä, X., & Garrell, J. M. (2001). Knowledge independent data mining with fine-grained parallel evolutionary algorithms. Proceedings of the Third Genetic and Evolutionary Computation Conference (GECCO--2001), 461--468.

[49]

Llorä, X., Goldberg, D. E., Traus, I., & Bernad243;, E. (2003). Accuracy, Parsimony, and Generality in Evolutionary Learning Systems via Multiobjective Selection. In Lanzi, P.L., Stolzmann, W. & Wilson, S.W. (Eds.). Learning classifier systems: 5th international workshop, IWLCS 2002 (LNAI 2661) (pp. 118--142). Berlin Heidelberg: Springer-Verlag.

[50]

Riolo, R. L. (1991). Lookahead planning and latent learning in a classifier system. In Meyer, J. & Wilson, S.W. (Eds.). From Animals to Animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior (pp. 316--326). MIT Press.

Digital Library

[51]

Sigaud, O., & Wilson, S. W. (in press). Learning classifier systems: A survey. Journal of Soft Computing.

Digital Library

[52]

Smith, S. F. (1980). A learning System Based on Genetic Adaptive Algorithms. PhD thesis, University of Pittsburgh, Pittsburgh, PA.

Digital Library

[53]

Stolzmann, W. (1998). Anticipatory classifier systems, Genetic Programming 1998: Proceedings of the Third Annual Conference, 658--664.

[54]

Sutton, R.S. (1990). Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proceedings of the Seventh International Conference on Machine Learning, 216--224.

Digital Library

[55]

Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. MIT Press.

Digital Library

[56]

Valenzuela-Rendঋn, M. (1991). The fuzzy classifier system: A classifier system for continuously varying variables. Proceedings of the 4th International Conference on Genetic Algorithms (ICGA 1991), 346--353.

[57]

Widrow, B., & Hoff, M. (1960). Adaptive switching circuits. Western Electronic Show and Convention, part 4 (pp. 96--104). New York: Convention Record.

[58]

Wilson, S. W. (1983). On the retino-cortical mapping. International Journal of Man-Machine Studies, 18, 361--389.

[59]

Wilson, S. W. (1985). Knowledge growth in an artificial animal. In Grefenstette, J. (Ed.), Proceedings of the 1st international conference on genetic algorithms and their application (ICGA-1985) (pp. 16--23). Pittsburg, PA: Lawrence Erlbaum Associates.

Digital Library

[60]

Wilson, S. W. (1987). Classifier systems and the animat problem. Machine Learning, 2, 199--228.

Digital Library

[61]

Wilson, S. W. (1994). ZCS: A zeroth level classifier system. Evolutionary Computation, 2, 1--18.

Digital Library

[62]

Wilson, S. W. (1995). Classifier fitness based on accuracy. Evolutionary Computation, 3, 149--175.

Digital Library

[63]

Wilson, S. W. (2002). Compact rulesets from XCSI. In Lanzi, P.L., Stolzmann, W., & Wilson, S.W. (Eds.). Advances in learning classifier systems: Fourth international workshop, IWLCS 2001 (LNAI 2321) (pp. 196--208). Berlin Heidelberg: Springer-Verlag.

Digital Library

Cited By

Qian LShi YGao YYin H(2013)Voting-XCScProceedings of the 14th International Conference on Intelligent Data Engineering and Automated Learning --- IDEAL 2013 - Volume 820610.1007/978-3-642-41278-3_73(603-610)Online publication date: 20-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41278-3_73
Shi LShi YGao Y(2009)Clustering with XCS and agglomerative rule mergingProceedings of the 10th international conference on Intelligent data engineering and automated learning10.5555/1789574.1789606(242-250)Online publication date: 23-Sep-2009
https://dl.acm.org/doi/10.5555/1789574.1789606
McEwan CHart E(2009)Representation in the (Artificial) Immune SystemJournal of Mathematical Modelling and Algorithms10.1007/s10852-009-9104-68:2(125-149)Online publication date: 17-Feb-2009
https://doi.org/10.1007/s10852-009-9104-6
Show More Cited By

Index Terms

Learning classifier systems
1. Computing methodologies
  1. Machine learning

Recommendations

Learning classifier systems
GECCO '10: Proceedings of the 12th annual conference companion on Genetic and evolutionary computation

This tutorial gives an introduction to Learning Classifier Systems focusing on the Michigan-Style type and XCS in particular. The objective is to introduce (1) where LCSs come from, (2) how LCSs generally work, (3) which different systems exist, (4) how ...
Gradient descent methods in learning classifier systems: improving XCS performance in multistep problems

The accuracy-based XCS classifier system has been shown to solve typical data mining problems in a machine-learning competitive way. However, successful applications in multistep problems, modeled by a Markov decision process, were restricted to very ...
Learning classifier system with average reward reinforcement learning

In the family of Learning Classifier Systems, the classifier system XCS is most widely used and investigated. However, the standard XCS has difficulties solving large multi-step problems, where long action chains are needed to get delayed rewards. Up to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GECCO '07: Proceedings of the 9th annual conference companion on Genetic and evolutionary computation

July 2007

1450 pages

ISBN:9781595936981

DOI:10.1145/1274000

Program Chairs:
Peter A. N. Bosman
Centre for Mathematics & Computer Science, The Netherlands
,
Tina Yu
Memorial University of Newfoundland, Canada
,
Anikó Ekárt
Aston University, UK

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

GECCO07

Sponsor:

GECCO07: Genetic and Evolutionary Computation Conference

July 7 - 11, 2007

London, United Kingdom

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
811
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Qian LShi YGao YYin H(2013)Voting-XCScProceedings of the 14th International Conference on Intelligent Data Engineering and Automated Learning --- IDEAL 2013 - Volume 820610.1007/978-3-642-41278-3_73(603-610)Online publication date: 20-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41278-3_73
Shi LShi YGao Y(2009)Clustering with XCS and agglomerative rule mergingProceedings of the 10th international conference on Intelligent data engineering and automated learning10.5555/1789574.1789606(242-250)Online publication date: 23-Sep-2009
https://dl.acm.org/doi/10.5555/1789574.1789606
McEwan CHart E(2009)Representation in the (Artificial) Immune SystemJournal of Mathematical Modelling and Algorithms10.1007/s10852-009-9104-68:2(125-149)Online publication date: 17-Feb-2009
https://doi.org/10.1007/s10852-009-9104-6
Shi LShi YGao Y(2009)Clustering with XCS and Agglomerative Rule MergingIntelligent Data Engineering and Automated Learning - IDEAL 200910.1007/978-3-642-04394-9_30(242-250)Online publication date: 2009
https://doi.org/10.1007/978-3-642-04394-9_30
Shi LGao YWu LShang L(2008)Clustering with XCS on Complex Structure DatasetProceedings of the 21st Australasian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence10.1007/978-3-540-89378-3_50(489-499)Online publication date: 1-Dec-2008
https://dl.acm.org/doi/10.1007/978-3-540-89378-3_50

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten