Summary
Genetics-based machine learning methods – also called learning classifier systems (LCSs) – are evolutionary computation based data mining techniques. The advantages of these techniques are: to provide rule-based models that represent human-readable patterns; to learn incrementally, capable of adapting quickly to any changes in dynamic environments; and some of them have linear 0(n) learning complexity in the size of data set. However, not too much effort has yet been put into investigating LCSs in distributed environments. This chapter will scrutinize several issues of LCSs in distributed environments such as knowledge passing in the system, knowledge combination methods at the central location, and the effect on the system’s learning accuracy of having different numbers of distributed sites.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
H. A. Abbass, J. Bacardit, M. V. Butz, and X. Llora. Online Adaptation in Learning Classifier Systems: Stream Data Mining. Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, June 2004. IlliGAL Report No. 2004031.
J. Bacardit and M. V. Butz. Data Mining in Learning Classifier Systems: Comparing XCS with GAssist. Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, June 2004. IlliGAL Report No. 2004030.
J. Bacardit and J. M. Garrell. Bloat control and generalization pressure using the minimum description length principle for a Pittsburgh approach learning classifier system. In Sixth International Workshop on Learning Classifier Systems (IWLCS-2003), Chicago, July 2003.
E. Bernadó-Mansilla and J. M. Garrell-Guiu. Accuracy-based learning classifier systems: models, analysis and applications to classification tasks. Evolutionary Computation, 11(3):209–238, 2003.
L. Bull and T. Kovacs. Foundations of Learning Classifier Systems: An Introduction, volume 183, pp. 1–17. Springer, Berlin Heidelberg New York, June 2005.
P. K. Chan and S. J. Stolfo. Toward parallel and distributed learning by meta-learning. In Working Notes AAAI Work. Knowledge Discovery in Databases, pp. 227–240, Washington, DC, 1993.
V. Cho and B. Wuthrich. Distributed mining of classification rules. Knowledge Information System, 4(1):1–30, 2002.
H. H. Dam, H. A. Abbass, and C. Lokan. DXCS: an XCS system for distributed data mining. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2005), Washington, 2005.
H. H. Dam, H. A. Abbass, and C. Lokan. Investigation on DXCS: An XCS system for distribution data mining, with continuous-valued inputs in static and dynamic environments. In Proceedings of IEEE Cogress on Evolutionary Computation, Edinburgh, Scotland, 2005.
T. G. Dietterich. Machine-learning research: Four current directions. The AI Magazine, 18(4):97–136, 1998.
U. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy. From data mining to knowledge discovery: An overview. In Advances in Knowledge Discovery and Data Mining, pp. 1–36. MIT, New York, 1996.
C. Giannella, R. Bhargava, and H. Kargupta. Multi-agent systems and distributed data mining. In Cooperative Information Agents VIII: 8th International Workshop (CIA 2004), pp. 1–15, Erfurt, Germany, 2004.
D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addision-Wesley, Reading, 1989.
Y. Guo, S. Rueger, J. Sutiwaraphun, and J. Forbes-Millott. Meta-learning for parallel data mining. In Proceedings of the Seventh Parallel Computing Worksop, 1997.
L. Hall, N. Chawla, and K. Bowyer. Combining decision trees learned in parallel. In Proceedings of the Workshop on Distributed Data Mining of the 4th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1997.
L. Hall, N. Chawla, and K. Bowyer. Decision tree learning on very large data sets. In Proceedings of the IEEE Conference on Systems, Man and Cybernetics, 1998.
J. H. Holland. Escaping Brittleness: The Possibilities of General-Purpose Learning Algorithms Applied to Parallel Rule-Based Systems. In Mitchell, Michalski, and Carbonell, editors, Machine Learning, an Artificial Intelligence Approach. Volume II, chapter 20, pp. 593–623. Morgan Kaufmann, Los Altos, 1986.
C. Jones, J. Hall, and J. Hale. Secure distributed database mining: Principles of design. In Advances in Distributed and Parallel Knowledge Discovery, pp. 277–294. MIT, 2000.
H. Kargupta and P. Chan, editors. Advances in Distributed and Parallel Knowledge Discovery. MIT, 2000.
T. Kovacs. Two views of classifier systems. In Fourth International Workshop on Learning Classifier Systems - (IWLCS-2001), pp. 367–371, San Francisco, California, USA, 7, 2001.
A. L. Prodromidis, P. K. Chan, and S. J. Stolfo. Meta-learning in distributed data mining systems: Issues and approaches. In Advances in Distributed and Parallel Knowledge Discovery, pp. 81–114. MIT, New York, 2000.
S. F. Smith. A Learning System Based on Genetic Adaptive Algorithms. PhD thesis, University of Pittsburgh, 1980.
S. W. Wilson. Classifier fitness based on accuracy. Evolutionary Computation, 3(2):149–175, 1995.
S. W. Wilson. Generalization in the XCS classifier system. In J. R. Koza, W. Banzhaf, K. Chellapilla, K. Deb, M. Dorigo, D. B. Fogel, M. H. Garzon, D. E. Goldberg, H. Iba, and R. Riolo, editors, Genetic Programming 1998: Proceedings of the Third Annual Conference, pp. 665–674, University of Wisconsin, Madison, Wisconsin, USA, 1998. Morgan Kaufmann.
S. W. Wilson. Mining oblique data with XCS. In P. L. Lanzi, W. Stolzmann, and S. W. Wilson, editors, Proceedings of the Third International Workshop (IWLCS-2000), Lecture Notes in Artificial Intelligence, pp. 158–174, 2001.
D. H. Wolpert. Stacked generalization. Neural Networks, 5:241–259, 1992.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Dam, H.H., Rojanavasu, P., Abbass, H.A., Lokan, C. (2008). Distributed Learning Classifier Systems. In: Bull, L., Bernadó-Mansilla, E., Holmes, J. (eds) Learning Classifier Systems in Data Mining. Studies in Computational Intelligence, vol 125. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78979-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-78979-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78978-9
Online ISBN: 978-3-540-78979-6
eBook Packages: EngineeringEngineering (R0)