skip to main content
10.1145/2464576.2466805acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
tutorial

Adaptive artificial datasets through learning classifier systems for classification tasks

Authors Info & Claims
Published:06 July 2013Publication History

ABSTRACT

In existing artificial classification systems, the problem domain is created and controlled by humans. Humans set up and tune the problem domain, such as determining the problem's complexity. If humans can set up the problem appropriately then the machines can extract beneficial knowledge to solve classification task. This paper introduces an autonomous classification problem generation approach. The classification problem's difficulty is adapted based on the classification agent's performance within the defined attributes. An automated problem generator has been created to evolve the simulated datasets whilst the classification agent, in this case a learning classifier system, attempts to learn the evolving problem. The idea here is to tune the datasets autonomously such that the problem characteristics may be determined efficiently to empirically test the learning bounds of the classification agent by lowering human involvement. In this way, the effect of the problem's characteristics, which alter the classification agent's performance, becomes human readable. Tabu Search has been applied in the problem generator to discover the best combination of domain features in order to adjust the problem's complexity. Experiments confirm that the problem generator was able to tune the problem's complexity either to make the problem 'harder' or 'easier' so that it can either 'increase' or 'decrease' the classification agent's performance.

References

  1. C. M. Bishop. Pattern Recognition and Machine Learning. Springer, Natural Computing Series. 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. O. Duda, P. E. Hart and D. G. Stork. Pattern Classification 2nd Edition. John Wiley, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Tin Kam Ho and Mitra Basu. Complexity Measure of Supervised Classification Problems. IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 24/2002(3):289--300. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. V. Butz. Kernel-based, Ellipsoidal Conditions in the Real-Valued XCS Classifier System. Genetic Evolutionary Computational Conference (GECCO 2005). ACM, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M.V. Butz. Rule-Based Evolutionary Online Learning Systems: A Principal Approach to LCS Analysis and Design. Springer. 2006.Google ScholarGoogle Scholar
  6. Muhammad Iqbal, Will N. Browne and Mengjie Zhang. XCSR with Computed Continuous Action. Australisian AI 2012, pages 350--361. Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. F. Kharbat, L. Bull and M. Odeh. Revisiting Genetic Selection in the XCS Learning Classifier System. The 2005 IEEE Congress on Evolutionary Computation, pages 2061--2068. 2005.Google ScholarGoogle ScholarCross RefCross Ref
  8. T. Kovacs. Strength or Accuracy: Credit Assignment in Learning Classifier Systems. Springer, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Syahaneim Marzukhi, Will N. Browne and Mengjie Zhang. Two-Cornered Learning Classifier Systems for Pattern Generation and Classification. The 12th Genetic and Evolutionary Computation Conference (GECCO 2012), pages 895--902. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R. J. Urbanowicz and J. H. Moore. Review Article Learning Classifier Systems: A Complete Introduction, Review, and Roadmap. Journal of Artificial Evolution and Applications, Volume 2009:1--25. 2009. Google ScholarGoogle ScholarCross RefCross Ref
  11. O. Sigaud and S. W. Wilson. Learning Classifier Systems: A Survey. Soft Computing - A Fusion of Foundations, Methodologies and Applications, Volume 11(11):1065--1078. 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. S. W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, Volume 3 (2):149--175. Massachusetts Institute of Technology, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. S. W. Wilson. Get Real! XCS with Continuous-Valued Inputs. Learning Classifier Systems, From Foundations to Applications, LNAI-1813,pages 209--219. Springer, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. W. Wilson. Coevolution of Pattern Generators and Recognizers. Lecture Notes in Computer Science (LNCS), Volume 6471/2010(1):38--46. 2010.Google ScholarGoogle ScholarCross RefCross Ref
  15. Nuria Macia, Albert Orriols-Puig and Ester Bernado-Mansilla. Beyond Homemade Artificial Data Sets. Hybrid Artificial Intelligence Systems Lecture Notes in Computer Science, Volume 5572/2009:605--612. 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Z. Michalewicz and D. B. Fogel. How to Solve It: Modern Heuristics. Springer, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. H. Holland. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, Artificial Intelligence. University of Michigan Press, pages 313--329. 1975.Google ScholarGoogle Scholar
  18. Sean Luke. Essentials of Metaheuristics: A Set of Undergraduate Lecture Notes. Department of Computer Science, George Mason University. 2010.Google ScholarGoogle Scholar
  19. Micheal Gendreau. A Tutorial On the Tabu Search. Department of Computer Science, de Montreal University, Canada. 2000.Google ScholarGoogle Scholar

Index Terms

  1. Adaptive artificial datasets through learning classifier systems for classification tasks

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        GECCO '13 Companion: Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
        July 2013
        1798 pages
        ISBN:9781450319645
        DOI:10.1145/2464576
        • Editor:
        • Christian Blum,
        • General Chair:
        • Enrique Alba

        Copyright © 2013 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 6 July 2013

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • tutorial

        Acceptance Rates

        Overall Acceptance Rate1,669of4,410submissions,38%

        Upcoming Conference

        GECCO '24
        Genetic and Evolutionary Computation Conference
        July 14 - 18, 2024
        Melbourne , VIC , Australia

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader