skip to main content
10.1145/1276958.1277293acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
Article

Novel ways of improving cooperation and performance in ensemble classifiers

Published: 07 July 2007 Publication History

Abstract

There are two common methods of evolving teams of genetic programs. Research suggests Island approaches produce teams of strong individuals that cooperate poorly and Team approaches produce teams of weak individuals that cooperate strongly. Ideally, teams should be composed of strong individuals that cooperate well. In this paper we present a new class of algorithms called Orthogonal Evolution of Teams (OET) that overcomes the weaknesses of current Island and Team approaches by applying evolutionary pressure at both the level of teams and individuals during selection and replacement. We present four novel algorithms in this new class and compare their performance to Island and Team approaches as well as multi-class Adaboost on a number of classification problems.

References

[1]
A. Avizienis and J. B. J. Kelly. Fault tolerance by design diversity: Concepts and experiments. In IEEE Computer, volume 17(8), pages 67--80, 1984.
[2]
M. Brameier and W. Banzhaf. Evolving teams of predictors with linear genetic programming. Genetic Programming and Evolvable Machines, 2(4):381--408, 2001.
[3]
C. B. D.J. Newman, S. Hettich and C. Merz. UCI repository of machine learning databases, 1998.
[4]
S. R. E. Freund, Yoav. Experiments with a new boosting algorithm. In Machine Learning: Proceedings of the Thirteenth International Conference, 1996.
[5]
S. R. E. Freund, Yoav. A short introduction to boosting. Journal of Japanese Society for Artificial Intelligence, 14:771--780, 1999.
[6]
L. Hatton. N-version vs. one good program. IEEE Software, 14(6):71--76, 1997.
[7]
S. S. D. S. Haynes, T. and R. Wainwright. Evolving a team. In Working Notes of the AAAI-95 Fall Symposium on Genetic Programming, 1995.
[8]
K. Imamura, R. B. Heckendorn, T. Soule, and J. A. Foster. Behavioral diversity and a probabilistically optimal gp ensemble. Genetic Programming and Evolvable Machines, 4:235--253, 2004.
[9]
J. C. Knight and N. B. Leveson. An experimental evaluation of the assumption of independence in multiversion programming, 1986.
[10]
P. Komireddy and T. Soule. Orthogonal Evolution of Teams: A Class of Algorithms for Evolving Teams with Inversely Correlated Errors. 2006.
[11]
S. Luke and L. Spector. Evolving teamwork and coordination with genetic programming. In In Genetic Programming 1996: Proceedings of the First Annual Conference., pages 141--149. Cambridge: MIT Press, 1996.
[12]
T. Soule. Voting teams: A cooperative approach to non-typical problems. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference, pages 916--922, Orlando, Florida, USA, 13-17 July 1999. Morgan Kaufmann.
[13]
T. Soule. Heterogeneity and specialization in evolving teams. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2000), pages 778--785, Las Vegas, Nevada, USA, 2000. Morgan Kaufmann.
[14]
T. Soule. Cooperative evolution on the intertwined spirals problem. In Genetic Programming: Proceedings of the 6th European Conference on Genetic Programming, EuroGP 2003, pages 434--442. Springer-Verlag, 2003.
[15]
R. S. H. T. Zhu, Ji. Multi--class adaboost. Technical Report 430, Department of Statistics, University of Michigan, 2005.

Cited By

View all
  • (2023)Evolutionary Ensemble LearningHandbook of Evolutionary Machine Learning10.1007/978-981-99-3814-8_8(205-243)Online publication date: 2-Nov-2023
  • (2023)A Boosting Approach to Constructing an Ensemble StackGenetic Programming10.1007/978-3-031-29573-7_9(133-148)Online publication date: 29-Mar-2023
  • (2022)On the interaction between lexicase selection, modularity and data subsetsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3528765(586-589)Online publication date: 9-Jul-2022
  • Show More Cited By
  1. Novel ways of improving cooperation and performance in ensemble classifiers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation
    July 2007
    2313 pages
    ISBN:9781595936974
    DOI:10.1145/1276958
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 July 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. genetic programming
    2. performance analysis

    Qualifiers

    • Article

    Conference

    GECCO07
    Sponsor:

    Acceptance Rates

    GECCO '07 Paper Acceptance Rate 266 of 577 submissions, 46%;
    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Evolutionary Ensemble LearningHandbook of Evolutionary Machine Learning10.1007/978-981-99-3814-8_8(205-243)Online publication date: 2-Nov-2023
    • (2023)A Boosting Approach to Constructing an Ensemble StackGenetic Programming10.1007/978-3-031-29573-7_9(133-148)Online publication date: 29-Mar-2023
    • (2022)On the interaction between lexicase selection, modularity and data subsetsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3528765(586-589)Online publication date: 9-Jul-2022
    • (2022)An Empirical Study of Progressive Insular Cooperative GPSN Computer Science10.1007/s42979-021-00998-73:2Online publication date: 7-Jan-2022
    • (2021)Emergent Tangled Program Graphs in Partially Observable Recursive Forecasting and ViZDoom Navigation TasksACM Transactions on Evolutionary Learning and Optimization10.1145/34688571:3(1-41)Online publication date: 18-Aug-2021
    • (2021)Evolving Simple Solutions to the CIFAR-10 Benchmark using Tangled Program Graphs2021 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC45853.2021.9504998(2061-2068)Online publication date: 28-Jun-2021
    • (2021)Progressive Insular Cooperative GPGenetic Programming10.1007/978-3-030-72812-0_2(19-35)Online publication date: 25-Mar-2021
    • (2020)Genetic Programming for Evolving Similarity Functions for ClusteringEvolutionary Computation10.1162/evco_a_0026428:4(531-561)Online publication date: 1-Dec-2020
    • (2019)Solving complex problems with coevolutionary algorithmsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3319619.3323384(975-1001)Online publication date: 13-Jul-2019
    • (2019)A Survey of Statistical Machine Learning Elements in Genetic ProgrammingIEEE Transactions on Evolutionary Computation10.1109/TEVC.2019.290091623:6(1029-1048)Online publication date: Dec-2019
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media