skip to main content
10.1145/2001576.2001791acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Many-threaded implementation of differential evolution for the CUDA platform

Published: 12 July 2011 Publication History

Abstract

Differential evolution is an efficient populational meta -- heuristic optimization algorithm successful in solving difficult real world problems. Due to the simplicity of its operations and data structures, it is suitable for a parallel implementation on multicore systems and on the GPU. In this paper, we design a simple yet highly parallel implementation of the differential evolution using the CUDA architecture. We demonstrate the speedup obtained by the proposed parallelization of the differential evolution on an NP hard combinatorial optimization problem and on a benchmark function of many variables.

References

[1]
S. Ali, T. Braun, H. Siegel, and A. Maciejewski. Heterogeneous computing. In J. Urbana and P. Dasgupta, editors, Encyclopedia of Distributed Computing. Kluwer Academic Publishers, Norwell, MA, 2002.
[2]
M. Andrecut. Fast gpu implementation of sparse signal recovery from random projections. Engineering Letters, 17(3):151--158, 2009.
[3]
T. D. Braun, H. J. Siegel, N. Beck, L. L. Bölöni, M. Maheswaran, A. I. Reuther, J. P. Robertson, M. D. Theys, B. Yao, D. Hensgen, and R. F. Freund. A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distrib. Comput., 61:810--837, June 2001.
[4]
J. Carretero, F. Xhafa, and A. Abraham. Genetic algorithm based schedulers for grid computing systems. International Journal of Innovative Computing, Information and Control, 3(7), 2007.
[5]
L. de Veronese and R. Krohling. Differential evolution algorithm on the gpu with c-cuda. In Evolutionary Computation (CEC), 2010 IEEE Congress on, pages 1 --7, 2010.
[6]
T. J. Desell, D. P. Anderson, M. Magdon-Ismail, H. J. Newberg, B. K. Szymanski, and C. A. Varela. An analysis of massively distributed evolutionary algorithms. In IEEE Congress on Evolutionary Computation, pages 1--8. IEEE, 2010.
[7]
D. Fernandez-Baca. Allocating modules to processors in a distributed system. IEEE Trans. Softw. Eng., 15(11):1427--1436, 1989.
[8]
G. Hager, T. Zeiser, and G. Wellein. Data access optimizations for highly threaded multi-core cpus with multiple memory controllers. In Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, pages 1 --7, 2008.
[9]
H. Izakian, A. Abraham, and V. Snasel. Comparison of heuristics for scheduling independent tasks on heterogeneous distributed environments. In Computational Sciences and Optimization, 2009. CSO 2009. International Joint Conference on, volume 1, pages 8 --12, april 2009.
[10]
P. Kromer, V. Snasel, J. Platos, A. Abraham, and H. Ezakian. Evolving schedules of independent tasks by differential evolution. In S. Caballé, F. Xhafa, and A. Abraham, editors, Intelligent Networking, Collaborative Systems and Applications, volume 329 of Studies in Computational Intelligence, pages 79--94. Springer Berlin / Heidelberg, 2011.
[11]
W. Langdon and W. Banzhaf. A simd interpreter for genetic programming on gpu graphics cards. In M. O'Neill, L. Vanneschi, S. Gustafson, A. Esparcia Alcázar, I. De Falco, A. Della Cioppa, and E. Tarantino, editors, Genetic Programming, volume 4971 of Lecture Notes in Computer Science, pages 73--85. Springer Berlin / Heidelberg, 2008.
[12]
E. Munir, J.-Z. Li, S.-F. Shi, and Q. Rasool. Performance analysis of task scheduling heuristics in grid. In Machine Learning and Cybernetics, 2007 International Conference on, volume 6, pages 3093--3098, aug. 2007.
[13]
NVIDIA. CUDA Programming Guide 3.2. 2010.
[14]
NVIDIA. CUDA Toolkit 3.2 Math Library Performance. 2011.
[15]
A. J. Page and T. J. Naughton. Framework for task scheduling in heterogeneous distributed computing using genetic algorithms. Artificial Intelligence Review, 24:137--146, 2004.
[16]
D. Patnaik, S. P. Ponce, Y. Cao, and N. Ramakrishnan. Accelerator-oriented algorithm transformation for temporal data mining. Network and Parallel Computing Workshops, IFIP International Conference on, 0:93--100, 2009.
[17]
P. Pospíchal, J. Jaros, and J. Schwarz. Parallel genetic algorithm on the cuda architecture. In Applications of Evolutionary Computation, LNCS 6024, pages 442--451. Springer Verlag, 2010.
[18]
T. Preis, P. Virnau, W. Paul, and J. J. Schneider. Accelerated fluctuation analysis by graphic cards and complex pattern formation in Econophysics. New J. Phys., 11:093024, 2009.
[19]
K. V. Price, R. M. Storn, and J. A. Lampinen. Differential Evolution A Practical Approach to Global Optimization. Natural Computing Series. Springer-Verlag, Berlin, Germany, 2005.
[20]
G. Ritchie and J. Levine. A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments. In Proceedings of the 23rd Workshop of the UK Planning and Scheduling Special Interest Group, December 2004.
[21]
D. Robilliard, V. Marion, and C. Fonlupt. High performance genetic programming on gpu. In Proceedings of the 2009 workshop on Bio-inspired algorithms for distributed systems, BADS '09, pages 85--94, New York, NY, USA, 2009. ACM.
[22]
A. YarKhan and J. Dongarra. Experiments with scheduling using simulated annealing in a grid environment. In GRID '02: Proceedings of the Third International Workshop on Grid Computing, pages 232--242, London, UK, 2002. Springer-Verlag.
[23]
W. Zhu. Massively parallel differential evolution - pattern search optimization with graphics hardware acceleration: an investigation on bound constrained optimization problems. Journal of Global Optimization, pages 1--21, 2010. 10.1007/s10898-010--9590-0.
[24]
W. Zhu and Y. Li. Gpu-accelerated differential evolutionary markov chain monte carlo method for multi-objective optimization over continuous space. In Proceeding of the 2nd workshop on Bio-inspired algorithms for distributed systems, BADS '10, pages 1--8, New York, NY, USA, 2010. ACM.

Cited By

View all
  • (2022)A Stigmergy-Based Differential EvolutionApplied Sciences10.3390/app1212609312:12(6093)Online publication date: 15-Jun-2022
  • (2022)Implementing and evaluating parallel evolutionary algorithms in modern GPU computing librariesProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3529000(506-509)Online publication date: 9-Jul-2022
  • (2021)Parallel Evolutionary Algorithm for EEG Optimization Problems2021 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC45853.2021.9504925(2577-2584)Online publication date: 28-Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '11: Proceedings of the 13th annual conference on Genetic and evolutionary computation
July 2011
2140 pages
ISBN:9781450305570
DOI:10.1145/2001576
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 July 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CUDA
  2. differential evolution
  3. parallelization
  4. scheduling

Qualifiers

  • Research-article

Conference

GECCO '11
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A Stigmergy-Based Differential EvolutionApplied Sciences10.3390/app1212609312:12(6093)Online publication date: 15-Jun-2022
  • (2022)Implementing and evaluating parallel evolutionary algorithms in modern GPU computing librariesProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3529000(506-509)Online publication date: 9-Jul-2022
  • (2021)Parallel Evolutionary Algorithm for EEG Optimization Problems2021 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC45853.2021.9504925(2577-2584)Online publication date: 28-Jun-2021
  • (2021)Evolutionary algorithm applications for IoTs dedicated to precise irrigation systems: state of the artEvolutionary Intelligence10.1007/s12065-021-00676-w16:2(383-400)Online publication date: 12-Nov-2021
  • (2017)Solving optimization problems using a hybrid systolic search on GPU plus CPUSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-2005-x21:12(3227-3245)Online publication date: 1-Jun-2017
  • (2016)A Comparison of Differential Evolution and Genetic Algorithms for the Column Subset Selection ProblemProceedings of the 9th International Conference on Computer Recognition Systems CORES 201510.1007/978-3-319-26227-7_21(223-232)Online publication date: 5-Mar-2016
  • (2015)Fast Knowledge Discovery in Time Series with GPGPU on Genetic ProgrammingProceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation10.1145/2739480.2754669(1159-1166)Online publication date: 11-Jul-2015
  • (2015)GPU Particle Swarm Optimization Applied to Travelling Salesman ProblemProceedings of the 2015 IEEE 9th International Symposium on Embedded Multicore/Many-core Systems-on-Chip10.1109/MCSoC.2015.18(112-119)Online publication date: 23-Sep-2015
  • (2015)cuSaDE: A CUDA-Based Parallel Self-adaptive Differential Evolution AlgorithmProceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems - Volume 210.1007/978-3-319-13356-0_30(375-388)Online publication date: 2015
  • (2014)Implementation of an improved parallel metaheuristic on GPU applied to humanoid robot simulation2014 International Conference on Multimedia Computing and Systems (ICMCS)10.1109/ICMCS.2014.6911288(42-47)Online publication date: Apr-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media