Skip to main content
Springer Nature Link
Log in

Optimizing a parameterized message-passing metaheuristic scheme on a heterogeneous cluster

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This paper studies the development of message-passing parameterized schemes of metaheuristics and the use of auto-tuning techniques to optimize their execution time. Previous parameterized schemes on shared-memory are extended with new metaheuristic-parallelism parameters representing the migration frequency, the size of the migration and the number of processes. An optimization Problem of Electricity Consumption in Exploitation of Wells is used as test case. Experimental results in heterogeneous systems are reported for this problem, and the influence of the parallelism parameters is studied. The message-passing scheme proves to be preferable to the shared-memory scheme in terms of execution time, giving similar results for the goodness of the solutions. In the executions in a heterogeneous cluster, the best experimental results are obtained in terms of speed-up and quality of the solution by mapping a number of processes close to the value of the population size, and considering the relative speeds of the components of the heterogeneous system. Furthermore, optimized execution times can be achieved with auto-tuning techniques based on theoretical–empirical models of the execution time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley-Interscience, New York

    Book  MATH  Google Scholar 

  • Almeida F, Giménez D, López-Espín J-J (2011) A parameterized shared-memory scheme for parameterized metaheuristics. J Supercomput 58(3):292–301

    Article  Google Scholar 

  • Almeida F, Giménez D, López-Espín J-J, Pérez-Pérez M (2013) Parameterised schemes of metaheuristics: basic ideas and applications with genetic algorithms, scatter search and GRASP. IEEE Trans Syst Man Cybern A Syst Hum 43(3):570–586

    Article  Google Scholar 

  • Azadeh A, Faiz Z (2011) A meta-heuristic framework for forecasting household electricity consumption. Appl Soft Comput 11(1):614–620

    Article  Google Scholar 

  • Azadeh A, Ghaderi SF, Tarverdian S, Saberi M (2007) Integration of artificial neural networks and genetic algorithm to predict electrical energy consumption. Appl Math Comput 186(2):1731–1741

    MathSciNet  MATH  Google Scholar 

  • Birattari M (2009) Tuning metaheuristics: a machine learning perspective, 2nd edn. Springer Publishing Company, Berlin

    Book  MATH  Google Scholar 

  • Cantú-Paz E (1998) A survey of parallel genetic algorithms. Calculateurs Paralleles, Reseaux et Systems Repartis 10

  • Cantú-Paz E, Goldberg DE (1999) On the scalability of parallel genetic algorithms. Evol Comput 7(4):429–449

    Article  Google Scholar 

  • Cutillas-Lozano J-M, Giménez D (2013) Determination of the kinetic constants of a chemical reaction in heterogeneous phase using parameterized metaheuristics. In: Proceedings of the international conference on computational science, pp 787–796

  • Cutillas-Lozano J-M, Giménez D (2014) Optimizing shared-memory hyperheuristics on top of parameterized metaheuristics. In Proceedings of the international conference on computational science, pp 20–29

  • Cutillas-Lozano L-G, Giménez D, Giménez D (2012) Modeling shared-memory metaheuristic schemes for electricity consumption. In: 9th International conference on distributed computing and artificial intelligence, pp 33–40

  • Cutillas-Lozano J-M, Giménez D, Almeida F (2015) Hyperheuristics based on parametrized metaheuristic schemes. In: Proceedings of the genetic and evolutionary computation conference, pp 361–368

  • Frigo M, Johnson SG (1998) FFTW: an adaptive software architecture for the FFT. IEEE Int Conf Acoust Speech Signal Process 3:1381–1384

    Google Scholar 

  • Harik GR, Cantú-Paz E, Goldberg DE, Miller BL (1999) The gambler’s ruin problem, genetic algorithms, and the sizing of populations. Evol Comput 7(3):231–253

    Article  Google Scholar 

  • Imbernón B, Cecilia JM, Giménez D (2016) Enhancing metaheuristic-based virtual screening methods on massively parallel and heterogeneous systems. In: Proceedings of the 7th international workshop on programming models and applications for multicores and manycores, pp 50–58

  • Kalinov A, Lastovetsky A (2001) Heterogeneous distribution of computations while solving linear algebra problems on network of heterogeneous computers. J Parallel Distrib Comput 61(44):520–535

    Article  MATH  Google Scholar 

  • Karafotias G, Hoogendoorn M, Eiben ÁE (2015) Parameter control in evolutionary algorithms: trends and challenges. IEEE Trans Evol Comput 19(2):167–187

    Article  Google Scholar 

  • Katagiri T, Kise K, Honda H (2004) Effect of auto-tuning with user’s knowledge for numerical software. In: Vassiliadis JLGS, Piuri V (eds) Proceedings of the first conference on computing frontiers, pp 12–25

  • Lässig J, Sudholt D (2011a) Adaptive population models for offspring populations and parallel evolutionary algorithms. In: Foundations of genetic algorithms, 11th international workshop, pp 181–192

  • Lässig J, Sudholt D (2011b) Analysis of speedups in parallel evolutionary algorithms for combinatorial optimization—(extended abstract). In: Algorithms and computation—22nd international symposium, pp 405–414

  • Mezmaz M-S, Kessaci Y, Lee YC, Melab N, Talbi E-G, Zomaya AY, Tuyttens D (2010) A parallel island-based hybrid genetic algorithm for precedence-constrained applications to minimize energy consumption and makespan. In: GRID, pp 274–281

  • Raidl GR (2006) A unified view on hybrid metaheuristics. Hybrid metaheuristics, third international workshop, LNCS 4030:1–12

  • Talbi E (2015) Parallel evolutionary combinatorial optimization. In: Springer handbook of, computational intelligence, pp 1107–1125

  • Whaley RC, Petitet A, Dongarra J (2001) Automated empirical optimizations of software and the ATLAS project. Parallel Comput 27(1–2):3–35

    Article  MATH  Google Scholar 

  • Yu T, Sastry K, Goldberg DE (2005) Online population size adjusting using noise and substructural measurements. In: Proceedings of the IEEE congress on evolutionary computation, pp 2491–2498

Download references

Acknowledgments

This work was supported by the Spanish MINECO, as well as European Commission FEDER funds, under Grant TIN2015-66972-C5-3-R.

Author information

Authors and Affiliations

  1. Departamento de Informática y Sistemas, University of Murcia, 30071, Murcia, Spain

    José-Matías Cutillas-Lozano & Domingo Giménez

Authors
  1. José-Matías Cutillas-Lozano
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Domingo Giménez
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to José-Matías Cutillas-Lozano.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Communicated by C.M. Vide, A.H. Dediu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cutillas-Lozano, JM., Giménez, D. Optimizing a parameterized message-passing metaheuristic scheme on a heterogeneous cluster. Soft Comput 21, 5557–5572 (2017). https://doi.org/10.1007/s00500-016-2371-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-016-2371-z

Keywords