Skip to main content
Springer Nature Link
Log in

A load index and load balancing algorithm for heterogeneous clusters

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

This paper presents a load balancing algorithm specifically designed for heterogeneous clusters, composed of nodes with different computational capabilities. The method is based on a new index, which takes into consideration two levels of processors heterogeneity: the number of cores per node and the computational power of each core. The experimental results show that this index allows achieving balanced workload distributions even on those clusters where heterogeneity can not be neglected.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Nas parallel benchmarks. http://www.nas.nasa.gov/Software/NPB

  2. The top500 project. November 2010. http://www.top500.org

  3. Dongarra J, Lastovetsky AL (2009) High performance heterogeneous computing. In: IEEE international symposium on parallel and distributed computing. Wiley, New York

    Google Scholar 

  4. Vinh T, Duy T, Sato Y, Inoguchi Y (2009) Improving accuracy of host load predictions on computational grids by artificial neural networks. In: IEEE international symposium on parallel distributed processing, IPDPS 2009, pp 1–8, May 2009

    Google Scholar 

  5. Galindo I, Almeida F, Badía-Contelles JM (2008) Dynamic load balancing on dedicated heterogeneous systems. In: PVM/MPI, pp 64–74

    Google Scholar 

  6. Gondhi NK, Pant D (2009) An evolutionary approach for scalable load balancing in cluster computing. In: Advance computing conference, 2009. IACC 2009. IEEE international, pp 1259–1264, March 2009

    Chapter  Google Scholar 

  7. Li W, Shi H (2009) Dynamic load balancing algorithm based on fcfs. In: Fourth international conference on innovative computing, information and control (ICICIC), 2009, pp 1528–1531, Dec 2009

    Chapter  Google Scholar 

  8. Martínez J, Almeida F, Garzón E, Acosta A, Blanco V (2011) Adaptive load balancing of iterative computation on heterogeneous nondedicated systems. J Supercomput 58:385–393. doi:10.1007/s11227-011-0595-3

    Article  Google Scholar 

  9. Tong X, Shu W (2008) An efficient dynamic load balancing scheme for heterogeneous processing system. In: International conference on computational intelligence and natural computing, 2009. CINC ’09, vol 2, pp 319–322

    Google Scholar 

  10. Xu C, Lau F (1997) Load balancing in parallel computers: theory and practice. Kluwer Academic, Boston

    Google Scholar 

  11. Sun YX-H, Wu M (2008) Algorithm-system scalability of heterogeneous computing. J Parallel Distrib Comput 68(11):1403–1412

    Article  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by the Spanish Ministry of Education, Science, and Innovation (Grants TIN2010-21289, TIN2010-21291-C02-02, Consolider CSD2007-00050, and the Cajal Blue Brain Project, Spanish partner of the Blue Brain Project initiative from EPFL).

Author information

Authors and Affiliations

  1. Dpto. de Electrónica y Computadores, Universidad de Cantabria, Santander, Spain

    Jose Luis Bosque

  2. Dpto. de Arquitectura y Tecnología de Computadores y Ciencia de la Computación e Inteligencia Artificial, Universidad Rey Juan Carlos, Madrid, Spain

    Pablo Toharia, Oscar D. Robles & Luis Pastor

Authors
  1. Jose Luis Bosque
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Pablo Toharia
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Oscar D. Robles
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Luis Pastor
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Oscar D. Robles.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bosque, J.L., Toharia, P., Robles, O.D. et al. A load index and load balancing algorithm for heterogeneous clusters. J Supercomput 65, 1104–1113 (2013). https://doi.org/10.1007/s11227-013-0881-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-013-0881-3

Keywords