Skip to main content
SpringerLink
Log in

A heterogeneity-aware approach to load balancing of computational tasks: a theoretical and simulation study

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

One of the distinct characteristics of computing platforms shared by multiple users such as a cluster and a computational grid is heterogeneity on each computer and/or among computers. Temporal heterogeneity refers to variation, along the time dimension, of computing power available for a task on a computer, and spatial heterogeneity represents the variation among computers. In minimizing the average parallel execution time of a target task on a spatially heterogeneous computing system, it is not optimal to distribute the target task linearly proportional to the average computing powers available on computers. In this paper, effects of the temporal and spatial heterogeneity on performance of a target task have been analyzed in terms of the mean and standard deviation of parallel execution time. Based on the analysis results, an approach to load balancing for minimizing the average parallel execution time of a target task is described. The proposed approach whose validity has been verified through simulation considers temporal and spatial heterogeneities in addition to the average computing power on each computer.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Buyya, R.: High Peformance Cluster Computing (1999)

  2. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Kaufmann (1988)

  3. Freund, R.F., Siegel, H.J.: Heterogeneous processing. Computer, 13–17 (1993)

  4. Maheswaran, M., Siegel, H.: A dynamic matching and scheduling algorithm for heterogeneous computing systems. In: Proceedings of Heterogeneous Computing, pp. 57–69 (1998)

  5. Thanalapati, T., Dandamudi, S.: An efficient adaptive scheduling scheme for distributed memory multicomputers. IEEE Trans. Parallel Distributed Syst., 758–768 (2001)

  6. Zhang, Y., Sivasubrmaniam, A., Moreira, J., Franke, H.: Impact of workload and system parameters on next generation cluster scheduling mechanisms. IEEE Trans. Parallel Distributed Syst., 967–985 (2001)

  7. Ali, S., Siegel, H., Maheswaran, M., Hensgen, D., Ali, S.: Task execution time modeling for heterogeneous computing systems. In: Proceedings of the 9th Heterogeneous Computing Workshop, pp. 185–199, May 2000

  8. Armstrong, R.: Investigation of effect of different run-time distributions on smartnet performance. Master’s thesis, Department of Computer Science, Naval Postgraduate School (1997)

  9. Al-Jaroodi, J., Mohamed, N., Jiang, H., Swanson, D.: Modeling parallel applications performance on heterogeneous systems. In: Proceedings of IPDPS 2003, Workshop on Advances in Parallel and Distributed Computational Models, Nice, France, April 2003

  10. Figueira, S.M., Berman, F.: A slowdown model for application executing on time-shared clusters of workstations. IEEE Trans. Parallel Distributed Syst., 653–670 (2001)

  11. Xu, C.-Z., Wang, L.Y., Fong, N.-T.: Stochastic prediction of execution time for dynamic bulk synchronous computations. In: Proceedings of International Parallel and Distributed Processing Symposium, San Francisco, April 2001

  12. Zhang, X., Yan, Y.: Modeling and characterizing parallel computing performance on heterogeneous networks of workstations. In: Proceedings of Seventh IEEE Symposium. Parallel and Distributed Processing, pp. 25–34, October 1995

  13. Dogon, A., Ozguner, F.: Trading off execution time for reliability in scheduling precedence-constrained tasks in heterogeneous computing. In: Proceedings of International Parallel and Distributed Processing Symposium, San Francisco, April 2001

  14. Schopf, J., Berman, F.: Stochastic scheduling. In: CS Dept. Technical Report (CS-99-03), University of California, San Diego (1999)

  15. Huang, J., Lee, S.-Y.: Effects of spatial and temporal heterogeneity on performance of a target task in heterogeneous computing environmentss. In: Proceedings of ISCA 15th International Conference on Parallel and Distributed Computing Systems, pp. 301–306, September 2002

  16. Lee, S.-Y., Huang, J.: A theoretical approach to load balancing of a target task in temporally and spatially heterogeneous grid computing environment. In: The 3rd International Workshop on Grid Computing, pp. 70–81, November 2002

  17. David, H.: Order Statistics. Wiley (1970)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Auburn University, Auburn, AL, 36849, USA

    Jun Huang & Soo-Young Lee

Authors
  1. Jun Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Soo-Young Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soo-Young Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huang, J., Lee, SY. A heterogeneity-aware approach to load balancing of computational tasks: a theoretical and simulation study. Cluster Comput 11, 133–149 (2008). https://doi.org/10.1007/s10586-007-0038-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-007-0038-3

Keywords

Search

Navigation