Skip to main content
SpringerLink
Log in

Performance-based dynamic loop scheduling in heterogeneous computing environments

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

With the rapid advance of computing technologies, it becomes more and more common to construct high-performance computing environments with heterogeneous commodity computers. Previous loop scheduling schemes were not designed for this kind of environments. Therefore, better loop scheduling schemes are needed to further increase the performance of the emerging heterogeneous PC cluster environments. In this paper, we propose a new heuristic for the performance-based approach to partition loop iterations according to the performance weighting of cluster/grid nodes. In particular, a new parameter is proposed to consider HPCC benchmark results as part of performance estimation. A heterogeneous cluster and grid were built to verify the proposed approach, and three kinds of application program were implemented for execution on cluster testbed. Experimental results show that the proposed approach performs better than the previous schemes on heterogeneous computing environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Baker M, Buyya R (2002) Cluster computing: the commodity supercomputer. Softw Pract Exp 29(6):551–575, 1999

    Article  Google Scholar 

  2. Beaumont O, Casanova H, Legrand A, Robert Y, Yang Y (2005) Scheduling divisible loads on star and tree networks: results and open problems. IEEE Trans Parall Distrib Syst 16:207–218

    Article  Google Scholar 

  3. Bennett BH, Davis E, Kunau T, Wren W (2000) Beowulf parallel processing for dynamic load-balancing. Proc IEEE Aerosp Conf 4:389–395

    Google Scholar 

  4. Bohn CA, Lamont GB (2002) Load balancing for heterogeneous clusters of PCs. Future Gener Comput Syst 18:389–400

    Article  Google Scholar 

  5. Challenge Benchmark HPC. http://icl.cs.utk.edu/hpcc/

  6. Cheng K-W, Yang C-T, Lai C-L, Chang S-C (2004) A parallel loop self-scheduling on grid computing environments. In: Proceedings of the 2004 IEEE international symposium on parallel architectures, algorithms and networks, KH, China, May 2004, pp 409–414

  7. Chronopoulos AT, Andonie R, Benche M, Grosu D (2001) A class of loop self-scheduling for heterogeneous clusters. In: Proceedings of the 2001 IEEE international conference on cluster computing, pp 282–291

  8. Hummel SF, Schonberg E, Flynn LE (1992) Factoring: a method scheme for scheduling parallel loops. Commun ACM 35:90–101

    Article  Google Scholar 

  9. Introduction to the Mandelbrot Set, http://www.ddewey.net/mandelbrot/

  10. Li H, Tandri S, Stumm M, Sevcik KC (1993) Locality and loop scheduling on NUMA multiprocessors. In: Proceedings of the 1993 international conference on parallel processing, vol II, pp 140–147

  11. Polychronopoulos CD, Kuck D (1987) Guided self-scheduling: a practical scheduling scheme for parallel supercomputers. IEEE Trans Comput 36(12):1425–1439

    Article  Google Scholar 

  12. Post E, Goosen HA (2001) Evaluation of the parallel performance of a heterogeneous system. In: Proceedings of 5th international conference and exhibition on high-performance computing in the Asia-Pacific region (HPC Asia 2001)

  13. Shih W-C, Yang C-T, Tseng S-S (2005) A performance-based parallel loop self-scheduling on grid environments. In: Network and parallel computing: IFIP international conference, NPC 2005. Lecture notes in computer science, vol 3779. Springer, Berlin, pp 48–55

    Google Scholar 

  14. Shih W-C, Yang C-T, Tseng S-S (2005) A hybrid parallel loop scheduling scheme on grid environments. In: Grid and cooperative computing: 4th international conference, GCC 2005. Lecture notes in computer science, vol 3795. Springer, Berlin, pp 370–381

    Chapter  Google Scholar 

  15. Shih W-C, Yang C-T, Tseng S-S (2005) A hybrid parallel loop scheduling scheme on heterogeneous PC clusters. In: Proceedings of the 6th international conference on parallel and distributed computing, applications and technologies (PDCAT 2005), December 5–8, 2005, pp 56–58

  16. Shih W-C, Yang C-T, Tseng S-S (2006) A performance-based approach to dynamic workload distribution for master–slave applications on grid environments. In: GPC 2006. Lecture notes in computer science, vol 3947. Springer, Berlin, pp 73–82

    Google Scholar 

  17. Shih W-C, Yang C-T, Tseng S-S (2007) A performance-based parallel loop scheduling on grid environments. J Supercomput 41(3):247–267

    Article  Google Scholar 

  18. Sterling T, Bell G, Kowalik JS (2002) Beowulf cluster computing with Linux. MIT Press, Cambridge

    Google Scholar 

  19. Tang P, Yew PC (1986) Processor self-scheduling for multiple-nested parallel loops. In: Proceedings of the 1986 international conference on parallel processing, pp 528–535

  20. The Scalable Computing Laboratory (SCL), http://www.scl.ameslab.gov/

  21. Tzen TH, Ni LM (1993) Trapezoid self-scheduling: A practical scheduling scheme for parallel compilers. IEEE Trans Parallel Distrib Syst 4:87–98

    Article  Google Scholar 

  22. Yang C-T, Chang S-C (2004) A parallel loop self-scheduling on extremely heterogeneous PC clusters. J Inf Sci Eng 20(2):263–273

    Google Scholar 

  23. Yang C-T, Cheng K-W, Li K-C (2004) An efficient parallel loop self-scheduling on grid environments. In: Jin H, Gao G, Xu Z (eds) NPC’2004 IFIP international conference on network and parallel computing. Lecture notes in computer science, vol 3222. Springer, Heidelberg, pp 92–100

    Google Scholar 

  24. Yang C-T, Cheng K-W, Li K-C (2005) An enhanced parallel loop self-scheduling scheme for cluster environments. J Supercomput 34(3):315–335

    Article  Google Scholar 

  25. Yang C-T, Cheng K-W, Shih W-C (2007) On development of an efficient parallel loop self-scheduling for grid computing environments. Parallel Comput 33(7–8):467–487

    Article  Google Scholar 

  26. Yang C-T, Shih W-C, Tseng S-S (2007) Dynamic partitioning of loop iterations on heterogeneous PC clusters. J Supercomput 44(1):1–23

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. High-Performance Computing Laboratory, Department of Computer Science, Tunghai University, Taichung, 40704, Taiwan, R.O.C.

    Chao-Tung Yang & Lung-Hsing Cheng

  2. Department of Information Science and Applications, Asia University, Taichung, 41354, Taiwan, R.O.C.

    Wen-Chung Shih

Authors
  1. Chao-Tung Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen-Chung Shih
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lung-Hsing Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao-Tung Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, CT., Shih, WC. & Cheng, LH. Performance-based dynamic loop scheduling in heterogeneous computing environments. J Supercomput 59, 414–442 (2012). https://doi.org/10.1007/s11227-010-0443-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-010-0443-x

Keywords

Search

Navigation