Skip to main content
Springer Nature Link
Log in

An Enhanced Parallel Loop Self-Scheduling Scheme for Cluster Environments

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Approaches for dealing with scheduling and load-balancing in PC-based cluster systems are famous and well known. In such environments, Self-Scheduling Schemes are suitable for parallel loops with independent iterations. However, while schemes such as FSS, GSS, and TSS fit most computer systems, they cannot provide good load-balancing. Chao-Tung Yang and Shun-Chi Chang proposed a parallel loop scheduling scheme for heterogeneous PC cluster systems in Yang and Chang [13]. Though the proposed scheme allows users to choose parameters before execution initialization, weaknesses in it motivated us to develop further improvements. For instance, using fixed and monotonous parameters can easily lead to invalid scheduling due to use of previously input information. Thus, in this paper we propose a new scheme that fits most widely available computer systems and allows the scheduling parameter to be adjusted dynamically in order to provide higher overall performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. C. A. Bohn and G. B. Lamont. Load balancing for heterogeneous clusters of PCs. Future Generation Computer Systems, 18:389–400, 2002.

    Article  Google Scholar 

  2. A. T. Chronopoulos, R. Andonie, M. Benche, and D. Grosu. A class of loop self-scheduling for heterogeneous clusters. In Proceedings of 3rd IEEE International Conference on Cluster Computing CLUSTER 2001), pp.282–291, 2001.

  3. Y.-W. Fann, C.-T. Yang, S.-S. Tseng, and C.-J. Tsai. An intelligent parallel loop scheduling for multiprocessor systems. Journal of Information Science and Engineering-Special Issue on Parallel and Distributed Computing, 16(2):169–200, 2000.

    Google Scholar 

  4. A. S. Grimshaw. Meta-Systems: An Approach Combining Parallel Processing and Heterogeneous Distributed Computing Systems. In Workshop on Heterogeneous Processing, International Parallel Processing Symposium, pp. 54–59, 1992.

  5. http://hint.byu.edu/

  6. S. F. Hummel, E. Schonberg, and L. E. Flynn. Factoring: A method scheme for scheduling parallel loops. Communications of the ACM, 35(8):90–101, 1992.

    Article  Google Scholar 

  7. H. Li, S. Tandri, M. Stumm, and K. C. Sevcik. Locality and loop scheduling on NUMA multiprocessors. In Proceedings of International Conference on Parallel Processing, vol.II, pp.140–147, 1993.

    Google Scholar 

  8. C. D. Polychronopoulos and D. Kuck. Guided self-scheduling: A practical scheduling scheme for parallel supercomputers. IEEE Transactions on Computers, 36:1425–1439, 1987.

    Google Scholar 

  9. E. Post and H. A. Goosen. Evaluating the parallel performance of a heterogeneous system. In Proceedings of 5th International Conference and Exhibition on High-Performance Computing in the Asia-Pacific Region (HPC Asia 2001), http://parallel.hpc.unsw.edu.au/HPCAsia/papers/12.pdf.

  10. V. S. Sunderam. PVM: A Framework for Parallel Distributed Computing. Concurrency: Practice and Experience, 2(4):315–339, 1990.

    Google Scholar 

  11. P. Tang and P. C. Yew. Processor self-scheduling for multiple-nested parallel loops. In Proceedings of International Conference on Parallel Processing (ICPP’86), pp. 528–535, 1986.

  12. T. H. Tzen and L. M. Ni. Trapezoid self-scheduling: A practical scheduling scheme for parallel compilers, IEEE Transactions on Parallel and Distributed Systems, 4:87–98, 1993.

    Article  Google Scholar 

  13. Chao-Tung Yang and Shun-Chyi Chang. A Parallel Loop Self-Scheduling on Extremely Heterogeneous PC Clusters. Journal of Information Science and Engineering, 20(2):263–273, 2004.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung City, 40704, Taiwan, R.O.C.

    Chao-Tung Yang & Kuan-Wei Cheng

  2. Parallel and Distributed Processing Center, Department of Computer Science and Information Management, Providence University, Taichung County, 43301, Taiwan, R.O.C.

    Kuan-Ching Li

Authors
  1. Chao-Tung Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Kuan-Wei Cheng
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Kuan-Ching Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Chao-Tung Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, CT., Cheng, KW. & Li, KC. An Enhanced Parallel Loop Self-Scheduling Scheme for Cluster Environments. J Supercomput 34, 315–335 (2005). https://doi.org/10.1007/s11227-005-0787-9

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-005-0787-9

Keywords