Abstract
Dynamic loop scheduling methods are suitable for balancing parallel loops on shared-memory multiprocessor machines. However, their centralized nature causes a bottleneck for relatively small number of processors in internet-wise parallel processing using computational grids because of the order-of-magnitude differences in communications overheads. Moreover, improvements of basic loop scheduling methods have not dealt effectively with irregularly distributed workloads in parallel loops, which commonly occur in large applications. In this paper, we present a decentralized balancing method, which tries to balance load and performance simultaneously, for parallel loops on computational grids.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. Open Grid Service Infrastructure WG, Global Grid Forum (2002)
Grimshaw, A., Wulf, A.: The Legion Vision of a Worldwide Virtual Computer. Communications of the ACM 40(1) (1997)
Tang, P., Yew, P.-C.: Processor Self-Scheduling for Multiple Nested Parallel Loops. In: Proceedings of International Conference on Parallel Processing (1986)
Kruskal, C.P., Weiss, A.: Allocating Independent Subtasks on Parallel Processors. IEEE Transactions on Software Engineering 11, 1001–1016 (1985)
Polychronopoulos, C.D., Kuck, D.J.: Guided Self-scheduling: A Practical Scheduling Scheme for Parallel Supercomputers. IEEE Transactions on Computer C-36(12), 1425–1496 (1987)
Tzen, T.H., Ni, L.M.: Dynamic Loop Scheduling for Shared-Memory Multiprocessors. In: Proceedings of International Conference on Parallel Processing (1991)
Cierniak, M., Li, W., Zaki, M.J.: Loop Scheduling for Heterogeneity. In: Proceedings of International Symposium on High Performance Distributed Computing (1995)
Krueger, P., Shivaratri, N.: Adaptive Location Policies for Global Scheduling. IEEE Transactions on Software Engineering 20(6) (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, TH. (2004). Load and Performance Balancing Scheme for Heterogeneous Parallel Processing. In: Zhang, J., He, JH., Fu, Y. (eds) Computational and Information Science. CIS 2004. Lecture Notes in Computer Science, vol 3314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30497-5_47
Download citation
DOI: https://doi.org/10.1007/978-3-540-30497-5_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24127-0
Online ISBN: 978-3-540-30497-5
eBook Packages: Computer ScienceComputer Science (R0)