Abstract
In a multicluster architecture, where jobs can be submitted through each constituent cluster, the job arrival rates in individual clusters may be uneven and the load therefore needs to be balanced among clusters. In this paper we investigate load balancing for two types of jobs, namely non-QoS and QoS-demanding jobs and as a result, two performance-specific load balancing strategies (called ORT and OMR) are developed. The ORT strategy is used to obtain the optimised mean response time for non-QoS jobs and the OMR strategy is used to achieve the optimised mean miss rate for QoS-demanding jobs. The ORT and OMR strategies are mathematically modelled combining queuing network theory to establish sets of optimisation equations. Numerical solutions are developed to solve these optimisation equations, and a so called fair workload level is determined for each cluster. When the current workload in a cluster reaches this pre-calculated fair workload level, the jobs subsequently submitted to the cluster are transferred to other clusters for execution. The effectiveness of both strategies is demonstrated through theoretical analysis and experimental verification. The results show that the proposed load balancing mechanisms bring about considerable performance gains for both job types, while the job transfer frequency among clusters is considerably reduced. This has a number of advantages, in particular in the case where scheduling jobs to remote resources involves the transfer of large executable and data files.
This work is sponsored in part by grants from the NASA AMES Research Center (administrated by USARDSG, contract no. N68171-01-C-9012), the EPSRC (contract no. GR/R47424/01) and the EPSRC e-Science Core Programme (contract no. GR/S03058/01).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aumage, O.: Heterogeneous multi-cluster networking with the Madeleine III. In: International Parallel and Distributed Processing Symposium, IPDPS 2002 (2002)
Banen, S., Bucur, A.I.D., Epema, D.H.J.: A Measurement-Based Simulation Study of Processor Co-Allocation in Multicluster Systems. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) Ninth Workshop on Job Scheduling Strategies for Parallel Processing (2003)
Barreto, M., Avila, R., Navaux, P.: The MultiCluster model to the integrated use of multiple workstation clusters. In: Proc. of the 3rd Workshop on Personal Computer-based Networks of Workstations, pp. 71–80 (2000)
Bolch, G.: Performance Modeling of Computer Systems (2002)
Bucur, A.I.D., Epema, D.H.J.: The maximal utilization of processor co-allocation in multicluster Systems. In: Int’l Parallel and Distributed Processing Symp. (IPDPS 2003), pp. 60–69 (2003)
Buyya, R., Baker, M.: Emerging Technologies for Multicluster/Grid Computing. In: Proceedings of the 2001 IEEE International Conference on Cluster Computing (2001)
Cao, J., Kerbyson, D.J., Nudd, G.R.: Performance Evaluation of an Agent-Based Resource Management Infrastructure for Grid Computing. In: Proceedings of 1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001 (2001)
Chanson, S.T., Deng, W., Hui, C., Tang, X., To, M.: Multidomain Load Balancing. In: International Conf. on Network Protocols, Japan (2000)
He, L., Jarvis, S.A., Spooner, D.P., Nudd, G.R.: Optimising static workload allocation in multiclusters. In: Proceedings of 18th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2004 (2004)
Kao, B., Garcia-Molina, H.: Scheduling soft real-time jobs over dual non-real-time servers. IEEE Trans. on Parallel and Distributed Systems 7(1), 56–68 (1996)
Kleinrock, L.: Queueing system. John Wiley & Sons, Chichester (1975)
Tang, X.Y., Chanson, S.T.: Optimizing static job scheduling in a network of heterogeneous computers. In: The 29th International Conference on Parallel Processing (2000)
Wu, M.: On Runtime Parallel Scheduling for Processor Load Balancing. IEEE Transaction on Parallel and Distributed Systems 8(2), 173–186 (1997)
Zhu, W.: Scheduling soft real-time tasks on cluster. In: Proc. of 1999 Annual Australian Parallel and Real-Time Conference (1999)
Zhu, W., Fleisch, B.: Performance evaluation of soft real-time scheduling on a multicomputer cluster. In: The 20th International Conference on Distributed Computing Systems, ICDCS 2000 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
He, L., Jarvis, S.A., Bacigalupo, D., Spooner, D.P., Nudd, G.R. (2004). Performance-Aware Load Balancing for Multiclusters. In: Cao, J., Yang, L.T., Guo, M., Lau, F. (eds) Parallel and Distributed Processing and Applications. ISPA 2004. Lecture Notes in Computer Science, vol 3358. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30566-8_75
Download citation
DOI: https://doi.org/10.1007/978-3-540-30566-8_75
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24128-7
Online ISBN: 978-3-540-30566-8
eBook Packages: Computer ScienceComputer Science (R0)