Abstract
Heterogeneous clusters are becoming very popular for providing flexible, scalable and cost-effective solutions for high performance computing. An efficient resources utilization can significantly enhance cluster performance, specially in heterogeneous environments. So, load balancing is critical for achieving high performance in this systems. In this paper a dynamic, global, distributed, general purpose and automatically tuning itself off load balancing scheme is proposed for heterogeneous clusters. A new workload index is developed to take into account nodes heterogeneity. To verify and validate our approach, a complete set of experiments on a real heterogeneous cluster is presented too.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Xu, C., Lau, F.: Load Balancing in Parallel Computers: Theory and Practice. Kluwer Academic Publishers, Boston (1997)
Pfister, G.F.: In search of clusters: The Ongoing Battle in Lowly Parallel Computing, 2nd edn. (1995). Prentice Hall, Englewood Cliffs (1998) ISBN 0-13-899709-8, IBM
Bell, G., Gray, J.: What’s next in high-performance computing? Communications of the ACM 45(2), 91–95 (2002)
Snell, Q., Judd, G., Clement, M.: Load balancing in a heterogeneous supercomputing environment. In: Proc. 1998 International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 951–957 (1998)
Bohn, C.A., Lamont, G.B.: Asymmetric load balancing on a heterogeneous cluster of PCs. Future Generation Computer Systems 18(3), 389–400 (2002)
Rajagopalan, A., Hariri, S.: Anagent based dynamic load balancing system. In: International Workshop on Autonomous Decentralized Systems, pp. 164–171. IEEE, Los Alamitos (2000)
Obeloer, W., Grewe, C., Pals, H.: Load management with mobile agents. In: 24th Euromicro Conference, vol. 2, pp. 1005–1012. IEEE, Los Alamitos (1998)
Grosu, D., Chronopoulos, A., Leung, M.: Load balancing in distributed systems: an approach using cooperative games. In: 16th International Parallel and Distributed Processing Symposium IPDPS 2002, April 2002, pp. 52–53. IEEE, Los Alamitos (2002)
Kunz, T.: The influence of different workload descriptions on a heuristic load balancing scheme. IEEE Transactions on Software Engineering 17(7), 725–730 (1991)
Eager, D.L., Lazowska, E.D., Zahorjan, J.: Adaptive load sharing in homogeneous distributed systems. IEEE Transactions on Software Eng. 12, 662–675 (1986)
Shen, K., Yang, T., Chu, L.: Cluster load balancing for fine-grain network services. In: Proceedings of the International Parallel an Distributed Processing Symposium (IPDPS), pp. 51–58 (2002)
Willebeek-LeMair, M.H., Reeves, A.P.: Strategies for dynamic load balancing on highly parallel computers. IEEE Transactions on Parallel and Distributed Systems 4(9), 979–993 (1993)
Eager, D.L., Lazowska, E.D., Zahorjan, J.: a comparison of receiver initiated and senderinitiated dynamic load sharing. Technical Report 85-04-01, University ofWashington (1985)
MPI Forum. : A message-passing interface standard (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Beltrán, M., Guzmán, A., Bosque, J.L. (2004). Dynamic Tasks Assignment for Real Heterogeneous Clusters. In: Wyrzykowski, R., Dongarra, J., Paprzycki, M., Waśniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2003. Lecture Notes in Computer Science, vol 3019. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24669-5_115
Download citation
DOI: https://doi.org/10.1007/978-3-540-24669-5_115
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21946-0
Online ISBN: 978-3-540-24669-5
eBook Packages: Springer Book Archive