Abstract
An effective workload distribution has a prime rule on reducing the total execution time of a parallel application on heterogeneous environments, such as computational grids and heterogeneous clusters. Several methods have been proposed in the literature by many researchers in the last decade. This paper presents two approaches to workload distribution based on analytical models developed to performance prediction of parallel applications, named PEMPIs VRP (Vector of Relative Performances). The workload is distributed based on relative performance ratios, obtained by these models. In this work, we present two schemes, static and dynamic, in a research middleware for a heterogeneous network of computers. In the experimental tests we evaluated and compared them using two MPI applications. The results show that, using the VRP’s dynamic strategy, we can reduce the imbalance, among the execution time of the processes, in relation to average time from 25% to near of 5%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Németh, Z., Sunderam, V.: Characterizing grids: Attributes, definitions, and formalisms. Journal of Grid Computing 1(1), 9–23 (2003)
Foster, I., Kesselman, C., Nick, J.M., Tuecke, S.: The physiology of the grid: An open grid services architecture for distributed systems integration. Technical Report OGSI WG, Global Grid Forum (June 2002)
Snir, M., Otto, S.: MPI — The Complete Reference: The MPI Core. MIT Press, Cambridge (1998)
Gropp, W., Huss-Lederman, S., Lumsdaine, A., Lusk, E., Nitzberg, B., Saphir, W., Snir, M.: MPI — The Complete Reference: the MPI-2 Extensions, vol. 2. MIT Press, Cambridge (1998)
Polychronopoulos, C.D., Kuck, D.J.: Guided self-scheduling: a practical scheduling scheme for parallel supercomputers. IEEE Transactions on Computers C-36(12), 1425–1439 (1987)
Tzen, T.T., Ni, L.M.: Trapezoidal self-scheduling: A practical scheduling scheme for parallel compilers. IEEE Transactions on Parallel and Distributed Systems 4(1), 87–98 (1993)
Shih, W.C., Yang, C.T., Tseng, S.S.: A performance-based approach to dynamic workload distribution for master-slave applications on grid environments. In: GPC 73–82 (2006)
Yang, C.T., Shih, W.C., Tseng, S.S.: A dynamic partitioning self-scheduling scheme for parallel loops on heterogeneous clusters. In: International Conference on Computational Science, vol. 1, pp. 810–813 (2006)
Yang, C.T., Chang, S.C.: A parallel loop self-scheduling on extremely heterogeneous pc clusters. In: International Conference on Computational Science, pp. 1079–1088 (2003)
Li, H., Tandri, S., Stumm, M., Sevcik, K.C.: Locality and loop scheduling on NUMA multiprocessors. In: Proceedings of the 1993 International Conference on Parallel Processing. Volume II - Software, pp. II-140–II-147. CRC Press, Boca Raton (1993)
Buyya, R.: High Performance Cluster Computing: Architectures and Systems. Prentice Hall PTR, Upper Saddle River (1999)
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers Inc., San Francisco (2003)
Midorikawa, E.T., Oliveira, H., Laine, J.M.: Pempis: A new methodology for modeling and prediction of mpi programs performance. International Journal of Parallel Programming 33(5), 499–527 (2005)
Franklin, M., Govindan, V.: The n-body problem: Distributed system load balancing and performance evaluation. Technical Report 93-16, Department of Computer Science and Engineering, Washington University, St. Louis (2003)
Vraalse, F., Aydt, R.A., Mendes, C.L., Reed, D.A.: Performance contracts: Predicting and monitoring grid application behavior. In: Lee, C.A. (ed.) GRID 2001. LNCS, vol. 2242, pp. 154–165. Springer, Heidelberg (2001)
Ribler, R.L., Vetter, J.S., Simitci, H., Reed, D.A.: Autopilot: Adaptive control of distributed applications. In: 7th IEEE Symposium on High-Performance Distributed Computing (HPDC), pp. 172–179 (1998)
Ciorba, F.M., Andronikos, T., Riakiotakis, I., Chronopoulos, A.T., Papakonstantinou, G.: Dynamic multi phase scheduling for heterogeneous clusters. In: IPDPS 2006. 20th International Parallel and Distributed Processing Symposium, Rhodes Island, Greece, p. 10. IEEE Computer Society Press, Los Alamitos (2006)
Banicescu, I., Carino, R.L., Pabico, J.P., Balasubramaniam, M.: Overhead analysis of a dynamic load balancing library for cluster computing. In: 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2005) - Workshop 1, Washington, DC, USA, IEEE Computer Society Press, Los Alamitos (2005)
Penmatsa, S., Chronopoulos, A.T.: Cooperative load balancing for a network of heterogeneous computers. In: 20th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2006), 15th Heterogeneous Computing Workshop, p. 10. IEEE Computer Society Press, Los Alamitos (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Laine, J.M., Midorikawa, E.T. (2007). Using Analytical Models to Load Balancing in a Heterogeneous Network of Computers. In: Malyshkin, V. (eds) Parallel Computing Technologies. PaCT 2007. Lecture Notes in Computer Science, vol 4671. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73940-1_56
Download citation
DOI: https://doi.org/10.1007/978-3-540-73940-1_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73939-5
Online ISBN: 978-3-540-73940-1
eBook Packages: Computer ScienceComputer Science (R0)