Abstract
The performance of SPMD programs is strongly affected by dynamic load imbalancing factors. The use of a suitable load balancing algorithm is essential for overcoming the effects of these imbalancing factors. In this work, we evaluate the performance of a scientific SPMD parallel application when executed on a computational grid, with different kinds of load balancing strategies. The developed SPMD application computes the macroscopic thermal dispersion in porous media. A set of experiments was conducted on a computational grid composed by two geographically separated clusters. The main contribution of this work is the performance evaluation and comparison of a large variety of load balancing techniques under dynamic environment conditions. The experimental results showed the importance of choosing appropriate load balancing strategies when developing SPMD applications on a grid environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aida, K., Futakata, Y., Hara, S.: High-Performance Parallel and Distributed Computing for the BMI Eigenvalue Problem. In: Proceedings of the 16th International Parallel and Distributed Processing Symposium (2002), CD-ROM/Abstracts
Cao, J., Spooner, D.P., Jarvis, S.A., Saini, S., Nudd, G.R.: Agent-based Grid Load Balancing using Performance-driven Task Scheduling. In: Proceedings of 17th International Parallel and Distributed Processing Symposium (2003), CDROM/ Abstracts
Berman, F., Wolski, R., Figueira, S., Schopf, J., Shao, G.: Application Level Scheduling on Distributed Heterogeneous Networks. In: Proceedings of Supercomputing (1996)
Dijkstra, E., Seijen, W., Gasteren, A.: Derivation of a Termination Detection Algorithm for a Distributed Computation. Information Processing Letters 16, 217–219 (1983)
Foster, I.: The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, San Francisco (1998)
Franklin, M.A., Govindan, V.: A General Matrix Iterative Model for Dynamic Load Balancing. Parallel Computing 22, 969–989 (1996)
Furuichi, M., Taki, K., Ichiyoshi, N.: A Multi-Level Load Balancing Scheme for Or-Parallel Exhaustive Search Programs on the Multi-Psi. In: Proceedings of the II ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 50–59 (1990)
Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Pattern - Elements of Reusable Object Oriented Software. Addison-Wesley, Reading (1994)
Goux, J.-P., Kulkarni, S., Yoder, M., Linderoth, J.: An Enabling Framework for Master-Worker Applications on the Computational Grid. In: Proceedings of the Ninth IEEE International Symposium on High Performance Distributed Computing (2000)
Heymann, E., Senar, M.A., Luque, E., Livny, M.: Adaptive Scheduling for Master-Worker Applications on the Computational Grid. In: Proceedings of the First IEEE/ACM International Workshop on Grid Computing, pp. 214–227 (2000)
Lifschitz, S., Plastino, A., Ribeiro, C.C.: Exploring Load Balancing in Parallel Processing of Recursive Queries. In: Lengauer, C., Griebl, M., Gorlatch, S. (eds.) Euro-Par 1997. LNCS, vol. 1300, pp. 1125–1129. Springer, Heidelberg (1997)
Mattson, T.G.: Scientific Computation. In: Zomaya, A.Y. (ed.) Handbook in Parallel and Distributed Computing, pp. 981–1002. McGraw-Hill, New York (1996)
Moyne, C., Didierjean, S., Souto, H.P.A., da Silveira Filho, O.T.: Thermal Dispersion in Porous Media: One-Equation Model. International Journal of Heat and Mass Transfer 43, 3853–3867 (2000)
Plastino, A., Ribeiro, C.C., Rodriguez, N.: A Tool for SPMD Application Development with Support for Load Balancing. In: Proceedings of the International Conference ParCo 1999, pp. 639–646. Imperial College Press, UK (2000)
Plastino, A., Ribeiro, C.C., Rodriguez, N.: A Framework for SPMD Applications with Load Balancing. In: Proceedings of the XII Brazilian Symposium on Computer Architecture and High Performance Computing, pp. 245–252 (2000)
Plastino, A., Ribeiro, C.C., Rodriguez, N.: Developing SPMD Applications with Load Balancing. Parallel Computing 29, 743–766 (2003)
Plastino, A., Thomé, V., Vianna, D., Costa, R., da Silveira Filho, O.T.: Load Balancing in SPMD Applications: Concepts and Experiments. In: Yang, L.T., Pan, Y. (eds.) High Performance Scientific and Engineering Computing: Hardware/Software Support, pp. 95–107. Kluwer Academic Publishers, Dordrecht (2004)
Pree, W.: Design Patterns for Object-Oriented Software Development. Addison-Wesley, Reading (1995)
Pree, W.: Framework Patterns. SIG Books & Multimedia (1996)
Quinn, M.J.: Parallel Computing: Theory and Practice. McGraw-Hill, New York (1994)
Rumbaugh, J., Blaha, M., Premerlani, W., Eddy, F., Lorensen, W.: Object Oriented Modeling and Design. Prentice-Hall, Englewood Cliffs (1991)
Shao, G., Berman, F., Wolski, R.: Master/Slave Computing on Grid. In: Proceedings of the 9th Heterogeneous Computing Workshop, pp. 3–16 (2001)
Souto, H.P.A., da Silveira Filho, O.T., Moyne, C., Didierjean, S.: Thermal Dispersion in Porous Media: Computations by the Random Walk Method. Computational and Applied Mathematics 21, 513–543 (2002)
Thomé, V., Vianna, D., Costa, R., Plastino, A., da Silveira Filho, O.T.: Exploring Load Balancing in a Scientific SPMD Parallel Application. In: Proceedings of the IV International Workshop on High Performance Scientific and Engineering Computing with Applications in conjunction with the XXXI International Conference on Parallel Processing, pp. 419–426 (2002)
Willebeek-LeMair, M.A., Reeves, A.P.: Strategies for Dynamic Load Balancing on Highly Parallel Computers. IEEE Transactions on Parallel and Distributed Systems 4, 979–993 (1993)
Zaki, M.J., Li, W., Parthasarathy, S.: Customized Dynamic Load Balancing for a Network of Workstations. Journal of Parallel and Distributed Computing 43, 156–162 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oliveira, A., Argolo, G., Iglesias, P., Martins, S., Plastino, A. (2005). Evaluating a Scientific SPMD Application on a Computational Grid with Different Load Balancing Techniques. In: Ramos, F.F., Larios Rosillo, V., Unger, H. (eds) Advanced Distributed Systems. ISSADS 2005. Lecture Notes in Computer Science, vol 3563. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11533962_27
Download citation
DOI: https://doi.org/10.1007/11533962_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28063-7
Online ISBN: 978-3-540-31674-9
eBook Packages: Computer ScienceComputer Science (R0)