Skip to main content
SpringerLink
Log in

Load balancing for regular data-parallel applications on workstation network

  • Conference paper
  • First Online:
Communication and Architectural Support for Network-Based Parallel Computing (CANPC 1997)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1199))

Abstract

A cluster of machines connected by a high-speed interconnection network is emerging as a new architecture for high-performance computing. Among the important issues that need to be addressed in this type of computing environment are adaptive load balancing and data partitioning. In this paper we discuss the parallelization of matrix multiplication and Gaussian elimination on adaptive and nonuniform environments. We present a simple strategy to reduce communication cost when remapping the arrays of these applications. We also develop CYCLIC distribution scheme for adaptive and nonuniform environments. Finally, we present performance results for the solution of the two applications on a cluster of heterogeneous workstations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Edjlali, G., Agrawal, G., Sussman, A., Saltz, J.: Data-Parallel Programming in An Adaptive Environment. Proceedings of International Parallel Processing Symposium. April (1995) 827–832.

    Google Scholar 

  2. Nedeljkovic, N., Quinn, M.: Data-Parallel Programming on a Network of Heterogeneous Workstations. Proceedings of the First International Symposium on High-Performance Distributed Computing. September (1992) 28–36

    Google Scholar 

  3. Kaddoura, M., Ranka, S., Wang, A.: Array Decompositions for Non-Uniform Computational Environments. Journal of Parallel and Distributed Computing. 36 (1996) 91–105.

    Google Scholar 

  4. kaddoura, M., Ranka, S.: Run-time Support for Parallelization of Data-Parallel Applications on Adaptive and Non-Uniform Computational Environments. Proceedings of High Performance Distributed Computing. August (1996) 30–39.

    Google Scholar 

  5. Keyser, J., Lust, K., Roose, D.: Run-Time Load Balancing Support for Parallel Multiblock Euler/Navier-Stokes Code with Adaptive Refinement on Distributed Memory Computers. Parallel Computing. 20 (1994) 1069–1088.

    Google Scholar 

  6. Siegell, B., Steenkiste, P.: Automatic Generation of Parallel Programs with Dynamic Load Balancing. Proceedings of the Third International Symposium on High-Performance Distributed Computing. August (1994) 166–175

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Architecture Technology Corporation, P.O Box 24344, 55424, Minneapolis, MN

    Maher Kaddoura

Authors
  1. Maher Kaddoura
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Dhabaleswar K. Panda Craig B. Stunkel

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kaddoura, M. (1997). Load balancing for regular data-parallel applications on workstation network. In: Panda, D.K., Stunkel, C.B. (eds) Communication and Architectural Support for Network-Based Parallel Computing. CANPC 1997. Lecture Notes in Computer Science, vol 1199. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62573-9_13

Download citation

  • DOI: https://doi.org/10.1007/3-540-62573-9_13

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-62573-5

  • Online ISBN: 978-3-540-68085-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation