Abstract
Performing runtime parallelization on general networks of workstations (NOWs) without special hardware or system software supports is very difficult, especially for DOACROSS loops. With the high communication overhead on NOWs, there is hardly any performance gain for runtime parallelization, due to the latter's large amount of messages for dependence detection, data accesses, and computation scheduling. In this paper, we introduce the EXPLORER system for runtime parallelization of DOACROSS and DOALL loops on general NOWs. EXPLORER hides the communication overhead on NOWs through multithreading — a facility supported in almost all workstations. A preliminary version of EXPLORER was implemented on a NOW consisting of eight DEC Alpha workstations connected through an Ethernet. The Pthread package was used to support multithreading. Experiments on synthetic loops showed speedups of up to 6.5 in DOACROSS loops and 7 in DOALL Loops.
This work was supported in part by the National Science Council under Grant NSC86-2213-E-007-043 and NCHC-86-08-024.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
T. E. Anderson, D. E. Culler, D. A. Patterson, “A case for networks of workstations: NOW,” IEEE Micro 94.
D. K. Chen, J. Torrelas, and P. C. Yew, “An efficient algorithm for the run-time parallelization of DOACROSS loops,” Proc. of Supercomputing 1994, pp.518–527, November 1994.
R. Das, M. Uysal, J. Saltz, and Y. S. Hwang, “Communication optimizations for irregular scientific computations on distributed memory architectures,” Jorunal of Parallel and Distributed Computing, 22(3), pp. 462–479, September 1994.
C. Fu and T. Yang, “Run-time compilation for parallel sparse matrix computations,” Proc. of the 10th ACM International Conference on Supercomputing, pp.237–244, May 1996.
C. Fu and T. Yang, “Efficient run-time support for irregular task computations with Mixed granularities,” Proc. of 10th International Parallel Processing Symposium — IPPS'96, pp.823–830, April 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, YL., King, CT. (1997). EXPLORER: Supporting run-time parallelization of DO-ACROSS loops on general networks of workstations. In: Bilardi, G., Ferreira, A., Lüling, R., Rolim, J. (eds) Solving Irregularly Structured Problems in Parallel. IRREGULAR 1997. Lecture Notes in Computer Science, vol 1253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63138-0_10
Download citation
DOI: https://doi.org/10.1007/3-540-63138-0_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63138-5
Online ISBN: 978-3-540-69157-0
eBook Packages: Springer Book Archive