Abstract
We have built an eight node SMP cluster called COMPaS (Cluster Of Multi-Processor Systems), each node of which is a quadprocessor Pentium Pro PC. We have designed and implemented a remote memory based user-level communication layer which provides lowover-head and high bandwidth using Myrinet. We designed a hybrid programming model in order to take advantage of locality in each SMP node. Intra-node computations utilize a multi-threaded programming style (Solaris threads) and inter-node programming is based on message passing and remote memory operations. In this paper we report on this hybrid shared memory/distributed memory programming on COMPaS and its preliminary evaluation. The performance of COMPaS is affected by data size and access patterns, and the proportion of inter-node communication. If the data size is small enough to all fit on the cache, parallel efficiency exceeds 1.0 using the hybrid programming model on COMPaS. But the performance is limited by the low memory bus bandwidth of PC-based SMP nodes for some memory intensive workloads.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
“Pentium Pro Cluster Workshop”, http://www.scl.ameslab.gov/workshops/.
N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic and S. Wen-King, “Myrinet — A Gigabit-per-Second Local-Area Network,” IEEE MICRO, Vol. 15, No. 1, pp. 29–36 (1996).
H. Tezuka, A. Hori, Y. Ishikawa and M. Sato, “PM: An Operating System Coordinated High Performance Communication Library”, High-Performance Computing and Networking, Lecture Notes in Computer Science, Vol. 1225, pp. 708–717, Springer-Verlag (1997).
“TheMessaging Passing Interface (MPI) standard”, http://www.mcs.anl.gov/mpi/index.html.
W. Gropp and E. Lusk, “MPICH Working Note: Creating a new MPICH device using the Channel interface”, Argonne National Laboratory Technical Report (1995).
T.von Eicken, D.E.Culler, S.C.Goldstein and K.E.Schauser, “Active Messages: a Mechanism for Integrated Communication and Computation”, Proc. 19th Int'l Symp. on Computer Architecture, pp. 256–266 (1992).
M. Matsuda, H. Tezuka, Y. Tanaka, K. Kubota, M. Ando and M. Sato, “Network Interface Active Messages on SMP Clusters” Proc. IPSJ SIGARC, Vol. 97, No. 76, pp. 55–60 (1997) (in Japanese).
Y. Kodama, H. Sakane, H. Koike, M. Sato, S. Sakai, and Y. Yamaguchi, “Parallel Execution of Radix Sort Program Using Fine-Grain Communication”, Proc. PACT'97, pp. 136–145 (1997).
“Scalable Clusters of Commodity Computers”, http://www-csag.cs.uiuc.edu/projects/clusters.html.
Thomas E. ANderson, David E. Culler, David A. Patterson and the NOW Team. “A Case for Networks of Workstations: NOW”, IEEE Micro (1995).
“The Jazznet Project”, http://math.nist.gov/jazznet/index.html.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tanaka, Y., Matsuda, M., Ando, M., Kubota, K., Sato, M. (1998). COMPaS: A pentium Pro PC-based SMP cluster and its experience. In: Rolim, J. (eds) Parallel and Distributed Processing. IPPS 1998. Lecture Notes in Computer Science, vol 1388. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64359-1_722
Download citation
DOI: https://doi.org/10.1007/3-540-64359-1_722
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64359-3
Online ISBN: 978-3-540-69756-5
eBook Packages: Springer Book Archive