Abstract
This paper presents a new implementation of MPI on a cluster of Linux-based, dual-processor PCs interconnected by a Myricom high speed network. A survey of existing software for this hardware configuration resulted in the non-availability of a fully functional, correct and complete MPI library exploiting the full hardware potential. Our library uses MPICH for the high level protocol and FM/HPVM for the basic communications layer. It allows multiple processes and multiple users on the same PC, and passes an extensive test suite, including all test programs from the MPICH distribution, for both C and Fortran. The presented benchmarks, both simple communication kernels and full applications, show good performance. The result is the first high-performance MPI interface which allows regular multi-user service for applications on our PC cluster.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beowulf Project at CESDIS, http://cesdis.gsfc.nasa.gov/linux/beowulf/beowulf.html .
Butenhof, D.R.: Programming with POSIX Threads. Addison-Wesley, 1997.
Chien, A., Pakin, S., Lauria, M., Buchanan, M., Hane K., Giannini, L., Prusakova, J.: High Performance Virtual Machines (HPVM): Clusters with Supercomputing APIs and Performance. Eighth SIAM Conference on Parallel Processing for Scientic Computing (PP97). March, 1997.
Dubnicki, C., Bilas, A., Li, K., Philbin, J.: Design and Implementation of Virtual Memory-Mapped Communication on Myrinet. NECI Technical Report. October, 1996.
Edler, J., Gottlieb, A., Philbin, J.: The NECI LAMP: What, Why, and How. Heterogeneous Computing and Multi-Disciplinary Applications: Proceedings of the eighth NEC Research Symposium.
GigaBit Ethernet with Linux, http://cesdis.gsfc.nasa.gov/linux/drivers/yellow_n.html .
Gropp, W., Lusk, E.: A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard. http://www.mcs.anl.gov/mpi/mpicharticle/paper.html .
Gropp, W., Lusk, E.: MPICH Working Note: The implementation of the second generation MPICH ADI. ANL.
Gustavson, D.: The scalable coherent interface and related standards projects. IEEE Micro, 12(1), February, 1992.
Hempel, R., Ritzdorf, H.: The GMD communications subroutine library for grid-oriented problems. Arbeitspapiere der GMD Nr. 589, St. Augustin, 1991.
Henley G., Doss, N., McMahon, T., Skjellum, A.: BDM: A Multiprotocol Myrinet Control Program and Host Application Programmer Interface. Technical Report, Mississippi State University. May, 1997.
Koike, N.: NEC Cenju-3: A Microprocessor-Based Parallel Computer. Proceedings of IPPS. April, 1994.
Lauria, M., Pakin, S., Chien, A.: Efficient Layering for High Speed Communication: Fast Messages 2.x. Proceedings of the 7th High Performance Distributed Computing (HPDC7) conference. Chicago Illinois, July, 1998.
Leroy, X.: The LinuxThreads library. http://pauillac.inria.fr/~xleroy/linuxthreads/
Linden, J., Lonsdale, G., Ritzdorf, H., Shüller, A.: Scalability aspects of parallel multigrid. FGCS, 10 (1994).
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. June, 1995.
Message Passing Interface Forum: MPI-2: Extensions to the Message-Passing Interface. July, 1997.
Myrinet Documentation. http://www.myri.com/scs/documentation .
Pakin, S., Buchanan, M., Connelly, K., Lavery, A., Koenig, G., Giannini, L., Prusakova, J., Herman, G., Chien, A.: HPVM 1.0 User Documentation. August, 1997.
Philbin, J., Li, K.: Rationale and Requirements for Low Cost Scalable Servers and Parallel Processors. NECI Technical Note. March, 1995.
Prylli, L., Tourancheau, B.: BIP: a new protocol designed for high performance networking on Myrinet. Workshop PC-NOW, IPPS/SPDP98. Orlando, USA, 1998.
Ritzdorf, H., Hempel, R.: CLIC-The Communications Library for Industrial Codes Development at GMD-SCAI. http://www.gmd.de/SCAI/num/clic/clic.html .
Ritzdorf, H., Schüller, A., Steckel, B., Stüben, K.: LiSS-An environment for the parallel multigrid solution of partial differential equations on general 2D domains. Parallel Computing, 20 (1994).
Snir, M., Otto, S.W., Huss-Lederman, S., Walker, D.W., Dongarra, J.: MPI: The Complete Reference. MIT Press, 1996.
Thakur, R., Lusk, E., Gropp, W.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. ANL Technical Memorandum No. 234, October, 1997.
Warren, M.S., Becker, D.J., Goda, M.P., Salmon, J.K., Sterling, T.: Parallel Supercomputing with Commodity Components. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’97), 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Golebiewski, M., Baum, M., Hempel, R. (1999). High Performance Implementation of MPI for Myrinet. In: Zinterhof, P., Vajteršic, M., Uhl, A. (eds) Parallel Computation. ACPC 1999. Lecture Notes in Computer Science, vol 1557. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49164-3_49
Download citation
DOI: https://doi.org/10.1007/3-540-49164-3_49
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65641-8
Online ISBN: 978-3-540-49164-4
eBook Packages: Springer Book Archive