Abstract
This paper describes an implementation of the Message Passing Interface (MPI) on the Portals 3.0 data movement layer. Portals 3.0 provides low-level building blocks that are flexible enough to support higher-level message passing layers such as MPI very efficiently. Portals 3.0 is also designed to allow for programmable network interface cards to offload message processing from the host processor. We will describe the basic building blocks in Portals 3.0, show how they can be put together to implement MPI, and describe the protcols of an MPI implementation. We will look at several key operations within an MPI implementation and describe the effects that a Portals 3.0 implementation has on scalability and performance.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract DE-AC04-94AL85000.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
N. Boden, D. Cohen, R.E. Felderman, A.E. Kulawik, C. L. Seitz, J.N. Seizovic, and W. Su. Myrinet-A Gigabit-Per-Second Local-Area Network. IEEE Micro, 15(1):29–36, February 1995.
R. Brightwell, W. Lawry, A. B. Maccabe, and R. Riesen. Portals 3.0: Protocol Building Blocks for Low Overhead Communication. In Proceedings of the 2002 Workshop on Communication Architecture for Clusters, April 2002.
R.B. Brightwell, T.B. Hudson, A.B. Maccabe, and R.E. Riesen. The Portals 3.0 Message Passing Interface. Technical Report SAND99-2959, Sandia National Laboratories, December 1999.
Compaq, Microsoft, and Intel. Virtual Interface Architecture Specification Version 1.0. Technical report, Compaq, Microsoft, and Intel, December 1997.
R. Dimitrov and A. Skjellum. An Efficient MPI Implementation for Virtual Interface (VI) Architecture-Enabled Cluster Computing. In Proceedings of the Third MPI Developers’ and Users’ Conference, pages 15–24, March 1999.
William Gropp, Ewing Lusk, Nathan Doss, and Anthony Skjellum. A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing, 22(6):789–828, September 1996.
Y. Ishikawa, H. Tezuka, and A. Hori. PM: A High-Performance Communication Library for Multi-user Parallel Envrionments. Technical Report Technical Report TR-96015, RWCP, 1996.
M. Lauria and A.A. Chien. MPI-FM: High Performance MPI on Workstation Clusters. Journal of Parallel and Distributed Computing, 40(1):4–18, January 1997.
A.B. Maccabe, K.S. McCurley, R.E. Riesen, and S.R. Wheat. SUNMOS for the Intel Paragon: A brief user’s guide. In Proceedings of the Intel Supercomputer Users’ Group. 1994 Annual North America Users’ Conference., pages 245–251, June 1994.
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. The International Journal of Supercomputer Applications and High Performance Computing, 8, 1994.
Myricom, Inc. The GM Message Passing System. Technical report, Myricom, Inc., 1997.
F. O’Carroll, A. Hori, H. Tezuka, and Y. Ishikawa. The Design and Implementation of Zero Copy MPI Using Commodity Hardware with a High Performance Network. In A CM SIGARCH ICS’98, pages 243–250, July 1998.
S. Pakin, V. Karamcheti, and A. A. Chien. Fast Messages (FM): Efficient, Portable Communication for Workstation Clusters and Massively Parallel Processors. IEEE Concurrency, 40(1):4–18, January 1997.
L. Prylli. BIP Messages User Manual for BIP 0.94. Technical report, LHPC, June 1998.
L. Prylli, B. Tourancheau, and R. Westrelin. The Design for a High Performance MPI Implementation on the Myrinet Network. In Proceedings of the 6th European PVM/MPI Users’ Group, pages 223–230, September 1999.
P. L. Shuler, C. Jong, R. E. Riesen, D. van Dresser, A. B. Maccabe, L. A. Fisk, and T. M. Stallcup. The Puma operating system for massively parallel computers. In Proceedings of the 1995 Intel Supercomputer User’s Group Conference. Intel Supercomputer User’s Group, 1995.
T. von Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A User-Level Network Interface for Parallel and Distributed Computing. In Proceedings of the Fifteenth SOSP, pages 40–53, December 1995.
T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser. Active Messages: A Mechanism for Integrated Communications and Computation. In Proceedings of the 19th International Symposium on Computer Architecture, May 1992.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brightwell, R., Maccabe, A.B., Riesen, R. (2002). Design and Implementation of MPI on Portals 3.0. In: Kranzlmüller, D., Volkert, J., Kacsuk, P., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2002. Lecture Notes in Computer Science, vol 2474. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45825-5_50
Download citation
DOI: https://doi.org/10.1007/3-540-45825-5_50
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44296-7
Online ISBN: 978-3-540-45825-8
eBook Packages: Springer Book Archive