Skip to main content
Springer Nature Link
Log in

The Design of Seamless MPI Computing Environment for Commodity-Based Clusters

  • Conference paper
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 2009)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5759))

Abstract

This paper describes the design and implementation of a seamless MPI runtime environment, called MPI-Adapter, that realizes MPI program binary portability in different MPI runtime environments. MPI-Adapter enables an MPI binary program to run on different MPI implementations. It is implemented as a dynamic loadable module so that the module dynamically captures all MPI function calls and invokes functions defined in a different MPI implementation using the data type translation techniques. A prototype system was implemented for Linux PC clusters to evaluate the effectiveness of MPI-Adapter. The results of an evaluation on a Xeon Processor (3.8GHz) based cluster show that the MPI translation overhead of MPI sending (receiving) is around 0.028μs, and the performance degradation of MPI-Adapter is negligibly small on the NAS parallel benchmark IS.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. T2K Open Supercomputer Alliance, http://www.open-supercomputer.org/

  2. GSIC, http://www.gsic.titech.ac.jp/index.html.en

  3. RSCC: RIKEN Super Combined Cluster System, http://w3cic.riken.go.jp/rscc/

  4. Super Computer TOP500, http://www.top500.org/

  5. The Message Passing Interface (MPI) standard, http://www.mpi-forum.org/docs/docs.html

  6. The Message Passing Interface (MPI) Forum, http://www.mpi-forum.org

  7. OpenMPI, http://www.open-mpi.org/

  8. MPICH2, http://www.mcs.anl.gov/research/projects/mpich2/

  9. MPI ABI OpenMPI + MPICH2 + HPMPI + LAMPI + NEC + vendors.xls, https://svn.mpi-forum.org/trac/mpi-forum-web/attachment/wiki/abiwikipage/mpi%20abi%20openmpi%20%2b%20mpich2%20%2b%20hpmpi%20%2b%20lampi%%20%2b%20nec%20%2b%20vendors.xls

    Google Scholar 

  10. SCore Cluster System Software, http://www.pccluster.org/

  11. Sumimoto, S., Ooe, K., Kumon, K., Boku, T., Sato, M., Ukawa, A.: A Scalable Communication Layer for Multi-Dimensional Hyper Crossbar Network Using Multiple Gigabit Ethernet. In: The International Conference on Supercomputing 2006 (ICS 2006). ACM Press, New York (2006)

    Google Scholar 

  12. MorphMPI, http://morphmpi.sourceforge.net/

  13. Gropp, W.: Building library components that can use any mpi implementation. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J., Volkert, J. (eds.) PVM/MPI 2002. LNCS, vol. 2474, pp. 280–287. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  14. Application Binary Interface Working Group, https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/abiwikipage

Download references

Author information

Authors and Affiliations

  1. Fujitsu Laboratories, Ltd, 4-1-1, Kamikodanaka Nakahara-ku, Kawasaki, Kanagawa, 211-8588, Japan

    Shinji Sumimoto, Kohta Nakashima, Akira Naruse & Kouichi Kumon

  2. Hitachi Ltd., 1-280 Higashi-Koigakubo, Kokubunji, Tokyo, 185-8601, Japan

    Takashi Yasui

  3. The University of Tokyo, 2-11-16 Yayoi Bunkyo-ku, Tokyo, 113-8658, Japan

    Yoshikazu Kamoshida, Hiroya Matsuba, Atsushi Hori & Yutaka Ishikawa

Authors
  1. Shinji Sumimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kohta Nakashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Akira Naruse
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kouichi Kumon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Takashi Yasui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yoshikazu Kamoshida
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hiroya Matsuba
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Atsushi Hori
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yutaka Ishikawa
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information Technology, Åbo Akademi, 20500, Turku, Finland

    Matti Ropo  & Jan Westerholm  & 

  2. Department of Electrical Engineering and Computer Science, University of Tennessee, 37996-3450, Knoxville, TN, USA

    Jack Dongarra

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sumimoto, S. et al. (2009). The Design of Seamless MPI Computing Environment for Commodity-Based Clusters. In: Ropo, M., Westerholm, J., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2009. Lecture Notes in Computer Science, vol 5759. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03770-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03770-2_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03769-6

  • Online ISBN: 978-3-642-03770-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics