Abstract
Modern HEC systems, such as Blue Gene/P, rely on achieving high-performance by using the parallelism of a massive number of low-frequency/low-power processing cores. This means that the local pre- and post-communication processing required by the MPI stack might not be very fast, owing to the slow processing cores. Similarly, small amounts of serialization within the MPI stack that were acceptable on small/medium systems can be brutal on massively parallel systems. In this paper, we study different non-data-communication overheads within the MPI implementation on the IBM Blue Gene/P system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balaji, P., Buntinas, D., Balay, S., Smith, B., Thakur, R., Gropp, W.: Nonuniformly Communicating Noncontiguous Data: A Case Study with PETSc and MPI. In: IPDPS (2007)
Balaji, P., Buntinas, D., Goodell, D., Gropp, W., Thakur, R.: Toward Efficient Support for Multithreaded MPI Communication. Technical report, Argonne National Laboratory (2008)
Overview of the IBM Blue Gene/P project, http://www.research.ibm.com/journal/rd/521/team.pdf
IBM System Blue Gene Solution: Blue Gene/P Application Development, http://www.redbooks.ibm.com/redbooks/pdfs/sg247287.pdf
Buntinas, D., Mercier, G., Gropp, W.: Implementation and Shared-Memory Evaluation of MPICH2 over the Nemesis Communication Subsystem. In: Euro PVM/MPI (2006)
Gropp, W., Lusk, E., Swider, D.: Improving the Performance of MPI Derived Datatypes. In: MPIDC (1999)
Kumar, S., Dozsa, G., Almasi, G., Chen, D., Giampapa, M., Heidelberger, P., Blocksome, M., Faraj, A., Parker, J., Ratterman, J., Smith, B., Archer, C.: The Deep Computing Messaging Framework: Generalized Scalable Message Passing on the Blue Gene/P Supercomputer. In: ICS (2008)
D.K. Panda.: OSU Micro-benchmark Suite, http://mvapich.cse.ohio-state.edu/benchmarks
Ross, R., Miller, N., Gropp, W.: Implementing Fast and Reusable Datatype Processing. In: Euro PVM/MPI (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Balaji, P., Chan, A., Gropp, W., Thakur, R., Lusk, E. (2008). Non-data-communication Overheads in MPI: Analysis on Blue Gene/P. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2008. Lecture Notes in Computer Science, vol 5205. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87475-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-87475-1_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87474-4
Online ISBN: 978-3-540-87475-1
eBook Packages: Computer ScienceComputer Science (R0)