Abstract
Many tools, including performance analysis tools, tracing libraries and application level checkpointers, add piggyback data to messages. However, transparently implementing this functionality on top of MPI is not trivial and can severely reduce application performance. We study three transparent piggyback implementations on multiple production platforms and demonstrate that all are inefficient for some application scenarios. Overall, our results show that efficient piggyback support requires mechanisms within the MPI implementation and, thus, the interface should be extended to support them.
This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344 (LLNL-CONF-402937).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Accelerated Strategic Computing Initiative. The ASCI sweep3d benchmark code (December 1995), http://www.llnl.gov/asci_benchmarks/asci/limited/sweep3d/
Barnes, B., Rountree, B., Lowenthal, D., Reeves, J., de Supinski, B.R., Schulz, M.: A Regression-Based Approach to Scalability Prediction. In: Proceedings of the International Conference on Supercomputing (June 2008)
Falgout, R., Yang, U.: Hypre: a Library of High Performance Preconditioners. In: Sloot, P.M.A., Tan, C.J.K., Dongarra, J., Hoekstra, A.G. (eds.) ICCS-ComputSci 2002. LNCS, vol. 2331, pp. 632–641. Springer, Heidelberg (2002)
Kranzlmüller, D., Volkert, J.: NOPE: A Nondeterministic Program Evaluator. In: Zinterhof, P., Vajtersic, M., Uhl, A. (eds.) ACPC 1999 and ParNum 1999. LNCS, vol. 1557, pp. 490–499. Springer, Heidelberg (1999)
Schulz, M., Bronevetsky, G., Fernandes, R., Marques, D., Pingali, K., Stodghill, P.: Implementation and Evaluation of a Scalable Application-level Checkpoint-Recovery Scheme for MPI Programs. In: Supercomputing 2004 (SC 2004) (November 2004)
Schulz, M., de Supinski, B.R.: PNMPI tools a whole lot greater than the sum of their parts. In: Supercomputing 2007 (SC 2007) (2007)
Shende, S., Malony, A.D., Morris, A., Wolf, F.: Performance Profiling Overhead Compensation for MPI Programs. In: Proceedings of the 12th European PVM/MPI Users’ Group Meeting, September 2005, pp. 359–367 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schulz, M., Bronevetsky, G., de Supinski, B.R. (2008). On the Performance of Transparent MPI Piggyback Messages. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2008. Lecture Notes in Computer Science, vol 5205. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87475-1_28
Download citation
DOI: https://doi.org/10.1007/978-3-540-87475-1_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87474-4
Online ISBN: 978-3-540-87475-1
eBook Packages: Computer ScienceComputer Science (R0)