Abstract
The use of efficient communication patterns is becoming increasingly important to utilize high concurrency and achieve high throughput and low latency of modern high-performance supercomputers. Efficacy is not only dictated by an application communication pattern, but also driven by the interconnect properties, the node architecture, and the quality of runtime communication libraries. Different systems require different tradeoffs with respect to communication mechanisms, which can impact the choice of application implementations. We use the in-house MPI benchmark suite to study the communication behavior of the interconnects and guide the performance tuning of scientific applications. We report the results of our investigation of four supercomputer systems located at ALCF, and present lessons learned from our experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Grinberg, L., Morozov, V., Fedosov, D., Insley, J.A., Papka, M.E., Kumaran, K., Karniadakis, G.E.: A New Computational Paradigm in Multiscale Simulations with Applications to Brain Blood Flow. Gordon Bell Honorable Mention. In: Int. Conf. for High Performance Computing, Networking, Storage, and Analysis, Seattle, WA, November 12-18 (2011)
Müller, M.S., van Waveren, M., Lieberman, R., Whitney, B., Saito, H., Kumaran, K., Baron, J., Brantley, W.C., Parrott, C., Elken, T., Feng, H., Ponder, C.: SPEC MPI2007 – an Application Benchmark Suite for Parallel Systems using MPI. J. Concurrency and Computation: Practice and Experience – Int. Supercomputing Conf. 22(2), 191–205 (2010)
Intel MPI Benchmarks 3.2.3. Intel Corporation, http://software.intel.com/en-us/articles/intel-mpi-benchmarks/
Phloem MPI Benchmarks. Lawrence Livermore National Laboratory Technical report LLNL-MI-400479, https://asc.llnl.gov/sequoia/benchmarks/
The Ohio State University MPI Benchmarks. The Ohio State University, http://mvapich.cse.ohio-state.edu/benchmarks/
Augustin, W., Worsch, T.: The SKaMPI 5 Manual. Technical report (2008), http://liinwww.ira.uka.de/~skampi/
Morozov, V., Meng, J., Vishwanath, V., Hammond, J., Kumaran, K., Papka, M.: ALCF MPI Benchmarks: Understanding Machine-Specific Communication Behavior. In: Fifth Int. Workshop on Parallel Programming Models and Systems Software for High-End Computing, Pittsburgh, MA, September 10 (2012)
NAS Parallel Benchmarks. NASA Advanced Supercomputing Division, http://www.nas.nasa.gov/publications/npb.html
Underwood, K.D., Brightwell, R.: The Impact of MPI Queue Usage on Message Latency. In: Proc. Int. Conf. on Parallel Processing, vol. 1, pp. 152–160 (2004)
Brodsky, A., Pedersen, J.B., Wagner, A.S.: On the Complexity of Buffer Allocation in Message Passing Systems. J. Parallel Distrib. Comput. 65(6), 692–713 (2005)
Chen, D., Eisley, N.A., Heidelberger, P., Senger, R.M., Sugawara, Y., Kumar, S., Salapura, V., Satterfield, D.L., Steinmacher-Burow, B., Parker, J.J.: The IBM Blue Gene/Q Interconnection Network and Message Unit. In: Int. Conf. on High Performance Computing, Networking, Storage and Analysis, Seattle, WA, November 12-18 (2011)
Overview of the IBM Blue Gene/P project. IBM J. Res. Dev. 52(1/2), 199–220 (2008)
Hoefler, T., Snir, M.: Generic Topology Mapping Strategies for Large-Scale Parallel Architectures. In: Proc. Int. Conf. on Supercomputing, Tucson, Arizona, pp. 78–84 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Morozov, V., Meng, J., Vishwanath, V., Kumaran, K., Papka, M.E. (2013). Characterization and Understanding Machine-Specific Interconnects. In: Malyshkin, V. (eds) Parallel Computing Technologies. PaCT 2013. Lecture Notes in Computer Science, vol 7979. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39958-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-39958-9_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39957-2
Online ISBN: 978-3-642-39958-9
eBook Packages: Computer ScienceComputer Science (R0)