Abstract
Performance characteristics of application programs on large-scale systems are often significantly different from those on smaller systems. SPEC OMP includes benchmark suites intended for measuring performance of modern shared memory parallel systems. SPEC OMPM2001 is developed for medium-scale (4- to 16-way) systems whereas SPEC OMPL2001 is developed for large-scale systems (32-way and larger). We present our experiences on benchmark development in achieving good scalability using the OpenMP API. We also analyze the published results of these benchmark suites on large systems (32-way and larger), based on application program behavior and systems' architectural features.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
V. Aslot, M. Domeika, R. Eigenmann, G. Gaertner, W. B. Jones, and B. Parady, SPEComp: A New Benchmark Suite for Measuring Parallel Computer Performance, Proc. Of WOMPAT 2001, Workshop on OpenMP Applications and Tools, Lecture Notes in Computer Science, Vol. 2104, pp. 1–10 (July 2001).
V. Aslot and R. Eigenmann, Performance Characteristics of the SPEC OMP2001 Benchmarks, Proc. of the Third European Workshop on OpenMP (EWOMP'2001), Barcelona, Spain (September 2001).
H. Iwashita, E. Yamanaka, N. Sueyasu, M. van Waveren, and K. Miura, The SPEC OMP2001 Benchmark on the Fujitsu PRIMEPOWER System, Proc. of the Third European Workshop on OpenMP (EWOMP'2001), Barcelona, Spain (September 2001).
H. Saito, G. Gaertner, W. Jones, R. Eigenmann, H. Iwashita, R. Lieberman, M. van Waveren, and B. Whitney, Large System Performance of SPEC OMP2001 Benchmarks, Proc. of the International Workshop on OpenMP: Experiences and Implementations (WOMPEI 2002), Lecture Notes in Computer Science, Vol. 2327, pp. 370–379, Nara, Japan (May 2002).
E. Barszcz, R. Fatoohi, V. Venkatkrishnan, and S. Weeratunga, Solution of Regular Sparse Triangular Systems on Vector and Distributed-Memory Multiprocessors, Rept. No. RNR–93–007, NASA Ames Research Center (1993).
A. Yu. Gelfgat, P. Z. Bar-Yoseph, and A. Solan, Stability of Confined Swirling Flow with and without Vortex Breakdown, J. Fluid Mechanics, 311:1–36 (1996).
S. W. Key and C. C. Hoff, An Improved Constant Membrane and Bending Stress Shell Element for Explicit Transient Dynamics, Comput. Methods Appl. Mech. Engrg., 124:33–47 (1995).
M. J. Domeika, C. W. Roberson, E. W. Page, and G. A. Tagliarini, Adaptive Resonance Theory 2 Neural Network Approach to Star Field Recognition, in Applications and Science of Artificial Neural Networks II, S. K. Rogers and D. W. Ruck, eds., Proc. SPIE 2760, pp. 589–596 (1996).
H. Bao, J. Bielak, O. Ghattas, L. F. Kallivokas, D. R. O'Hallaron, J. R. Shewchuk, and J. Xu, Large-scale Simulation of Elastic Wave Propagation in Heterogeneous Media on Parallel Computers, Comput. Methods Appl. Mech. Engrg., 152:85 102(January 1998).
OpenMP Architecture Review Board, OpenMP Fortran Application Programming Interface Version 1.1, November 1999 (http://www.openmp.org/specs/mp-documents/fspec11.pdf)
OpenMP Architecture Review Board, OpenMP Fortran Application Programming Interface Version 2.0, November 2000 (http://www.openmp.org/specs/mp-documents/fspec20.pdf)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Saito, H., Gaertner, G., Jones, W. et al. Large System Performance of SPEC OMP Benchmark Suites. International Journal of Parallel Programming 31, 197–209 (2003). https://doi.org/10.1023/A:1023086618401
Issue Date:
DOI: https://doi.org/10.1023/A:1023086618401