Synonyms
Definition
Application-based Benchmarks measure the performance of computer systems by running a set of applications with a well defined configuration and workload.
Discussion
Introduction
The Standard Performance Evaluation Corporation (SPEC [Product and service names mentioned herein may be the trademarks of their respective owners]) is an organization for creating industry-standard benchmarks to measure various aspects of modern computer system performance. SPEC was founded in 1988. In January 1994, the High-Performance Group of the Standard Performance Evaluation Corporation (SPEC HPG) was founded with the mission to establish, maintain, and endorse a suite of benchmarks representative of real-world, high-performance computing applications. Several efforts joined forces to form SPEC HPG and to initiate a new benchmarking venture that is supported broadly. Founding partners included the member organizations of SPEC,...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Bibliography
ASCI-Purple home page (2003) http://asc.llnl.gov/computing_resources/purple/archive/benchmarks
ASCI-Sequoia home page. https://asc.llnl.gov/sequoia/benchmarks.
Aslot V, Domeika M, Eigenmann R, Gaertner G, Jones WB, Parady B (2001) SPEComp: a new benchmark suite for measuring parallel computer performance. In: Eigenmann R, Voss MJ (eds) WOMPAT’01: workshop on openmp applications and tools. LNCS, vol 2104. Springer, Heidelberg, pp 1–10
Aslot V, Eigenmann R (2001) Performance characteristics of the SPEC OMP2001 benchmarks. In: 3rd European workshop on OpenMP, EWOMP’01, Barcelona, Spain, September 2001
Bailey D, Harris T, Saphir W, van der Wijngaart R, Woo A, Yarrow M (1995) The NAS parallel benchmarks 2.0. Technical report NAS-95-020, NASA Ames Research Center, Moffett Field, CA. http://www.nas.nasa.gov/Software/NPB
Berry M, Chen D, Koss P, Kuck D, Lo S, Pang Y, Pointer, Rolo R, Sameh A, Clementi E, Chin S, Schneider D, Fox G, Messina P, Walker D, Hsiung C, Schwarzmeier J, Lue K, Orszag S, Seidl F, Johnson O, Goodrum R, Martin J (1989) The perfect club benchmarks: effective performance evaluation of supercomputers. Int J High Perform Comp Appl 3(3):5–40
DEISA benchmark suite home page. http://www.deisa.eu/science/benchmarking
Dongarra J, Luszczek P (2005) Introduction to the hpcchallenge benchmark suite. ICL technical report ICL-UT-05-01, ICL 2005
Eigenmann R, Hassanzadeh S (1996) Benchmarking with real industrial applications: the SPEC high-performance group. IEEE Comp Sci & Eng 3(1):18–23
Eigenmann R, Gaertner G, Jones W (2002) SPEC HPC2002: the next high-performance computer benchmark. In: Lecture notes in computer science, vol 2327. Springer, Heidelberg, pp 7–10
Iwashita H, Yamanaka E, Sueyasu N, van Waveren M, Miura K (2001) The SPEC OMP 2001 benchmark on the Fujitsu PRIMEPOWER system. In: 3rd European workshop on OpenMP, EWOMP’01, Barcelona, Spain, September 2001
Müller MS, Kalyanasundaram K, Gaertner G, Jones W, Eigenmann R, Lieberman R, van Waveren M, Whitney B (2004) SPEC HPG benchmarks for high performance systems. Int J High Perform Comp Netw 1(4):162–170
Müuller MS, van Waveren M, Lieberman R, Whitney B, Saito H, Kumaran K, Baron J, Brantley WC, Parrott C, Elken T, Feng H, Ponder C (2010) SPEC MPI2007 – an application benchmark suite for parallel systems using MPI. Concurrency Computat: Pract Exper 22(2):191–205
Saito H, Gaertner G, Jones W, Eigenmann R, Iwashita H, Lieberman R, van Waveren M, Whitney B (2002) Large system performance of SPEC OMP2001 benchmarks. In: Zima HP, Joe K, Sata M, Seo Y, Shimasaki M (eds) High performance computing, 4th international symposium, ISHPC 2002. Lecture notes in computer science, vol 2327. Springer, Heidelberg, pp 370–379
Szebenyi Z, Wylie BJN, Wolf F (2008) SCALASCA parallel performance analyses of SPEC MPI2007 applications. In: Proceedings of the 1st SPEC international performance evaluation workshop (SIPEW). LNCS, vol 5119. Springer, Heidelberg, pp 99–123
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this entry
Cite this entry
Müller, M., Whitney, B., Henschel, R., Kumaran, K. (2011). SPEC Benchmarks. In: Padua, D. (eds) Encyclopedia of Parallel Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09766-4_370
Download citation
DOI: https://doi.org/10.1007/978-0-387-09766-4_370
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09765-7
Online ISBN: 978-0-387-09766-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering