Synonyms
Definition
Software that utilizes standard applications, or their core routines that focus on a particular access pattern, in order to measure the performance and/or efficiency of one of the primary server and storage components (CPU transactions, memory, storage, and network IO).
Historical Background
From earliest days of digital computer systems, the goal of quantifying, improving, and optimizing computational performance has been a subject great interest. The earliest measures of performance were comparisons of low-level instruction execution times. A mix of several of these execution times would be combined to produce an overall rating that could be compared between systems. The most well-known of these early benchmarks was the Gibson mix, devised by Jack Gibson of IBM (Gibson 1970). As high-level computer languages were developed, more complex applications were created to develop more rigorous methods of measuring a system’s performance. Whetstone...
This is a preview of subscription content, log in via an institution to check access.
References
3DMark benchmark. https://www.3dmark.com
Chauffeur harness. https://www.spec.org/chauffeur-wdk/
Dongarra JJ, Luszczek P, Petitet A (2002) The LINPACK benchmark: past, present, and future. http://www.netlib.org/utk/people/JackDongarra/PAPERS/hplpaper.pdf
Gibson JC (1970) The Gibson mix. Technical report TR 00.2043. IBM Systems Development Division, Poughkeepsie
HEPiX benchmarking working group. https://www.hepix.org/e10227/e10327/e10325
Iometer project. http://www.iometer.org
IOzone filesystem benchmark. http://www.iozone.org/docs/IOzone_msword_98.pdf
LMBench tool. http://lmbench.sourceforge.net
Longbottom R. Whetstone benchmark history and results. http://www.roylongbottom.org.uk/whetstone.htm
McCalpin JD (1995) Memory bandwidth and machine balance in current high performance computers. IEEE Comput Soc Tech Comm Comput Arch (TCCA) Newsl. https://www.researchgate.net/publication/213876927_Memory_Bandwidth_and_Machine_Balance_in_Current_High_Performance_Computers
Michelotto M, Alef M, Iribarren A, Meinhard H, Wegner P, Bly M, Benelli G, Brasolin F, Degaudenzi H, De Salvo A, Gable I, Hirstius A, Hristov P (2010) A comparison of HEP code with SPEC benchmark on multi-core worker nodes. http://www.pd.infn.it/hepmark/HS06.pdf
Netperf benchmark. https://github.com/HewlettPackard/netperf
PCMark benchmark. https://www.futuremark.com/benchmarks/pcmark
Server Efficiency Rating Tool (SERT). https://www.spec.org/sert
SiSoftware Sandra. http://www.sisoftware.eu
SPEC CPU 2006 benchmark. https://www.spec.org/cpu2006
SPEC CPU 2017 benchmark. https://www.spec.org/cpu2017
SPEC SFS 2014 benchmark. https://www.spec.org/sfs2014/
Standard Performance Evaluation Corporation (SPEC). https://www.spec.org
STREAM benchmark. https://www.cs.virginia.edu/stream
The LINPACK benchmark programs and reports. http://www.netlib.org/benchmark/index.html
Transaction Processing Performance Council (TPC). http://www.tpc.org/
Weiss A (2002) Dhrystone benchmark: history, analysis, scores and recommendations. http://www.johnloomis.org/NiosII/dhrystone/ECLDhrystoneWhitePaper.pdf
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this entry
Cite this entry
Lange, KD., Schmidt, D.L. (2018). Component Benchmark. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_110-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-63962-8_110-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63962-8
Online ISBN: 978-3-319-63962-8
eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering