ABSTRACT
Innovation needs a competitive and fair playing field on which products can be compared and informed choices can be made. Standard benchmarks are a necessity to create such a level playing field among competitors in the server market for more energy-efficient servers. That, in turn, motivates their engineers to design more energy-efficient hardware. The SPECpower_ssj 2008 benchmark drove the increase of server energy efficiency by 113 times for single CPU servers, or 19 times on average. Yet, with added functionality and load, they are expected to consume a rising amount of energy. Additionally, server usage in data centers has changed over time with new application types. To continue the effort of increasing server energy efficiency, a new version, SPECpowerNext, is under development. In this work, after a short introduction to SPECpower_ssj 2008, we present the new implementation of SPECpowerNext together with the standardized way to collect server information in heterogeneous data centers. We also give insight, including preliminary measurements, into two of SPECpowerNext new workloads, the Wiki and the APA workload, in addition to an overview of both workloads.
- Anders Andrae and Tomas Edler. 2015. On Global Electricity Usage of Communication Technology: Trends to 2030. Challenges, Vol. 6, 1 (Apr 2015), 117--157. https://doi.org/10.3390/challe6010117Google ScholarCross Ref
- Jeremy Arnold. 2013. Chauffeur: A framework for measuring Energy Efficiency of Servers.Google Scholar
- Anthony Danalis, Gabriel Marin, Collin McCurdy, Jeremy S Meredith, Philip C Roth, Kyle Spafford, Vinod Tipparaju, and Jeffrey S Vetter. 2010. The scalable heterogeneous computing (SHOC) benchmark suite. In Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units. ACM, 63--74.Google ScholarDigital Library
- DMTF. 2019 a. End-to-End Interoperable Management: The Standards Requirement for Modern IT. White Paper. Distributed Management Task Force.Google Scholar
- DMTF. 2019 b. Redfish Specification. Specification DSP0266 Version 1.8.0. Distributed Management Task Force.Google Scholar
- DMTF. 2020. Redfish -- Simple and Secure Management for Converged, Hybrid IT. Technical Note. Distributed Management Task Force.Google Scholar
- Karl Huppler. 2009. The Art of Building a Good Benchmark. In Performance Evaluation and Benchmarking, Raghunath Nambiar and Meikel Poess (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 18--30.Google Scholar
- Samuel Kounev, Klaus-Dieter Lange, and Jóakim von Kistowski. 2020. Systems Benchmarking 1 ed.). Springer International Publishing. https://doi.org/10.1007/978--3-030--41705--5Google Scholar
- John D. McCalpin. 1991--2007. STREAM: Sustainable Memory Bandwidth in High Performance Computers. Technical Report. University of Virginia, Charlottesville, Virginia. http://www.cs.virginia.edu/stream/ A continually updated technical report. http://www.cs.virginia.edu/stream/.Google Scholar
- John D. McCalpin. 1995. Memory Bandwidth and Machine Balance in Current High Performance Computers. IEEE Computer Society Technical Committee on Computer Architecture (TCCA) Newsletter (Dec. 1995), 19--25.Google Scholar
- John Nickolls, Ian Buck, Michael Garland, and Kevin Skadron. 2008. Scalable Parallel Programming with CUDA: Is CUDA the Parallel Programming Model That Application Developers Have Been Waiting For? Queue, Vol. 6, 2 (March 2008), 40--53. https://doi.org/10.1145/1365490.1365500Google ScholarDigital Library
- nVidia. 2020. cuBLAS Library User Guide v11.1. https://docs.nvidia.com/cuda/pdf/CUBLAS_Library.pdf.Google Scholar
- Steve Plimpton, Paul Crozier, and Aidan Thompson. 2007. LAMMPS-large-scale atomic/molecular massively parallel simulator. Sandia National Laboratories, Vol. 18 (2007), 43.Google Scholar
- SPEC. 2012a. Design Document SSJ Workload SPECpower_ssj2008. https://www.spec.org/power/docs/SPECpower_ssj2008-Design_ssj.pdf.Google Scholar
- SPEC. 2012b. Design Overview SPECpower_ssj2008. https://www.spec.org/power/docs/SPECpower_ssj2008-Design_Overview.pdf.Google Scholar
- SPEC. 2013. Server Efficiency Rating Tool (SERT) Design Document 1.0.2. https://www.spec.org/sert/docs/SERT-Design_Doc.pdf.Google Scholar
- SPEC. 2016. SPECpower_ssj2008 Run and Reporting Rules. https://www.spec.org/power/docs/SPECpower_ssj2008-Run_Reporting_Rules.html, Accessed: 21.10.2020.Google Scholar
- SPEC. 2017. Chauffeur#8482; Worklet Development Kit (WDK) User Guide 2.0.0. https://www.spec.org/chauffeur-wdk/docs/Chauffeur-User_Guide.pdf.Google Scholar
- SPEC. 2019. Beyond performance to power consumption. https://www.spec.org/30th/power.html, Accessed: 06.10.2020.Google Scholar
- SPEC. 2020. All Published SPECpower_ssj2008 Results. https://www.spec.org/power_ssj2008/results/power_ssj2008.html, Accessed: 13.10.2020.Google Scholar
- J. E. Stone, D. Gohara, and G. Shi. 2010. OpenCL: A Parallel Programming Standard for Heterogeneous Computing Systems. Computing in Science Engineering, Vol. 12, 3 (2010), 66--73. https://doi.org/10.1109/MCSE.2010.69Google ScholarCross Ref
- Jóakim von Kistowski, Jeremy A. Arnold, Karl Huppler, Klaus-Dieter Lange, John L. Henning, and Paul Cao. 2015. How to Build a Benchmark. In Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering (ICPE 2015) (ICPE '15). ACM, New York, NY, USA. https://doi.org/10.1145/2668930.2688819Google ScholarDigital Library
- Jóakim von Kistowski, Johann Pais, Tobias Wahl, Klaus-Dieter Lange, Hansfried Block, John Beckett, and Samuel Kounev. 2019. Measuring the Energy Efficiency of Transactional Loads on GPGPU. In Proceedings of the 19th ACM/SPEC International Conference on Performance Engineering (ICPE '19). ACM, New York, NY, USA.Google ScholarDigital Library
Index Terms
- The SPECpowerNext Benchmark Suite, its Implementation and New Workloads from a Developer's Perspective
Recommendations
Server efficiency rating tool (SERT) 1.0.2: an overview
ICPE '14: Proceedings of the 5th ACM/SPEC international conference on Performance engineeringThe Server Efficiency Rating Tool (SERT) has released the Standard Performance Evaluation Corporation (SPEC) and the EPA released Version 2.0 of the ENERGY STAR for Computer Servers program in early 2013 to include the mandatory use of the SERT. Other ...
SPECpower_ssj2008: driving server energy efficiency
ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance EngineeringSPECpower_ssj2008 [1] is the first industry-standard SPEC [2] benchmark that evaluates the power and performance characteristics of volume server-class and multi-node class computers. This poster-paper gives an overview of the benchmark that defines the ...
Further implementation aspects of the server efficiency rating tool (SERT)
ICPE '13: Proceedings of the 4th ACM/SPEC International Conference on Performance EngineeringThe Server Efficiency Rating Tool (SERT) has been developed by the Standard Performance Evaluation Corporation (SPEC) at the request of the US Environmental Protection Agency (EPA). Almost 3% of all electricity consumed within the US in 2010 went to ...
Comments