skip to main content
10.1145/3297663.3310314acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
short-paper

SPEC CPU2017: Performance, Event, and Energy Characterization on the Core i7-8700K

Published: 04 April 2019 Publication History

Abstract

Computer engineers in academia and industry rely on a standardized set of benchmarks to quantitatively evaluate the performance of computer systems and research prototypes. SPEC CPU2017 is the most recent incarnation of standard benchmarks designed to stress a system's processor, memory subsystem, and compiler. This paper describes the results of measurement-based studies focusing on characterization, performance, and energy-efficiency analyses of SPEC CPU2017 on the Intel's Core i7-8700K. Intel and GNU compilers are used to create executable files utilized in performance studies. The results show that executables produced by the Intel compilers are superior to those produced by GNU compilers. We characterize all the benchmarks, perform a top-down microarchitectural analysis to identify performance bottlenecks, and test benchmark scalability with respect to performance and energy. Findings from these studies can be used to guide future performance evaluations and computer architecture research

References

[1]
J. N. Amaral, E. Borin, D. R. Ashley, C. Benedicto, E. Colp, J. H. S. Hoffman, M. Karpoff, E. Ochoa, M. Redshaw, and R. E. Rodrigues. 2018. The Alberta Workloads for the SPEC CPU 2017 Benchmark Suite. In 2018 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 159--168.
[2]
A. Dzhagaryan and A. Milenkovic. 2014. Impact of Thread and Frequency Scaling on Performance and Energy in Modern Multicores: A Measurement-based Study. In Proceedings of the 2014 ACM Southeast Regional Conference (ACM SE '14), 14:1--14:6.
[3]
H. Esmaeilzadeh, T. Cao, X. Yang, S. M. Blackburn, and K. S. McKinley. 2011. Looking Back on the Language and Hardware Revolutions: Measured Power, Performance, and Scaling. Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems (March 2011), 319--332.
[4]
J. L. Henning. 2006. SPEC CPU2006 Benchmark Descriptions. SIGARCH Comput. Archit. News 34, 4 (September 2006), 1--17.
[5]
A. Kejariwal, A. V. Veidenbaum, A. Nicolau, X. Tian, M. Girkar, H. Saito, and U. Banerjee. 2008. Comparative architectural characterization of SPEC CPU2000 and CPU2006 benchmarks on the intel® CoreTM 2 Duo processor. In International Conference on Embedded Computer Systems: Architectures, Modeling, 132--141.
[6]
A. Limaye and T. Adegbija. 2018. A Workload Characterization of the SPEC CPU2017 Benchmark Suite. In 2018 IEEE International Symposium on Perfor-mance Analysis of Systems and Software (ISPASS), 149--158.
[7]
R. Panda, S. Song, J. Dean, and L. K. John. 2018. Wait of a Decade: Did SPEC CPU 2017 Broaden the Performance Horizon? In 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA), 271--282.
[8]
T. K. Prakash and L. Peng. 2008. Performance Characterization of SPEC CPU2006 Benchmarks on Intel Core 2 Duo Processor. In ISAST Trans. Comput. Softw. Eng. (1), 36--41.
[9]
J. Treibig, G. Hager, and G. Wellein. 2010. LIKWID: A Lightweight Performance-Oriented Tool Suite for x86 Multicore Environments. In 2010 39th International Conference on Parallel Processing Workshops, 207--216.
[10]
V. Uzelac and A. Milenkovic. 2009. Experiment flows and microbenchmarks for reverse engineering of branch predictor structures. In 2009 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS'09), 207--217.
[11]
V. M. Weaver, M. Johnson, K. Kasichayanula, J. Ralph, P. Luszczek, D. Terpstra, and S. Moore. 2012. Measuring Energy and Power with PAPI. In 2012 41st International Conference on Parallel Processing Workshops, 262--268.
[12]
A. Yasin. 2014. A Top-Down method for performance analysis and counters architecture. In IEEE International Symposium on Performance Analysis of Systems and Software, 35--44.
[13]
2010. White-Paper Using SPEC CPU2006 Benchmark Results to Compare the Compute Performance of Servers.
[14]
SPEC CPU® 2017. Retrieved March 19, 2018 from https://www.spec.org/cpu2017/
[15]
Intel® CoreTM i7--8700K Processor Product Specifications. Intel® ARK (Product Specs). Retrieved March 24, 2018, from https://tinyurl.com/ybcw5vc8
[16]
Perf?: Linux profiling with performance counters. Perf Wiki. Retrieved March 19, 2018, from https://perf.wiki.kernel.org/index.php/Main_Page
[17]
Intel® VTuneTM Amplifier 2018 User's Guide. Retrieved June 1, 2018, from https://tinyurl.com/y76ondwo

Cited By

View all
  • (2023)Fine-Grained CPU Power Management Based on Digital Frequency DividerElectronics10.3390/electronics1202040712:2(407)Online publication date: 13-Jan-2023
  • (2023)An Application-Oriented Approach to Designing Hybrid CPU Architectures2023 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)10.1109/ISPASS57527.2023.00018(92-102)Online publication date: Apr-2023
  • (2023)Revitalizing Buffered I/O: Optimizing Page Reclaim and I/O Throttling2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00078(475-482)Online publication date: 6-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICPE '19: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering
April 2019
348 pages
ISBN:9781450362399
DOI:10.1145/3297663
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. benchmarks
  2. energy-efficiency
  3. microarchitectural analysis

Qualifiers

  • Short-paper

Conference

ICPE '19

Acceptance Rates

ICPE '19 Paper Acceptance Rate 13 of 71 submissions, 18%;
Overall Acceptance Rate 252 of 851 submissions, 30%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)50
  • Downloads (Last 6 weeks)9
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Fine-Grained CPU Power Management Based on Digital Frequency DividerElectronics10.3390/electronics1202040712:2(407)Online publication date: 13-Jan-2023
  • (2023)An Application-Oriented Approach to Designing Hybrid CPU Architectures2023 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)10.1109/ISPASS57527.2023.00018(92-102)Online publication date: Apr-2023
  • (2023)Revitalizing Buffered I/O: Optimizing Page Reclaim and I/O Throttling2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00078(475-482)Online publication date: 6-Nov-2023
  • (2022)A Soft Coprocessor Approach for Developing Image and Video Processing Applications on FPGAsJournal of Imaging10.3390/jimaging80200428:2(42)Online publication date: 11-Feb-2022
  • (2022)Benchmark Research on Computing Performance of Domestic General-purpose Processors2022 6th International Symposium on Computer Science and Intelligent Control (ISCSIC)10.1109/ISCSIC57216.2022.00080(357-362)Online publication date: Nov-2022
  • (2022)Splash-4: A Modern Benchmark Suite with Lock-Free Constructs2022 IEEE International Symposium on Workload Characterization (IISWC)10.1109/IISWC55918.2022.00015(51-64)Online publication date: Nov-2022
  • (2021)An Experimental Evaluation of Workload Driven DVFSCompanion of the ACM/SPEC International Conference on Performance Engineering10.1145/3447545.3451192(95-102)Online publication date: 19-Apr-2021
  • (2021)A Preliminary Scalability Analysis of SPEC CPU2017 BenchmarksSoutheastCon 202110.1109/SoutheastCon45413.2021.9401917(1-8)Online publication date: 10-Mar-2021
  • (2020)AVX overhead profilingProceedings of the 11th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3409963.3410488(59-66)Online publication date: 24-Aug-2020
  • (2020)Performance, Power, and Energy-Efficiency Impact Analysis of Compiler Optimizations on the SPEC CPU 2017 Benchmark Suite2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)10.1109/UCC48980.2020.00047(292-301)Online publication date: Dec-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media