Fadi N. Sibai
Abstract
PCMark®05 [4, 8] is a highly popular synthetic benchmark for evaluating the performance of personal computers (PCs) with millions of downloads via the Internet. Based on open source and commercial applications, it measures the execution time of highly representative code extracts of these applications and reports scores reflecting the overall system performance, the CPU performance, the memory subsystem performance, the graphics subsystem performance, and the disk subsystem performance. In this article, we focus on the PCMark®05 CPU test suite which is composed of 8 tests to measure the performance and scalability of various Intel single- and dual-core processors. Six of these tests run a single application each. One test runs 2 multitasked applications in parallel and another test runs 4 multitasked applications simultaneously. We present the results of executing this benchmark's CPU test suite on high end Intel-based PC platforms with top of the line single processor and dual core processors, present the results of our profiling and hotspot analysis, shed some light on this test suite's prominent microarchitecture events and its active threads' distributions, and characterize this suite's workload. These results help in understanding the performance characteristics of this popular benchmark and in guiding future processor design enhancements.
- ATI Corporation, Radeon X850 Graphics Technology, DOI=http://www.ati.com/products/radeonx850/index.htmlGoogle Scholar
- BABPCo, SysMark® 2004 SE Benchmark, DOI=http://www.bapco.com/products/sysmark2004/Google Scholar
- Crypto++ 5.0 Library, DOI=http://www.cryptopp.comGoogle Scholar
- FutureMark Corporation, PCMark®05 Benchmark, DOI=http://www.futuremark.com/products/pcmark05/Google Scholar
- Independent JPEG Group, JPEG Compression and Decompression, DOI=http://www.ijg.orgGoogle Scholar
- Intel Corporation, Thread Profiler Tool, DOI=http://www.intel.com/cd/software/products/asmo-na/eng/threading/index.htmGoogle Scholar
- Intel Corporation, VTune® Performance Analyzer, DOI=http://www.intel.com/cd/software/products/asmo-na/eng/vtune/index.htmGoogle Scholar
- Niemela, S., PCMark®05 PC Performance Analysis White Paper, June 2005, DOI=http://www.futuremark.com/companyinfo/PCMark05_Whitepaper_1_0.pdfGoogle Scholar
- SPEC, SPEC CPU2000 Benchmark, DOI=http://www.spec.org/cpu/Google Scholar
- The XIPH Open Source Community, Ogg Vorbis Audio Compression and Decompression, DOI=http://xiph.orgGoogle Scholar
- Zlib Library 1.2.2, DOI=http://www.gzip.org/zlib/apps.htmlGoogle Scholar
- Dujmovic, J., and Dujmovic, I. 1998. Evolution and evaluation of SPEC Benchmarks, ACM SIGMETRICS Performance Evaluation Review 26, 3 (December 1998). Google ScholarDigital Library
- Ye, D. et al. 2006. Performance Characterization of SPEC CPU2006 Integer Benchmarks on x86-64 Architecture. In Proc. of the IEEE International Workshop on Workload Characterization (Oct. 2006). 120--127.Google Scholar
- Kleinosowski, A. J., Lilja, D. J. 2002. MinneSPEC: A New SPEC Benchmark Workload for Simulation-Based Computer Architecture Research. IEEE Computer Architecture Letters, 1, 1 (Jan. 2002), 7--17. Google ScholarDigital Library
- Henning, J. L. 2000. SPEC CPU2000: Measuring CPU Performance in the New Millennium. IEEE Computer. 33, 7 (July 2000), 28--35. Google ScholarDigital Library
- Joshi, A. et al. 2006. Measuring Benchmark Similarity Using Inherent Program Characteristics. IEEE Transactions on Computers. 55, 6 (June 2006), 769--782. Google ScholarDigital Library
- Todi, R. 2001. SPEClite: Using Representative Samples to Reduce SPEC CPU2000 Workload. In Proc. of the IEEE Workshop on Workload Characterization (Dec. 2001). 15--23. Google ScholarDigital Library
- Kim, J., Yi, J. 2004. Performance Sensitivity of SPEC CPU2000 Over Operating Frequency. In Proc. of the International Symposium on Information and Communication Technologies (June 2004). ISICT '04. Google ScholarDigital Library
- Majumdar, S. 2000. Performance Scalability in Multiprocessor Systems with Resource Contention. In Proc. of IEEE International Symposium on Performance Analysis of Systems and Software (Austin, Texas, 2000). 129--138. Google ScholarDigital Library
- Majumdar, S. 1999. Scheduling Strategies for Controlling Resource Contention on Multiprocessor Systems. In Proceedings of the 6th International Conference on High Performance Computing (1999). 151--157. Google ScholarDigital Library
- Phansalkar, A., Joshi, A., John, L. 2007. Analysis of redundancy and application balance in the SPEC CPU2006 benchmark suite. ACM SIGARCH Computer Architecture 35, 2 (May 2007), 412--423. Google ScholarDigital Library
- Sibai, F. N. 2007. Performance Analysis and Workload Characterization of the 3DMark05 Benchmark on Modern Parallel Computer Platforms. ACM SIGARCH Computer Architecture News. 35, 3 (June 2007), 44--52. Google ScholarDigital Library
- Albayraktaroglu, K. et al. 2005. BioBench: A Benchmark Suite of Bioinformatics Applications. In Proc. of IEEE Int. Symp. on Performance Analysis of Sys. and Software. 2005. Google ScholarDigital Library
- Kejariwal, A. et al. 2007. Thread-Level Speculation: Tight Analysis of the Performance Potential of Thread Speculation Using SPEC CPU 2006. In Proc. of the 12th ACM Symp. on Principles & Practice of Parallel Program. (March 2007) Google ScholarDigital Library
Index Terms
- Evaluating the performance of single and multiple core processors with PCMARK®05 and benchmark analysis
Recommendations
Hybrid multi-core architecture for boosting single-threaded performance
The scaling of technology and the diminishing return of complicated uniprocessors have driven the industry towards multicore processors. While multithreaded applications can naturally leverage the enhanced throughput of multi-core processors, a large ...
Performance characteristics of biomolecular simulations on high-end systems with multi-core processors
Biological processes occurring inside cell involve multiple scales of time and length; many popular theoretical and computational multi-scale techniques utilize biomolecular simulations based on molecular dynamics. Till recently, the computing power ...
Evaluating performance of new quad-core Intel®Xeon®5500 family processors for HPC
PPAM'09: Proceedings of the 8th international conference on Parallel processing and applied mathematics: Part IIn this paper we take a look at what the new Quad-Core Intel Xeon Processor code name Nehalem brings to high performance computing. We compare Intel Xeon 5400 series based system with a server utilizing his successor the new Intel Xeon X5560. We compare ...
Comments