Shay Gal-On
ABSTRACT
To appreciate the challenges of analysing embedded processor behaviour, step back in time to understand the evolution of embedded processors. Only a few decades ago, embedded processors were relatively simple devices (compared to today), represented by a host of 8- and 16-bit microcontrollers, and 32-bit microprocessors, with minimal integration. Today, these processors (even the so-called, low-end microcontrollers), have evolved into highly-integrated SoCs with a wide variety of architectures capable of tackling both specific and general-purpose tasks. Associated with these transformations, the benchmarks used to quantify the capabilities have also grown in complexity and range. At the simplest level, benchmarks such as CoreMark analyse the fundamental processor cores. At the other end of the spectrum, system benchmarks, such BrowsingBench, analyse the entire SoC as well as the system software stack and even the physical interfaces. This paper examines some of the challenges of applying such benchmarks, and explains the methodologies used at EEMBC to manage portability, repeatability, and realism.
- Comparing Benchmarks Using Key Microarchitecture-Independent Characteristics by Kenneth Hoste and Lieven Eeckhout IISWC2006, Oct. 2006; San Jose, CA (US)Google Scholar
- Alam, S. R., Barrett, R. F., Kuehn, J. A., Roth, P. C., and Vetter, J. S. 2006. Characterization of Scientific Workloads on Systems with Multi-Core Processors. In Proceedings of the 2006 IEEE International Symposium on Workload Characterization (Oct. 2006) 225--236Google Scholar
- Hall, M. (1998). Correlation-based feature subset selection for machine learning. Ph.D. thesis, Department of Computer Science, University of Waikato, Hamilton, New Zealand.Google Scholar
- A Benchmark Characterization of the EEMBC Benchmark Suite, IEEE Micro Volume 9, Issue 5. Google ScholarDigital Library
- Ajay M. Joshi*, Lieven Eeckhout**, and Lizy K. John* "The Return of Synthetic Benchmarks"Google Scholar
- Gal-On, S. Levy, M (2010). Exploring CoreMark -- A Benchmark Maximizing Simplicity and Efficacy. www.eembc.org/techlit/whitepaper.phpGoogle Scholar
- How To Select a Multicore Processor for Embedded Applications. In proceedings of 2010 embedded systems design conference, Israel Technologies Group.Google Scholar
Index Terms
- Creating portable, repeatable, realistic benchmarks for embedded systems and the challenges thereof
Recommendations
Creating portable, repeatable, realistic benchmarks for embedded systems and the challenges thereof
LCTES '12To appreciate the challenges of analysing embedded processor behaviour, step back in time to understand the evolution of embedded processors. Only a few decades ago, embedded processors were relatively simple devices (compared to today), represented by ...
Vector vs. superscalar and VLIW architectures for embedded multimedia benchmarks
MICRO 35: Proceedings of the 35th annual ACM/IEEE international symposium on MicroarchitectureMultimedia processing on embedded devices requires an architecture that leads to high performance, low power consumption, reduced design complexity, and small code size. In this paper, we use EEMBC, an industrial benchmark suite, to compare the VIRAM ...
Entropy-Based Analysis of Benchmarks for Instruction Set Simulators
RAPIDO '23: Proceedings of the DroneSE and RAPIDO: System Engineering for constrained embedded systemsInstruction-Set Simulators (ISSs) are widely used to simulate the execution of programs for a target architecture on a host machine. They translate the instructions of the program that should be executed into instructions of the host Instruction-Set ...
Comments