Strategies for Energy-Efficient Resource Management of Hybrid Programming Models
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States)
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Queen's Univ. Belfast, Ireland (United Kingdom); Foundation for Research and Technology Hellas FORTH, Crete (Greece)
- Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States)
Many scientific applications are programmed using hybrid programming models that use both message passing and shared memory, due to the increasing prevalence of large-scale systems with multicore, multisocket nodes. Previous work has shown that energy efficiency can be improved using software-controlled execution schemes that consider both the programming model and the power-aware execution capabilities of the system. However, such approaches have focused on identifying optimal resource utilization for one programming model, either shared memory or message passing, in isolation. The potential solution space, thus the challenge, increases substantially when optimizing hybrid models since the possible resource configurations increase exponentially. Nonetheless, with the accelerating adoption of hybrid programming models, we increasingly need improved energy efficiency in hybrid parallel applications on large-scale systems. In this work, we present new software-controlled execution schemes that consider the effects of dynamic concurrency throttling (DCT) and dynamic voltage and frequency scaling (DVFS) in the context of hybrid programming models. Specifically, we present predictive models and novel algorithms based on statistical analysis that anticipate application power and time requirements under different concurrency and frequency configurations. Furthermore, we apply our models and methods to the NPB MZ benchmarks and selected applications from the ASC Sequoia codes. Overall, we achieve substantial energy savings (8.74 percent on average and up to 13.8 percent) with some performance gain (up to 7.5 percent) or negligible performance loss.
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA); European Commission (EC); National Science Foundation (NSF)
- Grant/Contract Number:
- AC52-07NA27344; 224759; CNS-0905187; CNS-0910784; CCF-0848670; CNS-0709025; CNS-0720750
- OSTI ID:
- 1734607
- Report Number(s):
- LLNL-JRNL-521391; 551350
- Journal Information:
- IEEE Transactions on Parallel and Distributed Systems, Vol. 24, Issue 1; ISSN 1045-9219
- Publisher:
- IEEECopyright Statement
- Country of Publication:
- United States
- Language:
- English
Web of Science
Energy measurement, modeling, and prediction for processors with frequency scaling
|
journal | June 2014 |
Energy-Aware High-Performance Computing: Survey of State-of-the-Art Tools, Techniques, and Environments
|
journal | April 2019 |
Similar Records
Complexity in scalable computing.
Application configuration selection for energy-efficient execution on multicore systems