skip to main content
10.1145/1736020.1736047acmconferencesArticle/Chapter ViewAbstractPublication PagesasplosConference Proceedingsconference-collections
research-article

Power routing: dynamic power provisioning in the data center

Published: 13 March 2010 Publication History

Abstract

Data center power infrastructure incurs massive capital costs, which typically exceed energy costs over the life of the facility. To squeeze maximum value from the infrastructure, researchers have proposed over-subscribing power circuits, relying on the observation that peak loads are rare. To ensure availability, these proposals employ power capping, which throttles server performance during utilization spikes to enforce safe power budgets. However, because budgets must be enforced locally -- at each power distribution unit (PDU) -- local utilization spikes may force throttling even when power delivery capacity is available elsewhere. Moreover, the need to maintain reserve capacity for fault tolerance on power delivery paths magnifies the impact of utilization spikes.
In this paper, we develop mechanisms to better utilize installed power infrastructure, reducing reserve capacity margins and avoiding performance throttling. Unlike conventional high-availability data centers, where collocated servers share identical primary and secondary power feeds, we reorganize power feeds to create shuffled power distribution topologies. Shuffled topologies spread secondary power feeds over numerous PDUs, reducing reserve capacity requirements to tolerate a single PDU failure. Second, we propose Power Routing, which schedules IT load dynamically across redundant power feeds to: (1) shift slack to servers with growing power demands, and (2) balance power draw across AC phases to reduce heating and improve electrical stability. We describe efficient heuristics for scheduling servers to PDUs (an NP-complete problem). Using data collected from nearly 1000 servers in three production facilities, we demonstrate that these mechanisms can reduce the required power infrastructure capacity relative to conventional high-availability data centers by 32% without performance degradation.

References

[1]
SPECpower Benchmark Results. {Online}. Available: http://www.spec.org/power\_ssj2008/results
[2]
G. Alvarez, W. Burkhard, L. Stockmeyer, and F. Cristian, "Declustered disk array architectures with optimal and near-optimal parallelism," in Proceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA), 1998.
[3]
L. A. Barroso and U. Hölzle, "The case for energy-proportional computing," Computer, vol. 40, no. 12, 2007.
[4]
J. S. Chase, D. C. Anderson, P. N. Thakar, A. M. Vahdat, and R. P. Doyle, "Managing energy and server resources in hosting centers," SIGOPS Oper. Syst. Rev., vol. 35, no. 5, 2001.
[5]
J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramanium, "Profiling, prediction, and capping of power consumption in consolidated environments," in MASCOTS, September 2008.
[6]
C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live migration of virtual machines," in Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation (NSDI), 2005.
[7]
T. Cormen, C. Leiserson, R. Rivest, and C. Stein, Introduction to Algorithms. MIT Press, 2001.
[8]
X. Fan, W.-D. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," in Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA), 2007.
[9]
M. E. Femal and V. W. Freeh, "Boosting data center performance through non-uniform power allocation," in Proceedings of Second International Conference on Autonomic Computing (ICAC), 2005.
[10]
A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy, "Optimal power allocation in server farms," in Proceedings of ACM SIGMETRICS 2009 Conference on Measurement and Modeling of Computer Systems, 2009.
[11]
A. Gandhi, M. Harchol-Balter, R. Das, C. Lefurgy, and J. Kephart, "Power capping via forced idleness," in Workshop on Energy-Efficient Design, 2009.
[12]
M. Garey, D. Johnson, R. Backhouse, G. von Bochmann, D. Harel, C. van Rijsbergen, J. Hopcroft, J. Ullman, A. Marshall, I. Olkin phet al., phA Guide to the Theory of Computers and Intractability. Springer.
[13]
S. Govindan, J. Choi, B. Urgaonkar, A. Sivasubramaniam, and A. Baldini, "Statistical profiling-based techniques for effective power provisioning in data centers," in phProceedings of the 4th ACM European Conference on Computer systems (EuroSys), 2009.
[14]
T. Gruzs, "A survey of neutral currents in three-phase computer power systems," IEEE Transactions on Industry Applications, vol. 26, no. 4, Jul/Aug 1990.
[15]
J. Hamilton, "Internet-scale service infrastructure efficiency," Keynote at the International Symposium on Computer Architecture (ISCA), 2009.
[16]
HP Staff, "HP power capping and dynamic power capping for ProLiant servers," HP, Tech. Rep. TC090303TB, 2009.
[17]
C. Lefurgy, X. Wang, and M. Ware, "Power capping: A prelude to power shifting," Cluster Computing, vol. 11, no. 2, 2008.
[18]
Luiz André Barroso and Urs Hölzle, The Datacenter as a Computer. Morgan Claypool, 2009.
[19]
D. Meisner, B. T. Gold, and T. F. Wenisch, "Powernap: eliminating server idle power," in Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2009.
[20]
R. Nathuji and K. Schwan, "Virtualpower: coordinated power management in virtualized enterprise systems," in Proceedings of twenty-first ACM SIGOPS Symposium on Operating Systems Principles (SOSP), 2007.
[21]
P. Popa, "Managing server energy consumption using IBM PowerExecutive," IBM, Tech. Rep., 2006.
[22]
R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu, "No 'power' struggles: coordinated multi-level power management for the data center," in phProceeding of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems, 2008.
[23]
P. Ranganathan, P. Leech, D. Irwin, and J. Chase, "Ensemble-level power management for dense blade servers," in phProceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA), 2006.
[24]
N. Rasmussen, "A scalable, reconfigurable, and efficient data center power distribution architecture," APC by Schneider Electric, Tech. Rep. #129, 2009.
[25]
A. Seznec, "A case for two-way skewed-associative caches," in phProceedings of the 20th Annual International Symposium on Computer Architecture (ISCA), 1993.
[26]
W. Turner and J. Seader, "Dollars per kW plus dollars per square foot are a better datacenter cost model than dollars per square foot alone," Uptime Institute, Tech. Rep., 2006.
[27]
W. Turner, J. Seader, and K. Brill, "Industry standard tier classifications define site infrastructure performance," Uptime Institute, Tech. Rep., 2005.
[28]
X. Wang and M. Chen, "Cluster-level feedback power control for performance optimization," in phProceedings of the 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA), 2008.
[29]
X. Wang, M. Chen, C. Lefurgy, and T. W. Keller, "SHIP: Scalable hierarchical power control for large--scale data centers," in phProceedings of the 18th International Conference on Parallel Architectures and Compilation Techniques (PACT), 2009.

Cited By

View all
  • (2023)Fast, Light-weight, and Accurate Performance Evaluation using Representative Datacenter BehaviorsProceedings of the 24th International Middleware Conference10.1145/3590140.3629117(220-233)Online publication date: 27-Nov-2023
  • (2021)Precise Power Capping for Latency-Sensitive Applications in DatacenterIEEE Transactions on Sustainable Computing10.1109/TSUSC.2018.28818936:3(469-480)Online publication date: 1-Jul-2021
  • (2021)FlexProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00033(319-332)Online publication date: 14-Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ASPLOS XV: Proceedings of the fifteenth International Conference on Architectural support for programming languages and operating systems
March 2010
422 pages
ISBN:9781605588391
DOI:10.1145/1736020
  • General Chair:
  • James C. Hoe,
  • Program Chair:
  • Vikram S. Adve
  • cover image ACM SIGARCH Computer Architecture News
    ACM SIGARCH Computer Architecture News  Volume 38, Issue 1
    ASPLOS '10
    March 2010
    399 pages
    ISSN:0163-5964
    DOI:10.1145/1735970
    Issue’s Table of Contents
  • cover image ACM SIGPLAN Notices
    ACM SIGPLAN Notices  Volume 45, Issue 3
    ASPLOS '10
    March 2010
    399 pages
    ISSN:0362-1340
    EISSN:1558-1160
    DOI:10.1145/1735971
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. data centers
  2. power infrastructure

Qualifiers

  • Research-article

Conference

ASPLOS '10

Acceptance Rates

ASPLOS XV Paper Acceptance Rate 32 of 181 submissions, 18%;
Overall Acceptance Rate 535 of 2,713 submissions, 20%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)67
  • Downloads (Last 6 weeks)8
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Fast, Light-weight, and Accurate Performance Evaluation using Representative Datacenter BehaviorsProceedings of the 24th International Middleware Conference10.1145/3590140.3629117(220-233)Online publication date: 27-Nov-2023
  • (2021)Precise Power Capping for Latency-Sensitive Applications in DatacenterIEEE Transactions on Sustainable Computing10.1109/TSUSC.2018.28818936:3(469-480)Online publication date: 1-Jul-2021
  • (2021)FlexProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00033(319-332)Online publication date: 14-Jun-2021
  • (2020)Data Center Power Oversubscription with a Medium Voltage Power Plane and Priority-Aware CappingProceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3373376.3378533(497-511)Online publication date: 9-Mar-2020
  • (2020)Fair Online Power Capping for Emergency Handling in Multi-Tenant Cloud Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2017.27623118:1(152-166)Online publication date: 1-Jan-2020
  • (2020)A QoS-Demand-Aware Computing Resource Management Scheme in Cloud-RANIEEE Open Journal of the Communications Society10.1109/OJCOMS.2020.30342971(1850-1863)Online publication date: 2020
  • (2020)Mediating Power Struggles on a Shared Server2020 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)10.1109/ISPASS48437.2020.00030(149-159)Online publication date: Aug-2020
  • (2020)What does Power Consumption Behavior of HPC Jobs Reveal? : Demystifying, Quantifying, and Predicting Power Consumption Characteristics2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS47924.2020.00087(799-809)Online publication date: May-2020
  • (2019)Greener, Energy-Efficient and Sustainable Networks: State-Of-The-Art and New TrendsSensors10.3390/s1922486419:22(4864)Online publication date: 8-Nov-2019
  • (2019)Stochastic resource allocationProceedings of the 15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3313808.3313815(122-136)Online publication date: 14-Apr-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media