ABSTRACT
Power infrastructure contributes to a significant portion of datacenter expenditures. Overbooking this infrastructure for a high percentile of the needs is becoming more attractive than for occasional peaks. There exist several computing knobs to cap the power draw within such under-provisioned capacity. Recently, batteries and other energy storage devices have been proposed to provide a complementary alternative to these knobs, which when decentralized (or hierarchically placed), can temporarily take the load to suppress power peaks propagating up the hierarchy. With aggressive under-provisioning, the power hierarchy becomes as central a datacenter resource as other computing resources, making it imperative to carefully allocate, isolate and manage this resource (including batteries), across applications. Towards this goal, we present vPower, a software system to virtualize power distribution. vPower includes mechanisms and policies to provide a virtual power hierarchy for each application. It leverages traditional computing knobs as well as batteries, to apportion and manage the infrastructure between co-existing applications in the hierarchy. vPower allows applications to specify their power needs, performs admission control and placement, dynamically monitors power usage, and enforces allocations for fairness and system efficiency. Using several datacenter applications, and a 2-level power hierarchy prototype containing batteries at both levels, we demonstrate the effectiveness of vPower when working in an under-provisioned power infrastructure, using the right computing knobs and the right batteries at the right time. Results show over 50% improved system utilization and scale-out for vPower's over-booking, and between 12-28% better application performance than traditional power-capping control knobs. It also ensures isolation between applications competing for power.
- F. Bellosa, A. Weibel, M. Waitz, and S. Kellner. Event-Driven Energy Accounting for Dynamic Thermal Management. In Workshop on Compilers and Operating Systems for Low Power (COLP), 2003.Google Scholar
- R. Bianchini and R. Rajamony. Power and Energy Management for Server Systems. IEEE Computer, 37(11), 2004. Google ScholarDigital Library
- O. Bilgir, M. Martonosi, and Q. Wu. Exploring the Potential of CMP Core Count Management on Data Center Energy Savings. In Workshop on Energy Efficient Design, 2011.Google Scholar
- Q. Cao, D. Kassa, N. Pham, Y. Sarwar, and T. Abdelzaher. Virtual Battery: An Energy Reservation Abstraction for Embedded Sensor Networks. In Proceedings of RTSS, 2008. Google ScholarDigital Library
- J. Chase, D. Anderson, P. Thakur, and A. Vahdat. Managing Energy and Server Resources in Hosting Centers. In Proceedings of SOSP, 2001. Google ScholarDigital Library
- G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao. Energy-aware Server Provisioning and Load Dispatching for Connection-intensive Internet Services. In Proceedings of NSDI, 2008. Google ScholarDigital Library
- J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramaniam. Profiling, Prediction, and Capping of Power Consumption in Consolidated Environments. In Proceedings of MASCOTS, 2008.Google ScholarCross Ref
- B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking Cloud Serving Systems with YCSB. In Proceedings of SoCC, 2010. Google ScholarDigital Library
- G. Dhiman, G. Marchetti, and T. Rosing. vGreen: A System for Energy-Efficient Management of Virtual Machines. ACM TODAES, 16(1):6:1--6:27, 2010. Google ScholarDigital Library
- Facebook Rack-level UPS for Improved Efficiency. http://www.datacenterknowledge.com/archives/2011/04/07/.Google Scholar
- X. Fan, W.-D. Weber, and L. A. Barroso. Power Provisioning for a Warehouse-Sized Computer. In Proceedings of ISCA, 2007. Google ScholarDigital Library
- M. Ferdman, A. Adileh, O. Kocberber, S. Volos, M. Alisafaee, D. Jevdjic, C. Kaynak, A. D. Popescu, A. Ailamaki, and B. Falsafi. Clearing the Clouds: A Study of Emerging Scale-out Workloads on Modern Hardware. In Proceedings of ASPLOS, 2012. Google ScholarDigital Library
- A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy. Optimal Power Allocation in Server Farms. In Proceedings of SIGMETRICS, 2009. Google ScholarDigital Library
- Google Server-level UPS for Improved Efficiency. http://news.cnet.com/8301-1001_3-10209580-92.html.Google Scholar
- S. Govindan, A. Sivasubramaniam, and B. Urgaonkar. Benefits and Limitations of Tapping into Stored Energy For Datacenters. In Proceedings of ISCA, 2011. Google ScholarDigital Library
- S. Govindan, D. Wang, L. Y. Chen, A. Sivasubramaniam, and B. Urgaonkar. Towards Realizing a Low Cost and Highly Available Datacenter Power Infrastructure. In Workshop on HotPower, 2011. Google ScholarDigital Library
- S. Govindan, D. Wang, A. Sivasubramaniam, and B. Urgaonkar. Leveraging Stored Energy for Handling Power Emergencies in Aggressively Provisioned Datacenters. In Proceedings of ASPLOS, 2012. Google ScholarDigital Library
- J. Hamilton. Internet-scale Service Infrastructure Efficiency, ISCA Keynote, 2009. Google ScholarDigital Library
- C. Isci, G. Contreras, and M. Martonosi. Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In Proceedings of MICRO, 2006. Google ScholarDigital Library
- A. Kansal, F. Zhao, J. Liu, N. Kothari, and A. Bhattacharya. Virtual Machine Power Metering and Provisioning. In Proceedings of SOCC, 2010. Google ScholarDigital Library
- V. Kontorinis, L. Zhang, B. Aksanli, J. Sampson, H. Homayoun, E. Pettis, T. Rosing, and D. Tullsen. Managing Distributed UPS Energy for Effective Power Capping in Data Centers. In Proceedings of ISCA, 2012. Google ScholarDigital Library
- J. Leverich, M. Monchiero, V. Talwar, P. Ranganathan, and C. Kozyrakis. Power Management of Datacenter Workloads Using Per-Core Power Gating. IEEE Computer Architecture Letters, 8(2):48--51, 2009. Google ScholarDigital Library
- J. Mars, L. Tang, and R. Hundt. Heterogeneity in Homogeneous Warehouse-Scale Computers: A Performance Opportunity. IEEE Computer Architecture Letters, 10(2):29--32, 2011. Google ScholarDigital Library
- M. R. Marty and M. D. Hill. Virtual Hierarchies to Support Server Consolidation. In Proceedings of ISCA, 2007. Google ScholarDigital Library
- D. Meisner, B. T. Gold, and T. F. Wenisch. PowerNap: Eliminating Server Idle Power. In Proceedings of ASPLOS, 2009. Google ScholarDigital Library
- Memslap: Load Testing and Benchmarking a Server, 2012. http://docs.libmemcached.org/memslap.html/.Google Scholar
- Microsoft Reveals its Specialty Servers, Racks, Apr. 2011. http://www.datacenterknowledge.com/archives/.Google Scholar
- J. Moore, J. Chase, P. Ranganathan, and R. Sharma. Making Scheduling Cool: Temperature-Aware Workload Placement in Data Centers. In Proceedings of USENIX, 2005. Google ScholarDigital Library
- R. Nathuji and K. Schwan. VirtualPower: Coordinated Power Management in Virtualized Enterprise Systems. In Proceedings of SOSP, 2007. Google ScholarDigital Library
- S. Pelley, D. Meisner, P. Zandevakili, T. F. Wenisch, and J. Underwood. Power routing: Dynamic power provisioning in the data center. In Proceedings of ASPLOS, 2010. Google ScholarDigital Library
- E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Workshop on COLP, 2001.Google Scholar
- R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu. No Power Struggles: Coordinated Multi-level Power Management for the Data Center. In Proceedings of ASPLOS, 2008. Google ScholarDigital Library
- K. Shen, A. Shriraman, S. Dwarkadas, X. Zhang, and Z. Chen. Power Containers: An OS Facility for Fine-Grained Power and Energy Management on Multicore Servers. In Proceedings of ASPLOS, 2013. Google ScholarDigital Library
- J. Stoess, C. Klee, S. Domthera, and F. Bellosa. Transparent, power-aware migration in virtualized systems. In GI/ITG Fachgruppentreffen Betriebssysteme, number 2007--23, pages 3--8, 2007.Google Scholar
- J. Stoess, C. Lang, and F. Bellosa. Energy management for hypervisor-based virtual machines. In Proceedings of USENIX, 2007. Google ScholarDigital Library
- A. Verma, G. Dasgupta, T. Kumar, N. Pradipta, and R. Kothari. Server Workload Analysis for Power Minimization Using Consolidation. In Proceedings of USENIX, 2009. Google ScholarDigital Library
- C. A. Waldspurger and W. E. Weihl. Lottery scheduling: Flexible Proportional-share Resource Management. In Proceedings of OSDI, 1994. Google ScholarDigital Library
- D. Wang, C. Ren, and A. Sivasubramaniam. Virtualizing Power Distribution in the Datacenter. Technical Report CSE-13-004, The Pennsylvania State University, 2013.Google Scholar
- D. Wang, C. Ren, A. Sivasubramaniam, B. Urgaonkar, and H. Fathy. Energy Storage in Datacenters: What, Where, and How Much? In Proceedings of SIGMETRICS, 2012. Google ScholarDigital Library
- X. Wang and M. Chen. Cluster-level Feedback Power Control for Performance Optimization. In Proceedings of HPCA, 2008.Google ScholarCross Ref
- H. Zeng, C. S. Ellis, A. R. Lebeck, and A. Vahdat. ECOSystem: Managing Energy as a First Class Operating System Resource. In Proceedings of ASPLOS, 2002. Google ScholarDigital Library
Index Terms
- Virtualizing power distribution in datacenters
Recommendations
Virtualizing power distribution in datacenters
ICSA '13Power infrastructure contributes to a significant portion of datacenter expenditures. Overbooking this infrastructure for a high percentile of the needs is becoming more attractive than for occasional peaks. There exist several computing knobs to cap ...
Aggressive Datacenter Power Provisioning with Batteries
Datacenters spend $10--25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively ...
Underprovisioning the Grid Power Infrastructure for Green Datacenters
ICS '15: Proceedings of the 29th ACM on International Conference on SupercomputingWhile there have been prior studies on underprovisioning the power distribution infrastructure for a grid-based datacenter, how to save grid capital investment by means of leveraging renewable energy to underprovision the grid power infrastructure in ...
Comments