skip to main content
10.1145/2485922.2485973acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiscaConference Proceedingsconference-collections
research-article

Virtualizing power distribution in datacenters

Authors Info & Claims
Published:23 June 2013Publication History

ABSTRACT

Power infrastructure contributes to a significant portion of datacenter expenditures. Overbooking this infrastructure for a high percentile of the needs is becoming more attractive than for occasional peaks. There exist several computing knobs to cap the power draw within such under-provisioned capacity. Recently, batteries and other energy storage devices have been proposed to provide a complementary alternative to these knobs, which when decentralized (or hierarchically placed), can temporarily take the load to suppress power peaks propagating up the hierarchy. With aggressive under-provisioning, the power hierarchy becomes as central a datacenter resource as other computing resources, making it imperative to carefully allocate, isolate and manage this resource (including batteries), across applications. Towards this goal, we present vPower, a software system to virtualize power distribution. vPower includes mechanisms and policies to provide a virtual power hierarchy for each application. It leverages traditional computing knobs as well as batteries, to apportion and manage the infrastructure between co-existing applications in the hierarchy. vPower allows applications to specify their power needs, performs admission control and placement, dynamically monitors power usage, and enforces allocations for fairness and system efficiency. Using several datacenter applications, and a 2-level power hierarchy prototype containing batteries at both levels, we demonstrate the effectiveness of vPower when working in an under-provisioned power infrastructure, using the right computing knobs and the right batteries at the right time. Results show over 50% improved system utilization and scale-out for vPower's over-booking, and between 12-28% better application performance than traditional power-capping control knobs. It also ensures isolation between applications competing for power.

References

  1. F. Bellosa, A. Weibel, M. Waitz, and S. Kellner. Event-Driven Energy Accounting for Dynamic Thermal Management. In Workshop on Compilers and Operating Systems for Low Power (COLP), 2003.Google ScholarGoogle Scholar
  2. R. Bianchini and R. Rajamony. Power and Energy Management for Server Systems. IEEE Computer, 37(11), 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. O. Bilgir, M. Martonosi, and Q. Wu. Exploring the Potential of CMP Core Count Management on Data Center Energy Savings. In Workshop on Energy Efficient Design, 2011.Google ScholarGoogle Scholar
  4. Q. Cao, D. Kassa, N. Pham, Y. Sarwar, and T. Abdelzaher. Virtual Battery: An Energy Reservation Abstraction for Embedded Sensor Networks. In Proceedings of RTSS, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. J. Chase, D. Anderson, P. Thakur, and A. Vahdat. Managing Energy and Server Resources in Hosting Centers. In Proceedings of SOSP, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao. Energy-aware Server Provisioning and Load Dispatching for Connection-intensive Internet Services. In Proceedings of NSDI, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramaniam. Profiling, Prediction, and Capping of Power Consumption in Consolidated Environments. In Proceedings of MASCOTS, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  8. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking Cloud Serving Systems with YCSB. In Proceedings of SoCC, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. G. Dhiman, G. Marchetti, and T. Rosing. vGreen: A System for Energy-Efficient Management of Virtual Machines. ACM TODAES, 16(1):6:1--6:27, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Facebook Rack-level UPS for Improved Efficiency. http://www.datacenterknowledge.com/archives/2011/04/07/.Google ScholarGoogle Scholar
  11. X. Fan, W.-D. Weber, and L. A. Barroso. Power Provisioning for a Warehouse-Sized Computer. In Proceedings of ISCA, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Ferdman, A. Adileh, O. Kocberber, S. Volos, M. Alisafaee, D. Jevdjic, C. Kaynak, A. D. Popescu, A. Ailamaki, and B. Falsafi. Clearing the Clouds: A Study of Emerging Scale-out Workloads on Modern Hardware. In Proceedings of ASPLOS, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy. Optimal Power Allocation in Server Farms. In Proceedings of SIGMETRICS, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Google Server-level UPS for Improved Efficiency. http://news.cnet.com/8301-1001_3-10209580-92.html.Google ScholarGoogle Scholar
  15. S. Govindan, A. Sivasubramaniam, and B. Urgaonkar. Benefits and Limitations of Tapping into Stored Energy For Datacenters. In Proceedings of ISCA, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Govindan, D. Wang, L. Y. Chen, A. Sivasubramaniam, and B. Urgaonkar. Towards Realizing a Low Cost and Highly Available Datacenter Power Infrastructure. In Workshop on HotPower, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. S. Govindan, D. Wang, A. Sivasubramaniam, and B. Urgaonkar. Leveraging Stored Energy for Handling Power Emergencies in Aggressively Provisioned Datacenters. In Proceedings of ASPLOS, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. J. Hamilton. Internet-scale Service Infrastructure Efficiency, ISCA Keynote, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. C. Isci, G. Contreras, and M. Martonosi. Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In Proceedings of MICRO, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Kansal, F. Zhao, J. Liu, N. Kothari, and A. Bhattacharya. Virtual Machine Power Metering and Provisioning. In Proceedings of SOCC, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. V. Kontorinis, L. Zhang, B. Aksanli, J. Sampson, H. Homayoun, E. Pettis, T. Rosing, and D. Tullsen. Managing Distributed UPS Energy for Effective Power Capping in Data Centers. In Proceedings of ISCA, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. J. Leverich, M. Monchiero, V. Talwar, P. Ranganathan, and C. Kozyrakis. Power Management of Datacenter Workloads Using Per-Core Power Gating. IEEE Computer Architecture Letters, 8(2):48--51, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. J. Mars, L. Tang, and R. Hundt. Heterogeneity in Homogeneous Warehouse-Scale Computers: A Performance Opportunity. IEEE Computer Architecture Letters, 10(2):29--32, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. R. Marty and M. D. Hill. Virtual Hierarchies to Support Server Consolidation. In Proceedings of ISCA, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. D. Meisner, B. T. Gold, and T. F. Wenisch. PowerNap: Eliminating Server Idle Power. In Proceedings of ASPLOS, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Memslap: Load Testing and Benchmarking a Server, 2012. http://docs.libmemcached.org/memslap.html/.Google ScholarGoogle Scholar
  27. Microsoft Reveals its Specialty Servers, Racks, Apr. 2011. http://www.datacenterknowledge.com/archives/.Google ScholarGoogle Scholar
  28. J. Moore, J. Chase, P. Ranganathan, and R. Sharma. Making Scheduling Cool: Temperature-Aware Workload Placement in Data Centers. In Proceedings of USENIX, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. R. Nathuji and K. Schwan. VirtualPower: Coordinated Power Management in Virtualized Enterprise Systems. In Proceedings of SOSP, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. S. Pelley, D. Meisner, P. Zandevakili, T. F. Wenisch, and J. Underwood. Power routing: Dynamic power provisioning in the data center. In Proceedings of ASPLOS, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Workshop on COLP, 2001.Google ScholarGoogle Scholar
  32. R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu. No Power Struggles: Coordinated Multi-level Power Management for the Data Center. In Proceedings of ASPLOS, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. K. Shen, A. Shriraman, S. Dwarkadas, X. Zhang, and Z. Chen. Power Containers: An OS Facility for Fine-Grained Power and Energy Management on Multicore Servers. In Proceedings of ASPLOS, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. J. Stoess, C. Klee, S. Domthera, and F. Bellosa. Transparent, power-aware migration in virtualized systems. In GI/ITG Fachgruppentreffen Betriebssysteme, number 2007--23, pages 3--8, 2007.Google ScholarGoogle Scholar
  35. J. Stoess, C. Lang, and F. Bellosa. Energy management for hypervisor-based virtual machines. In Proceedings of USENIX, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. A. Verma, G. Dasgupta, T. Kumar, N. Pradipta, and R. Kothari. Server Workload Analysis for Power Minimization Using Consolidation. In Proceedings of USENIX, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. C. A. Waldspurger and W. E. Weihl. Lottery scheduling: Flexible Proportional-share Resource Management. In Proceedings of OSDI, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. D. Wang, C. Ren, and A. Sivasubramaniam. Virtualizing Power Distribution in the Datacenter. Technical Report CSE-13-004, The Pennsylvania State University, 2013.Google ScholarGoogle Scholar
  39. D. Wang, C. Ren, A. Sivasubramaniam, B. Urgaonkar, and H. Fathy. Energy Storage in Datacenters: What, Where, and How Much? In Proceedings of SIGMETRICS, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. X. Wang and M. Chen. Cluster-level Feedback Power Control for Performance Optimization. In Proceedings of HPCA, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  41. H. Zeng, C. S. Ellis, A. R. Lebeck, and A. Vahdat. ECOSystem: Managing Energy as a First Class Operating System Resource. In Proceedings of ASPLOS, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Virtualizing power distribution in datacenters

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ISCA '13: Proceedings of the 40th Annual International Symposium on Computer Architecture
      June 2013
      686 pages
      ISBN:9781450320795
      DOI:10.1145/2485922
      • cover image ACM SIGARCH Computer Architecture News
        ACM SIGARCH Computer Architecture News  Volume 41, Issue 3
        ICSA '13
        June 2013
        666 pages
        ISSN:0163-5964
        DOI:10.1145/2508148
        Issue’s Table of Contents

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 June 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      ISCA '13 Paper Acceptance Rate56of288submissions,19%Overall Acceptance Rate543of3,203submissions,17%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader