skip to main content
10.1145/1294261.1294287acmconferencesArticle/Chapter ViewAbstractPublication PagessospConference Proceedingsconference-collections
Article

VirtualPower: coordinated power management in virtualized enterprise systems

Published:14 October 2007Publication History

ABSTRACT

Power management has become increasingly necessary in large-scale datacenters to address costs and limitations in cooling or power delivery. This paper explores how to integrate power management mechanisms and policies with the virtualization technologies being actively deployed in these environments. The goals of the proposed VirtualPower approach to online power management are (i) to support the isolated and independent operation assumed by guest virtual machines (VMs) running on virtualized platforms and (ii) to make it possible to control and globally coordinate the effects of the diverse power management policies applied by these VMs to virtualized resources. To attain these goals, VirtualPower extends to guest VMs `soft' versions of the hardware power states for which their policies are designed. The resulting technical challenge is to appropriately map VM-level updates made to soft power states to actual changes in the states or in the allocation of underlying virtualized hardware. An implementation of VirtualPower Management (VPM) for the Xen hypervisor addresses this challenge by provision of multiple system-level abstractions including VPM states, channels, mechanisms, and rules. Experimental evaluations on modern multicore platforms highlight resulting improvements in online power management capabilities, including minimization of power consumption with little or no performance penalties and the ability to throttle power consumption while still meeting application requirements. Finally, coordination of online methods for server consolidation with VPM management techniques in heterogeneous server systems is shown to provide up to 34% improvements in power consumption.

Skip Supplemental Material Section

Supplemental Material

1294287.mp4

mp4

146 MB

References

  1. S. Agarwala, F. Alegre, K. Schwan, and J. Mehalingham. E2eprof: Automated end-to-end performance management for enterprise systems. In Proceedings of the IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. J. Almeida, V. Almeida, D. Ardagna, C. Francalanci, and M. Trubian. Resource management in the autonomic service-oriented architecture. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.Google ScholarGoogle Scholar
  4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. D. Brooks and M. Martonosi. Dynamic thermal management for high-performance microprocessors. In Proceedings of the 7th International Symposium on High-Performance Computer Architecture (HPCA), January 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proceedings of the 18th Symposium on Operating Systems Principles (SOSP), 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. E. N. Elnozahy, M. Kistler, and R. Rajamony. Energy-efficient server clusters. In Proceedings of the Workshop on Power-Aware Computing Systems, February 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. X. Fan, W.-D. Weber, and L. Barroso. Power provisioning for a warehouse-sized computer. In Proceedings of the International Symposium on Computer Architecture (ISCA), June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. M. Femal and V. Freeh. Boosting data center performance through non-uniform power allocation. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. K. Flautner and T. Mudge. Vertigo: Automatic performance-setting for linux. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI), 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Flinn and M. Satyanarayanan. Energy-aware adaptation for mobile applications. In Proceedings of the Symposium on Operating Systems Principles (SOSP), December 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. S. Ghiasi, T. Keller, and F. Rawson. Scheduling for heterogeneous processors in server systems. In Proceedings of the International Conference on Computing Frontiers, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Graupner, R. Konig, V. Machiraju, J. Pruyne, A. Sahai, and A. V. Moorsel. Impact of virtualization on management systems. Technical report, Hewlett-Packard Labs, 2003.Google ScholarGoogle Scholar
  15. T. Heath, A. P. Centeno, P. George, L. Ramos, Y. Jaluria, and R. Bianchini. Mercury and freon: Temperature emulation and management in server systems. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), October 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. Heath, B. Diniz, E. V. Carrera, W. Meira Jr., and R. Bianchini. Energy conservation in heterogeneous server clusters. In Proceedings of the 10th Symposium on Principles and Practice of Parallel Programming (PPoPP), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004.Google ScholarGoogle Scholar
  18. C. Isci, G. Contreras, and M. Martonosi. Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In Proceedings of the 39th International Symposium on Microarchitecture (MICRO--39), December 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Y. Koh, R. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu. An analysis of performance interference effects in virtual environments. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007.Google ScholarGoogle ScholarCross RefCross Ref
  20. R. Kotla, S. Ghiasi, T. Keller, and F. Rawson. Scheduling processor voltage and frequency in server and cluster systems. In Proceedings of the Workshop on High-Performance, Power-Aware Computing (HP--PAC), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. R. Kumar, D. Tullsen, P. Ranganathan, N. Jouppi, and K. Farkas. Single-isa heterogeneous multi-core architectures for multithreaded workload performance. In Proceedings of the International Symposium on Computer Architecture (ISCA), June 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. C. Lefurgy, X. Wang, and M. Ware. Server-level power control. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. H. Li, C. Cher, T. Vijaykumar, and K. Roy. Vsv: L2-miss-driven variable supply-voltage scaling for low power. In Proceedings of the IEEE International Symposium on Microarchitecture (MICRO--36), December 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Lim, V. Freeh, and D. Lowenthal. Adaptive, transparent frequency and voltage scaling of communication phases in mpi programs. In IEEE/ACM Supercomputing, November 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. J. Moore, J. Chase, P. Ranganathan, and R. Sharma. Making scheduling cool: Temperature-aware workload placement in data centers. In Proceedings of the USENIX Annual Technical Conference, June 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. R. Nathuji, C. Isci, and E. Gorbatov. Exploiting platform heterogeneity for power efficient data centers. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. R. Nathuji and K. Schwan. Reducing system level power consumption for mobile and embedded platforms. In Proceedings of the International Conference on Architecture of Computing Systems (ARCS), March 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. G. Neiger, A. Santoni, F. Leung, D. Rodgers, and R. Uhlig. Intel virtualization technology: Hardware support for efficient processor virtualization. In Intel Technology Journal (http://www.intel.com/technology/itj/2006/v10i3/), August 2006.Google ScholarGoogle Scholar
  29. Nutch. http://lucene.apache.org/nutch.Google ScholarGoogle Scholar
  30. P. Pillai and K. Shin. Real-time dynamic voltage scaling for low-power embedded operating systems. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP), October 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. C. Poellabauer, L. Singleton, and K. Schwan. Feedback-based dynamic frequency scaling for memory-bound real-time applications. In Proceedings of the 11th Real-Time and Embedded Technology and Applications Symposium (RTAS), March 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. K. Rajamani and C. Lefurgy. On evaluating request-distribution schemes for saving energy in server clusters. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), March 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. P. Ranganathan, P. Leech, D. Irwin, and J. Chase. Ensemble-level power management for dense blade servers. In Proceedings of the International Symposium on Computer Architecture (ISCA), 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. B. Seshasayee, R. Nathuji, and K. Schwan. Energy-aware mobile service overlays: Cooperative dynamic power management in distributed mobile systems. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. J. Stoess, C. Lang, and F. Bellosa. Energy management for hypervisor-based virtual machines. In Proceedings of the USENIX Annual Technical Conference, June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. J. Sugerman, G. Venkitachalam, and B.-H. Lim. Virtualizing i/o devices on vmware workstation's hosted virtual machine monitor. In Proceedings of the USENIX Annual Technical Conference, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. W. Yuan and K. Nahrstedt. Energy-efficient soft real-time cpu scheduling for mobile multimedia systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. H. Zeng, C. Ellis, A. Lebeck, and A. Vahdat. Currentcy: A unifying abstraction for expressing energy management policies. In Proceedings of the USENIX Annual Technical Conference, June 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. Hibernator: Helping disk arrays sleep through the winter. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP), October 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. VirtualPower: coordinated power management in virtualized enterprise systems

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              SOSP '07: Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
              October 2007
              378 pages
              ISBN:9781595935915
              DOI:10.1145/1294261
              • cover image ACM SIGOPS Operating Systems Review
                ACM SIGOPS Operating Systems Review  Volume 41, Issue 6
                SOSP '07
                December 2007
                363 pages
                ISSN:0163-5980
                DOI:10.1145/1323293
                Issue’s Table of Contents

              Copyright © 2007 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 14 October 2007

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • Article

              Acceptance Rates

              Overall Acceptance Rate131of716submissions,18%

              Upcoming Conference

              SOSP '24

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader