Abstract
Power management is becoming an increasingly critical component of modern enterprise computing environments. The traditional drive for higher performance has influenced trends towards consolidation and higher densities, artifacts enabled by virtualization and new small form factor server blades. The resulting effect has been increased power and cooling requirements in data centers which elevate ownership costs and put more pressure on rack and enclosure densities. To address these issues, we exploit a fundamental characteristic of data centers: “platform heterogeneity”. This heterogeneity stems from the architectural and management-capability variations of the underlying platforms. We define an intelligent heterogeneity-aware load management (HALM) system that leverages heterogeneity characteristics to provide two data center level benefits: (i) power efficient allocations of workloads to the best fitting platforms and (ii) improved overall performance in a power constrained environment. Our infrastructure relies upon platform and workload descriptors as well as a novel analytical prediction layer that accurately predicts workload power/performance across different platform architectures and power management capabilities. Our allocation scheme achieves on average 20% improvements in power efficiency for representative heterogeneous data center configurations, and up to 18% improvements in performance degradation when power budgeting must be performed. These results highlight the significant potential of heterogeneity-aware management.
Similar content being viewed by others
References
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003
Bianchini, R., Rajamony, R.: Power and energy management for server systems. IEEE Comput. 37(11), 68–76 (2004)
Brooks, D., Martonosi, M.: Dynamic thermal management for high-performance microprocessors. In: Proceedings of the 7th International Symposium on High-Performance Computer Architecture (HPCA), January 2001
Chase, J., Anderson, D., Thakar, P., Vahdat, A., Doyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the 18th Symposium on Operating Systems Principles (SOSP), October 2001
Chou, Y., Fahs, B., Abraham, S.: Microarchitecture optimizations for exploiting memory-level parallelism. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2004
Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005
Elnozahy, E.N., Kistler, M., Rajamony, R.: Energy-efficient server clusters. In: Proceedings of the Workshop on Power-Aware Computing Systems, February 2002
Fan, X., Weber, W.-D., Barroso, L.: Power provisioning for a warehouse-sized computer. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2007
Femal, M., Freeh, V.: Boosting data center performance through non-uniform power allocation. In: Proceedings of the Second International Conference on Autonomic Computing (ICAC), 2005
Ghiasi, S., Keller, T., Rawson, F.: Scheduling for heterogeneous processors in server systems. In: Proceedings of the International Conference on Computing Frontiers, 2005
Heath, T., Centeno, A.P., George, P., Ramos, L., Jaluria, Y., Bianchini, R.: Mercury and freon: Temperature emulation and management in server systems. In: Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), October 2006
Heath, T., Diniz, B., Carrera, E.V., Meira, W. Jr., Bianchini, R.: Energy conservation in heterogeneous server clusters. In: Proceedings of the 10th Symposium on Principles and Practice of Parallel Programming (PPoPP), 2005
Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba: Advanced configuration and power interface specification. http://www.acpi.info (2004)
Isci, C., Contreras, G., Martonosi, M.: Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In: Proceedings of the 39th International Symposium on Microarchitecture (MICRO-39), December 2006
Koh, Y., Knauerhase, R., Brett, P., Bowman, M., Wen, Z., Pu, C.: An analysis of performance interference effects in virtual environments. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007
Kotla, R., Ghiasi, S., Keller, T., Rawson, F.: Scheduling processor voltage and frequency in server and cluster systems. In: Proceedings of the Workshop on High-Performance, Power-Aware Computing (HP-PAC), 2005
Kumar, R., Tullsen, D., Ranganathan, P., Jouppi, N., Farkas, K.: Single-Isa heterogeneous multi-core architectures for multithreaded workload performance. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2004
Lefurgy, C., Wang, X., Ware, M.: Server-level power control. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007
Li, H., Cher, C., Vijaykumar, T., Roy, K.: Vsv: L2-miss-driven variable supply-voltage scaling for low power. In: Proceedings of the IEEE International Symposium on Microarchitecture (MICRO-36), 2003
Luo, K., Gummaraju, J., Franklin, M.: Balancing throughput and fairness in SMT processors. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), November 2001
Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling cool: Temperature-aware workload placement in data centers. In: Proceedings of USENIX ’05, June 2005
Nathuji, R., Isci, C., Gorbatov, E.: Exploiting platform heterogeneity for power efficient data centers. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007
Rajamani, K., Lefurgy, C.: On evaluating request-distribution schemes for saving energy in server clusters. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), March 2003
Ranganathan, P., Leech, P., Irwin, D., Chase, J.: Ensemble-level power management for dense blade servers. In: Proceedings of the International Symposium on Computer Architecture (ISCA), 2006
Sugerman, J., Venkitachalam, G., Lim, B.-H.: Virtualizing i/o devices on VMware workstation’s hosted virtual machine monitor. In: Proceedings of the USENIX Annual Technical Conference, 2001
Zhang, W.: Linux virtual server for scalable network services. In: Ottawa Linux Symposium, 2000
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nathuji, R., Isci, C., Gorbatov, E. et al. Providing platform heterogeneity-awareness for data center power management. Cluster Comput 11, 259–271 (2008). https://doi.org/10.1007/s10586-008-0054-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-008-0054-y