Yiyu Chen
ABSTRACT
The growing cost of tuning and managing computer systems is leading to out-sourcing of commercial services to hosting centers. These centers provision thousands of dense servers within a relatively small real-estate in order to host the applications/services of different customers who may have been assured by a service-level agreement (SLA). Power consumption of these servers is becoming a serious concern in the design and operation of the hosting centers. The effects of high power consumption manifest not only in the costs spent in designing effective cooling systems to ward off the generated heat, but in the cost of electricity consumption itself. It is crucial to deploy power management strategies in these hosting centers to lower these costs towards enhancing profitability. At the same time, techniques for power management that include shutting down these servers and/or modulating their operational speed, can impact the ability of the hosting center to meet SLAs. In addition, repeated on-off cycles can increase the wear-and-tear of server components, incurring costs for their procurement and replacement. This paper presents a formalism to this problem, and proposes three new online solution strategies based on steady state queuing analysis, feedback control theory, and a hybrid mechanism borrowing ideas from these two. Using real web server traces, we show that these solutions are more adaptive to workload behavior when performing server provisioning and speed control than earlier heuristics towards minimizing operational costs while meeting the SLAs.
- Web Caching project. http://www.ircache.net.]]Google Scholar
- Intel Outlines Platform Innovations for More Manageable, Balanced and Secure Enterprise Computing. Intel Press Release, February 2004. http://www.intel.com/ca/pressroom/2004/0218b.htm.]]Google Scholar
- T. Abdelzaher, K. G. Shin, and N. Bhatti. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, 13(1), 2002.]] Google ScholarDigital Library
- B. D. O. Anderson and J. B. Moore. Optimal Control: Linear Quadratic Methods. Prentice Hall, 1989.]] Google ScholarDigital Library
- K. Appleby, S. Fakhouri, L. Fong, G. Goldszmidt, M. Kalantar, S. Krishnakumar, D. Pazel, J. Pershing, and B. Rochwerger. Oceano-SLA Based Management of a Computing Utility. In Proceedings of the IEEE/IFIP Integrated Network Management, May 2001.]]Google ScholarCross Ref
- P. Bohrer, M. Elnozahy, M. Kistler, C. Lefurgy, C. McDowell, and R. Rajamony. The Case for Power Management in Web Servers. In R. Graybill and R. Melhem, editors, Power Aware Computing. Kluwer Academic Publishers, 2002.]] Google ScholarDigital Library
- G. Bolch, S. Greiner, H. Meer, and K. S. Trivedi. Queueing Networks and Markov Chains: Modeling and Performance Evaluation with Computer Science Applications. John Wiley, New York, 1998.]] Google ScholarDigital Library
- E. Carrera, E. Pinheiro, and R. Bianchini. Conserving Disk Energy in Network Servers. In Proceedings of the 17th International Conference on Supercomputing, 2003.]] Google ScholarDigital Library
- A. Chandra, P. Goyal, and P. Shenoy. Quantifying the Benefits of Resource Multiplexing in On-Demand Data Centers. In Proceedings of First ACM Workshop on Algorithms and Architectures for Self-Managing Systems, June 2003.]]Google Scholar
- A. Chandrakasan and R. W. Brodersen. Low-Power CMOS Design. Wiley-IEEE Press, 1998.]] Google ScholarDigital Library
- J. Chase, D. Anderson, P. Thakur, and A. Vahdat. Managing Energy and Server Resources in Hosting Centers. In Proceedings of the 18th Symposium on Operating Systems Principles SOSP'01, October 2001.]] Google ScholarDigital Library
- J. Chase and R. Doyle. Balance of Power: Energy Management for Server Clusters. In Proceedings of the 8th Workshop on Hot Topics in Operating Systems, May 2001.]] Google ScholarDigital Library
- Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam. Managing Server Energy and Operational Costs in Hosting Centers. Technical Report CSE-05-002, The Pennsylvania State University, February 2005.]]Google ScholarDigital Library
- J. G. Elerath. Specifying Reliability in the Disk Drive Industry: No More MTBFs. In Proceedings of the Annual Reliability and Maintainability Symposium, pages 194--199, 2000.]]Google ScholarCross Ref
- M. Elnozahy, M. Kistler, and R. Rajamony. Energy-Efficient Server Clusters. In Proceedings of the Second Workshop on Power Aware Computing Systems, February 2002.]] Google ScholarDigital Library
- M. Elnozahy, M. Kistler, and R. Rajamony. Energy Conservation Policies for Web Servers. In Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems, March 2003.]] Google ScholarDigital Library
- K. Flautner, S. Reinhardt, and T. Mudge. Automatic performance setting for dynamic voltage scaling. In Proceedings of the 7th annual international conference on Mobile computing and networking, pages 260--271, 2001.]] Google ScholarDigital Library
- N. Gandhi, S. Parekh, J Hellerstein, and D. Tilbury. Feedback Control of a Lotus Notes Server: Modeling and Control Design. In Proceedings of the American Control Conference, 2001.]]Google ScholarCross Ref
- D. Grunwald, P. Levis, K. I. Farkas, C. B. Morrey III, and M. Neufeld. Policies for Dynamic Clock Scheduling. In Proceedings of the Symposium on Operating Systems Design and Implementation, pages 73--86, 2000.]] Google ScholarDigital Library
- S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. DRPM: Dynamic Speed Control for Power Management in Server Class Disks. In Proceedings of the International Symposium on Computer Architecture, pages 169--179, 2003.]] Google ScholarDigital Library
- D. P. Helmbold, D. E. Long, T. L. Sconyers, and B. Sherrod. Adaptive disk spin-down for mobile computers. Mob. Netw. Appl., 5(4):285--297, 2000.]] Google ScholarDigital Library
- J. Jones and B. Fonseca. Energy Crisis Pinches Hosting Vendors. http://iwsun4.infoworld.com/articles/hn/xml/01/01/08/010108hnpower.xml.]]Google Scholar
- C. Lefurgy, K. Rajamani, F. Rawson, W. Felter, M. Kistler, and T. W. Kelle. Energy Management for Commercial Servers. IEEE Computer, 36(12):39--48, 2003.]] Google ScholarDigital Library
- K. Li, R. Kumpf, P. Horton, and T. E. Anderson. Quantitative Analysis of Disk Drive Power Management in Portable Computers. Technical report, University of California at Berkeley, 1993.]] Google ScholarDigital Library
- J. R. Lorch and A. J. Smith. Improving Dynamic Voltage Scaling Algorithms with PACE. In Proceedings of ACM SIGMETRICS, June 2001.]] Google ScholarDigital Library
- C. Lu, T. F. Abdelzaher, J. A. Stankovic, and S. H. Son. A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers. In Proceedings of the Seventh Real-Time Technology and Applications Symposium, page 51, 2001.]] Google ScholarDigital Library
- C. D. Patel, C. E. Bash, C. Belady, L. Stahl, and D. Sullivan. Computational Fluid Dynamics Modeling of High Compute Density Data Centers to Assure System Inlet Air Specifications. In Proceedings of the Pacific Rim ASME International Electronic Packaging Technical Conference and Exhibition (IPACK), 2001.]]Google Scholar
- T. Pering, T. Burd, and R. Brodersen. The simulation and evaluation of dynamic voltage scaling algorithms. In Proceedings of the 1998 international symposium on Low power electronics and design, pages 76--81, 1998.]] Google ScholarDigital Library
- E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Proceedings of the Workshop on Compilers and Operating Systems for Low Power, September 2001.]]Google Scholar
- P. Pradhan, R. Tewari, S. Sahu, A. Chandra, and P. Shenoy. An Observation-based Approach Towards Self-managing Web Servers. In Proceedings of ACM/IEEE Intl Workshop on Quality of Service, May 2002.]]Google ScholarCross Ref
- S. Ranjan, J. Rolia, H. Fu, and E. Knightly. QoS-Driven Server Migration for Internet Data Centers. In Proceedings of International Workshop on QoS, May 2002.]]Google ScholarCross Ref
- K. Roy and S. Prasad. Low-Power CMOS VLSI Circuit Design. John Wiley and Sons, New York, 2000.]]Google Scholar
- V. Sharma, A. Thomas, T. Abdelzaher, and K. Skadron. Power-aware QoS Management in Web Servers. In Proceedings of the Real-Time Systems Symposium, December 2003.]] Google ScholarDigital Library
- K. Shen, H. Tang, T. Yang, and L. Chu. Integrated resource management for cluster-based Internet services. SIGOPS Oper. Syst. Rev., 36(11):225--238, 2002.]] Google ScholarDigital Library
- D. S. Stoffer and R. H. Shumway. Time Series Analysis and Its Applications. Springer Verlag, New York, 2000.]] Google ScholarDigital Library
- B. Urgaonkar and P. Shenoy. Cataclysm: Handling Extreme Overloads in Internet Services. In Proceedings of ACM Principles of Distributed Computing, July 2004.]] Google ScholarDigital Library
- M. Weiser, B. Welch, A. J. Demers, and S. Shenker. Scheduling for Reduced CPU Energy. In Proceedings of the Symposium on Operating Systems Design and Implementation, pages 13--23, 1994.]] Google ScholarDigital Library
- Q. Zhang, E. Smirni, and G. Ciardo. Profit-driven Service Differentiation in Transient Environments. In Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003.]]Google ScholarCross Ref
Index Terms
- Managing server energy and operational costs in hosting centers
Recommendations
Managing energy and server resources in hosting centers
Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving ...
Managing server energy and operational costs in hosting centers
Performance evaluation reviewThe growing cost of tuning and managing computer systems is leading to out-sourcing of commercial services to hosting centers. These centers provision thousands of dense servers within a relatively small real-estate in order to host the applications/...
Managing energy and server resources in hosting centers
SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principlesInternet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving ...
Comments