Abstract
With the ever increasing trend of dynamic and static content web, clusters have been widely used for large-scale web servers to improve the system scalability. Dynamically switching the cluster nodes between different power states is one effective approach to save the energy in such clusters. Many research efforts have been invested in designing power-aware clusters by using this method. However, booting a cluster node from a low-power state to an active state takes a certain amount of time that depends on different configurations. This process incurs significant performance degradation. The existing work normally trades a certain amount of performance degradation for energy saving. This paper proposes a hybrid method to predict the number of requests per booting time of the web workloads. A power-aware web cluster scheduler is designed to divide the cluster nodes into an active group and a low-power group. The scheduler attempts to minimize the active group and maximize the low-power group, and boot the cluster nodes in the low-power group in advance to minimize/eliminate performance degradation by leveraging the prediction scheme. Furthermore, this paper integrates the power awareness into the conventional load balancers including Least Connections, Deficit Round Robin, and Skew. Comprehensive experiments are performed to explore the potential opportunities to minimize/eliminate the performance degradation of the power-aware web cluster.
Similar content being viewed by others
References
Seitz, C.L.: Recent advances in cluster networks. In: Proceedings of the 2001 IEEE International Conference on Cluster Computing, pp. 365–365. (2001)
Fan, X., Weber, W., Barroso, L.A.: Power provisioning for a warehouse-sized computer, In: Proceedings of the 34th Annual International Symposium on Computer Architecture, pp. 13–23. (2007)
Report to congress on server and data center energy efficiency. http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency_study
IDC China 2008 Predictions. China 2008 Top 10 information and communication technology predictions (2008)
Barroso, L., Hölzle, U.: The case for energy-proportional computing. Computer 40(12), 33–37 (2007)
Vasan, A., Sivasubramaniam, A., Shimpi, V., Sivabalan, T., Subbiah, R.: Worth their watts? An empirical study of datacenter servers. In: Proceedings of the 16th International Symposium on High Performance Computer Architecture (HPCA) (2010)
SPEC-Power and Performance. http://www.spec.org/power_ssj2008/
Chase, J., Anderson, D., Thakar, P., Vahdat, A., Doyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the 18th Symposium on Operating Systems Principles (SOSP), pp. 103–116. (2001)
Pinheiro, E., Bianchini, R., Carrera, E.V., Heath, T.: Load balancing and unbalancing for power and performance in cluster-based systems. In: Proceedings of Workshop Compilers and Operating Systems for Low Power (COLP) (2001)
Meisner, D., Sadler, C., Barroso, L., Weber, W.-D., Wenisch, T. F.: Power management of on-line data intensive services. In: Proceedings of the 38th International Symposium on Computer Architecture (ISCA) (2011)
Advanced Configuration and Power Interface Specification. http://www.acpica.org/
Rajamani, K., Lefurgy, C.: On evaluating request-distribution schemes for saving energy in server clusters. In: Proceedings of the 2003 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS 03) (2003)
Krioukov, A., Mohan, P., Alspaugh, S., Keys, L., Culler, D., Katz, R.: NapSAC: design and implementation of a power-proportional web cluster. ACM SIGCOMM Comput. Commun. Rev. 41(1), 102–109 (2011)
Zhang, F., Chanson, S.: Blocking-aware processor voltage scheduling for real-time tasks. ACM TECS 3(2), 307–335 (2004)
Barroso, L., Hölzle, U.: The case for energy-proportional computing. Computer 40(12), 33–37 (2007)
Femal, M.E., Freeh, V.W.: Boosting data center performance through non-uniform power allocation. In: Proceedings of the 2nd International Conference on Autonomic Computing (ICAC), pp. 250–262. (2005)
Elnozahy, E., Kistler, M., Rajamony, R.: Energy-efficient server clusters. In: Proceedings of the Workshop on Power-Aware Computing Systems (2002)
Horvath, T., Abdelzaher, T., Skadron, K., Liu, X.: Dynamic voltage scaling in multitier web servers with end-to-end delay control. IEEE Trans. Comput. 56(4), 444–458 (2007)
Sharma, V., Thomas, A., Abdelzaher, T., Skadron, K.: Power-aware QoS management in web servers. In: Proceedings of the 24th IEEE Real-Time systems Symposium (RTSS03) (2003)
Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., Zhao, F.: Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of NSDI08 (2008)
Menascé, D.A.: Web performance modeling issues. Int. J. High Perform. Comput. Appl. 14(4), 292–303 (2000)
Iyengar, A., Squillante, M., Zhang, L.: Analysis and characterization of large-scale web server access patterns and performance. World Wide Web 2(1–2), 85–100 (1998)
Baryshnikov, Y., Coffman, E., Pierre, G., et al.: Predictability of web-server traffic congestion. In: Proceedings of the 10th International Workshop on Web Content Caching and Distribution (WCW 2005) (2005)
Dinda, P., Hallaron, D.: Host load prediction using linear models. Clust. Comput. 3(4), 265–280 (2000)
Zhang, W.: Linux virtual servers for scalable network services. In: Ottawa Linux Symposium (2000)
Shreedhar, M., Varghese, G.: Efficient fair queueing using deficit round-robin. IEEE/ACM Trans. Netw. 4(3), 375–385 (1996)
Hwang, C., Wu, A.: A predictive system shutdown method for energy saving of event-driven computation. ACM TODAES 5(2), 226–241 (2000)
Power Analyzer Datalogger. http://www.extech.com/
Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., Wilkes, J.: Hibernator: helping disk arrays sleep through the winter. In: Proceedings of the 20th ACM Symposium on Operating Systems Principles 2005 (SOSP 2005), pp. 177–190. (2005)
Internet Traffic Traces. http://ita.ee.lbl.gov/html/traces.html (2011)
Deng, Y., Meng, X., Zhou, J.: Self-similarity: behind workload reshaping and prediction. Future Gener. Comput. Syst. 28(2), 350–357 (2012)
Ranganathan, P., Leech, P., Irwin, D., Chase, J.: Ensemble-level power management for dense blade servers. In: Proceedings of the International Symposium on Computer Architecture (ISCA06) (2006)
Bisson, T., Brandt, S.A., Long, D.D.E.: A hybrid disk-aware spin-down algorithm with I/O subsystem support. In: proceedings of IEEE International conference on Performance, Computing, and Communications Conference 2007 (IPCCC 2007), pp. 236–245. (2007)
Gianni, R., Linden, P., Arreola, O., Chen, H.: Thermal stress relief with power management. In: Proceedings of the 1997 IEEE International Symposium on Electronics and the Environment (1997)
Deng, Y.: What is the future of disk drives, death or rebirth? ACM Comput. Surv. 43(3), 23 (2011)
Deng, Y., Pung, B.: Conserving disk energy in virtual machine based environments by amplifying bursts. Computing 91(1), 3–21 (2011)
Barroso, L., Hölzle, U.: The case for energy-proportional computing. Computer 40(12), 33–37 (2007)
Acknowledgments
We would like to thank the anonymous reviewers for helping us refine this paper. Their constructive comments and suggestions are very helpful. This work is supported by the National Natural Science Foundation (NSF) of China under Grant (No. 61272073), the key program of Natural Science Foundation of Guangdong Province (No. S2013020012865), National High-tech R&D Program of China (863 Program) (No. 2012AA01A401), National Natural Science Foundation (NSF) of China under Grant (No. 61073064), the Scientific Research Foundation for the Returned Overseas Chinese Scholars (State Education Ministry), the Educational Commission of Guangdong Province (No. 2012KJCX0013), the NSF CCF 0937988, IIS 091663, and EAR 1027809, Open Research Fund of Key Laboratory of Computer System and Architecture, Institute of Computing Technology, Chinese Academy of Sciences (CARCH201107).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Deng, Y., Hu, Y., Meng, X. et al. Predictively booting nodes to minimize performance degradation of a power-aware web cluster. Cluster Comput 17, 1309–1322 (2014). https://doi.org/10.1007/s10586-014-0385-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-014-0385-9