Abstract
Energy consumption is a growing concern in cloud data centers because underutilization of servers results in significant wasted power. Thus, improving server utilization for optimal energy use is now an urgent issue. We propose an energy-saving strategy based on multi-server vacation queuing theory that switches servers between on and sleep in groups. The strategy incorporates both synchronous and asynchronous strategies. When the number of idle servers reaches to a given threshold, idle servers enter sleep mode synchronously as a group. Varying workloads cause groups of servers to sleep asynchronously. We model the data center with our strategy as an M/M/H vacation queuing system and construct a two-dimensional continuous-time Markov chain to formulate the queuing system. Using a powerful matrix-geometric method, we obtain the stationary probability distribution for the system states. We use results from theoretical and simulated experiments to estimate the performance of our approach. The results are valuable for studying the power-performance trade-off in cloud data centers.
Similar content being viewed by others
References
Lovasz G, Niedermeier F, De Meer H (2013) Performance tradeoffs of energy-aware virtual machine consolidation. J Netw Softw Tools Appl 16:37–38
Hameed A, Khoshkbarforoushha A, Ranjan R et al (2014) A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems. Computing 98:751–774
Jing SY, Ali S, She K et al (2013) State-of-the-art research study for green cloud computing. J Supercomput 21:701–712
Tan Y-M, Zeng G-S, Wang W (2012) Policy of energy optimal management for cloud computing platform with stochastic tasks. J Softw 23:266–278
Xiong K, Perros H (2009) Service performance and analysis in cloud computing. In: Proceedings of IEEE World Conference Services, pp 693–700
Yang B, Tan F, Dai Y-S (2009) Performance evaluation of cloud service considering fault recovery. In: Proceedings of the First International Conference on Cloud, pp 571–576
Kusaka T, Okuda T, Ideguchi T et al (2011) Queuing theoretic approach to server allocation problem in time-delay cloud computing systems. In: Proceedings of the 23rd International Teletraffic Congress, pp 310–311
Xu XL, Zhang ZG (2006) Analysis of multi-server queue with a single vacation (e, d)-policy. Perform Eval 63:825–838
Wang W, Luo J-Z, Song A-B (2013) Dynamic pricing based energy cost optimization data center environments. Chin J Comput 36:599–612
Liu MX, Ma ZY, Xu XL (2006) The M/M/c Queue with policy and asynchronous multiple vacation of partial servers. J Yanshan Univ 3:230–234
Kumar JA, Vasudevan S (2012) Verifying dynamic power managements schemes using statistical model checking. In: Proceedings of the 17th Asia and South Pacific Design Automation Conference, pp 579–584
Wang L, von Laszewski G, Dayal J et al (2010) Towards energy aware scheduling for precedence constrained parallel tasks in a cluster with DVFS. In: Proceeding of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, pp 368–377
Kang J, Ranka S (2010) Dynamic slack allocation algorithms for energy minimization on parallel machines. J Parallel Distrib Comput 70(5):417–430
Sakata T, Kasahara S (2016) Multi-server queue with job service time depending on a background process. In: van Do T, Takahashi Y, Yue W, Nguyen VH (eds) Queueing theory and network applications. Springer, Cham, pp 163–171
Cheng CL, Wang Y, Deng Y (2015) Strategy of servers awakening based on dynamic threshold in cloud computing. Syst Eng Electron 6:1437–1445
Kuehn PJ, Mashaly M (2015) Automatic energy efficiency management of data center resources by load-dependent server activation and sleep modes. Ad Hoc Netw 25:497–504
Liao D, Li K, Sun G et al (2015) Energy and performance management in large data centers: a queuing theory perspective. In: Proceedings of 2015 International Conference on Computing, Networking and Communications, pp 287–291
Cheng CL, Li J, Wang Y (2015) An energy-saving task scheduling strategy based on vacation queuing theory in cloud computing. Tsinghua Sci Technol 20:28–39
Nguyen BM, Tran D, Nguye G (2016) Enhancing service capability with multiple finite capacity server queues in cloud data centers. Clust Comput 19:1747–1767
Phung-Duc T, Kawanishi K (2016) Impacts of retrials on power-saving policy in data centers. In: Proceedings of the 11th International Conference on Queueing Theory and Network Applications, p 22
Acknowledgements
This work was supported in part by National Natural Science Foundation (No. 61472342), China, and was supported by Hebei Province Science Foundation (No. F2017203141).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chunxia, Y., Shunfu, J. An energy-saving strategy based on multi-server vacation queuing theory in cloud data center. J Supercomput 74, 6766–6784 (2018). https://doi.org/10.1007/s11227-018-2513-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-018-2513-4