Skip to main content

Advertisement

Springer Nature Link
Log in

Online real-time energy consumption optimization with resistance to server switch jitter for server clusters

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Adjusting the deployment of each server in a server cluster in real-time and online based on a changing load has important considerations. In response to the deficiencies in the existing research on server switch jitter and real-time optimization, this paper proposes a periodic energy consumption optimization strategy based on mixed integer programming (MIP) for server clusters. During an optimization period, the strategy allows the CPU of the server to switch between adjacent frequencies to optimize cluster energy consumption at a granular level. First, we describe cluster energy optimization as a basic MIP model, with a reasonable definition of the decision variables and the modeling of the server load and power. Then, we include the server switch overhead in the objective function of the model, considering the joint optimization of multiple periods. Finally, we design an efficient solution scheme based on Gurobi and create two solution adjustment schemes that can reduce CPU frequency switching. The test results reveal that the proposed strategy can effectively suppress server switch jitter and can be carried out in real-time. The extra power cost of reducing CPU frequency switching is also evaluated and analyzed in the testing section.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

No datasets were generated or analyzed during the current study.

References

  1. Piontek T, Haghshenas K, Aiello M (2024) Carbon emission-aware job scheduling for Kubernetes deployments. J Supercomput 80:549–569

    Article  Google Scholar 

  2. Koot M, Wijnhoven F (2021) Usage impact on data center electricity needs: A system dynamic forecasting model. Appl Energy 291:116798

    Article  Google Scholar 

  3. Liang J, Lin W, Xu Y, Liu Y, Mo R, Luo X (2024) Energy-aware parameter tuning for mixed workloads in cloud server. Clust Comput 27:4805–4821

    Article  MATH  Google Scholar 

  4. Arshad U, Aleem M, Srivastava G, Lin JC-W (2022) Utilizing power consumption and SLA violations using dynamic VM consolidation in cloud data centers. Renew Sustain Energy Rev 167:112782

    Article  Google Scholar 

  5. Cui Y, Zhang Y, Li X, Jin S (2023) A dynamic energy conservation scheme with dual-rate adjustment and semi-sleep mode in cloud system. J Supercomput 79:2451–2487

    Article  MATH  Google Scholar 

  6. Dong Z, Liu N, Rojas-Cessa R (2015) Greedy scheduling of tasks with time constraints for energy-efficient cloud-computing data centers. J Cloud Comput Adv Syst Appl 4:5

    Article  MATH  Google Scholar 

  7. Shi X, Dong J, Djouadi SM, Feng Y, Ma X, Wang Y (2016) PAPMSC: Power-aware performance management approach for virtualized web servers via stochastic control. J Grid Comput 14:171–191

    Article  Google Scholar 

  8. Zhang W, Zhang Z, Zeadally S, Chao H-C, Leung VCM (2020) Energy-efficient workload allocation and computation resource configuration in distributed cloud/edge computing systems with stochastic workloads. IEEE J Sel Areas Commun 38(6):1118–1132

    Article  MATH  Google Scholar 

  9. Ciesielczyk T, Cabrera A, Oleksiak A, Piątek W, Waligóra G, Almeida F, Blanco V (2021) An approach to reduce energy consumption and performance losses on heterogeneous servers using power capping. J Sched 24:489–505

    Article  MathSciNet  Google Scholar 

  10. Enokido T, Duolikun D, Takizawa M (2017) An energy-aware load balancing algorithm to perform computation type application processes in a cluster of servers. Int J Web Grid Serv 13(2):145–169

    Article  MATH  Google Scholar 

  11. Wang Q, Cai H, Cao Q, Wang F (2020) An energy-efficient power management for heterogeneous servers in data centers. Computing 102:1717–1741

    Article  MATH  Google Scholar 

  12. Entrialgo J, Medrano R, García DF, García J (2016) Autonomic power management with self-healing in server clusters under QoS constraints. Computing 98:871–894

    Article  MathSciNet  MATH  Google Scholar 

  13. Zhou Z, Liu F, Zou R, Liu J, Xu H, Jin H (2016) Carbon-aware online control of geo-distributed cloud services. IEEE Trans Parallel Distrib Syst 27(9):2506–2519

    Article  MATH  Google Scholar 

  14. Kwon S, Ntaimo L, Gautam N (2019) Demand response in data centers: integration of server provisioning and power procurement. IEEE Trans Smart Grid 10(5):4928–4938

    Article  MATH  Google Scholar 

  15. Gu C, Li Z, Huang H, Jia X (2020) Energy efficient scheduling of servers with multi-sleep modes for cloud data center. IEEE Trans Cloud Comput 8(3):833–846

    MATH  Google Scholar 

  16. Aalto S, Lassila P (2019) Near-optimal dispatching policy for energy-aware server clusters. Perform Eval 135:102034

    Article  MATH  Google Scholar 

  17. Chang C-J, Chang F-M, Ke J-C (2019) Optimal power consumption analysis of a load-dependent server activation policy for a data service center. Comput Ind Eng 130:745–756

    Article  MATH  Google Scholar 

  18. O’Dwyer KJ, Creedon E, Purcell M, Malone D (2020) Power saving proxies for web servers. Comput J 63(2):179–192

    Article  Google Scholar 

  19. Monteiro A, Loques O (2019) Quantum virtual machine: power and performance management in virtualized web servers clusters. Clust Comput 22:205–221

    Article  MATH  Google Scholar 

  20. Xiong Z, Zhao M, Tan L, Cai L (2022) Real-time power optimization for application server clusters based on Mixed-Integer Programming. Futur Gener Comput Syst 137:260–273

    Article  MATH  Google Scholar 

  21. Xiong Z, Zhao M, Yuan Z, Xu J, Cai L (2023) Energy-saving optimization of application server clusters based on mixed integer linear programming. J Parallel Distrib Comput 171:111–129

    Article  MATH  Google Scholar 

  22. Gurobi Optimization. The fastest solver - Gurobi, https://www.gurobi.com. Accessed 28 February 2024

  23. Ajmera K, Tewari TK (2023) SR-PSO: server residual efficiency-aware particle swarm optimization for dynamic virtual machine scheduling. J Supercomput 79:15459–15495

    Article  Google Scholar 

  24. Abbasi-khazaei T, Rezvani MH (2022) Energy-aware and carbon-efficient VM placement optimization in cloud datacenters using evolutionary computing methods. Soft Comput 26:9287–9322

    Article  MATH  Google Scholar 

  25. Li Z, Lin K, Cheng S, Yu L, Qian J (2022) Energy-efficient and load-aware VM placement in cloud data centers. Journal of Grid Computing 20:39

    Article  MATH  Google Scholar 

  26. Jayanetti A, Halgamuge S, Buyya R (2022) Deep reinforcement learning for energy and time optimized scheduling of precedence-constrained tasks in edge–cloud computing environments. Futur Gener Comput Syst 137:14–30

    Article  Google Scholar 

  27. Cheng D, Zhou X, Lama P, Ji M, Jiang C (2018) Energy efficiency aware task assignment with DVFS in heterogeneous Hadoop clusters. IEEE Trans Parallel Distrib Syst 29(1):70–82

    Article  MATH  Google Scholar 

  28. Dabiri S, Azizi S, Abdollahpouri A (2022) Optimizing deadline violation time and energy consumption of IoT jobs in fog–cloud computing. Neural Comput Appl 34:21157–21173

    Article  Google Scholar 

  29. Chai S, Huang J (2024) Dependent task scheduling using parallel deep neural networks in mobile edge computing. J Grid Comput 22:27

    Article  MATH  Google Scholar 

  30. Tian Y, Lin C, Yao M (2012) Modeling and analyzing power management policies in server farms using stochastic Petri nets. In: Proceedings of the 3rd international conference on Future Energy Systems: Where Energy, Computing and Communication Meet, Article 26

  31. Villebonnet V, Da Costa G, Lefevre L, Pierson J M, Stolf P (2016) Energy aware dynamic provisioning for heterogeneous data centers. In: Proceedings of 2016 28th international symposium on computer architecture and high performance computing, pp 206–213

  32. Krzywda J, Ali-Eldin A, Carlson TE, Östberg P-O, Elmroth E (2018) Power-performance tradeoffs in data center servers: DVFS, CPU pinning, horizontal, and vertical scaling. Futur Gener Comput Syst 81:114–128

    Article  Google Scholar 

  33. Fatehi S, Motameni H, Barzegar B, Golsorkhtabaramiri M (2021) Energy aware multi objective algorithm for task scheduling on DFVS-enabled cloud datacenters using fuzzy NSGA-II. Int J Nonlinear Anal Appl 12(2):2303–2331

    MATH  Google Scholar 

  34. Cheng D, Guo Y, Jiang C, Zhou X (2015) Self-tuning batching with DVFS for performance improvement and energy efficiency in internet servers. ACM Trans Auton Adapt Syst 10(1):6

    Article  MATH  Google Scholar 

  35. Cao J, Li K, Stojmenovic I (2014) Optimal power allocation and load distribution for multiple heterogeneous multicore server processors across clouds and data centers. IEEE Trans Comput 63(1):45–58

    Article  MathSciNet  MATH  Google Scholar 

  36. Gurobi Optimization. GRBModel::addSOS(), https://www.gurobi.com/documentation/9.5/refman/cpp_model_addsos.html. Accessed 28 February 2024

  37. Gurobi Optimization. GRBModel::addGenConstrMax(), https://www.gurobi.com/documentation/9.5/refman/cpp_model_agc_max.html. Accessed 28 February 2024

  38. Alibaba. Cluster-trace-v2018, https://github.com/alibaba/clusterdata/blob/master/cluster-trace-v2018, 2019. Accessed 28 February 2024

Download references

Funding

This work is supported in part by the National Natural Science Foundation of China under Grant 61202366, the Guangdong Basic and Applied Basic Research Foundation, China under Grant 2024A1515011765, and the Guangdong Science and Technology Plan Project, China under Grant STKJ2023012.

Author information

Authors and Affiliations

  1. Department of Computer Science and Technology, Shantou University, Shantou, 515063, China

    Zhi Xiong, Linhui Tan, Jianlong Xu & Lingru Cai

  2. Key Laboratory of Intelligent Manufacturing Technology (Shantou University), Ministry of Education, Shantou University, Shantou, 515063, China

    Zhi Xiong, Jianlong Xu & Lingru Cai

Authors
  1. Zhi Xiong
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Linhui Tan
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Jianlong Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Lingru Cai
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Zhi Xiong was contributed conceptualization, formal analysis, writing—review and editing, and verification proof. Linhui Tan was involved in software and experimentation. Jianlong Xu was performed experimentation and writing—review and editing. Lingru Cai was done formal analysis and writing—original draft.

Corresponding author

Correspondence to Zhi Xiong.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Ethical approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiong, Z., Tan, L., Xu, J. et al. Online real-time energy consumption optimization with resistance to server switch jitter for server clusters. J Supercomput 81, 460 (2025). https://doi.org/10.1007/s11227-024-06827-x

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-024-06827-x

Keywords