Skip to main content
SpringerLink
Log in

MO-FreeVM: multi-objective server release algorithm for cluster resource management

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

With the rise of 5G/6G and cloud computing, cluster management has become increasingly popular. Elastic cluster resources allow cloud clients to dynamically scale their resource requirements over time. Existing researches of cluster schedulers focus on improving resource scheduling speed, increasing cluster utilization, compacting the number of active physical machines (PMs) and time satisfaction function (TSF) within a cluster. The TSF is applied as a time to measure the parallel-VM scheduling problem. However, completing execution time (makespan) of task requests is often neglected, which results in inaccurate scheduling and unreasonable total cost computation. The total cost involves PM cost, migrate cost, and balance cost. To solve the problem of inaccurate scheduling of task requests and total cost billing in cluster management, in this paper, we propose an innovative heuristic algorithm, namely, multi-objective two-stage variable neighborhood searching (MO_STVNS), which aims at minimizing total cost while also considering TSF for active PMs. Moreover, we design a Multi-Objective FreeVM (MO-FreeVM) scheduler based on resource prediction, which incorporates a variety of algorithms to work in collaboration to provide near-optimal resource management for cluster. We evaluate MO_STVNS in different real traces and measure it through extensive experiments. The experimental results show that compared with state-of-art methods, the average total cost and average TSF of MO_STVNS are reduced by 33.75% and 60.67% respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

All data generated or analysed during this study are included in the article.

Code availability

Open source software is used.

References

  1. Birke, R., Podzimek, A., Chen, L.Y., Smirni, E.: Virtualization in the private cloud: state of the practice. IEEE Trans. Netw. Serv. Manag. 13(3), 608–621 (2016)

    Article  Google Scholar 

  2. Stoyanova, M., Nikoloudakis, Y., Panagiotakis, S., Pallis, E., Markakis, E.K.: A survey on the internet of things (iot) forensics: challenges, approaches, and open issues. IEEE Commun. Surv. Tutor. 22(2), 1191–1221 (2020)

    Article  Google Scholar 

  3. Wan, J., Li, X., Dai, H.-N., Kusiak, A., Martínez-García, M., Li, D.: Artificial-intelligence-driven customized manufacturing factory: key technologies, applications, and challenges. Proc. IEEE. 109(4), 377–398 (2020)

    Article  Google Scholar 

  4. Saxena, D., Singh, A.K., Buyya, R.: Op-mlb: An online vm prediction based multi-objective load balancing framework for resource management at cloud datacenter. IEEE Trans. Cloud Comput. (2021). https://doi.org/10.1109/TCC.2021.3059096

  5. Guerrero, C., Lera, I., Juiz, C.: Genetic algorithm for multi-objective optimization of container allocation in cloud architecture. J. Grid Comput. 16(1), 113–135 (2018)

    Article  Google Scholar 

  6. Liu, B., Li, P., Lin, W., Shu, N., Li, Y., Chang, V.: A new container scheduling algorithm based on multi-objective optimization. Soft Comput. 22(23), 7741–7752 (2018)

    Article  Google Scholar 

  7. Kaewkasi, C., Chuenmuneewong, K.: Improvement of container scheduling for Docker using ant colony optimization. In: 2017 9th International Conference on Knowledge and Smart Technology (KST), pp. 254–259. IEEE (2017)

  8. Taherizadeh, S., Stankovski, V.: Dynamic multi-level auto-scaling rules for containerized applications. Comput. J. 62(2), 174–197 (2019)

    Article  Google Scholar 

  9. Kehrer, S., Blochinger, W.: Tosca-based container orchestration on mesos. Comput. Sci. Res. Dev. 33(3), 305–316 (2018)

    Article  Google Scholar 

  10. Yin, L., Luo, J., Luo, H.: Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans. Industr. Inf. 14(10), 4712–4721 (2018)

    Article  Google Scholar 

  11. Xu, X., Yu, H., Pei, X.: A novel resource scheduling approach in container based clouds. In: 2014 IEEE 17th International Conference on Computational Science and Engineering, pp. 257–264. IEEE (2014)

  12. Han, P., Du, C., Chen, J., Ling, F., Du, X.: Cost and makespan scheduling of workflows in clouds using list multiobjective optimization technique. J. Syst. Arch. 112, 101837 (2021)

  13. Zhou, X., Zhang, G., Sun, J., Zhou, J., Wei, T., Hu, S.: Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based heft. Future Gener. Comput. Syst. 93, 278–289 (2019)

  14. Kaur, N., Aulakh, T.S., Cheema, R.S.: Comparison of workflow scheduling algorithms in cloud computing. Int. J. Adv. Compute. Sci. Appl. 2(10), 81 (2011)

  15. Liu, K., Jin, H., Chen, J., Liu, X., Yuan, D., Yang, Y.: A compromised-time-cost scheduling algorithm in swindew-c for instance-intensive cost-constrained workflows on a cloud computing platform. Int. J. High Perform. Comput. Appl. 24(4), 445–456 (2010)

  16. Wu, Z., Liu, X., Ni, Z., Yuan, D., Yang, Y.: A market-oriented hierarchical scheduling strategy in cloud workflow systems. J. Supercomput. 63(1), 256–293 (2013)

    Article  Google Scholar 

  17. Abrishami, S., Naghibzadeh, M.: Deadline-constrained workflow scheduling in software as a service cloud. Sci. Iran. 19(3), 680–689 (2012)

    Article  Google Scholar 

  18. Barroso, L.A., Clidaras, J., Hölzle, U.: The datacenter as a computer: an introduction to the design of warehouse-scale machines. Synt. Lect. Comput. Architect. 8(3), 1–154 (2013)

    Article  Google Scholar 

  19. Alshahrani, R., Peyravi, H.: Modeling and simulation of data center networks. In: Proceedings of the 2nd ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, pp. 75–82 (2014)

  20. Alkhanak, E.N., Lee, S.P., Khan, S.U.R.: Cost-aware challenges for workflow scheduling approaches in cloud computing environments: taxonomy and opportunities. Future Gener. Comput. Syst. 50, 3–21 (2015)

    Article  Google Scholar 

  21. Zhang, S., Zhang, Y., Gong, X., Wang, R.: Freevm: A server release algorithm in datacenter network. In: ICC 2021-IEEE International Conference on Communications, pp. 1–6 (2021). IEEE

  22. Verma, A., Ahuja, P., Neogi, A.: pmapper: power and migration cost aware application placement in virtualized systems. In: ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing, pp. 243–264. Springer (2008)

  23. Ferdaus, M.H., Murshed, M., Calheiros, R.N., Buyya, R.: Virtual machine consolidation in cloud data centers using aco metaheuristic. In: European Conference on Parallel Processing, pp. 306–317. Springer (2014)

  24. Le, T.N., Sun, X., Chowdhury, M., Liu, Z.: Allox: compute allocation in hybrid clusters. In: Proceedings of the Fifteenth European Conference on Computer Systems, pp. 1–16 (2020)

  25. Chaudhary, S., Ramjee, R., Sivathanu, M., Kwatra, N., Viswanatha, S.: Balancing efficiency and fairness in heterogeneous gpu clusters for deep learning. In: Proceedings of the Fifteenth European Conference on Computer Systems, pp. 1–16 (2020)

  26. Joseph, C.T., Chandrasekaran, K., Cyriac, R.: Improving the efficiency of genetic algorithm approach to virtual machine allocation. In: 2014 International Conference on Computer and Communication Technology (ICCCT), pp. 111–116 (2014). IEEE

  27. Wu, Y., Tang, M., Fraser, W.: A simulated annealing algorithm for energy efficient virtual machine placement. In: 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1245–1250. IEEE (2012)

  28. Zhang, X., Lin, Q., Mao, W., Liu, S., Dou, Z., Liu, G.: Hybrid particle swarm and grey wolf optimizer and its application to clustering optimization. Appl. Soft Comput. 101, 107061 (2021)

    Article  Google Scholar 

  29. Zhang, Y., Li, Y., Xu, K., Wang, D., Li, M., Cao, X., Liang, Q.: A communication-aware container re-distribution approach for high performance vnfs. In: 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), pp. 1555–1564. IEEE (2017)

  30. Lv, L., Zhang, Y., Li, Y., Xu, K., Wang, D., Wang, W., Li, M., Cao, X., Liang, Q.: Communication-aware container placement and reassignment in large-scale internet data centers. IEEE J. Select. Areas Commun. 37(3), 540–555 (2019)

    Article  Google Scholar 

  31. Canali, C., Chiaraviglio, L., Lancellotti, R., Shojafar, M.: Joint minimization of the energy costs from computing, data transmission, and migrations in cloud data centers. IEEE Trans. Green Commun. Netw. 2(2), 580–595 (2018)

    Article  Google Scholar 

  32. Ran, W., Yuchao, Z., Wendong, W., Ke, X., Laizhong, C.: Algorithm of mixed traffic scheduling among data centers based on prediction. J. Comput. Res. Dev. 58(6), 1307 (2021)

    Google Scholar 

  33. Pickartz, S., Eiling, N., Lankes, S., Razik, L., Monti, A.: Migrating linux containers using criu. In: International Conference on High Performance Computing, pp. 674–684. Springer (2016)

  34. Rizvi, N., Dharavath, R., Edla, D.R.: Cost and makespan aware workflow scheduling in iaas clouds using hybrid spider monkey optimization. Simul. Model. Pract. Theory 110, 102328 (2021)

    Article  Google Scholar 

  35. Sahni, J., Vidyarthi, D.P.: A cost-effective deadline-constrained dynamic scheduling algorithm for scientific workflows in a cloud environment. IEEE Trans. Cloud Comput. 6(1), 2–18 (2015)

    Article  Google Scholar 

  36. Wu, K.: A tunable workflow scheduling algorithm based on particle swarm optimization for cloud computing (2014)

  37. Su, S., Li, J., Huang, Q., Huang, X., Shuang, K., Wang, J.: Cost-efficient task scheduling for executing large programs in the cloud. Parall. Comput. 39(4–5), 177–188 (2013)

    Article  Google Scholar 

  38. Quan, Z., Wang, Z.-J., Ye, T., Guo, S.: Task scheduling for energy consumption constrained parallel applications on heterogeneous computing systems. IEEE Trans. Parall. Distrib. Syst. 31(5), 1165–1182 (2019)

    Article  Google Scholar 

  39. Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J.: Large-scale cluster management at google with borg. In: Proceedings of the Tenth European Conference on Computer Systems, pp. 1–17 (2015)

  40. Burns, B., Beda, J., Hightower, K.: Kubernetes: up and Running: Dive Into the Future of Infrastructure. O’Reilly Media, ??? (2019)

  41. Garefalakis, P., Karanasos, K., Pietzuch, P., Suresh, A., Rao, S.: Medea: scheduling of long running applications in shared production clusters. In: Proceedings of the Thirteenth EuroSys Conference, pp. 1–13 (2018)

  42. Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S.: Apache hadoop yarn: yet another resource negotiator. In: Proceedings of the 4th Annual Symposium on Cloud Computing, pp. 1–16 (2013)

  43. Al-Moalmi, A., Luo, J., Salah, A., Li, K.: Optimal virtual machine placement based on grey wolf optimization. Electronics 8(3), 283 (2019)

    Article  Google Scholar 

  44. Zhang, L., Li, K., Li, C., Li, K.: Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems. Inf. Sci. 379, 241–256 (2017)

    Article  Google Scholar 

  45. Khalilzad, N., Faragardi, H.R., Nolte, T.: Towards energy-aware placement of real-time virtual machines in a cloud data center. In: 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems, pp. 1657–1662 (2015). IEEE

  46. Marotta, A., Avallone, S.: A simulated annealing based approach for power efficient virtual machines consolidation. In: 2015 IEEE 8th International Conference on Cloud Computing, pp. 445–452 (2015). IEEE

  47. Zhong, Z., Buyya, R.: A cost-efficient container orchestration strategy in kubernetes-based cloud computing infrastructures with heterogeneous resources. ACM Trans. Internet Technol. (TOIT) 20(2), 1–24 (2020)

    Article  Google Scholar 

  48. Curino, C., Krishnan, S., Karanasos, K., Rao, S., Fumarola, G.M., Huang, B., Chaliparambil, K., Suresh, A., Chen, Y., Heddaya, S.: Hydra: a federated resource manager for data-center scale analytics. In: 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19), pp. 177–192 (2019)

  49. Liu, X., Cheng, B., Wang, S.: Availability-aware and energy-efficient virtual cluster allocation based on multi-objective optimization in cloud datacenters. IEEE Trans. Netw. Serv. Manag. 17(2), 972–985 (2020)

    Article  Google Scholar 

  50. Li, C., Wang, Y., Tang, H., Luo, Y.: Dynamic multi-objective optimized replica placement and migration strategies for saas applications in edge cloud. Future Gener. Comput. Syst. 100, 921–937 (2019)

    Article  Google Scholar 

  51. Ji, J.-Y., Wong, M.L.: An improved dynamic multi-objective optimization approach for nonlinear equation systems. Inf. Sci. 576, 204–227 (2021)

    Article  MathSciNet  Google Scholar 

  52. Patel, Y.S., Malwi, Z., Nighojkar, A., Misra, R.: Truthful online double auction based dynamic resource provisioning for multi-objective trade-offs in iaas clouds. Clust. Comput. 24(3), 1855–1879 (2021)

    Article  Google Scholar 

  53. Devi, K.L., Valli, S.: Multi-objective heuristics algorithm for dynamic resource scheduling in the cloud computing environment. J. Supercomput. 77(8), 8252–8280 (2021)

    Article  Google Scholar 

  54. Liu, Q., Yu, Z.: The elasticity and plasticity in semi-containerized co-locating cloud workload: a view from alibaba trace. In: Proceedings of the ACM Symposium on Cloud Computing, pp. 347–360 (2018)

  55. Hansen, P., Mladenović, N., Moreno Perez, J.A.: Variable neighbourhood search: methods and applications. 4OR 6(4), 319–360 (2008)

  56. Lusa, A., Potts, C.N.: A variable neighbourhood search algorithm for the constrained task allocation problem. J. Oper. Res. Soc. 59(6), 812–822 (2008)

    Article  MATH  Google Scholar 

  57. Kardani-Moghaddam, S., Khodadadi, F., Entezari-Maleki, R., Movaghar, A.: A hybrid genetic algorithm and variable neighborhood search for task scheduling problem in grid environment. Proc. Eng. 29, 3808–3814 (2012)

    Article  Google Scholar 

  58. Google trace. https://github.com/google/cluster-data (2011)

  59. Tripathi, A.K., Sharma, K., Bala, M.: A novel clustering method using enhanced grey wolf optimizer and mapreduce. Big Data Res. 14, 93–100 (2018)

    Article  Google Scholar 

  60. Tariq, R., Aadil, F., Malik, M.F., Ejaz, S., Khan, M.U., Khan, M.F.: Directed acyclic graph based task scheduling algorithm for heterogeneous systems. In: Proceedings of SAI Intelligent Systems Conference, pp. 936–947. Springer (2018)

  61. Google trace. https://github.com/alibaba/clusterdata (2017)

  62. Fatima, A., Javaid, N., Anjum Butt, A., Sultana, T., Hussain, W., Bilal, M., Hashmi, M.A.U.R., Akbar, M., Ilahi, M.: An enhanced multi-objective gray wolf optimization for virtual machine placement in cloud data centers. Electronics 8(2), 218 (2019)

  63. Singh, P., Rizvi, M.A.: Virtual machine selection strategy based on grey wolf optimizer in cloud environment: a study. In: 2018 8th International Conference on Communication Systems and Network Technologies (CSNT), pp. 108–112. IEEE (2018)

  64. Kaaouache, M.A., Bouamama, S.: An energy-efficient vm placement method for cloud data centers using a hybrid genetic algorithm. J. Syst. Inf. Technol. 20, 430–445 (2018)

Download references

Funding

The work was supported in part by the National Natural Science Foundation of China (NSFC) under Grant 62172054, the Key Project of Beijing Natural Science Foundation under M21030, the NSFC under Grant 62072047, and the National Key R&D Program of China under Grant 2019YFB1802603.

Author information

Authors and Affiliations

  1. The State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, No.10 Xitucheng Road, Haidian District, Beijing, 100089, China

    Shiyan Zhang, Yuchao Zhang, Ran Wang & Xiangyang Gong

Authors
  1. Shiyan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuchao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ran Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiangyang Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Methodology, Shiyan Zhang; Writing-original draft preparation, Shiyan Zhang; Writing review and editing, Shiyan Zhang, Ran Wang; Funding acquisition, Yuchao Zhang. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Yuchao Zhang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, S., Zhang, Y., Wang, R. et al. MO-FreeVM: multi-objective server release algorithm for cluster resource management. Cluster Comput 26, 1011–1034 (2023). https://doi.org/10.1007/s10586-022-03663-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-022-03663-7

Keywords

Search

Navigation