Skip to main content

An Energy-Efficient Scheduling Method for Real-Time Multi-workflow in Container Cloud

  • Conference paper
  • First Online:
Combinatorial Optimization and Applications (COCOA 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14461))

  • 256 Accesses

Abstract

Cloud computing has a powerful ability to handle a large number of tasks. Correspondingly, it also consumes a lot of energy. Reducing the energy consumption of cloud service platforms while ensuring the quality of service has become a crucial issue. In this paper, we propose a heuristic energy-saving scheduling algorithm named Real-time Multi-workflow Energy-efficient Scheduling (RMES) with the aim to minimize the total energy consumption in container cloud. RMES executes tasks as parallel as possible to enhance the resource utilization of the running machines in cluster, therefore reducing the time of the global process, saving energy as a result. RMES takes advantage of the affinity between containers and machines to meet the resource quantity and performance requirements of containers during scheduling. In order to follow the change of the system state overtime, we introduce the re-scheduling mechanism, which can automatically adjust the scheduling decisions of the tasks that have not yet been executed in the scheduling scheme. The experimental results show that RMES has obvious advantages over other scheduling algorithms in terms of energy consumption and success ratio.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://confluence.pegasus.isi.edu/display/pegasus/WorkflowGenerator.

References

  1. Third quarter 2021 specpower_ssj2008 results (2021). www.spec.org/power_ssj2008/results/res2021q3/

  2. Al-Dulaimy, A., Taheri, J., Kassler, A., HoseinyFarahabady, M.R., Deng, S., Zomaya, A.: Multiscaler: a multi-loop auto-scaling approach for cloud-based applications. IEEE Trans. Cloud Comput. 10(4), 2769–2786 (2022)

    Article  Google Scholar 

  3. Arabnejad, V., Bubendorfer, K., Ng, B.: Dynamic multi-workflow scheduling: a deadline and cost-aware approach for commercial clouds. Futur. Gener. Comput. Syst. 100, 98–108 (2019)

    Article  Google Scholar 

  4. Beloglazov, A., Buyya, R., Lee, Y.C., Zomaya, A.: A taxonomy and survey of energy-efficient data centers and cloud computing systems. In: Advances in Computers, vol. 82, pp. 47–111 (2011)

    Google Scholar 

  5. Chen, H., Zhu, X., Liu, G., Pedrycz, W.: Uncertainty-aware online scheduling for real-time workflows in cloud service environment. IEEE Trans. Serv. Comput. 14(4), 1167–1178 (2018)

    Article  Google Scholar 

  6. Cheng, M., Li, J., Nazarian, S.: DRL-cloud: deep reinforcement learning-based resource provisioning and task scheduling for cloud service providers. In: 2018 23rd Asia and South Pacific Design Automation Conference, pp. 129–134 (2018)

    Google Scholar 

  7. Deng, F., Lai, M., Geng, J.: Multi-workflow scheduling based on genetic algorithm. In: 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), pp. 300–305. IEEE (2019)

    Google Scholar 

  8. Ding, D., Fan, X., Zhao, Y., Kang, K., Yin, Q., Zeng, J.: Q-learning based dynamic task scheduling for energy-efficient cloud computing. Futur. Gener. Comput. Syst. 108, 361–371 (2020)

    Article  Google Scholar 

  9. Havet, A., Schiavoni, V., Felber, P., Colmant, M., Rouvoy, R., Fetzer, C.: Genpack: a generational scheduler for cloud data centers. In: 2017 IEEE International Conference on Cloud Engineering (IC2E), pp. 95–104 (2017)

    Google Scholar 

  10. Hu, B., Cao, Z., Zhou, M.: Scheduling real-time parallel applications in cloud to minimize energy consumption. IEEE Trans. Cloud Comput. 10(1), 662–674 (2022)

    Article  Google Scholar 

  11. Hu, Y., Zhou, H., de Laat, C., Zhao, Z.: Concurrent container scheduling on heterogeneous clusters with multi-resource constraints. Futur. Gener. Comput. Syst. 102, 562–573 (2020)

    Article  Google Scholar 

  12. Hussain, M., Wei, L.F., Lakhan, A., Wali, S., Ali, S., Hussain, A.: Energy and performance-efficient task scheduling in heterogeneous virtualized cloud computing. Sustain. Comput. Inform. Syst. 30, 100517 (2021)

    Google Scholar 

  13. Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. Futur. Gener. Comput. Syst. 29(3), 682–692 (2013)

    Article  Google Scholar 

  14. Merkel, D., et al.: Docker: lightweight Linux containers for consistent development and deployment. Linux J. 2014(239), 2 (2014)

    Google Scholar 

  15. Sun, Z., Huang, H., Li, Z., Gu, C., Xie, R., Qian, B.: Efficient, economical and energy-saving multi-workflow scheduling in hybrid cloud. Expert Syst. Appl. 228, 120401 (2023)

    Article  Google Scholar 

  16. Sun, Z., Zhang, B., Gu, C., Xie, R., Qian, B., Huang, H.: ET2FA: a hybrid heuristic algorithm for deadline-constrained workflow scheduling in cloud. IEEE Trans. Serv. Comput. 16(3), 1807–1821 (2023)

    Google Scholar 

  17. Zhang, F., Tang, X., Li, X., Khan, S.U., Li, Z.: Quantifying cloud elasticity with container-based autoscaling. Futur. Gener. Comput. Syst. 98, 672–681 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the Shenzhen Science and Technology Program under Grant No. GXWD20220817124827001, and No. JCYJ20210324132406016.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chonglin Gu .

Editor information

Editors and Affiliations

Appendices

Appendix for “An Energy-Efficient Scheduling Method for Real-Time Multi-workflow in Container Cloud”

A Detailed Pseudocode of the Proposed Algorithm

The detailed procedure is given in Algorithm 1. \(task_{ready}\) and \(task_{scheduled}\) represent task sets of type task ready and task scheduled in the task pool, respectively. \({<}Q_{n,i,j}, c_i, p_j{>}\) means assign \(task_n\) to \(c_i\) running in \(p_j\). Firstly, we evaluate the task state in the system and judge whether to reschedule the scheduled tasks according to the current task state of the system, as shown in lines 2–10 of Algorithm 1. Then, for the task to be scheduled, the system calculates the Q value of the task deployed on the existing container, and deploys the task to the container with the lowest Q value, as shown in lines 11–24 of Algorithm 1. For a task without a suitable container to run, the system will create a new container for it, calculate the Q value of the container deployed to each PM in the cluster, and select the PM with the lowest Q value to run the container, as shown in lines 25–41 of Algorithm 1.

Algorithm 1
figure a

RMES

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sun, Z., Li, Z., Gu, C., Huang, H. (2024). An Energy-Efficient Scheduling Method for Real-Time Multi-workflow in Container Cloud. In: Wu, W., Guo, J. (eds) Combinatorial Optimization and Applications. COCOA 2023. Lecture Notes in Computer Science, vol 14461. Springer, Cham. https://doi.org/10.1007/978-3-031-49611-0_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49611-0_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49610-3

  • Online ISBN: 978-3-031-49611-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics