Skip to main content

Advertisement

Log in

An adaptive and deadline-constrained workflow scheduling algorithm in infrastructure as a service clouds

  • Original Article
  • Published:
Iran Journal of Computer Science Aims and scope Submit manuscript

Abstract

Cloud computing technology, which is a model of service provisioning in distributed systems, has been introduced as a way to execute workflow applications. One of the most challenging problems for executing workflow applications in cloud environment is developing workflow scheduling algorithms that consider different QoS requirements such as time and cost. We have previously presented a workflow scheduling algorithm called the CTDC (Constrained Time and Decreased Cost), which decreases the execution cost of the workflow while meeting user-defined deadline. However, the CTDC algorithm is a static scheduling algorithm and does not take into account the virtual machine performance variability. In CTDC algorithm, if the performance of virtual machines is reduced during the execution of the workflow due to the virtualization of resources and shared nature of infrastructure, the virtual machines cannot complete the tasks within the estimated time, and thus, the defined deadline will be missed. Therefore, in this paper, we complete the CTDC algorithm and propose a scheduling algorithm named AWS-CTDC (Adaptive Workflow Scheduling-CTDC) which considers the performance variation of virtual machines in the cloud environment and tries to complete the execution of the workflow within the user-defined deadline. The AWS-CTDC algorithm involves initial static scheduling, monitoring the finish time of completed tasks and rescheduling unexecuted tasks, if needed. The proposed algorithm is evaluated by a simulation process using WorkflowSim which is based on CloudSim. To evaluate the proposed algorithm, its results are compared with the results of CTDC, JIT-C (Just-In-Time), RTC (Robustness-Time-Cost), RCT (Robustness-Cost-Time), and CEGA (Cost-Effective Genetic Algorithm) algorithms. The results show that the proposed algorithm performs better than the above-mentioned algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Juve G., Deelman E., Vahi K., Mehta G., Berriman B., Berman B.P., Maechling, P.: Scientific Workflow Applications on Amazon EC2. In: 5th IEEE International Conference on e-Science (2010)

  2. Ijaz, S., Munir, E.: MOPT: list-based heuristic for scheduling workflows in cloud environment. J. Supercomput. 75(7), 3740–3768 (2019)

    Article  Google Scholar 

  3. Gupta, I., Kumar, M., Jana, P., Algorithm, efficient workflow scheduling., for cloud computing system: a dynamic priority-based approach. Arab. J. Sci. Eng. 43(12), 7945–7960 (2018)

  4. Arabnejad, V., Bubendorfer, K., Ng, B.: Scheduling deadline constrained scientific workflows on dynamically provisioned cloud resources. Future Gen. Comput. Syst. 75, 348–364 (2017)

    Article  Google Scholar 

  5. Singh, V., Gupta, I., Jana, P.: A novel cost-efficient approach for deadlineconstrained workflow scheduling by dynamic provisioning of resources. Future Gen. Comp. Syst. 79, 95–110 (2018)

    Article  Google Scholar 

  6. Chen, H., Zhu, X., Liu, G., Pedrycz, W.: Uncertainty-aware online scheduling for real-time workflows in cloud service environment. IEEE Trans. Services Comput. (2018)

  7. Sahni, J., Vidyarthi, D.: A cost-effective deadline-constrained dynamic scheduling algorithm for scientific workflows in a cloud environment. IEEE Trans. Cloud Comput. 6(1), 2–18 (2018)

    Article  Google Scholar 

  8. Ghafouri, R., Movaghar, A., Mohsenzadeh, M.: A budget constrained scheduling algorithm for executing workflow application in infrastructure as a service clouds. Peer-to-Peer Netw. Appl. 12(1), 241–268 (2019)

    Article  Google Scholar 

  9. Chen W., Xie G., Li R., Bai R., Fan C., Li K.(2017) Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud. Future Gen. Comput. Syst. 74(C), 1–11

  10. Zhang, F., Li, K., Khan, S., Hwang, K.: Multi-objective scheduling of many tasks in cloud platforms. Future Gen. Comput. Syst. 37(2014), 309–320 (2014)

    Article  Google Scholar 

  11. Schad, J., Dittrich, J., Quiané-Ruiz, J.A.: Runtime measurements in the cloud: observing, analyzing, and reducing variance. Proc. VLDB Endow. 3, 460–471 (2010)

    Article  Google Scholar 

  12. Ghafouri, R., Movaghar, A., Mohsenzadeh, M.: Time-cost efficient scheduling algorithms for executing workflow in infrastructure as a service clouds. Wireless Pers. Commun. 103(3), 2035–2070 (2018)

    Article  Google Scholar 

  13. Simranjit, K., Pallavi, B., Rahul, H., Harjot, K.: Quality of service (QoS) aware workflow scheduling (WFS) in cloud computing: a systematic review. Arab. J. Sci. Eng. 44(4), 2867–2897 (2019)

    Article  Google Scholar 

  14. Abrishami, S., Naghibzadeh, M., Epema, D.H.: Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds. Future Gen. Comput. Syst. 29(1), 158–169 (2013)

    Article  Google Scholar 

  15. Poola D., Garg S.K., Buyya R., Yang Y., Ramamohanarao, K.: Robust scheduling of scientific workflows with deadline and budget constraints in clouds. In: Advanced Information Networking and Applications (AINA), 2014 IEEE 28th International Conference on. IEEE. May, 858–865 (2014)

  16. Calheiros, R., Buyya, R.: Meeting deadlines of scientific workflows in public clouds with tasks replication. IEEE Trans. Parallel Distrib. Syst. 25(7), 1787–1796 (2014)

    Article  Google Scholar 

  17. Chopra, N., Singh, S.: HEFT Based workflow scheduling algorithm for cost optimization within deadline in hybrid clouds. In: Proceeding of Fourth international conference on computing, communications and networking technologies (ICCCNT) India. 1–6, (2013)

  18. Zhu, Z., Zhang, G., Li, M., Liu, X.: Evolutionary multi-objective workflow scheduling in cloud. IEEE Trans. Parallel Distrib. Syst. 27(5), 1344–1357 (2016)

    Article  Google Scholar 

  19. Liu, L., Zhang, M., Buyya, R., Fan, Q.: Deadline-constrained coevolutionary genetic algorithm for scientific workflow scheduling in cloud computing. Concurr. Computat Pract Exper. 29(5), e3942 (2017)

    Article  Google Scholar 

  20. Xie, G., Zeng, G., Li, R., Li, K.: Quantitative fault-tolerance for reliable workflows on heterogeneous iaas clouds. IEEE Trans. Cloud Comput. (2017). https://doi.org/10.1109/TCC.2017.2780098

  21. Malawski M., Juve G., Deelman E., Nabrzyski J.: Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in iaas clouds. Future Gen. Comput Syst. 48(C), 1–18 (2015)

  22. Mao, M., Humphrey, M.: Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. Seatle, WA, 1–12. (2011)

  23. Meena, J., Kumar, M., Vardhan, M.: Cost effective genetic algorithm for workflow scheduling in cloud under deadline constraint. IEEE Access 4, 5065–5082 (2016)

    Article  Google Scholar 

  24. Haiou J., Haihong E., Meina S.: Dynamic scheduling of workflow for makespan and robustness improvement in the IaaS cloud. IEICE Trans. Inf. Syst. E100.D(4), 813–821 (2017)

  25. Singh, V., Gupta, I., Jana, P.K.: An energy efficient algorithm for workflow scheduling in IaaS cloud. J. Grid Comput. (2019). https://doi.org/10.1007/s10723-019-09490-2

  26. Yadav, R., Zhang, W., Kaiwartya, O., et al.: Adaptive energy-aware algorithms for minimizing energy consumption and SLA violation in cloud computing. IEEE Access. 6, 55923–55936 (2018)

    Article  Google Scholar 

  27. Yadav R., Zhang W.: MeReg: managing energy-SLA Tradeoff for green mobile cloud computing. Wirel. Commun. Mobile Computi. 2017, Article ID 6741972 (2017)

  28. Yadav, R., Zhang, W., Li, K., et al.: An adaptive heuristic for managing energy consumption and overloaded hosts in a cloud data center. Wirel. Netw. (2018)

  29. Yadav R., Zhang W.,Chen H., Guo T.: MuMs: Energy-aware VM selection scheme for cloud data center, 2017. In: 28th International Workshop on Database and Expert Systems Applications (DEXA), pp. 132–136. (2017)

  30. Rahman, M., Hassan, R., Ranjan, R., Buyya, R.: Adaptive workflow scheduling for dynamic Grid and cloud computing environment. Concurr. Comput. Pract. Exp. 25(13), 1816–1842 (2013)

    Article  Google Scholar 

  31. Garg, R., Singh, A.: Adaptive workflow scheduling in grid computing based on dynamic resource availability. Eng. Sci. Technol. Int. J. 18(2), 256–269 (2015)

    Google Scholar 

  32. Zhang S., Chen X., Huo X.: Cloud computing research and development trend. In: Future Networks, 2010. ICFN ’10, Second International Conference on, 93–97 (2010)

  33. Chen, W., Deelman, E.: WorkflowSim: A toolkit for simulating scientific workflows in distributed environments. In: E-Science (e-Science), 2012 IEEE 8th International Conference on. 1–8. (2012)

  34. Calheiros, R., Ranjan, R., Beloglazov, A., De, R., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exper. 14(1), 23–50 (2011)

    Article  Google Scholar 

  35. Bharathi S., Chervenak A., Deelman E., Mehta G., Su M.H., Vahi K.: Characterization of scientific workflows. In: 2008 Third Workshop on Workflows in Support of Large-Scale Science. 1–10. (2008)

  36. Rodriguez, M.A., Buyya, R.: Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans. Cloud Comput. 2(2), 222–235 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robabeh Ghafouri.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghafouri, R., Movaghar, A. An adaptive and deadline-constrained workflow scheduling algorithm in infrastructure as a service clouds. Iran J Comput Sci 5, 17–39 (2022). https://doi.org/10.1007/s42044-021-00082-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42044-021-00082-6

Keywords

Navigation