Skip to main content
Log in

Reliability Based Workflow Scheduling on Cloud Computing with Deadline Constraint

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Distributed computing workflow is an effective paradigm to express a range of applications with cloud computing platforms for scientific research explorations. One of the most difficult application areas of cloud computing technology is task scheduling. In a cloud, heterogeneous context, job scheduling with minimal execution cost and time, as well as workflow reliability, are critical. While working in the heterogeneous cloud environment, tasks that are successfully executed are widely identified by considering the failure of the processor or any communication technologies link. It will also have an impact on the workflow's reliability as well as the user's service quality expectations. This research paper proposes a Critical Parent Reliability-based Scheduling (CPRS) method that uses the reliability parameter to plan the task while taking into account the user-defined cost and deadline metrics. The effectiveness of the algorithm is compared to current algorithms utilizing scientific workflows as a benchmark, such as Cybershake, Sipht, and Montage. The simulation results supported the assertions by efficiently allocating resources to the cloudlets and stabilizing all of the aforementioned parameters using sufficient performance metrics growth.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Availability of Data and Materials

Not applicable.

Code Availability

Not applicable.

References

  1. Bawa, R. K., & Sharma, G. (2012). Reliable resource selection in grid environment. arXiv preprint arXiv:1204.1516

  2. Badotra, S., & Panda, S. N. (2022). Software defined networking: a crucial approach for cloud computing adoption. International Journal of Cloud Computing, 11(2), 123–137. https://doi.org/10.1504/IJCC.2022.122028

  3. Faragardi, H. R., Shojaee, R., & Yazdani, N. (2012, June). Reliability-aware task allocation in distributed computing systems using hybrid simulated annealing and tabu search. In 2012 IEEE 14th international conference on high performance computing and communication & 2012 IEEE 9th international conference on embedded software and systems (pp. 1088–1095). IEEE. https://doi.org/10.1109/HPCC.2012.159

  4. Shojaee, R., Faragardi, H. R., Alaee, S., & Yazdani, N. (2012, November). A new cat swarm optimization based algorithm for reliability-oriented task allocation in distributed systems. In 6th international symposium on telecommunications (IST) (pp. 861–866). IEEE. https://doi.org/10.1109/ISTEL.2012.6483106

  5. Sahoo, S., Sahoo, B., Turuk, A. K., & Mishra, S. K. (2017). Real time task execution in cloud using mapreduce framework. In Resource management and efficiency in cloud computing environments (pp. 190–209). IGI Global. https://doi.org/10.4018/978-1-5225-1721-4.ch008

  6. Olakanmi, O. O., & Dada, A. (2019). An efficient privacy-preserving approach for secure verifiable outsourced computing on untrusted platforms. International Journal of Cloud Applications and Computing, 9(2), 79–98. https://doi.org/10.4018/IJCAC.2019040105

    Article  Google Scholar 

  7. Rani, M., Guleria, K., & Panda, S. N. (2021, September). Cloud Computing An Empowering Technology: Architecture, Applications and Challenges. 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) (pp. 1–6). IEEE. https://ieeexplore.ieee.org/abstract/document/9596259

  8. Daoud, M. I., & Kharma, N. (2008). A high performance algorithm for static task scheduling in heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing, 68(4), 399–409. https://doi.org/10.1016/j.jpdc.2007.05.015

    Article  MATH  Google Scholar 

  9. Zhou, A., Wang, S., Cheng, B., Zheng, Z., Yang, F., Chang, R. N., Lyu, M. R., & Buyya, R. (2016). Cloud service reliability enhancement via virtual machine placement optimization. IEEE Transactions on Services Computing, 10(6), 902–913. https://doi.org/10.1109/TSC.2016.2519898

    Article  Google Scholar 

  10. Zhao, L., Ren, Y., & Sakurai, K. (2013). Reliable workflow scheduling with less resource redundancy. Parallel Computing, 39(10), 567–585. https://doi.org/10.1016/j.parco.2013.06.003

    Article  MathSciNet  Google Scholar 

  11. Qiu, W., Zheng, Z., Wang, X., Yang, X., & Lyu, M. R. (2013). Reliability-based design optimization for cloud migration. IEEE Transactions on Services Computing, 7(2), 223–236. https://doi.org/10.1109/TSC.2013.38

    Article  Google Scholar 

  12. Silic, M., Delac, G., & Srbljic, S. (2014). Prediction of atomic web services reliability for QoS-aware recommendation. IEEE Transactions on services Computing, 8(3), 425–438. https://doi.org/10.1109/TSC.2014.2346492

    Article  Google Scholar 

  13. Dongarra, J. J., Jeannot, E., Saule, E., & Shi, Z. (2007, June). Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems. In Proceedings of the nineteenth annual ACM symposium on parallel algorithms and architectures (pp. 280–288). https://doi.org/10.1145/1248377.1248423

  14. Zheng, Q., & Veeravalli, B. (2009). On the design of communication-aware fault-tolerant scheduling algorithms for precedence constrained tasks in grid computing systems with dedicated communication devices. Journal of Parallel and Distributed Computing, 69(3), 282–294. https://doi.org/10.1016/j.jpdc.2008.11.007

    Article  Google Scholar 

  15. Yu, J., Buyya, R., & Ramamohanarao, K. (2008). Workflow scheduling algorithms for grid computing. In Metaheuristics for scheduling in distributed computing environments (pp. 173–214). Springer. https://doi.org/10.1007/978-3-540-69277-5_7

  16. Yu, J., & Buyya, R. (2005). A taxonomy of workflow management systems for grid computing. Journal of Grid Computing, 3(3), 171–200. https://doi.org/10.1007/s10723-005-9010-8

    Article  Google Scholar 

  17. Arabnejad, H., & Barbosa, J. G. (2014). A budget constrained scheduling algorithm for workflow applications. Journal of Grid Computing, 12(4), 665–679. https://doi.org/10.1007/s10723-014-9294-7

    Article  Google Scholar 

  18. Sakellariou, R., Zhao, H., Tsiakkouri, E., & Dikaiakos, M. D. (2007). Scheduling workflows with budget constraints. In Integrated research in GRID computing (pp. 189–202). Springer. https://doi.org/10.1007/978-0-387-47658-2_14

  19. Miglani, N., & Sharma, G. (2018). An adaptive load balancing algorithm using categorization of tasks on virtual machine based upon queuing policy in cloud environment. International Journal of Grid and Distributed Computing, 11(11), 1–2. https://doi.org/10.14257/ijgdc.2018.11.11.01

    Article  Google Scholar 

  20. Su, S., Li, J., Huang, Q., Huang, X., Shuang, K., & Wang, J. (2013). Cost-efficient task scheduling for executing large programs in the cloud. Parallel Computing, 39(4–5), 177–188. https://doi.org/10.1016/j.parco.2013.03.002

    Article  Google Scholar 

  21. Mousavi Nik, S. S., Naghibzadeh, M., & Sedaghat, Y. (2020). Cost-driven workflow scheduling on the cloud with deadline and reliability constraints. Computing, 102(2), 477–500. https://doi.org/10.1007/s00607-019-00740-5

    Article  MathSciNet  Google Scholar 

  22. Kianpisheh, S., & Moghadam Charkari, N. (2014). A grid workflow Quality-of-Service estimation based on resource availability prediction. The Journal of Supercomputing, 67(2), 496–527. https://doi.org/10.1007/s11227-013-1014-8

    Article  Google Scholar 

  23. Khurana, S., & Singh, R. K. (2018, September). Virtual machine categorization and enhance task scheduling framework in cloud environment. In 2018 international conference on computing, power and communication technologies (GUCON) (pp. 391–394). IEEE. https://doi.org/10.1109/GUCON.2018.8675020

  24. Xie, G., Zeng, G., Chen, Y., Bai, Y., Zhou, Z., Li, R., & Li, K. (2017). Minimizing redundancy to satisfy reliability requirement for a parallel application on heterogeneous service-oriented systems. IEEE Transactions on Services Computing, 13(5), 871–886. https://doi.org/10.1109/TSC.2017.2665552

    Article  Google Scholar 

  25. Zhao, L., Ren, Y., & Sakurai, K. (2011, March). A resource minimizing scheduling algorithm with ensuring the deadline and reliability in heterogeneous systems. In 2011 IEEE international conference on advanced information networking and applications (pp. 275–282). IEEE. https://doi.org/10.1109/AINA.2011.87

  26. Qin, X., Jiang, H., & Swanson, D. R. (2002, August). An efficient fault-tolerant scheduling algorithm for real-time tasks with precedence constraints in heterogeneous systems. In Proceedings international conference on parallel processing (pp. 360–368). IEEE. https://doi.org/10.1109/ICPP.2002.1040892

  27. Boeres, C., Sardiña, I. M., & Drummond, L. M. (2011). An efficient weighted bi-objective scheduling algorithm for heterogeneous systems. Parallel Computing, 37(8), 349–364. https://doi.org/10.1016/j.parco.2010.10.003

    Article  Google Scholar 

  28. Narendrababu Reddy, G., & Phani Kumar, S. (2019). Regressive whale optimization for workflow scheduling in cloud computing. International Journal of Computational Intelligence and Applications, 18(04), 1950024. https://doi.org/10.1142/S146902681950024X

    Article  Google Scholar 

  29. Chakravarthi, K. K., Shyamala, L., & Vaidehi, V. (2021). Cost-effective workflow scheduling approach on cloud under deadline constraint using firefly algorithm. Applied Intelligence, 51(3), 1629–1644. https://doi.org/10.1007/s10489-020-01875-1

    Article  Google Scholar 

  30. Zhang, L., Zhou, L., & Salah, A. (2020). Efficient scientific workflow scheduling for deadline-constrained parallel tasks in cloud computing environments. Information Sciences, 531, 31–46. https://doi.org/10.1016/j.ins.2020.04.039

    Article  MathSciNet  MATH  Google Scholar 

  31. Iranmanesh, A., & Naji, H. R. (2021). DCHG-TS: A deadline-constrained and cost-effective hybrid genetic algorithm for scientific workflow scheduling in cloud computing. Cluster Computing, 24(2), 667–681. https://doi.org/10.1007/s10586-020-03145-8

    Article  Google Scholar 

  32. Yuan, H., Liu, H., Bi, J., & Zhou, M. (2020). Revenue and energy cost-optimized biobjective task scheduling for green cloud data centers. IEEE Transactions on Automation Science and Engineering, 18(2), 817–830. https://doi.org/10.1109/TASE.2020.2971512

    Article  Google Scholar 

  33. Pham, T. P., Durillo, J. J., & Fahringer, T. (2017). Predicting workflow task execution time in the cloud using a two-stage machine learning approach. IEEE Transactions on Cloud Computing, 8(1), 256–268. https://doi.org/10.1109/TCC.2017.2732344

    Article  Google Scholar 

  34. Arabnejad, H., & Barbosa, J. G. (2013). List scheduling algorithm for heterogeneous systems by an optimistic cost table. IEEE Transactions on Parallel and Distributed Systems, 25(3), 682–694. https://doi.org/10.1109/TPDS.2013.57

    Article  Google Scholar 

  35. Khurana, S., & Singh, R. (2020). Workflow scheduling and reliability improvement by hybrid intelligence optimization approach with task ranking. EAI Endorsed Transactions on Scalable Information Systems. https://doi.org/10.4108/eai.13-7-2018.161408

    Article  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

SK conceived the idea, designed the experiments and analysed the data; GS performed the experiments and conducted the analysis; MK and NG analysed the methods, interpreted the results and drew the conclusions; BS proofread the paper. All the authors agree with the above contribution details.

Corresponding author

Correspondence to Nitin Goyal.

Ethics declarations

Conflict of interest

No conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khurana, S., Sharma, G., Kumar, M. et al. Reliability Based Workflow Scheduling on Cloud Computing with Deadline Constraint. Wireless Pers Commun 130, 1417–1434 (2023). https://doi.org/10.1007/s11277-023-10337-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-023-10337-z

Keywords

Navigation