Skip to main content

Advertisement

Springer Nature Link
Log in

HBDCWS: heuristic-based budget and deadline constrained workflow scheduling approach for heterogeneous clouds

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The predilection of scientific applications toward a high-performance computing system is attained through the emergence of the cloud. Large-scale scientific applications can be modeled as workflows and are scheduled on the cloud. However, such scheduling becomes even more onerous due to the dynamic and heterogeneous nature of cloud and therefore considered as a problem of NP-Complete. The scheduling of workflows is always constrained to QoS parameters. Most of the applications are bound to time and cost, which is observed to be the most crucial parameter. Therefore, in this paper, a heuristic-based budget and deadline constrained workflow scheduling algorithm (HBDCWS) has been proposed to utilize those applications that have the budget and deadline constraints. The novelty of the proposed work is to provide a simple budget and deadline distribution strategy where budget and deadline of workflow are converted to level budget and level deadline. Additionally, the level budget is again transferred to each task. This strategy not only satisfies the given constraints but also proves to be efficient for minimizing the makespan and reducing the cost of execution. Experimental results on several workflows demonstrate that the proposed HBDCWS algorithm finds a feasible solution that accomplishes the given constraints with a higher success rate in most cases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Abrishami S, Naghibzadeh M (2012) Deadline-constrained workflow scheduling in software as a service cloud. Sci Iran 19(3):680–689

    Article  Google Scholar 

  • Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener Comput Syst 29(1):158–169

    Article  Google Scholar 

  • Alkhanak EN, Lee SP, Khan SUR (2015) Cost-aware challenges for workflow scheduling approaches in cloud computing environments: taxonomy and opportunities. Future Gener Comput Syst 50:3–21

    Article  Google Scholar 

  • Arabnejad H, Barbosa JG (2014) A budget constrained scheduling algorithm for workflow applications. J Grid Comput 12(4):665–679

    Article  Google Scholar 

  • Arabnejad H, Barbosa JG, Prodan R (2016a) Low-time complexity budget–deadline constrained workflow scheduling on heterogeneous resources. Future Gener Comput Syst 55:29–40

    Article  Google Scholar 

  • Arabnejad V, Bubendorfer K, Ng B (2016) Deadline distribution strategies for scientific workflow scheduling in commercial clouds. In: 2016 IEEE/ACM 9th international conference on utility and cloud computing (UCC). IEEE, pp 70–78

  • Arabnejad V, Bubendorfer K, Ng B (2019) Budget and deadline aware e-science workflow scheduling in clouds. IEEE Trans Parallel Distrib Syst 30(1):29–44

    Article  Google Scholar 

  • Barga RS, Fay D, Guo D, Newhouse S, Simmhan Y, Szalay A (2008) Efficient scheduling of scientific workflows in a high performance computing cluster. In: Proceedings of the 6th international workshop on challenges of large applications in distributed environments. ACM, pp 63–68

  • Bather JA (1994) Mathematical induction

  • Bharathi S, Chervenak A, Deelman E, Mehta G, Su MH, Vahi K (2008) Characterization of scientific workflows. In: 2008 third workshop on workflows in support of large-scale science. IEEE, pp 1–10

  • Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: 2009 international conference on high performance computing & simulation. IEEE, pp 1–11

  • Casanova H, Legrand A, Zagorodnov D, Berman F (2000) Heuristics for scheduling parameter sweep applications in grid environments. In: Proceedings 9th heterogeneous computing workshop (HCW 2000) (Cat. No. PR00556). IEEE, pp 349–363

  • Chen W, Xie G, Li R, Bai Y, Fan C, Li K (2017) Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems. Future Gener Comput Syst 74:1–11

    Article  Google Scholar 

  • Hasan MZ, Magana E, Clemm A, Tucker L, Gudreddi SLD (2012) Integrated and autonomic cloud resource scaling. In: 2012 IEEE network operations and management symposium. IEEE, pp 1327–1334

  • Hilman MH, Rodriguez MA, Buyya R (2017) Budget-constrained resource provisioning and scheduling algorithms for scientific workflows in cloud environments. In: School of computing and information systems 5th annual doctoral colloquium 19 July 2017, p 16

  • Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Future Gener Comput Syst 29(3):682–692

    Article  Google Scholar 

  • Kern ER (2013) U.S. Patent No. 8,572,612. Washington, DC: U.S. Patent and Trademark Office

  • Kim W (2009) Cloud computing: today and tomorrow. J Object Technol 8(1):65–72

    Article  Google Scholar 

  • Malawski M, Juve G, Deelman E, Nabrzyski J (2015) Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. Future Gener Comput Syst 48:1–18

    Article  Google Scholar 

  • Mao M, Humphrey M (2012) A performance study on the vm startup time in the cloud. In: 2012 IEEE fifth international conference on cloud computing. IEEE, pp 423–430

  • Mao M, Humphrey M (2013) Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In: 2013 IEEE 27th international symposium on parallel and distributed processing. IEEE, pp 67–78

  • Mayer-Schönberger V, Cukier K (2013) Big data: a revolution that will transform how we live, work, and think. Houghton Mifflin Harcourt, Boston

    Google Scholar 

  • Park SC, Ryoo SY (2013) An empirical investigation of end-users’ switching toward cloud computing: a two factor theory perspective. Comput Hum Behav 29(1):160–170

    Article  Google Scholar 

  • Rodriguez MA, Buyya R (2014) Deadline based resource provisioningand scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235

    Article  Google Scholar 

  • Sahni J, Vidyarthi DP (2018) A cost-effective deadline-constrained dynamic scheduling algorithm for scientific workflows in a cloud environment. IEEE Trans Cloud Comput 6(1):2–18

    Article  Google Scholar 

  • Shao X, Xie Z, Xin Y, Yang J (2019) A deadline constrained scheduling algorithm for cloud computing system based on the driver of dynamic essential path. PLoS ONE 14(3):e0213234

    Article  Google Scholar 

  • Singh S, Chana I (2016) A survey on resource scheduling in cloud computing: issues and challenges. J Grid Comput 14(2):217–264

    Article  Google Scholar 

  • Sun T, Xiao C, Xu X (2018) A scheduling algorithm using sub-deadline for workflow applications under budget and deadline constrained. Cluster Comput 1–10

  • Talukder AKA, Kirley M, Buyya R (2009) Multiobjective differential evolution for scheduling workflow applications on global grids. Concurr Comput Pract Exp 21(13):1742–1756

    Article  Google Scholar 

  • Topcuoglu H, Hariri S, Wu MY (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274

    Article  Google Scholar 

  • Truong D (2010) How cloud computing enhances competitive advantages: a research model for small businesses. Bus Rev Camb 15(1):59–65

    Google Scholar 

  • Verma A, Kaushal S (2012) Deadline and budget distribution based cost-time optimization workflow scheduling algorithm for cloud. In: IJCA proceedings on international conference on recent advances and future trends in information technology (iRAFIT 2012), vol 4. iRAFIT (7), pp 1–4

  • Wu CQ, Cao H (2016) Optimizing the performance of big data workflows in multi-cloud environments under budget constraint. In: 2016 IEEE international conference on services computing (SCC). IEEE, pp 138–145

  • Wu CQ, Lin X, Yu D, Xu W, Li L (2015) End-to-end delay minimization for scientific workflows in clouds under budget constraint. IEEE Trans Cloud Comput 3(2):169–181

    Article  Google Scholar 

  • Xie G, Zeng G, Liu L, Li R, Li K (2016) High performance real-time scheduling of multiple mixed-criticality functions in heterogeneous distributed embedded systems. J Syst Archit 70:3–14

    Article  Google Scholar 

  • Xu M, Cui L, Wang H, Bi Y (2009) A multiple QoS constrained scheduling strategy of multiple workflows for cloud computing. In: 2009 IEEE international symposium on parallel and distributed processing with applications. IEEE, pp 629–634

  • Yu J, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Program 14(3–4):217–230

    Google Scholar 

  • Yu J, Buyya R, Tham CK (2005) Cost-based scheduling of scientific workflow applications on utility grids. In: First international conference on e-science and grid computing (e-Science’05). IEEE, p 8

  • Yu J, Kirley M, Buyya R (2007) Multi-objective planning for workflow execution on grids. In: Proceedings of the 8th IEEE/ACM international conference on grid computing. IEEE Computer Society, pp 10–17

  • Yu J, Buyya R, Ramamohanarao K (2008) Workflow scheduling algorithms for grid computing. In: Xhafa F, Abraham A (eds) Metaheuristics for scheduling in distributed computing environments. Springer, Berlin, pp 173–214

  • Yuan Y, Li X, Wang Q, Zhang Y (2008) Bottom level based heuristic for workflow scheduling in grids. Chin J Comput Chin Ed 31(2):282

    Article  Google Scholar 

  • Zeng L, Veeravalli B, Li X (2012) Scalestar: budget conscious scheduling precedence-constrained many-task workflow applications in cloud. In: 2012 IEEE 26th international conference on advanced information networking and applications. IEEE pp 534–541

  • Zheng W, Sakellariou R (2013) Budget-deadline constrained workflow planning for admission control. J Grid Comput 11(4):633–651

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the Indian Institute of Technology (ISM), Dhanbad, Govt. of India. The authors wish to express their gratitude and heartiest thanks to the Department of Computer Science & Engineering, Indian Institute of Technology (ISM), Dhanbad, India, for providing their continuous research support.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Indian Institute of Technology (ISM), Dhanbad, Jharkhand, 826004, India

    Naela Rizvi & Dharavath Ramesh

Authors
  1. Naela Rizvi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Dharavath Ramesh
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Dharavath Ramesh.

Ethics declarations

Conflict of interest

The authors declare that they do not have any conflict of interest.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rizvi, N., Ramesh, D. HBDCWS: heuristic-based budget and deadline constrained workflow scheduling approach for heterogeneous clouds. Soft Comput 24, 18971–18990 (2020). https://doi.org/10.1007/s00500-020-05127-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-05127-9

Keywords