Skip to main content
SpringerLink
Log in

OPSA: an optimized prediction based scheduling approach for scientific applications in cloud environment

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Cloud computing has attracted scientists to deploy scientific applications by offering services such as Infrastructure-as-a-service (IaaS), Software-as-a-service (SaaS), and Platform-as-a-Service (PaaS). The research community is able to get access to resources on-demand within a short period of time. But, as the demand for cloud resources is dynamic in nature, this affects resource availability during scheduling. Hence, there is a need for efficient management of resources so that tasks can be scheduled based on their execution requirements. To provide a solution, a resource prediction based scheduling approach has been introduced in this paper which automates the resource allocation for scientific applications in a virtualized cloud environment. This research work focuses on the design of an optimized prediction based scheduling approach which maps the tasks of scientific application with the optimal VM by combining the features of swarm intelligence and TOPSIS. The proposed approach minimizes the execution time, cost, and SLA violation rate in comparison to existing scheduling heuristics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Kaur, G., Bala, A.: A survey of prediction-based resource scheduling techniques for physics-based scientific applications. Mod. Phys. Lett. B 32(25), 1850295 (2018)

    Article  Google Scholar 

  2. Peng, Z., Lin, J., Cui, D., Li, Q., He, J.: A multi-objective trade-off framework for cloud resource scheduling based on the deep q-network algorithm. Clust. Comput. (2020). https://doi.org/10.1007/s10586-019-03042-9

    Article  Google Scholar 

  3. Wang, B., Wang, C., Song, Y., Cao, J., Cui, X., Zhang, L.: A survey and taxonomy on workload scheduling and resource provisioning in hybrid clouds. Clust. Comput. (2020). https://doi.org/10.1007/s10586-020-03048-8

    Article  Google Scholar 

  4. Ebadifard, F., Babamir, S.M.: Autonomic task scheduling algorithm for dynamic workloads through a load balancing technique for the cloud-computing environment. Clust. Comput. (2020). https://doi.org/10.1007/s10586-020-03177-0

    Article  Google Scholar 

  5. Mortazavi-Dehkordi, M., Zamanifar, K.: Efficient deadline-aware scheduling for the analysis of big data streams in public cloud. Clust. Comput. 23(1), 241–263 (2020)

    Article  Google Scholar 

  6. Jiang, H., Haihong, E., Song, M.: Multi-prediction based scheduling for hybrid workloads in the cloud data center. Clust. Comput. 21(3), 1607–1622 (2018)

    Article  Google Scholar 

  7. Borkowski, M., Schulte, S., Hochreiner, C.: Predicting cloud resource utilization. In: 2016 IEEE/ACM 9th international conference on utility and cloud computing (UCC), pp. 37–42, IEEE (2016).

  8. Li, J., Ma, X., Singh, K., Schulz, M., de Supinski, B.R., McKee, S.A.: Machine learning based online performance prediction for runtime parallelization and task scheduling. In: 2009 IEEE international symposium on performance analysis of systems and software, pp. 89–100, IEEE.

  9. Kang, S., Veeravalli, B., Aung, K.M.M.: Dynamic scheduling strategy with efficient node availability prediction for handling divisible loads in multi-cloud systems. J. Parallel Distrib. Comput. 113, 1–16 (2018)

    Article  Google Scholar 

  10. Ghobaei-Arani, M., Jabbehdari, S., Pourmina, M.A.: An autonomic resource provisioning approach for service-based cloud applications: a hybrid approach. Fut. Gener. Comput. Syst. 78, 191–210 (2018)

    Article  Google Scholar 

  11. Choudhary, A., Gupta, I., Singh, V., Jana, P.K.: A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing. Fut. Gener. Comput. Syst. 83, 14–26 (2018)

    Article  Google Scholar 

  12. Zhang, N., Yang, X., Zhang, M., Sun, Y., Long, K.: A genetic algorithm-based task scheduling for cloud resource crowd-funding model. Int. J. Commun. Syst. 31(1), e3394 (2018)

    Article  Google Scholar 

  13. Kansal, N.J., Chana, I.: Artificial bee colony based energy-aware resource utilization technique for cloud computing. Concurr. Comput.: Pract. Exp. 27(5), 1207–1225 (2015)

    Article  Google Scholar 

  14. Emeakaroha, V.C., Netto, M.A., Calheiros, R.N., Brandic, I., Buyya, R., De Rose, C.A.: Towards autonomic detection of SLA violations in cloud infrastructures. Fut. Gener. Comput. Syst. 28(7), 1017–1029 (2012)

    Article  Google Scholar 

  15. Behzadian, M., Otaghsara, S.K., Yazdani, M., Ignatius, J.: A state-of the-art survey of topsis applications. Expert Syst. Appl. 39(17), 13051–13069 (2012)

    Article  Google Scholar 

  16. Jahanshahloo, G.R., Lot, F.H., Izadikhah, M.: An algorithmic method to extend topsis for decision-making problems with interval data. Appl. Math. Comput. 175(2), 1375–1384 (2006)

    MATH  Google Scholar 

  17. Chen, W., Deelman, E.: Workflowsim: a toolkit for simulating scientific workflows indistributed environments. In: 2012 IEEE 8th international conference on E-science, pp. 1–8, IEEE

  18. Kaur, G., Bala, A., Chana, I.: An intelligent regressive ensemble approach for predicting resource usage in cloud computing. J. Parallel Distrib. Comput. 123, 1–12 (2019)

    Article  Google Scholar 

  19. Fumo, N., Biswas, M.R.: Regression analysis for prediction of residential energy consumption. Renew. Sustain. Energy Rev. 47, 332–343 (2015)

    Article  Google Scholar 

  20. Zhang, W., Duan, P., Yang, L.T., Xia, F., Li, Z., Lu, Q., Gong, W., Yang, S.: Resource requests prediction in the cloud computing environment with a deep belief network. Softw. Pract. Exp. 47(3), 473–488 (2017)

    Article  Google Scholar 

  21. Takai, S., Yang, T., Cafeo, J.A.: A Bayesian method for predicting future customer need distributions. Concurr. Eng. 19(3), 255–264 (2011)

    Article  Google Scholar 

  22. Islam, S., Keung, J., Lee, K., Liu, A.: Empirical prediction models for adaptive resource provisioning in the cloud. Fut. Gener. Comput. Syst. 28(1), 155–162 (2012)

    Article  Google Scholar 

  23. Gupta, N., Ahuja, N., Malhotra, S., Bala, A., Kaur, G.: Intelligent heart disease prediction in cloud environment through ensembling. Expert Syst. 34(3), e12207 (2017)

    Article  Google Scholar 

  24. Huang, G., Huang, G.-B., Song, S., You, K.: Trends in extreme learning machines: a review. Neural Netw. 61, 32–48 (2015)

    Article  Google Scholar 

  25. Ismaeel, S., Miri, A.: Using elm techniques to predict data centre vm requests. In: 2015 IEEE 2nd international conference on cyber security and cloud computing, pp. 80–86, IEEE

  26. R. D. C. Team: The R project for statistical computing. (2018). https://www.r-project.org/. Accessed 5 Dec 2020

  27. Maechling, P., Deelman, E., Zhao, L., Graves, R., Mehta, G., Gupta, N., Mehringer, J., Kesselman, C., Callaghan, S., Okaya, D., et al.: Scec cybershake workflows automating probabilistic seismic hazard analysis calculations. In: Workflows for e-Science, pp. 143–163. Springer, London (2007)

    Chapter  Google Scholar 

  28. Ramakrishnan, L., Gannon, D.: A survey of distributed workflow characteristics and resource requirements, pp. 1–23. Indiana University, Bloomington (2008)

    Google Scholar 

  29. Ramakrishnan, L., Plale, B.: A multi-dimensional classification model for scientific workflow characteristics. In: Proceedings of the 1st international workshop on workflow approaches to new data-centric science, p. 4, ACM

Download references

Acknowledgements

One of the authors, Gurleen Kaur, acknowledges the Maulana Azad National Fellowship, UGC, Government of India, for awarding the scholarship which helped to avail the required resources to carry out this research work.

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Thapar Institute of Engineering and Technology, Patiala, 147003, India

    Gurleen Kaur & Anju Bala

Authors
  1. Gurleen Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anju Bala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gurleen Kaur.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kaur, G., Bala, A. OPSA: an optimized prediction based scheduling approach for scientific applications in cloud environment. Cluster Comput 24, 1955–1974 (2021). https://doi.org/10.1007/s10586-021-03232-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-021-03232-4

Keywords

Search

Navigation