Skip to main content
SpringerLink
Log in

Resource Provisioning Based Scheduling Framework for Execution of Heterogeneous and Clustered Workloads in Clouds: from Fundamental to Autonomic Offering

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Provisioning of adequate resources to cloud workloads depends on the Quality of Service (QoS) requirements of these cloud workloads. Based on workload requirements (QoS) of cloud users, discovery and allocation of best workload-resource pair is an optimization problem. Acceptable QoS can be offered only if provisioning of resources is appropriately controlled. So, there is a need for a QoS-based resource provisioning framework for the autonomic scheduling of resources to observe the behavior of the services and adjust it dynamically in order to satisfy the QoS requirements. In this paper, framework for self-management of cloud resources for execution of clustered workloads named as SCOOTER is proposed that efficiently schedules the provisioned cloud resources and maintains the Service Level Agreement (SLA) by considering properties of self-management and the maximum possible QoS parameters are required to improve cloud based services. Finally, the performance of SCOOTER has been evaluated in a cloud environment that demonstrates the optimized QoS parameters such as execution cost, energy consumption, execution time, SLA violation rate, fault detection rate, intrusion detection rate, resource utilization, resource contention, throughput and waiting time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Varghese, B., Buyya, R.: Next generation cloud computing: New trends and research directions. Future Generation Comput. Syst. 79, 849–861 (2017). https://doi.org/10.1016/j.future.2017.09.020

    Article  Google Scholar 

  2. Qi, Z.T.L., Cheng, Z., Li, K., Khan, S.U., Li, K.: An energy-efficient task scheduling algorithm in DVFS-enabled cloud environment. J. Grid Comput. 14(1), 55–74 (2016)

    Article  Google Scholar 

  3. de Carvalho, O.A. Jr, Adilson, O., Bruschi, S.M., Santana, R.H.C., Santana, M.J.: Green cloud meta-scheduling. J. Grid Comput. 14(1), 109–126 (2016)

    Article  Google Scholar 

  4. Jiang, J., Lin, Y., Xie, G., Fu, L., Yang, J.: Time and Energy Optimization Algorithms for the Static Scheduling of Multiple Workflows in Heterogeneous Computing System. J. Grid Comput., 1–22 (2017). https://doi.org/10.1007/s10723-017-9391-5

  5. Ebrahimirad, V., Goudarzi, M., Rajabi, A.: Energy-aware scheduling for precedence-constrained parallel virtual machines in virtualized data centers. J. Grid Comput. 13(2), 233–253 (2015)

    Article  Google Scholar 

  6. Singh, S., Chana, I.: Metrics based workload analysis technique for IaaS cloud. In: The Proceeding of International Conference on Next Generation Computing and Communication Technologies 23 - 24 April 2014, Dubai, pp. 1–6 (2014)

  7. Chana, I., Singh, S.: Quality of service and service level agreements for cloud environments: Issues and challenges, cloud Computing-Challenges, limitations and R&D solutions, 51-72 springer international publishing (2014)

  8. Singh, S., Chana, I.: Cloud resource provisioning: survey, Status and Future Research Directions. Knowl. Inf. Syst. 49(3), 1005–1069 (2016)

    Article  Google Scholar 

  9. Singh, S., Chana, I.: Q-aware: quality of service based cloud resource provisioning. Comput. Electr. Eng. 47, 138–160 (2015)

    Article  Google Scholar 

  10. Singh, S., Chana, I.: A survey on resource scheduling in cloud computing issues and challenges. J. Grid Comput. 14(2), 217–264 (2016)

    Article  Google Scholar 

  11. Singh, S., Chana, I.: QRSF Qos-aware resource scheduling framework in cloud computing. J. Supercomput. 71(1), 241–292 (2015)

    Article  Google Scholar 

  12. Singh, S., Chana, I.: Resource provisioning and scheduling in clouds: QoS perspective. J. Supercomput. 72(3), 926–960 (2016)

    Article  Google Scholar 

  13. Singh, S., Chana, I.: QoS-aware autonomic cloud computing for ICT. In: The proceeding of International Conference on Information and Communication Technology for Sustainable Development (ICT4SD - 2015), Ahmedabad, India, 3 - 4 July 2015, pp. 569–577. Springer, Singapore (2016)

  14. Singh, S., Chana, I.: Qos-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3), 1–46 (2015)

    Article  Google Scholar 

  15. Singh, S., Chana, I.: EARTH: energy-aware autonomic resource scheduling in cloud computing. J. Intell. Fuzzy Syst. 30(3), 1581–1600 (2016)

    Article  Google Scholar 

  16. Singh, S., Chana, I., Singh, M.: The journey of QoS-aware autonomic cloud computing. IEEE IT Professional 19(2), 42–49 (2017)

    Article  Google Scholar 

  17. Singh, S., Chana, I., Buyya, R.: STAR: SLA-aware autonomic management of cloud resources. In: IEEE Transactions on Cloud Computing, pp. 1–14 (2018). https://doi.org/10.1109/TCC.2017.2648788

  18. Sukhpal S.G., Chana, I., Singh, M., Buyya, R.: CHOPPER: an Intelligent QoS-aware autonomic resource management approach for cloud computing cluster computing, pp. 1–39 (2017). https://doi.org/10.1007/s10586-017-1040-z/ Available Online: https://link.springer.com/article/10.1007/s10586-017-1040-z

  19. Sukhpal S.G., Buyya, R., Chana, I., Singh, M., Abrahiam, A.: BULLET: particle swarm optimization based scheduling technique for provisioned cloud resources, Journal of Network and Management System, pp. 1–40. Springer, Berlin (2017). https://doi.org/10.1007/s10922-017-9419-y

    Google Scholar 

  20. Singh, S., Chana, I., Singh, M., Rajkumar, B.: SOCCER self-optimization Of energy-efficient cloud resources. Clust. Comput. 19(4), 1787–1800 (2016)

    Article  Google Scholar 

  21. Kephart, J.O., Walsh, W.E.: An architectural blueprint for autonomic computing. Technical Report, IBM Corporation, 1-29, IBM. http://www-03.ibm.com/autonomic/pdfs/AC%20Blueprint%20White%20Paper%20V7.pdf (2003)

  22. Quiroz, A., Kim, H., Parashar, M., Gnanasambandam, N., Sharma, N.: Towards autonomic workload provisioning for enterprise grids and clouds. In: 2009 10th IEEE/ACM International Conference on Grid Computing, pp. 50–57. IEEE (2009)

  23. Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Futur. Gener. Comput. Syst. 28(1), 58–65 (2012)

    Article  Google Scholar 

  24. Herbst, N.R., Huber, N., Kounev, S., Amrehn, E.: Self-adaptive workload classification and forecasting for proactive resource provisioning. Concurrency Comput.: Pract. Exp. 26(12), 2053–2078 (2014)

    Article  Google Scholar 

  25. Qavami, H.R., Jamali, S., Akbari, M.K., Javadi, B.: Dynamic resource provisioning in cloud computing: a heuristic markovian approach. In: Cloud Computing, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 133, pp. 102–111. Springer International Publishing (2014)

  26. Varalakshmi, P., Ramaswamy, A., Balasubramanian, A., Vijaykumar, P.: An optimal workflow based scheduling and resource allocation in cloud. In: Advances in computing and communications, pp. 411–420. Springer, Berlin (2011)

  27. Li, K., Gaochao, X., Zhao, G., Dong, Y., Wang, D.: Cloud task scheduling based on load balancing ant colony optimization. In: Sixth Annual Chinagrid Conference (ChinaGrid), pp. 3–9. IEEE (2011)

  28. Topcuoglu, H., Hariri, S., Wu, M.-Y.: Task scheduling algorithms for heterogeneous processors. In: Proceedings of the Eighth Heterogeneous Computing Workshop (HCW’99), pp. 3–14. IEEE (1999)

  29. Pandey, S., Wu, L., Guru, S., Buyya R: A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 24th IEEE International Conference on Advanced Information Networking and Applications (AINA), Perth, Australia (2010)

  30. Cardellini, V., Casalicchio, E., Presti, F.L., Silvestri, L.: SLA-aware resource management for application service providers in the cloud. In: First International Symposium on Network Cloud Computing and Applications (NCCA), pp. 20–27. IEEE (2011)

  31. Wu, L., Garg, S.K., Buyya, R.: SLA-based resource allocation for software as a service provider (SaaS) in cloud computing environments. In: 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 195–204. IEEE (2011)

  32. Maurer, M., Brandic, I., Sakellariou, R.: Adaptive resource configuration for cloud infrastructure management. Futur. Gener. Comput. Syst. 29(2), 472–487 (2013)

    Article  Google Scholar 

  33. Konstantinou, I., Kantere, V., Tsoumakos, D., Koziris, N.: COCCUS: self-configured cost-based query services in the cloud. In: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pp. 1041–1044. ACM (2013)

  34. Mao, M., Li, J., Humphrey, M.: Cloud auto-scaling with deadline and budget constraints. In: 2010 11th IEEE/ACM International Conference on In Grid Computing (GRID), pp. 41–48. IEEE (2010)

  35. Sah, S.K., Joshi, S.R.: Scalability of efficient and dynamic workload distribution in autonomic cloud computing. In: International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 12–18. IEEE (2014)

  36. Sheikhalishahi, M., Grandinetti, L., Wallace, R.M., Vazquez-Poletti, J.L.: Autonomic resource contention-aware scheduling. Softw.: Pract. Exp. 45(2), 161–175 (2015)

    Google Scholar 

  37. Yuan, E., Malek, S., Schmerl, B., Garlan, D., Gennari, J.: Architecture-based self-protecting software systems. In: Proceedings of the 9th International ACM Sigsoft Conference on Quality of Software Architectures, pp. 33–42. ACM (2013)

  38. Chopra, I., Singh, M.: SHAPE—An approach for self-healing and self-protection in complex distributed networks. J. Supercomput. 67(2), 585–613 (2014)

    Article  Google Scholar 

  39. Caswell, B., Beale, J.: Snort 2.1 intrusion detection, Syngress (2004)

  40. Boser, B.E., Guyon, I.M., Vapnik, V.N.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152. ACM (1992)

  41. Kadav, A., Renzelmann, M.J., Swift, M.M.: Tolerating hardware device failures in software. In: Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles, pp. 59–72. ACM (2009)

  42. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw.: Pract. Exp. 41(1), 23–50 (2011)

    Google Scholar 

  43. Talib, A.M., Alomary, F.O.: Cloud computing based E-Commerce as a service model: impacts and recommendations. In: Proceedings of the International Conference on Internet of Things and Cloud Computing, p 27. ACM (2016)

  44. Prasad, C.S.D., Rao, S.R.S.: Competition in the indian E-Commerce sector durga prasad the case of flipkart. Gavesana J. Manag. 7(2), 1–22 (2015)

    Google Scholar 

  45. Chauhan, P.: A Comparative study on consumer Preferences towards online retail marketers-with special reference to Flipkart, Jabong, Amazon, Snapdeal Myntra and fashion and you. IJAR 1(10), 1021–1026 (2015)

    Google Scholar 

  46. Sebastian, M., Jercinovic, S., Cosmina, T., Simonacarmen, D., Cosmin, S.: A study regarding online traffic analytics of websites for profit. Agricultural Management/Lucrari Stiintifice Seria I. Manag. Agricol 19(1), 81–84 (2017)

    Google Scholar 

  47. Luo, J., Liang, Y., Gao, W., Yang, J.: Hadoop based deep packet inspection system for traffic analysis of e-business websites. In: International Conference on Data Science and Advanced Analytics (DSAA), pp. 361–366. IEEE (2014)

  48. Arora, N., Zhang, H., Rhee, J., Yoshihira, K., iProbe, G.J.: A lightweight user-level dynamic instrumentation tool. In: Proceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering, pp. 742–745. IEEE Press (2013)

  49. Sukhpal S.G., Buyya, R.: A taxonomy and future directions for sustainable cloud computing: 360 degree view. http://www.buyya.com/papers/SustainableClouds360.pdf

  50. Exposito, J.A., Ametller, J., Robles, S.: Configuring the JADE HTTP MTP. http://jade.tilab.com/documentation/tutorials-guides/configuring-the-jade-http-mtp/ (2010)

Download references

Acknowledgements

One of the authors, Dr. Sukhpal Singh Gill [Post Doctorate Fellow], gratefully acknowledges the Cloud Computing and Distributed Systems (CLOUDS) Laboratory, School of Computing and Information Systems, The University of Melbourne, Australia, for awarding him the Fellowship to carry out this research work. We thank Adel Nadjaran Toosi and anonymous reviewers for their comments on improving the paper.

Author information

Authors and Affiliations

  1. Cloud Computing and Distributed Systems (CLOUDS) Laboratory, School of Computing and Information Systems, The University of Melbourne, Melbourne, Australia

    Sukhpal Singh Gill & Rajkumar Buyya

Authors
  1. Sukhpal Singh Gill
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajkumar Buyya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sukhpal Singh Gill.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gill, S.S., Buyya, R. Resource Provisioning Based Scheduling Framework for Execution of Heterogeneous and Clustered Workloads in Clouds: from Fundamental to Autonomic Offering. J Grid Computing 17, 385–417 (2019). https://doi.org/10.1007/s10723-017-9424-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-017-9424-0

Keywords

Search

Navigation