Skip to main content
Log in

A cognitive/intelligent resource provisioning for cloud computing services: opportunities and challenges

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

In cloud computing, resources could be provisioned in a dynamic way on demand for cloud services. Cloud providers seek to realize effective SLA execution mechanisms for avoiding SLA violations by provisioning the resources or applications and timely interacting to environmental changes and failures. Sufficient resource provisioning to cloud’s services relies on the requirements of the workloads to achieve a high performance for quality of service. Therefore, deciding the suitable amount of cloud’s resources for these services to achieve is one of the main works in cloud computing. During the runtime of services, the amount of cloud’s resources can be specified and provisioned based on the actual workloads changes. Determining the correct amount of cloud’s resources needed for running the services on clouds is not easy task, and it depends on the existing workloads of services. Consequently, it is required to predict the future workloads for dynamic provisioning of resources in order to meet the changes in workloads and demands of services in cloud computing environments. In this paper, we study the possibility of using a cognitive/intelligent approach for cloud resource provisioning which is a combination of the autonomic computing concept, deep learning technique and fuzzy logic control. Deep learning technique is a state-of-the-art in the machine learning field. It achieved promising results in many other fields like image classification and speech recognition. For these reasons, deep learning is proposed in this work to tackle the workload prediction in cloud computing. Additionally, we also propose to use a fuzzy logic-based method in order to make a decision in the case of uncertainty of the workload prediction. We study various exiting works on autonomic cloud resource provisioning and show that there is still an opportunity to improve the current methods. We also present the challenges that may exist on this domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Al-Ayyoub M, Jararweh Y, Daraghmeh M, Althebyan Q (2015) Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure. Cluster Comput 18:919–932

    Article  Google Scholar 

  • Amiri M, Mohammad-Khanli L (2017) Survey on prediction models of applications for resources provisioning in cloud. J Netw Comput Appl 82:93–113

    Article  Google Scholar 

  • Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A et al (2010) A view of cloud computing. Commun ACM 53:50–58

    Article  Google Scholar 

  • Aslanpour MS, Ghobaei-Arani M, Toosi AN (2017a) Auto-scaling web applications in clouds: a cost-aware approach. J Netw Comput Appl 95:26–41

    Article  Google Scholar 

  • Aslanpour MS, Dashti SE, Ghobaei-Arani M, Rahmanian AA (2017b) Resource provisioning for cloud applications: a 3-D, provident and flexible approach. J Supercomput 1–32

  • Bahrpeyma F, Haghighi H, Zakerolhosseini A (2015) An adaptive RL based approach for dynamic resource provisioning in Cloud virtualized data centers. Computing 97:1209–1234

    Article  MathSciNet  Google Scholar 

  • Barrett E, Howley E, Duggan J (2013) Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurr Comput Pract Exp 25:1656–1674

    Article  Google Scholar 

  • Bhardwaj T, Sharma SC (2018) Cloud-WBAN: an experimental framework for Cloud-enabled Wireless Body Area Network with efficient virtual resource utilization. Sustain Comput Inf Syst 20:14–33

    Google Scholar 

  • Bodik P, Fox A, Franklin MJ, Jordan MI, Patterson DA (2010) Characterizing, modeling, and generating workload spikes for stateful services. In: Proceedings of the 1st ACM symposium on cloud computing, pp 241–252

  • Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities. In: International conference on high performance computing & simulation, 2009. HPCS’09, pp 1–11

  • Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes, Oxford

    Google Scholar 

  • Byun E-K, Kee Y-S, Kim J-S, Maeng S (2011) Cost optimized provisioning of elastic resources for application workflows. Future Gener Comput Syst 27:1011–1026

    Article  Google Scholar 

  • Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41:23–50

    Article  Google Scholar 

  • Carvalho OA, Bruschi SM, Santana RH, Santana MJ (2016) Green cloud meta-scheduling. J Grid Comput 14:109–126

    Article  Google Scholar 

  • Casalicchio E, Silvestri L (2013) Mechanisms for SLA provisioning in cloud-based service providers. Comput Netw 57:795–810

    Article  Google Scholar 

  • Chandrasekaran K (2014) Essentials of cloud computing. CRC Press, Boca Raton

    Book  Google Scholar 

  • Clarknet-http-two weeks of http logs from the clarknet www server. http://ita.ee.lbl.gov/html/contrib/ClarkNet-HTTP.html. Accessed 15.10.14

  • Cole JH, Poudel RP, Tsagkrasoulis D, Caan MW, Steves C, Spector TD et al (2017) Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker. NeuroImage 163:115–124

    Article  Google Scholar 

  • Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537

    MATH  Google Scholar 

  • Deng L, Yu D (2014) Deep learning: methods and applications. In: Foundations and trends® in signal processing, vol 7, pp 197–387

  • Dernoncourt F (2013) Introduction to fuzzy logic, vol 21. Massachusetts Institute of Technology, Cambridge

    Google Scholar 

  • Dey S, Pratiher S, Banerjee S, Mukherjee CK (2017) SolarisNet: a deep regression network for solar radiation prediction. arXiv preprint arXiv:1711.08413

  • Ebrahimirad V, Goudarzi M, Rajabi A (2015) Energy-aware scheduling for precedence-constrained parallel virtual machines in virtualized data centers. J Grid Comput 13:233–253

    Article  Google Scholar 

  • Emeakaroha VC, Brandic I, Maurer M, Dustdar S (2010) Low level metrics to high level SLAs-LoM2HiS framework: bridging the gap between monitored metrics and SLA parameters in cloud environments. In: 2010 international conference on high performance computing and simulation (HPCS), pp 48–54

  • Emeakaroha VC, Brandic I, Maurer M, Dustdar S (2013) Cloud resource provisioning and SLA enforcement via LoM2HiS framework. Concurr Comput Pract Exp 25:1462–1481

    Article  Google Scholar 

  • Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35:1915–1929

    Article  Google Scholar 

  • Ghobaei-Arani M, Jabbehdari S, Pourmina MA (2016) An autonomic approach for resource provisioning of cloud services. Cluster Comput 19:1017–1036

    Article  Google Scholar 

  • Ghobaei-Arani M, Jabbehdari S, Pourmina MA (2018) An autonomic resource provisioning approach for service-based cloud applications: a hybrid approach. Future Gener Comput Syst 78:191–210

    Article  Google Scholar 

  • Gill SS, Buyya R (2018) Resource provisioning based scheduling framework for execution of heterogeneous and clustered workloads in clouds: from fundamental to autonomic offering. J Grid Comput. https://doi.org/10.1007/s10723-017-9424-0

    Google Scholar 

  • Hayat M, Bennamoun M, An S (2015) Deep reconstruction models for image set classification. IEEE Trans Pattern Anal Mach Intell 37:713–727

    Article  Google Scholar 

  • Hellerstein JL, Diao Y, Parekh S, Tilbury DM (2004) Feedback control of computing systems. Wiley, New York

    Book  Google Scholar 

  • Herbst NR, Kounev S, Reussner RH (2013) Elasticity in cloud computing: what it is, and what it is not. In: ICAC, pp 23–27

  • Hinton G, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29:82–97

    Article  Google Scholar 

  • Huebscher MC, McCann JA (2008) A survey of autonomic computing—degrees, models, and applications. ACM Comput Surv (CSUR) 40:7

    Article  Google Scholar 

  • Islam S, Keung J, Lee K, Liu A (2012) Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener Comput Syst 28:155–162

    Article  Google Scholar 

  • Jacob B, Lanyon-Hogg R, Nadgir DK, Yassin AF (2004) A practical guide to the IBM autonomic computing toolkit. IBM Redbooks 4:10

    Google Scholar 

  • Jamshidi P, Ahmad A, Pahl C (2014) Autonomic resource provisioning for cloud-based software. In: Proceedings of the 9th international symposium on software engineering for adaptive and self-managing systems, pp 95–104

  • Jiang J, Lin Y, Xie G, Fu L, Yang J (2017) Time and energy optimization algorithms for the static scheduling of multiple workflows in heterogeneous computing system. J Grid Comput 15:435–456

    Article  Google Scholar 

  • Kephart JO, Chess DM (2003) The vision of autonomic computing. Computer 36:41–50

    Article  Google Scholar 

  • Khorsand R, Ghobaei-Arani M, Ramezanpour M (2018a) FAHP approach for autonomic resource provisioning of multitier applications in cloud computing environments. Softw Pract Exp 48:2147–2173

    Article  Google Scholar 

  • Khorsand R, Ghobaei-Arani M, Ramezanpour M (2018b) WITHDRAWN: a fuzzy auto-scaling approach using workload prediction for MMOG application in a cloud environment. Elsevier, New York

    Google Scholar 

  • Koehler M (2014) An adaptive framework for utility-based optimization of scientific applications in the cloud. J Cloud Comput 3:4

    Article  Google Scholar 

  • Korenevskiy N (2015) Application of fuzzy logic for decision-making in medical expert systems. Biomed Eng 49:46–49

    Article  Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  • LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436

    Article  Google Scholar 

  • Liu J, Zhang Y, Zhou Y, Zhang D, Liu H (2015) Aggressive resource provisioning for ensuring QoS in virtualized environments. IEEE Trans Cloud Comput 3:119–131

    Article  Google Scholar 

  • Lorido-Botran T, Miguel-Alonso J, Lozano JA (2014) A review of auto-scaling techniques for elastic applications in cloud environments. J Grid Comput 12:559–592

    Article  Google Scholar 

  • Lv Y, Duan Y, Kang W, Li Z, Wang F-Y (2015) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16:865–873

    Google Scholar 

  • Manvi SS, Shyam GK (2014) Resource management for Infrastructure as a Service (IaaS) in cloud computing: a survey. J Netw Comput Appl 41:424–440

    Article  Google Scholar 

  • Maurer M, Brandic I, Sakellariou R (2013) Adaptive resource configuration for Cloud infrastructure management. Future Generation Computer Systems 29:472–487

    Article  Google Scholar 

  • Mikolov T, Deoras A, Povey D, Burget L, Černocký J (2011) Strategies for training large scale neural network language models. In: 2011 IEEE workshop on automatic speech recognition and understanding (ASRU), pp 196–201

  • Misra S, Krishna PV, Kalaiselvan K, Saritha V, Obaidat MS (2014) Learning automata-based QoS framework for cloud IaaS. IEEE Trans Netw Serv Manage 11:15–24

    Article  Google Scholar 

  • Muppala S, Chen G, Zhou X (2014) Multi-tier service differentiation by coordinated learning-based resource provisioning and admission control. J Parallel Distrib Comput 74:2351–2364

    Article  Google Scholar 

  • Mustafa S, Nazir B, Hayat A, Madani SA (2015) Resource management in cloud computing: taxonomy, prospects, and challenges. Comput Electr Eng 47:186–203

    Article  Google Scholar 

  • Nasa-http- two months of http logs from the kscnasa www server. http://ita.ee.lbl.gov/html/contrib/NASA-HTTP.html. Accessed 15.10.14

  • Pop F, Potop-Butucaru M (2016) ARMCO: Advanced topics in resource management for ubiquitous cloud computing: an adaptive approach. Elsevier

  • Prentzas J, Hatzilygeroudis I (2007) Categorizing approaches combining rule-based and case-based reasoning. Expert Syst 24:97–122

    Article  Google Scholar 

  • Qavami HR, Jamali S, Akbari MK, Javadi B (2013) Dynamic resource provisioning in cloud computing: a heuristic markovian approach. In: International conference on cloud computing, pp 102–111

  • Qiu F, Zhang B, Guo J (2016) A deep learning approach for VM workload prediction in the cloud. In: 2016 17th IEEE/ACIS international conference on software engineering, artificial intelligence, networking and parallel/distributed computing (SNPD), pp 319–324

  • Rahmanian AA, Ghobaei-Arani M, Tofighy S (2018) A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment. Future Gener Comput Syst 79:54–71

    Article  Google Scholar 

  • Ritter T, Mitschang B, Mega C (2012) Dynamic provisioning of system topologies in the cloud. In: Enterprise interoperability V. Springer, pp 391–401

  • Roy N, Dubey A, Gokhale A (2011) Efficient autoscaling in the cloud using predictive models for workload forecasting. In: 2011 IEEE international conference on cloud computing (CLOUD), pp 500–507

  • Russell SJ, Norvig P (2002) Artificial intelligence: a modern approach (International Edition)

  • Sainath TN, Mohamed A-R, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR. In: 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 8614–8618

  • Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  • Singh S, Chana I (2015) Q-aware: quality of service based cloud resource provisioning. Comput Electr Eng 47:138–160

    Article  Google Scholar 

  • Singh S, Chana I, Singh M (2017) The journey of QoS-aware autonomic cloud computing. IT Prof 19:42–49

    Article  Google Scholar 

  • Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D et al (2015) Going deeper with convolutions

  • Tang Z, Qi L, Cheng Z, Li K, Khan SU, Li K (2016) An energy-efficient task scheduling algorithm in DVFS-enabled cloud environment. J Grid Comput 14:55–74

    Article  Google Scholar 

  • Tompson JJ, Jain A, LeCun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. In: Advances in neural information processing systems, pp 1799–1807

  • Vadiati M, Asghari-Moghaddam A, Nakhaei M, Adamowski J, Akbarzadeh A (2016) A fuzzy-logic based decision-making approach for identification of groundwater quality based on groundwater quality indices. J Environ Manage 184:255–270

    Article  Google Scholar 

  • Varghese B, Buyya R (2018) Next generation cloud computing: new trends and research directions. Future Gener Comput Syst 79:849–861

    Article  Google Scholar 

  • Whitehead SD, Ballard DH (1991) Learning to perceive and act by trial and error. Mach Learn 7:45–83

    Google Scholar 

  • Xu J, Zhao M, Fortes J, Carpenter R, Yousif M (2007) On the use of fuzzy modeling in virtualized data center management. In: Fourth international conference on autonomic computing, 2007. ICAC’07, pp 25–25

  • Xu C-Z, Rao J, Bu X (2012) URL: a unified reinforcement learning approach for autonomic cloud management. J Parallel Distrib Comput 72:95–105

    Article  Google Scholar 

  • Yang J, Liu C, Shang Y, Cheng B, Mao Z, Liu C et al (2014) A cost-aware auto-scaling approach using the workload prediction in service clouds. Inf Syst Front 16:7–18

    Article  Google Scholar 

  • Yang Q, Zhou Y, Yu Y, Yuan J, Xing X, Du S (2015) Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing. J Supercomput 71:3037–3053

    Article  Google Scholar 

  • Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Intern Serv Appl 1:7–18

    Article  Google Scholar 

  • Zhang Q, Yang LT, Chen Z, Li P (2018a) A survey on deep learning for big data. Inf Fusion 42:146–157

    Article  Google Scholar 

  • Zhang Q, Yang LT, Yan Z, Chen Z, Li P (2018) An efficient deep learning model to predict cloud workload for industry informatics. IEEE transactions on industrial informatics

Download references

Acknowledgement

The authors are grateful to the Deanship of Scientific Research at King Saud University for funding this work through Vice Deanship of Scientific Research Chairs: Chair of Pervasive and Mobile Computing.

Funding

The authors are grateful to the Deanship of Scientific Research at King Saud University for funding this work through the Vice Deanship of Scientific Research Chairs.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammad Mehedi Hassan.

Ethics declarations

Conflict of interest

Authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by A. K. Sangaiah, H. Pham, M.-Y. Chen, H. Lu, F. Mercaldo.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Al-Asaly, M.S., Hassan, M.M. & Alsanad, A. A cognitive/intelligent resource provisioning for cloud computing services: opportunities and challenges. Soft Comput 23, 9069–9081 (2019). https://doi.org/10.1007/s00500-019-04061-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-019-04061-9

Keywords

Navigation