Abstract
In cloud computing, resources could be provisioned in a dynamic way on demand for cloud services. Cloud providers seek to realize effective SLA execution mechanisms for avoiding SLA violations by provisioning the resources or applications and timely interacting to environmental changes and failures. Sufficient resource provisioning to cloud’s services relies on the requirements of the workloads to achieve a high performance for quality of service. Therefore, deciding the suitable amount of cloud’s resources for these services to achieve is one of the main works in cloud computing. During the runtime of services, the amount of cloud’s resources can be specified and provisioned based on the actual workloads changes. Determining the correct amount of cloud’s resources needed for running the services on clouds is not easy task, and it depends on the existing workloads of services. Consequently, it is required to predict the future workloads for dynamic provisioning of resources in order to meet the changes in workloads and demands of services in cloud computing environments. In this paper, we study the possibility of using a cognitive/intelligent approach for cloud resource provisioning which is a combination of the autonomic computing concept, deep learning technique and fuzzy logic control. Deep learning technique is a state-of-the-art in the machine learning field. It achieved promising results in many other fields like image classification and speech recognition. For these reasons, deep learning is proposed in this work to tackle the workload prediction in cloud computing. Additionally, we also propose to use a fuzzy logic-based method in order to make a decision in the case of uncertainty of the workload prediction. We study various exiting works on autonomic cloud resource provisioning and show that there is still an opportunity to improve the current methods. We also present the challenges that may exist on this domain.
Similar content being viewed by others
References
Al-Ayyoub M, Jararweh Y, Daraghmeh M, Althebyan Q (2015) Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure. Cluster Comput 18:919–932
Amiri M, Mohammad-Khanli L (2017) Survey on prediction models of applications for resources provisioning in cloud. J Netw Comput Appl 82:93–113
Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A et al (2010) A view of cloud computing. Commun ACM 53:50–58
Aslanpour MS, Ghobaei-Arani M, Toosi AN (2017a) Auto-scaling web applications in clouds: a cost-aware approach. J Netw Comput Appl 95:26–41
Aslanpour MS, Dashti SE, Ghobaei-Arani M, Rahmanian AA (2017b) Resource provisioning for cloud applications: a 3-D, provident and flexible approach. J Supercomput 1–32
Bahrpeyma F, Haghighi H, Zakerolhosseini A (2015) An adaptive RL based approach for dynamic resource provisioning in Cloud virtualized data centers. Computing 97:1209–1234
Barrett E, Howley E, Duggan J (2013) Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurr Comput Pract Exp 25:1656–1674
Bhardwaj T, Sharma SC (2018) Cloud-WBAN: an experimental framework for Cloud-enabled Wireless Body Area Network with efficient virtual resource utilization. Sustain Comput Inf Syst 20:14–33
Bodik P, Fox A, Franklin MJ, Jordan MI, Patterson DA (2010) Characterizing, modeling, and generating workload spikes for stateful services. In: Proceedings of the 1st ACM symposium on cloud computing, pp 241–252
Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities. In: International conference on high performance computing & simulation, 2009. HPCS’09, pp 1–11
Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes, Oxford
Byun E-K, Kee Y-S, Kim J-S, Maeng S (2011) Cost optimized provisioning of elastic resources for application workflows. Future Gener Comput Syst 27:1011–1026
Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41:23–50
Carvalho OA, Bruschi SM, Santana RH, Santana MJ (2016) Green cloud meta-scheduling. J Grid Comput 14:109–126
Casalicchio E, Silvestri L (2013) Mechanisms for SLA provisioning in cloud-based service providers. Comput Netw 57:795–810
Chandrasekaran K (2014) Essentials of cloud computing. CRC Press, Boca Raton
Clarknet-http-two weeks of http logs from the clarknet www server. http://ita.ee.lbl.gov/html/contrib/ClarkNet-HTTP.html. Accessed 15.10.14
Cole JH, Poudel RP, Tsagkrasoulis D, Caan MW, Steves C, Spector TD et al (2017) Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker. NeuroImage 163:115–124
Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537
Deng L, Yu D (2014) Deep learning: methods and applications. In: Foundations and trends® in signal processing, vol 7, pp 197–387
Dernoncourt F (2013) Introduction to fuzzy logic, vol 21. Massachusetts Institute of Technology, Cambridge
Dey S, Pratiher S, Banerjee S, Mukherjee CK (2017) SolarisNet: a deep regression network for solar radiation prediction. arXiv preprint arXiv:1711.08413
Ebrahimirad V, Goudarzi M, Rajabi A (2015) Energy-aware scheduling for precedence-constrained parallel virtual machines in virtualized data centers. J Grid Comput 13:233–253
Emeakaroha VC, Brandic I, Maurer M, Dustdar S (2010) Low level metrics to high level SLAs-LoM2HiS framework: bridging the gap between monitored metrics and SLA parameters in cloud environments. In: 2010 international conference on high performance computing and simulation (HPCS), pp 48–54
Emeakaroha VC, Brandic I, Maurer M, Dustdar S (2013) Cloud resource provisioning and SLA enforcement via LoM2HiS framework. Concurr Comput Pract Exp 25:1462–1481
Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35:1915–1929
Ghobaei-Arani M, Jabbehdari S, Pourmina MA (2016) An autonomic approach for resource provisioning of cloud services. Cluster Comput 19:1017–1036
Ghobaei-Arani M, Jabbehdari S, Pourmina MA (2018) An autonomic resource provisioning approach for service-based cloud applications: a hybrid approach. Future Gener Comput Syst 78:191–210
Gill SS, Buyya R (2018) Resource provisioning based scheduling framework for execution of heterogeneous and clustered workloads in clouds: from fundamental to autonomic offering. J Grid Comput. https://doi.org/10.1007/s10723-017-9424-0
Hayat M, Bennamoun M, An S (2015) Deep reconstruction models for image set classification. IEEE Trans Pattern Anal Mach Intell 37:713–727
Hellerstein JL, Diao Y, Parekh S, Tilbury DM (2004) Feedback control of computing systems. Wiley, New York
Herbst NR, Kounev S, Reussner RH (2013) Elasticity in cloud computing: what it is, and what it is not. In: ICAC, pp 23–27
Hinton G, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29:82–97
Huebscher MC, McCann JA (2008) A survey of autonomic computing—degrees, models, and applications. ACM Comput Surv (CSUR) 40:7
Islam S, Keung J, Lee K, Liu A (2012) Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener Comput Syst 28:155–162
Jacob B, Lanyon-Hogg R, Nadgir DK, Yassin AF (2004) A practical guide to the IBM autonomic computing toolkit. IBM Redbooks 4:10
Jamshidi P, Ahmad A, Pahl C (2014) Autonomic resource provisioning for cloud-based software. In: Proceedings of the 9th international symposium on software engineering for adaptive and self-managing systems, pp 95–104
Jiang J, Lin Y, Xie G, Fu L, Yang J (2017) Time and energy optimization algorithms for the static scheduling of multiple workflows in heterogeneous computing system. J Grid Comput 15:435–456
Kephart JO, Chess DM (2003) The vision of autonomic computing. Computer 36:41–50
Khorsand R, Ghobaei-Arani M, Ramezanpour M (2018a) FAHP approach for autonomic resource provisioning of multitier applications in cloud computing environments. Softw Pract Exp 48:2147–2173
Khorsand R, Ghobaei-Arani M, Ramezanpour M (2018b) WITHDRAWN: a fuzzy auto-scaling approach using workload prediction for MMOG application in a cloud environment. Elsevier, New York
Koehler M (2014) An adaptive framework for utility-based optimization of scientific applications in the cloud. J Cloud Comput 3:4
Korenevskiy N (2015) Application of fuzzy logic for decision-making in medical expert systems. Biomed Eng 49:46–49
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436
Liu J, Zhang Y, Zhou Y, Zhang D, Liu H (2015) Aggressive resource provisioning for ensuring QoS in virtualized environments. IEEE Trans Cloud Comput 3:119–131
Lorido-Botran T, Miguel-Alonso J, Lozano JA (2014) A review of auto-scaling techniques for elastic applications in cloud environments. J Grid Comput 12:559–592
Lv Y, Duan Y, Kang W, Li Z, Wang F-Y (2015) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16:865–873
Manvi SS, Shyam GK (2014) Resource management for Infrastructure as a Service (IaaS) in cloud computing: a survey. J Netw Comput Appl 41:424–440
Maurer M, Brandic I, Sakellariou R (2013) Adaptive resource configuration for Cloud infrastructure management. Future Generation Computer Systems 29:472–487
Mikolov T, Deoras A, Povey D, Burget L, Černocký J (2011) Strategies for training large scale neural network language models. In: 2011 IEEE workshop on automatic speech recognition and understanding (ASRU), pp 196–201
Misra S, Krishna PV, Kalaiselvan K, Saritha V, Obaidat MS (2014) Learning automata-based QoS framework for cloud IaaS. IEEE Trans Netw Serv Manage 11:15–24
Muppala S, Chen G, Zhou X (2014) Multi-tier service differentiation by coordinated learning-based resource provisioning and admission control. J Parallel Distrib Comput 74:2351–2364
Mustafa S, Nazir B, Hayat A, Madani SA (2015) Resource management in cloud computing: taxonomy, prospects, and challenges. Comput Electr Eng 47:186–203
Nasa-http- two months of http logs from the kscnasa www server. http://ita.ee.lbl.gov/html/contrib/NASA-HTTP.html. Accessed 15.10.14
Pop F, Potop-Butucaru M (2016) ARMCO: Advanced topics in resource management for ubiquitous cloud computing: an adaptive approach. Elsevier
Prentzas J, Hatzilygeroudis I (2007) Categorizing approaches combining rule-based and case-based reasoning. Expert Syst 24:97–122
Qavami HR, Jamali S, Akbari MK, Javadi B (2013) Dynamic resource provisioning in cloud computing: a heuristic markovian approach. In: International conference on cloud computing, pp 102–111
Qiu F, Zhang B, Guo J (2016) A deep learning approach for VM workload prediction in the cloud. In: 2016 17th IEEE/ACIS international conference on software engineering, artificial intelligence, networking and parallel/distributed computing (SNPD), pp 319–324
Rahmanian AA, Ghobaei-Arani M, Tofighy S (2018) A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment. Future Gener Comput Syst 79:54–71
Ritter T, Mitschang B, Mega C (2012) Dynamic provisioning of system topologies in the cloud. In: Enterprise interoperability V. Springer, pp 391–401
Roy N, Dubey A, Gokhale A (2011) Efficient autoscaling in the cloud using predictive models for workload forecasting. In: 2011 IEEE international conference on cloud computing (CLOUD), pp 500–507
Russell SJ, Norvig P (2002) Artificial intelligence: a modern approach (International Edition)
Sainath TN, Mohamed A-R, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR. In: 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 8614–8618
Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117
Singh S, Chana I (2015) Q-aware: quality of service based cloud resource provisioning. Comput Electr Eng 47:138–160
Singh S, Chana I, Singh M (2017) The journey of QoS-aware autonomic cloud computing. IT Prof 19:42–49
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D et al (2015) Going deeper with convolutions
Tang Z, Qi L, Cheng Z, Li K, Khan SU, Li K (2016) An energy-efficient task scheduling algorithm in DVFS-enabled cloud environment. J Grid Comput 14:55–74
Tompson JJ, Jain A, LeCun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. In: Advances in neural information processing systems, pp 1799–1807
Vadiati M, Asghari-Moghaddam A, Nakhaei M, Adamowski J, Akbarzadeh A (2016) A fuzzy-logic based decision-making approach for identification of groundwater quality based on groundwater quality indices. J Environ Manage 184:255–270
Varghese B, Buyya R (2018) Next generation cloud computing: new trends and research directions. Future Gener Comput Syst 79:849–861
Whitehead SD, Ballard DH (1991) Learning to perceive and act by trial and error. Mach Learn 7:45–83
Xu J, Zhao M, Fortes J, Carpenter R, Yousif M (2007) On the use of fuzzy modeling in virtualized data center management. In: Fourth international conference on autonomic computing, 2007. ICAC’07, pp 25–25
Xu C-Z, Rao J, Bu X (2012) URL: a unified reinforcement learning approach for autonomic cloud management. J Parallel Distrib Comput 72:95–105
Yang J, Liu C, Shang Y, Cheng B, Mao Z, Liu C et al (2014) A cost-aware auto-scaling approach using the workload prediction in service clouds. Inf Syst Front 16:7–18
Yang Q, Zhou Y, Yu Y, Yuan J, Xing X, Du S (2015) Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing. J Supercomput 71:3037–3053
Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Intern Serv Appl 1:7–18
Zhang Q, Yang LT, Chen Z, Li P (2018a) A survey on deep learning for big data. Inf Fusion 42:146–157
Zhang Q, Yang LT, Yan Z, Chen Z, Li P (2018) An efficient deep learning model to predict cloud workload for industry informatics. IEEE transactions on industrial informatics
Acknowledgement
The authors are grateful to the Deanship of Scientific Research at King Saud University for funding this work through Vice Deanship of Scientific Research Chairs: Chair of Pervasive and Mobile Computing.
Funding
The authors are grateful to the Deanship of Scientific Research at King Saud University for funding this work through the Vice Deanship of Scientific Research Chairs.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by A. K. Sangaiah, H. Pham, M.-Y. Chen, H. Lu, F. Mercaldo.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Al-Asaly, M.S., Hassan, M.M. & Alsanad, A. A cognitive/intelligent resource provisioning for cloud computing services: opportunities and challenges. Soft Comput 23, 9069–9081 (2019). https://doi.org/10.1007/s00500-019-04061-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-019-04061-9