Abstract
Modern cluster management systems have effectively evolved to deal with the increasing and diverse cloud computing demands. However, several challenges including low resource utilization, high power consumption are still present that can be solved with a precise real-time usage prediction. This prediction problem is complicated since the cloud workloads vary dynamically and there are nonlinear relationships between the usage, duration and jobs characteristics. Therefore, non-linear feature extraction methods including logarithm, encoder and several feature extraction methods were used in the past studies. Our study utilized several regression models and deep learning models including GRU, LSTM in univariate and multivariate settings to explore and extract highly-dimensional and highly-nonlinear relationship. Our experiments used Google Cluster Trace data v3 to perform prediction on duration, CPU and memory utilization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, Z., Hu, J., Min, G., Zomaya, A.Y., El-Ghazawi, T.: Towards accurate prediction for high-dimensional and highly-variable cloud workloads with deep learning. IEEE Trans. Parallel Distrib. Syst. 31, 923–934 (2020)
Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation (2014)
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., Muller, P.-A.: Deep learning for time series classification: a review. Data Min. Knowl. Disc. 33(4), 917–963 (2019). https://doi.org/10.1007/s10618-019-00619-1
Géron, A.: Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 2nd edn. O’Reilly Media Inc, Sebastopol (2019). ISBN 9781492032649
Goodfellow, I.J., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9, 1735–1780 (1997)
Hua, Y., Zhao, Z., Li, R., Chen, X., Liu, Z., Zhang, H.: Deep learning with long short-term memory for time series prediction. IEEE Commun. Mag. 57, 114–119 (2019)
Lin, Y., Barker, A., Ceesay, S.: Exploring characteristics of inter-cluster machines and cloud applications on google clusters. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 2785–2794 (2020)
Peng, C., Li, Y., Yu, Y., Zhou, Y., Du, S.: Multi-step-ahead host load prediction with GRU based encoder-decoder in cloud computing. In: 2018 10th International Conference on Knowledge and Smart Technology, pp. 186–191. IEEE (2018)
Portnoy, M.: Virtualization Essentials. SYBEX Inc., USA, 2nd edn. (2016). ISBN 9781119267720
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., Cottrell, G.: A dual-stage attention-based recurrent neural network for time series prediction. In: IJCAI (2017)
Santana, G.A.A.: Data Center Virtualization Fundamentals: Understanding Techniques and Designs for Highly Efficient Data Centers with Cisco Nexus, UCS, MDS, and Beyond (2013)
Tirmazi, M., Barker, A., Deng, N., Haque, M.E., Qin, Z.G., Hand, S., Wilkes, J.: Borg: the next generation. In EuroSys 2020, Heraklion, Crete (2020)
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Kaiser, A.N.L., Polosukhin, I.: Attention is all you need, Gomez (2017)
Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J.: Large-scale cluster management at Google with Borg. In: Proceedings of the European Conference on Computer Systems (EuroSys), France (2015)
Wilkes, J.: Google cluster-usage traces v3. Google Inc., Mountain View, CA, USA, Technical report (2020)
Zhou, S., Li, J., Zhang, K., Wen, M., Guan, Q.: An accurate ensemble forecasting approach for highly dynamic cloud workload with VMD and R-transformer. IEEE Access 8, 115992–116003 (2020)
Zhu, Y., Zhang, W., Chen, Y., Gao, H.: A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment. EURASIP J. Wireless Commun. Network. 2019, 1–18 (2019)
Acknowledgment
We would like to thank Peiqiao Zhang, HaiYan Dong and Elaine Luo for helping out in data analysis needed for this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Alibasa, M.J., Suleiman, B., Bello, A., Anaissi, A., Yan, Q., Chen, S. (2023). Cloud Resources Usage Prediction Using Deep Learning Models. In: Daimi, K., Al Sadoon, A. (eds) Proceedings of the 2023 International Conference on Advances in Computing Research (ACR’23). ACR 2023. Lecture Notes in Networks and Systems, vol 700. Springer, Cham. https://doi.org/10.1007/978-3-031-33743-7_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-33743-7_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-33742-0
Online ISBN: 978-3-031-33743-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)