Binbin Feng
ABSTRACT
Accurately forecasting workloads can enable web service providers to achieve proactive runtime management for applications and ensure service quality and cost efficiency. For cloud-native applications, multiple containers collaborate to handle user requests, making each container’s workload changes influenced by workload group behavior. However, existing approaches mainly analyze the individual changes of each container and do not explicitly model the workload group evolution of containers, resulting in sub-optimal results. Therefore, we propose a workload prediction method, GROUP, which implements the shifts of workload prediction focus from individual to group, workload group behavior representation from data similarity to data correlation, and workload group behavior evolution from implicit modeling to explicit modeling. First, we model the workload group behavior and its evolution from multiple perspectives. Second, we propose a container correlation calculation algorithm that considers static and dynamic container information to represent the workload group behavior. Third, we propose an end-to-end multi-step-ahead prediction method that explicitly portrays the complex relationship between the evolution of workload group behavior and the workload changes of each container. Lastly, enough experiments on public datasets show the advantages of GROUP, which provides an effective solution to achieve workload prediction for cloud-native applications.
Supplemental Material
- Sounak Banerjee, Sarbani Roy, and Sunirmal Khatua. 2021. Efficient resource utilization using multi-step-ahead workload prediction technique in cloud. The Journal of Supercomputing 77, 9 (2021), 10636–10663.Google Scholar
- Jing Bi, Haitao Yuan, LiBo Zhang, and Jia Zhang. 2019. SGW-SCN: An integrated machine learning approach for workload forecasting in geo-distributed cloud data centers. Information Sciences 481 (2019), 57–68.Google Scholar
- Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).Google Scholar
- Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).Google Scholar
- Paolo Di Francesco, Patricia Lago, and Ivano Malavolta. 2018. Migrating towards microservice architectures: an industrial survey. In 2018 IEEE International Conference on Software Architecture (ICSA). IEEE, 29–2909.Google Scholar
- Zhijun Ding, Binbin Feng, and Changjun Jiang. 2022. COIN: A Container Workload Prediction Model Focusing on Common and Individual Changes in Workloads. IEEE Transactions on Parallel and Distributed Systems (2022), 1–14. https://doi.org/10.1109/TPDS.2022.3202833Google Scholar
- Rajdeep Dua, A Reddy Raja, and Dharmesh Kakadia. 2014. Virtualization vs containerization to support paas. In 2014 IEEE International Conference on Cloud Engineering. IEEE, 610–614.Google Scholar
- Martin Duggan, Rachael Shaw, Jim Duggan, Enda Howley, and Enda Barrett. 2019. A multitime-steps-ahead prediction approach for scheduling live migration in cloud data centers. Software: Practice and Experience 49, 4 (2019), 617–639.Google Scholar
- Hadeel El-Kassabi, Mohamed Adel Serhani, Rachida Dssouli, Nabeel Al-Qirim, and Ikbal Taleb. 2018. Cloud Workflow Resource Shortage Prediction and Fulfillment Using Multiple Adaptation Strategies. In 2018 IEEE 11th International Conference on Cloud Computing (CLOUD). IEEE, 974–977.Google Scholar
- Binbin Feng, Zhijun Ding, and Changjun Jiang. 2022. FAST: A Forecasting Model with Adaptive Sliding Window and Time Locality Integration for Dynamic Cloud Workloads. IEEE Transactions on Services Computing (2022).Google Scholar
- Bing Hu, Yanping Chen, and Eamonn Keogh. 2013. Time series classification under more realistic assumptions. In Proceedings of the 2013 SIAM international conference on data mining. SIAM, 578–586.Google Scholar
- In Kee Kim, Wei Wang, Yanjun Qi, and Marty Humphrey. 2020. Forecasting Cloud Application Workloads with CloudInsight for Predictive Resource Management. IEEE Transactions on Cloud Computing (2020), 1–1. https://doi.org/10.1109/TCC.2020.2998017Google Scholar
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google Scholar
- Nane Kratzke and Peter-Christian Quint. 2017. Understanding cloud-native applications after 10 years of cloud computing-a systematic mapping study. Journal of Systems and Software 126 (2017), 1–16.Google Scholar
- Jitendra Kumar and Ashutosh Kumar Singh. 2020. Decomposition based cloud resource demand prediction using extreme learning machines. Journal of Network and Systems Management 28, 4 (2020), 1775–1793.Google Scholar
- Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.Google Scholar
- Yang Liu and DanYang Zou. 2022. Multi-step-ahead Host Load Prediction with VMD-BiGRU-ED in Cloud Computing. In 2022 IEEE 6th Information Technology and Mechatronics Engineering Conference (ITOEC), Vol. 6. IEEE, 2046–2050.Google Scholar
- Shutian Luo, Huanle Xu, Chengzhi Lu, Kejiang Ye, Guoyao Xu, Liping Zhang, Yu Ding, Jian He, and Chengzhong Xu. 2021. Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis. In Proceedings of the ACM Symposium on Cloud Computing. 412–426.Google Scholar
- Ming Mao and Marty Humphrey. 2012. A performance study on the vm startup time in the cloud. In 2012 IEEE Fifth International Conference on Cloud Computing. IEEE, 423–430.Google Scholar
- Wiem Matoussi and Tarek Hamrouni. 2022. A new temporal locality-based workload prediction approach for SaaS services in a cloud environment. Journal of King Saud University-Computer and Information Sciences 34, 7 (2022), 3973–3987.Google Scholar
- Vinod Nair and Geoffrey E Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10). 807–814.Google Scholar
- Chenglei Peng, Yang Li, Yao Yu, Yu Zhou, and Sidan Du. 2018. Multi-step-ahead host load prediction with gru based encoder-decoder in cloud computing. In 2018 10th International Conference on Knowledge and Smart Technology (KST). IEEE, 186–191.Google Scholar
- Cleveland Robert, C William, and Terpenning Irma. 1990. STL: A seasonal-trend decomposition procedure based on loess. Journal of official statistics 6, 1 (1990), 3–73.Google Scholar
- Dymitr Ruta, Ling Cen, and Quang Hieu Vu. 2020. Deep Bi-Directional LSTM Networks for Device Workload Forecasting. In 2020 15th Conference on Computer Science and Information Systems (FedCSIS). IEEE, 115–118.Google Scholar
- Deepika Saxena and Ashutosh Kumar Singh. 2022. Auto-adaptive learning-based workload forecasting in dynamic cloud environment. International Journal of Computers and Applications 44, 6 (2022), 541–551. https://doi.org/10.1080/1206212X.2020.1830245 arXiv:https://doi.org/10.1080/1206212X.2020.1830245Google Scholar
- Rachael Shaw, Enda Howley, and Enda Barrett. 2019. An energy efficient anti-correlated virtual machine placement algorithm using resource usage predictions. Simulation Modelling Practice and Theory 93 (2019), 322–342. https://doi.org/10.1016/j.simpat.2018.09.019 Modeling and Simulation of Cloud Computing and Big Data.Google Scholar
- Ya Su, Youjian Zhao, Wentao Xia, Rong Liu, Jiahao Bu, Jing Zhu, Yuanpu Cao, Haibin Li, Chenhao Niu, Yiyin Zhang, 2019. CoFlux: Robustly correlating KPIs by fluctuations for service troubleshooting. In Proceedings of the International Symposium on Quality of Service. 1–10.Google Scholar
- Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1–9.Google Scholar
- Xuehai Tang, Qiuyang Liu, Yangchen Dong, Jizhong Han, and Zhiyuan Zhang. 2018. Fisher: An efficient container load prediction model with deep neural network in clouds. In 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom). IEEE, 199–206.Google Scholar
- Leandro Von Krannichfeldt, Yi Wang, and Gabriela Hug. 2020. Online ensemble learning for load forecasting. IEEE Transactions on Power Systems 36, 1 (2020), 545–548.Google Scholar
Index Terms
- GROUP: An End-to-end Multi-step-ahead Workload Prediction Approach Focusing on Workload Group Behavior
Recommendations
Efficient resource utilization using multi-step-ahead workload prediction technique in cloud
AbstractThe demand of cloud-based services is growing rapidly due to the high scalability and cost-effective nature of cloud infrastructure. As a result, the size of the data center is increasing drastically, so is the cost of maintenance in terms of ...
Optimizing Workload Category for Adaptive Workload Prediction in Service Clouds
Service-Oriented ComputingAbstractIt is important to predict the total workload for facilitating auto scaling resource management in service cloud platforms. Currently, most prediction methods use a single prediction model to predict workloads. However, they cannot get ...
Workload Estimation for Improving Resource Management Decisions in the Cloud
ISADS '15: Proceedings of the 2015 IEEE Twelfth International Symposium on Autonomous Decentralized SystemsIn cloud computing, good resource management can benefit both cloud users as well as cloud providers. Workload prediction is a crucial step towards achieving good resource management. While it is possible to estimate the workloads of long-running tasks ...
Comments