skip to main content
10.1145/2656075.2656095acmconferencesArticle/Chapter ViewAbstractPublication PagesesweekConference Proceedingsconference-collections
research-article

Prediction and control of bursty cloud workloads: a fractal framework

Published: 12 October 2014 Publication History

Abstract

Cloud Computing is a promising approach to handle the growing needs for computation and storage in an efficient and cost-effective manner. Towards this end, characterizing workloads in the cloud infrastructure (e.g., a data center) is essential for performing cloud optimizations such as resource provisioning and energy minimization. However, there is a huge gap between the characteristics of actual workloads (e.g., they tend to be bursty and exhibit fractal behavior) and existing cloud optimization algorithms, which tend to rely on simplistic assumptions about the workloads. To close this gap, based on fractional calculus concepts, we present a fractal model to account for the complex dynamics of cloud computing workloads (i.e., the number of request arrivals or CPU/memory usage during each time interval). More precisely, we introduce a fractal operator to account for the time-varying fractal properties of the cloud workloads. In addition, we present an efficient (online) parameter estimation algorithm, an accurate forecasting strategy, and a novel fractal-based model predictive control approach for optimizing the CPU utilization, and hence, the overall energy consumption in the system while satisfying networked architecture performance constraints like queue capacities. We demonstrate advantages of our fractal model in forecasting the complex cloud computing dynamics over conventional (non-fractal) models by using real-world cloud (Google) traces. Unlike non-fractal models, which have very poor prediction capabilities under bursty workload conditions, our fractal model can accurately predict bursty request processes, which is crucial for cloud computing workload forecasting. Finally, experimental results demonstrate that the fractal model based optimization outperforms the non-fractal based ones in terms of minimizing the resource utilization by an average of 30%.

References

[1]
B. Hayes. "Cloud Computing," Communications of the ACM, 2008.
[2]
M. Pedram, "Energy-Efficient Datacenters," IEEE Trans. on Computer-Aided Design of Integrated Circuits and Systems, 2012.
[3]
M. Armbrust, et al. "A view of cloud computing," Communications of the ACM, 2010.
[4]
R. H. Katz, "Tech titans building boom," IEEE Spectrum, 2009.
[5]
J. Koomey, "Growth in data center electricity use 2005 to 2010," Oakland, CA: Analytics Press, August 1, 2010.
[6]
H. Al-Daoud, et al. "Power-Aware Linear Programming based Scheduling for Heterogeneous Computer Clusters," Future Generation Computer Systems, 2012.
[7]
C. K. Peng, et al. "Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series," Chaos: An Interdisciplinary Journal of Nonlinear Science, 1995.
[8]
J. Bi, et al. "Dynamic Provisioning Modeling for Virtualized Multi-tier Applications in Cloud Data Center," Intl. Conf. on Cloud Computing, 2010.
[9]
M. Bjorkqvist, et al. "Opportunistic Service Provisioning in the Cloud," Intl. Conf. on Cloud Computing, 2012.
[10]
R. Buyya, "Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility," Future Generation computer systems, 2009.
[11]
U. V. âĂŽatalyÅÿrek, et al. "Integrated Data Placement and Task Assignment for Scientific Workflows in Clouds," Data-Intensive Distributed Computing, 2011.
[12]
L. Y. Chen, N. Gautam, "Server Frequency Control Using Markov Decision Processes," INFOCOM, 2009.
[13]
Y. Chen, et al., "A First Look at Inter-Data Center Traffic Characteristics via Yahoo! Datasets," INFOCOM, 2011.
[14]
A. Gandhi, et al. "Minimizing data center sla violations and power consumption via hybrid resource provisioning," Intl. Green Computing Conf., 2011.
[15]
Google Cluster Data at: http://code.google.com/p/googleclusterdata//
[16]
R. Jansen, P. R. Brenner, "Energy Efficient Virtual Machine Allocation in the Cloud," Intl. Green Computing Conference, 2011.
[17]
M. Hadji, D. Zeghlache, "Minimum Cost Maximum Flow Algorithm for Dynamic Resource Allocation in Clouds," Intl. Conf. on Cloud Computing, 2012.
[18]
B. Hayes, "Computing Science: Life Cycles," American scientist, 2005.
[19]
I. Hwang et al. "Portfolio Theory-Based Resource Assignment in a Cloud Computing System," Intl. Conf. on Cloud Computing, 2012.
[20]
Z. Liu et al. "On maximizing service-level-agreement profits," ACM conference on Electronic Commerce, 2001.
[21]
Z. Liu et al. "Greening geographical load balancing," SIGMETRICS, pp. 233--244, 2011.
[22]
S. T. Maguluri et al. "Stochastic Models of Load Balancing and Scheduling in Cloud Computing Clusters," INFOCOM, 2012.
[23]
X. Meng et al. "Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement," INFOCOM, 2010.
[24]
L. Rao et al. "Minimizing electricity cost: optimization of distributed internet data centers in a multi-electricity-market environment," INFOCOM, 2010.
[25]
M. Stillwell et al. "Resource Allocation Using Virtual Clusters," Intl. Symp. on Cluster Computing and the Grid, 2009.
[26]
W. Shi et al. "Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud," Intl Conf. on Cloud Computing Technology and Science (CloudCom), 2010.
[27]
R. Stanojevic, R. Shorten, "Distributed Dynamic Speed Scaling," INFOCOM, 2010.
[28]
H. N. Van, et al. "Performance and Power Management for Cloud Infrastructures," IEEE Intl. Conf. on Cloud Computing, 2010.
[29]
Y. Wang, et al. "Power Optimization with Performance Assurance for Multi-tier Applications in Virtualized Data Centers," Intl. Conf. on Parallel Processing Workshops, 2010.
[30]
B. Whitcher et al. "Wavelet estimation of a local long memory parameter," In Exploration Geophysics, 2000.
[31]
D. Wilcox, et al. "Probabilistic Virtual Machine Assignment," Intl. Conf. on Cloud Computing, GRIDs, and Virtualization, 2010.
[32]
H. Xu and B. Li, "A General and Practical Datacenter Selection Framework for Cloud Services," Intl. Conf. on Cloud Computing, 2012.
[33]
J. Yao, et al. "Dynamic Control of Electricity Cost with Power Demand Smoothing and Peak Shaving for Distributed Internet Data Centers," Intl. Conf. on Distributed Computing Systems,2012.
[34]
L. A. Barroso and U. Holzle, "The Case for Energy-Proportional Computing," Computer vol. 40, pp. 33--37, 2007.
[35]
X. Fan, W-D Weber and L. A. Barroso and U. Holzle, "Power Provisioning for a Warehouse-sized Computer," Proceedings of ISCA 2007.
[36]
N. Karmarkar, "A new polynomial-time algorithm for linear programming," Proceedings of the sixteenth annual ACM symposium on Theory of computing, 1984.
[37]
S. Bayliss et al. "An FPGA implementation of the simplex algorithm." Proceedings of IEEE International Conference on Field Programmable Technology, 2006.
[38]
C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch, "Heterogeneity and dynamicity of clouds at scale: Google trace analysis," Proceedings of the Third ACM Symposium on Cloud Computing (SoCC '12) 2012.
[39]
S. Di, D. Kondo, and W. Cirne, "Characterization and Comparison of Cloud versus Grid Workloads." Proceedings of IEEE International Conference on Cluster Computing (CLUSTER), pp.230--238, 2012.
[40]
Z. Liu and S. Cho, "Characterizing Machines and Workloads on a Google Cluster." Proceedings of International Conference on Parallel Processing Workshops (ICPPW), pp.397--403, 2012.
[41]
J. L. Vehel and M. Rams, "Large Deviation Multifractal Analysis of a Class of Additive Processes With Correlated Nonstationary Increments," IEEE/ACM Transactions on Networking, vol.21, no.4, pp.1309--1321, Aug. 2013
[42]
J. W. Kantelhardt et al., "Multifractal detrended uctuation analysis of nonstationary time series." Physica A: Statistical Mechanics and its Applications, pp. 87--114, 2002.
[43]
M. Ghorbani and P. Bogdan, "A cyber-physical system approach to artificial pancreas design.," Proceedings of the International Conference on Hardware/Software Codesign and System Synthesis, 2013.
[44]
P. Bogdan, R. Marculescu and S. Jain. "Dynamic power management for multidomain system-on-chip platforms: an optimal control approach." ACM Transactions on Design Automation of Electronic Systems (TODAES) 2013.
[45]
D. Wang, C. Ren, S. Govindan and A. Sivasubramaniam, "ACE: Abstracting, Characterizing and Exploiting Datacenter Power Demands," Proceedings of the IEEE International Symposium on Workload Characterization, 2013.
[46]
M. Wang, T. Madhyastha, N. H. Chan, S. Papadimitrious and C. Faloutsos, "Data mining meets performance evaluation: Fast algorithms for modeling bursty traffic," Proceedings of the IEEE International Symposium on Data Engineerings, 2002.
[47]
Z. Yunyue and D. Shasha, "Efficient elastic burst detection in data streams" Proceedings of the IEEE International conference on Knowledge discovery and data mining, 2003.
[48]
Q. Zhang, M. F. Zhani, S. Zhang, Q. Zhu, R. Boutaba and J. L. Hellerstein, "Dynamic energy-aware capacity provisioning for cloud computing environments," Proceedings of the 9th international conference on Autonomic computing, 2012.

Cited By

View all
  • (2025)Humas: A Heterogeneity- and Upgrade-Aware Microservice Auto-Scaling Framework in Large-Scale Data CentersIEEE Transactions on Computers10.1109/TC.2024.350686274:3(968-982)Online publication date: 1-Mar-2025
  • (2025)Multilayer multivariate forecasting network for precise resource utilization prediction in edge data centersFuture Generation Computer Systems10.1016/j.future.2024.107692166(107692)Online publication date: May-2025
  • (2024)Flexible Computing: A New Framework for Improving Resource Allocation and Scheduling in Elastic ComputingIEEE Transactions on Services Computing10.1109/TSC.2024.3489433(1-14)Online publication date: 2024
  • Show More Cited By

Index Terms

  1. Prediction and control of bursty cloud workloads: a fractal framework

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CODES '14: Proceedings of the 2014 International Conference on Hardware/Software Codesign and System Synthesis
    October 2014
    331 pages
    ISBN:9781450330510
    DOI:10.1145/2656075
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 October 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article

    Conference

    ESWEEK'14
    ESWEEK'14: TENTH EMBEDDED SYSTEM WEEK
    October 12 - 17, 2014
    New Delhi, India

    Acceptance Rates

    Overall Acceptance Rate 280 of 864 submissions, 32%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 28 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Humas: A Heterogeneity- and Upgrade-Aware Microservice Auto-Scaling Framework in Large-Scale Data CentersIEEE Transactions on Computers10.1109/TC.2024.350686274:3(968-982)Online publication date: 1-Mar-2025
    • (2025)Multilayer multivariate forecasting network for precise resource utilization prediction in edge data centersFuture Generation Computer Systems10.1016/j.future.2024.107692166(107692)Online publication date: May-2025
    • (2024)Flexible Computing: A New Framework for Improving Resource Allocation and Scheduling in Elastic ComputingIEEE Transactions on Services Computing10.1109/TSC.2024.3489433(1-14)Online publication date: 2024
    • (2022)STOWP: A light-weight deep residual network integrated windowing strategy for storage workload prediction in cloud systemsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2022.105303115(105303)Online publication date: Oct-2022
    • (2022)Fractional cyber-neural systems — A brief surveyAnnual Reviews in Control10.1016/j.arcontrol.2022.06.00254(386-408)Online publication date: 2022
    • (2021)Improving Learning-Based DAG Scheduling by Inserting Deliberate Idle SlotsIEEE Network: The Magazine of Global Internetworking10.1109/MNET.001.210023135:6(133-139)Online publication date: 1-Nov-2021
    • (2021)A Average Response Time Prediction Method For Seasonal Non-Stationary Concurrency Based On Improved RBF Algorithm2021 33rd Chinese Control and Decision Conference (CCDC)10.1109/CCDC52312.2021.9602449(586-591)Online publication date: 22-May-2021
    • (2021)Deep learning-based multivariate resource utilization prediction for hotspots and coldspots mitigation in green cloud data centersThe Journal of Supercomputing10.1007/s11227-021-04107-678:4(5806-5855)Online publication date: 7-Oct-2021
    • (2021)Multi-objective heuristics algorithm for dynamic resource scheduling in the cloud computing environmentThe Journal of Supercomputing10.1007/s11227-020-03606-2Online publication date: 18-Jan-2021
    • (2021)Energy Aware Load Balancing Algorithm for Upgraded Effectiveness in Green Cloud ComputingExpert Clouds and Applications10.1007/978-981-16-2126-0_22(247-260)Online publication date: 16-Jul-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media