Henrique Truta
ABSTRACT
Data centers have been criticized for being heavy consumers of energy, accounting for a significant share of the world's total energy use. This is compounded by the fact that a large portion of the computational resources in data centers remains idle most of the time, while nevertheless consuming a great amount of energy even in an idle state. One of the causes of resource idleness is the static resource allocation strategy of the widespread quota management systems in private clouds, which commonly do not keep track of the utilization rate of allocated resources, which are often idle. Better resource management strategies are therefore called for to improve the utilization rate of available capabilities and thereby minimize operational costs. We propose here a method for resource provisioning based on utilization-rate forecasting for clouds with data-processing PaaS environments. A clustering algorithm is used for estimating and dynamically scheduling the workload of batch applications. Based on current and historical records of resource utilization, the algorithm enables taking efficient scheduling decisions. Due to the non-proportionality of computing power consumption, we show that compared to static quota management systems for private clouds, average increases of 10+ in CPU and RAM utilization and 20+ in the number of processed jobs may be obtained without a significant reduction in the quality of service.
- A. F. R. K. A. Ganapathi, Y. Chen and D. Patterson. Statistics-driven workload modeling for the cloud. In Data Engineering Workshops (ICDEW), 2010 IEEE 26th International Conference on, pages 87 -- 92, Long Beach, CA, USA, 2010. IEEE. Google Scholar
Cross Ref
- S. Akaho. A kernel method for canonical correlation analysis. Learning, (4):1--7, 2006.Google Scholar
- L. A. Barroso and U. Hölzle. The case for energy-proportional computing. Computer, 40(12):33--37, Dec 2007. Google ScholarDigital Library
- M. Carvalho, F. Brasileiro, and J. Wilkes. Long-term SLOs for reclaimed cloud computing resources.Google Scholar
- S. Daneshyar and M. Razmjoo. Large-scale data processing using mapreduce in cloud computing environment. 2012.Google Scholar
- F. Farahnakian, A. Ashraf, and T. Pahikkala. Using Ant Colony System to Consolidate VMs for Green Cloud Computing. IEEE Transactions on Services Computing, 8(2):187--198, 2015. Google ScholarCross Ref
- Z. Gong, X. Gu, and J. Wilkes. PRESS: PRedictive Elastic reSource Scaling for cloud systems. Proceedings of the 2010 International Conference on Network and Service Management, CNSM 2010, pages 9--16, 2010. Google ScholarCross Ref
- P. Houle. Choosing the number of reducers. https://github.com/paulhoule/infovore/wiki/Choosing-the-number-of-reducers.Google Scholar
- C. g. I. Carrera, F. Scariot and P. Turin. An example for performance prediction for map reduce applications in cloud environments. Master's thesis, UFGRS, 2013.Google Scholar
- C. Reiss, G. R. Ganger, R. H. Katz, M. A. Kozuch, and A. Tumanov. Heterogeneity and Dynamicity of Clouds at Scale: Google Trace Analysis. In IEEE SOC Conference, page 13, 2012. Google ScholarDigital Library
- N. Roy, A. Dubey, and A. Gokhale. Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting. 2011 IEEE 4th International Conference on Cloud Computing, pages 500--507, July 2011. Google ScholarDigital Library
- L. Tomás and J. Tordsson. Improving cloud infrastructure utilization through overbooking. In Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference on - CAC '13, page 1, New York, New York, USA, 2013. ACM Press. Google ScholarDigital Library
- W. Voorsluys and R. Buyya. Reliable provisioning of spot instances for compute-intensive applications. In Proceedings - International Conference on Advanced Information Networking and Applications, AINA, pages 542--549, 2012. Google ScholarDigital Library
- R. Weingärtner, G. B. Bräscher, and C. B. Westphall. Cloud resource management: A survey on forecasting and profiling models. Journal of Network and Computer Applications, 47:99--106, Jan. 2015. Google ScholarDigital Library
Index Terms
- A predictive approach for enhancing resource utilization in PaaS clouds
Recommendations
Metaheuristics-Based Planning and Optimization for SLA-Aware Resource Management in PaaS Clouds
UCC '14: Proceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud ComputingThe Platform as a Service (PaaS) model of Cloud Computing has emerged as an enabling yet disruptive paradigm for accelerated development of applications on the Cloud. PaaS hides administration complexities of the underlying infrastructure such as the ...
A survey on elasticity management in PaaS systems
Elasticity is a goal of cloud computing. An elastic system should manage in an autonomic way its resources, being adaptive to dynamic workloads, allocating additional resources when workload is increased and deallocating resources when workload ...
Cloud resource provisioning: survey, status and future research directions
Cloud resource provisioning is a challenging job that may be compromised due to unavailability of the expected resources. Quality of Service (QoS) requirements of workloads derives the provisioning of appropriate resources to cloud workloads. Discovery ...
Comments