Skip to main content

Advertisement

SpringerLink
Log in

Multiperiod robust optimization for proactive resource provisioning in virtualized data centers

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Energy management has become a significant concern in data centers for reducing operational costs. Using virtualization allows server consolidation, which increases server utilization and reduces energy consumption by turning off idle servers. This needs to consider the power state change overhead. In this paper, we investigate proactive resource provisioning in short-term planning for performance and energy management. To implement short-term planning based on workload prediction, this requires dealing with high fluctuations that are inaccurately predictable by using single value prediction. Unlike long-term planning, short-term planning can not depend on periodical patterns. Thus, we propose an adaptive range-based prediction algorithm instead of a single value. We implement and extensively evaluate the proposed range-based prediction algorithm with different days of real workload. Then, we exploit the range prediction for implementing proactive provisioning using robust optimization taking into consideration uncertainty of the demand. We formulate proactive VM provisioning as a multiperiod robust optimization problem. To evaluate the proposed approach, we use several experimental setups and different days of real workload. We use two metrics: energy savings and robustness for ranking the efficiency of different scenarios. Our approach mitigates undesirable changes in the power state of servers. This enhances servers’ availability for accommodating new VMs, its robustness against uncertainty in workload change, and its reliability against a system failure due to frequent power state changes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Kusic D, Kephart JO, Hanson JE, Kandasamy N, Jiang G (2008) Power and performance management of virtualized computing environments via lookahead control. In: Proceedings of the 2008 International Conference on Autonomic Computing, ICAC’08. IEEE Computer Society, Washington, pp 3–12

  2. Deepcomp-7000 [Online] Available at http://www.sccas.cn/gb/compute/supports/documents/Lenovo7000.pdf. Accessed 20 May 2013

  3. Spec: Standard performance evaluation corporation. [Online]. Available at http://www.spec.org/power_ssj2008/results/res2011q1/. Accessed 20 May 2013

  4. Verma A, Ahuja P, Neogi A (2008) Pmapper: power and migration cost aware application placement in virtualized systems. In: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware, Middleware’08. Springer-Verlag New York Inc., New York, pp 243–264

  5. Gandhi A, Harchol-Balter M, Das R, Lefurgy C (2009) Optimal power allocation in server farms. In: Proceedings of the 11th international joint conference on Measurement and modeling of computer systems, SIGMETRICS’09. ACM, New York, pp 157–168

  6. Mathew V, Sitaraman RK, Shenoy PJ (2012) Energy-aware load balancing in content delivery networks. In: Proceedings of 31th IEEE International Conference on Computer Communications, Orlando, pp 954–962

  7. Booting-time [Online] Available at http://www.tomshardware.co.uk/ubuntu-oneiric-ocelot-benchmark-review,review-32377-15.html. Accessed 1 Jun 2012

  8. Mao M, Humphrey M (2012) A performance study on the vm startup time in the cloud. In: Proceedings of IEEE CLOUD, Honolulu, pp 423–430

  9. Chase JS, Anderson DC, Thakar PN, Vahdat AM, Doyle RP (2001) Managing energy and server resources in hosting centers. In: Proceedings of the 18th ACM symposium on Operating systems principles, SOSP’01. ACM, New York, pp 103–116

  10. Chen G, He W, Liu J, Nath S, Rigas L, Xiao L, Zhao F (2008) Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation, NSDI’08. USENIX Association, Berkeley, pp 337–350

  11. Qingbo Z, Zhifeng C, Lin T, Yuanyuan Z, Kimberly K, John W (2005) Hibernator: Helping disk arrays sleep through the winter. SIGOPS Oper Syst Rev 39(5):177–190

    Article  Google Scholar 

  12. Petrucci V, Loques O, Mossé D (2010) A dynamic optimization model for power and performance management of virtualized clusters. In: Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking, e-Energy’10. ACM, New York, pp 225–233

  13. Aharon B, Arkadi N (2000) Robust solutions of linear programming problems contaminated with uncertain data. Math Program 88:411–424

    Article  MATH  MathSciNet  Google Scholar 

  14. Dance CR, Gaivoronski AA (2012) Stochastic optimization for real time service capacity allocation under random service demand. Annals OR 193(1):221–253

    Article  MATH  MathSciNet  Google Scholar 

  15. Wang Y (2008) Empirical comparison of robust, data driven and stochastic optimization. M.S. thesis, Department of Computation for Design and Optimization, Massachusetts Institute of Technology (MIT) University, Cambridge, MA, USA

  16. Park KS, Pai VS (2006) Comon: a mostly-scalable monitoring system for planet- lab. 40(1):65–74

  17. Savitzky A, Golay MJE (1964) Analytical chemistry, vol 36, pp 1627–1639

  18. Kalekar PS (2004) Time series forecasting using holt-winters exponential smoothing. Technical Report. [Online]. Available at http://www.it.iitb.ac.in/praj/acads/seminar/04329008_ExponentialSmoothing.pdf. Accessed 1 Apr 2012

  19. Wu Y, Kai H, Yulai Y, Weiming Z (2010) Adaptive workload prediction of grid performance in confidence windows. IEEE Trans Parallel Distrib Syst 21(7):925–938

    Article  Google Scholar 

  20. Clement MJ, Quinn MJ (1993) Analytical performance prediction on multicomputers. In: Proceedings of the 1993 ACM/IEEE Conference on Supercomputing, Supercomputing’93. ACM, New York, pp 886–894

  21. Nathuji R, Schwan K (2007) Virtualpower: coordinated power management in virtualized enterprise systems. In Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, SOSP’07. ACM, New York, pp 265–278

  22. Li Z, Ding R, Floudas CA (2011) A comparative theoretical and computational study on robust counterpart optimization: I. Robust linear and robust mixed integer linear optimization. Ind Eng Chem Res 50(18):10567–10603

  23. Minghong L, Wierman A, Andrew LLH, Thereska E (2011) Dynamic right-sizing for power-proportional data centers. In: Proceedings of the 30th IEEE International Conference on Computer Communications, INFOCOM’11, 10–15 April, Shanghai, China. pp 1098–1106

  24. Cardosa M, Korupolu MR, Singh A (2009) Shares and utilities based power consolidation in virtualized server environments. In: Proceedings of the 11th IFIP/IEEE international conference on Symposium on Integrated Network Management, IM’09. IEEE Press, Piscataway, pp 327–334

  25. Verma A, Ahuja P, Neogi A (2008) Power-aware dynamic placement of hpc applications. In: Proceedings of the 22nd annual international conference on Supercomputing, ICS ’08. ACM, New York, pp 175–184

  26. Bobroff N, Kochut A, Beaty K (2007) Dynamic placement of virtual machines for managing sla violations. In: Proceedings of 10th IFIP/IEEE International Symposium on In Integrated Network Management. IEEE, pp 119–128

  27. Meng X, Isci C, Kephart J, Zhang L, Bouillet E, Pendarakis D (2010) Efficient resource provisioning in compute clouds via vm multiplexing. In: Proceedings of the 7th international conference on Autonomic computing, ICAC’10. ACM, New York, pp 11–20

  28. Gong Z, Gu X (2010) Pac: Pattern-driven application consolidation for efficient cloud computing. In: Proceedings of the 18th Annual IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS’12. IEEE, pp 24–33

  29. Srikantaiah S, Kansal A, Zhao F (2008) Energy-aware consolidation for cloud computing. In: Proceedings of the 2008 conference on Power aware computing and systems, HotPower’08. USENIX Association, Berkeley, pp 10–10

  30. Jung G, Joshi KR, Hiltunen MA, Schlichting RD, Pu C (2008) Generating adaptation policies for multi-tier applications in consolidated server environments. In: Strassner J, Dobson SA, Fortes JAB, Goswami KK (eds) ICAC. IEEE Computer Society, pp 23–32

  31. Jung G, Joshi KR, Hiltunen MA, Schlichting RD, Pu C (2009) A cost-sensitive adaptation engine for server consolidation of multitier applications. In: Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York Inc., New York, pp 9:1–9:20

  32. Zhu X, Young D, Watson BJ, Wang Z, Rolia J, Singhal S, McKee B, Hyser C, Gmach D, Gardner R, Christian T, Cherkasova L (2008) 1000 islands: Integrated capacity and workload management for the next generation data center. In: Proceedings of the 2008 International Conference on Autonomic Computing, ICAC’08. IEEE Computer Society, Washington, pp 172–181

  33. Petrucci V, Loques O, Mossé D (2010) Dynamic optimization of power and performance for virtualized server clusters. In: Proceedings of the 2010 ACM Symposium on Applied Computing, SAC’10. ACM, New York, pp 263–264

  34. Mylavarapu S, Sukthankar V, Banerjee P (2010) An optimized capacity planning approach for virtual infrastructure exhibiting stochastic workload. In: Proceedings of the 2010 ACM Symposium on Applied Computing, SAC ’10. ACM, New York, pp 386–390

  35. Li Berral J, Goiri I, Nou R, Julià F, Guitart J, Gavaldà R, Torres J (2010) Towards energy-aware scheduling in data centers using machine learning. In: Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking, e-Energy’10. ACM, New York, pp 215–224

  36. Wang L, Lu Y (2008) Efficient power management of heterogeneous soft real-time clusters. In: Proceedings of the 2008 Real-Time Systems Symposium, RTSS’08. IEEE Computer Society, Washington, pp 323–332

  37. Kim KH, Buyya R, Kim J (2007) Power aware scheduling of bag-of-tasks applications with deadline constraints on dvs-enabled clusters. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, CCGRID’07. IEEE Computer Society, Washington, pp 541–548

Download references

Author information

Authors and Affiliations

  1. Hasso Plattner Institute, University of Potsdam, Potsdam, Germany

    Ibrahim Takouna & Christoph Meinel

  2. SAP, Walldorf, Germany

    Kai Sachs

Authors
  1. Ibrahim Takouna
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kai Sachs
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christoph Meinel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ibrahim Takouna.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Takouna, I., Sachs, K. & Meinel, C. Multiperiod robust optimization for proactive resource provisioning in virtualized data centers. J Supercomput 70, 1514–1536 (2014). https://doi.org/10.1007/s11227-014-1246-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-014-1246-2

Keywords

Search

Navigation