Skip to main content

Advertisement

SpringerLink
Log in

Autonomic Performance and Power Control on Virtualized Servers: Survey, Practices, and Trends

  • Survey
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Modern datacenter servers hosting popular Internet services face significant and multi-facet challenges in performance and power control. The user-perceived performance is the result of a complex interaction of complex workloads in a very complex underlying system. Highly dynamic and bursty workloads of Internet services fluctuate over multiple time scales, which has a significant impact on processing and power demands of datacenter servers. High-density servers apply virtualization technology for capacity planning and system manageability. Such virtualized computer systems are increasingly large and complex. This paper surveys representative approaches to autonomic performance and power control on virtualized servers, which control the quality of service provided by virtualized resources, improve the energy efficiency of the underlying system, and reduce the burden of complex system management from human operators. It then presents three designed self-adaptive resource management techniques based on machine learning and control for percentile-based response time assurance, non-intrusive energy-efficient performance isolation, and joint performance and power guarantee on virtualized servers. The techniques were implemented and evaluated in a testbed of virtualized servers hosting benchmark applications. Finally, two research trends are identified and discussed for sustainable cloud computing in green datacenters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Huebscher M C, McCann J A. A survey of autonomic computing: Degrees, models, and applications. ACM Computing Surveys, 2008, 40(3), Article No.7.

  2. Mi N, Casale G, Cherkasova L, Smirni E. Burstiness in multi-tier applications: Symptoms, causes, and new models. In Proc. the 9th ACM/IFIP/USENIX Int. Middleware Conference (Middleware), Dec. 2008, pp.265-286.

  3. Caniff A, Lu L, Mi N, Cherkasova L, Smirni E. Fastrack for taming burstiness and saving power in multi-tiered systems. In Proc. the 22nd Int. Teletraffic Congress (ITC), Sept. 2010.

  4. Singh R, Sharma U, Cecchet E, Shenoy P. Autonomic mix-aware provisioning for non-stationary data center workloads. In Proc. the 7th IEEE Int. Conference on Autonomic Computing (ICAC), June 2010, pp.21-30.

  5. Sugerman J, Venkitachalam G, Lim B H. Virtualizing I/O devices on VMware workstation's hosted virtual machine monito. In Proc. USENIX Annual Technical Conference, June 2001.

  6. Barham P, Dragovic B, Fraser K et al. Xen and the art of virtualization. In Proc. the 19th ACM Symposium on Operating Systems Principles (SOSP), Oct. 2003, pp.164-177.

  7. Menascé D A, Bennani M N. Autonomic virtualized environments. In Proc. IEEE Int. Conference on Autonomic and Autonomous Systems, July 2006.

  8. Nathuji R, Schwan K. Virtualpower: Coordinated power management in virtualized enterprise systems. In Proc. the 21st ACM Symposium on Operating Systems Principles (SOSP), Oct. 2007, pp.265-278.

  9. Urgaonkar B, Shenoy P, Chandra A et al. Agile dynamic provisioning of multi-tier Internet applications. ACM Trans. Autonomous and Adaptive Systems, 2008, 3(1): 1-39.

    Article  Google Scholar 

  10. Lama P, Zhou X. Efficient server provisioning for end-to-end delay guarantee on multi-tier clusters. In Proc. the 17th IEEE Int. Workshop on Quality of Service (IWQoS), July 2009.

  11. Welsh M, Culler D. Adaptive overload control for busy Internet servers. In Proc. the 4th USENIX Symposium on Internet Technologies and Systems (USITS), Mar. 2003.

  12. Lama P, Zhou X. Autonomic provisioning with self-adaptive neural fuzzy control for end-to-end delay guarantee. In Proc. IEEE/ACM Int. Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), Aug. 2010, pp.151-160.

  13. Vaid K. Datacenter power efficiency: Separating fact from fiction (keynote). In the USENIX Workshop on Power Aware Computing and Systems (HotPower), Oct. 2010.

  14. Greenberg A, Hamilton J R, Jain N et al. Vl2: A scalable and flexible data center network. In Proc. ACM SIGCOMM, Aug. 2009, pp.51-62.

  15. Tam D K, Azimi R, Soares L B, Stumm M. RapidMRC: Approximating L2 miss rate curves on commodity systems for online optimizations. In Proc. the 14th Int. Conference on Architecture Support for Programming Language and Operating System (ASPLOS), March 2009, pp.121-132.

  16. Zhang X, Dwarkadas S, Shen K. Towards practical page coloring-based multicore cache management. In Proc. the 4th ACM European Conference on Computer Systems (EuroSys), April 2009, pp.89-102.

  17. Xie Y, Loh G H. Pipp: Promotion/insertion pseudo-partitioning of multi-core shared caches. In Proc. the 36th Int. Symposium on Computer architecture (ISCA), June 2009, pp.174-183.

  18. Wang Y, Wang X, Chen M, Zhu X. PARTIC: Power-aware response time control for virtualized Web servers. IEEE Trans. Parallel and Distributed Systems, 2011, 22(2): 323-336.

    Article  MathSciNet  Google Scholar 

  19. Gong J, Xu C Z. vPnP: Automated coordination of power and performance in virtualized datacenters. In Proc. IEEE Int. Workshop on Quality of Service (IWQoS), June 2010.

  20. Wang X, Wang Y. Co-Con: Coordinated control of power and application performance for virtualized server clusters. In Proc. the 17th IEEE Int. Workshop on Quality of Service (IWQoS), July 2009.

  21. Stewart C, Shen K. Performance modeling and system management for multi-component online services. In Proc. the 2nd USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005, Vol.2, pp.71-84.

  22. Villela D, Pradhan P, Rubenstein D. Provisioning servers in the application tier for e-commerce systems. ACM Trans. Internet Technology, 2007, 7(1): Article No.7.

  23. Diao Y, Hellerstein J L, Parekh S et al. Controlling quality of service in multi-tier Web applications. In Proc. the 26th IEEE Int. Conference on Distributed Computing Systems (ICDCS), July 2006.

  24. Liu X, Heo J, Sha L, Zhu X. Queueing-model-based adaptive control of multi-tiered Web applications. IEEE Transactions on Network and Service Management, 2008, 5(3): 157-167.

    Article  Google Scholar 

  25. Abdelzaher T F, Shin K G, Bhatti N. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Trans. Parallel and Distributed Systems, 2002, 13(1): 80-96.

    Article  Google Scholar 

  26. Lu Y, Abdelzaher T F, Lu C, Sha L, Liu X. Feedback control with queueing-theoretic prediction for relative delay guarantees in Web servers. In Proc. the 9th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), May 2003, pp.208-218.

  27. Kamra A, Misra V, Nahum E M. Yaksha: A self-tuning controller for managing the performance of 3-tiered Web sites. In Proc. the 12th IEEE Int. Workshop on Quality of Service (IWQoS), June 2004, pp.47-56.

  28. Lama P, Zhou X. aMOSS: Automated multi-objective server provisioning with stress-strain curving. In Proc. IEEE Int. Conference on Parallel Processing (ICPP), Sept. 2011, pp.345-354.

  29. Padala P, Hou K Y, Shin K G et al. Automated control of multiple virtualized resources. In Proc. EuroSys Conference (EuroSys), April 2009, pp.13-26.

  30. Padala P, Shin K G, Zhu X et al. Adaptive control of virtualized resources in utility computing environments. In Proc. EuroSys Conference (EuroSys), March 2007, pp.289-302.

  31. Leite J C B, Kusic D M, Mossé D, Bertini L. Stochastic approximation control of power and tardiness in a three-tier Web-hosting cluster. In Proc. the 7th IEEE Int. Conference on Autonomic Computing (ICAC), June 2010, pp.41-50.

  32. Watson B J, Marwah M, Gmach D et al. Probabilistic performance modeling of virtualized resource allocation. In Proc. the 7th IEEE Int. Conference on Autonomic Computing (ICAC), June 2010, pp.98-108.

  33. Rao J, Xu C. Online measurement of the capacity of multitier Websites using hardware performance counters. In Proc. the 28th IEEE Int. Conference on Distributed Computing Systems (ICDCS), June 2008, pp.705-712.

  34. Guo Y, Lama P, Rao J, Zhou X. V-cache: Towards flexible resource provisioning for clustered applications in IaaS clouds. In Proc. the 27th IEEE Int. Parallel and Distributed Processing Symposium (IPDPS), May 2013, pp.88-99.

  35. Rao J, Bu X, Xu C et al. VCONF: A reinforcement learning approach to virtual machines auto-conguration. In Proc. the 6th IEEE Int. Conference on Autonomic Computing (ICAC), June 2009, pp.137-146.

  36. Rao J, Wei Y, Gong J, Xu C Z. DynaQoS: Model-free self-tuning fuzzy control of virtualized resources for QoS provisioning. In Proc. the 19th Int. Workshop on Quality of Service (IWQoS), June 2011.

  37. Muppala S, Chen G, Zhou X. Multi-tier service differentiation: Coordinated resource provisioning and admission control. In Proc. the 18th IEEE Int. Conference on Parallel and Distributed Systems (ICPADS), December 2012, pp.69-76.

  38. Muppala S, Zhou X. Coordinated session-based admission control with statistical learning for multi-tier Internet applications. Journal of Network and Computer Applications, 2011, 34(1): 20-29.

    Article  Google Scholar 

  39. Muppala S, Zhou X, Zhang L, Chen G. Regression-based resource provisioning for session slowdown guarantee in multi-tier Internet servers. Journal of Parallel and Distributed Computing, 2012, 72(3): 362-375.

    Article  Google Scholar 

  40. Tesauro G, Jong N K, Das R, Bennani M N. A hybrid reinforcement learning approach to autonomic resource allocation. In Proc. the 3rd IEEE Int. Conference on Autonomic Computing (ICAC), June 2006, pp.65-73.

  41. Zhang Q, Cherkasova L, Smirni E. A regression-based analytic model for dynamic resource provisioning of multi-tier Internet applications. In Proc. the 4th IEEE Int. Conference on Autonomic Computing (ICAC), June 2007, Article No.27.

  42. Guo Y, Lama P, Zhou X. Automated and agile server parameter tuning with learning and control. In Proc. the 18th IEEE Int. Parallel and Distributed Processing Symposium (IPDPS), May 2012, pp.656-667.

  43. Guo Y, Lama P, Jiang C, Zhou X. Automated and agile server parameter tuning by coordinated learning and control. IEEE Transactions on Parallel and Distributed Systems, 2014, 25(4): 876-886.

    Article  Google Scholar 

  44. Guo Y, Zhou X. Coordinated VM resizing and server tuning: Throughput, power efficiency and scalability. In Proc. the 20th IEEE Int. Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), August 2012, pp.289-297.

  45. Unsal O, Koren I. System-level power-aware design techniques in real-time systems. Proc. IEEE, 2003, 91(7): 1055-1069.

    Article  Google Scholar 

  46. Elnozahy M, Kistler M, Rajamony R. Energy conservation policies for Web servers. In Proc. the 4th USENIX Symp. Internet Technologies and Systems (USITS), March 2003.

  47. Lefurgy C, Wang X, Ware M. Server-level power control. In Proc. the 4th IEEE Int. Conference on Autonomic Computing (ICAC), June 2007, Article No.4.

  48. Gandhi A, Harchol-Balter M, Das R, Lefurgy C. Optimal power allocation in server farms. In Proc. the 11th ACM SIGMETRICS, June 2009, pp.157-168.

  49. Horvath T, Abdelzaher T, Skadron K, Liu X. Dynamic voltage scaling in multitier Web servers with end-to-end delay control. IEEE Trans. Computers, 2007, 56(4): 444-458.

    Article  MathSciNet  Google Scholar 

  50. Wang X, Chen M, Fu X. MIMO power control for high-density servers in an enclosure. IEEE Trans. Parallel and Distributed Systems, 2010, 21(10): 1412-1426.

    Article  Google Scholar 

  51. Wang X, Chen M, Lefurgy C, Keller T W. Ship: Scalable hierarchical power control for large-scale data centers. In Proc. the 18th Int. Conference on Parallel Architectures and Compilation Techniques (PACT), September 2009, pp.91-100.

  52. Nathuji R, Isci C, Gorbatov E. Exploiting platform heterogeneity for power efficient data centers. In Proc. the 4th IEEE Int. Conference on Autonomic Computing (ICAC), June 2007, Article No.5.

  53. Das R, Kephart J O, Lenchner J, Hamann H. Utility-function-driven energy-efficient cooling in data centers. In Proc. the 7th IEEE Int. Conference on Autonomic computing (ICAC), June 2010, pp.61-70.

  54. Fu X, Wang X, Lefurgy C. How much power oversubscript is safe and allowed in data centers? In Proc. the 8th IEEE Int. Conf. Autonomic computing (ICAC), June 2011, pp.21-30.

  55. Gmach D, Rolia J, Cherkasova L. Resource and virtualization costs up in the cloud: Models and design choices. In Proc. IEEE/IFIP Int. Conference on Dependable Systems and Networks (DSN), June 2011, pp.395-402.

  56. Goiri F, Le K, Guitart J et al. Intelligent placement of datacenters for Internet services. In Proc. IEEE Int. Conference on Distributed Computing Systems (ICDCS), June 2011, pp.136-142.

  57. Meng X, Isci C, Kephart J et al. Efficient resource provisioning in compute clouds via VM multiplexing. In Proc. the 7th Int. Conference on Autonomic Computing (ICAC), June 2010, pp.11-20.

  58. Thereska E, Donnelly A, Narayanan D. Sierra: Practical power-proportionality for data center storage. In Proc. the 6th EuroSys Conference (EuroSys), April 2011, pp.169-182.

  59. Urgaonkar P, Urgaonkar B, Neely M J et al. Optimal power cost management using stored energy in data centers. In Proc. ACM SIGMETRICS, June 2011, pp.221-232.

  60. Raghavendra R, Ranganathan P, Talwar V et al. No power struggles: Coordinated multi-level power management for the data center. In Proc. the 13th ACM ASPLOS, March 2008, pp.48-59.

  61. Fan X, Weber W D, Barroso L A. Power provisioning for a warehouse-sized computer. ACM SIGARCH, 2007, 35(2): 13-23.

    Article  Google Scholar 

  62. Govindan S, Choi J, Urgaonkar B et al. Statistical profiling-based techniques for effective power provisioning in data centers. In Proc. EuroSys Conference (EuroSys), April 2009, pp.317-330.

  63. Verma A, Ahuja P, Neogi A. pMapper: Power and migration cost aware application placement in virtualized systems. In Proc. the 9th ACM/IFIP/USENIX Int. Middleware Conference (Middleware), December 2008, pp.243-264.

  64. Kumar S, Talwar V, Kumar V et al. vManage: Loosely coupled platform and virtualization management in data centers. In Proc. the 5th IEEE Int. Conference on Autonomic Computing (ICAC), June 2009, pp.127-136.

  65. Jiang C, Xu X, Wan J et al. Power aware job scheduling with QoS guarantees based on feedback control. In Proc. the 18th IEEE IWQoS, June 2010.

  66. Kusic D, Kephart J O, Hanson J E et al. Power and performance management of virtualized computing environments via lookahead control. In Proc. IEEE Int. Conference on Autonomic computing (ICAC), June 2008, pp.3-12.

  67. Le K, Bianchiniy R, Martonosiz M, Nguyeny T D. Cost-and energy-aware load distribution across data centers. In Proc. Workshop on Power Aware Computing and Systems (HotPower), October 2009.

  68. Cheng D, Guo Y, Zhou X. Self-tuning batching with DVFS for improving performance and energy efficiency in servers. In Proc. the 21st IEEE/ACM Int. Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), August 2013, pp.40-49.

  69. Jung G, Hiltunen M A, Joshi K R et al. Mistral: Dynamically managing power, performance, and adaptation cost in cloud infrastructures. In Proc. IEEE Int. Conf. Distributed Computing Systems (ICDCS), June 2010, pp.62-73.

  70. Kansal A, Liu J, Singh A et al. Semantic-less coordination of power management and application performance. ACM SIGPOS, 2010, 44(1): 66-70.

    Google Scholar 

  71. Lama P, Zhou X. PERFUME: Power and performance guarantee with fuzzy mimo control in virtualized servers. In Proc. the 19th IEEE Int. Workshop on Quality of Service (IWQoS), June 2011.

  72. Riska A, Smirni E. Autonomic exploration of trade-offs between power and performance in disk drives. In Proc. the 7th IEEE Int. Conference on Autonomic Computing (ICAC), June 2010, pp.131-140.

  73. Lama P, Zhou X. Coordinated power and performance guarantee with fuzzy mimo control in virtualized server clusters. IEEE Transactions on Computers, 2014. (to be appeared)

  74. Lama P, Guo Y, Zhou X. Autonomic performance and power control for co-located web applications on virtualized servers. In Proc. the 21st ACM/IEEE Int. Workshop on Quality of Service (IWQoS), June 2013, pp.63-72.

  75. Lama P, Li Y, Aji A et al. pVOCL: Power-aware dynamic placement and migration in virtualized GPU environments. In Proc. the 33rd IEEE Int. Conference on Distributed Computing Systems (ICDCS), June 2013.

  76. Aksanli B, Venkatesh J, Zhang L, Rosing T. Utilizing green energy prediction to schedule mixed batch and service jobs in data centers. In Proc. the 4th USENIX Workshop on Power Aware Computing and Systems (HotPower), October 2011, Article No.5.

  77. Deng N, Stewart C, Gmach D et al. Adaptive green hosting. In Proc. the 9th IEEE Int. Conference on Autonomic Computing (ICAC), Sept. 2012, pp.135-144.

  78. Liu Z, Lin M, Wierman A et al. Greening geographical load balancing. In Proc. ACM SIGMETRICS, June 2011, pp.233-244.

  79. Ren S, He Y. COCA: Online distributed resource management for cost minimization and carbon neutrality in data centers. In Proc. Supercomputing (SC), Nov. 2013, Article No.39.

  80. Zhang Y, Wang Y, Wang X. Greenware: Greening cloud-scale data centers to maximize the use of renewable energy. In Proc. the 12th ACM/IFIP/USENIX Int. Conference on Middle-ware (Middleware), December 2011, pp.143-164.

  81. Goiri I, Le K, Nguyen T D et al. Greenhadoop: Leveraging green energy in data-processing frameworks. In Proc. the 7th ACM European Conference on Computer Systems (EuroSys), April 2012, pp.57-70.

  82. Liu S, Ren S, Gang Q et al. Profit aware load balancing for distributed cloud data centers. In Proc. the 27th IEEE Int. Parallel and Distributed Processing Symposium (IPDPS), May 2013, pp.611-622.

  83. Gmach D, Rolia J, Bash C et al. Capacity planning and power management to exploit sustainable energy. In Proc. the 6th IEEE Int. Conference on Network and Service Management (CNSM), October 2010, pp.96-103.

  84. Li C, Zhou R, Li T. Enabling distributed generation powered sustainable high-performance data center. In Proc. the 19th IEEE Int. Symposium on High-Performance Computer Architecture (HPCA), Feb. 2013, pp.35-46.

  85. Wang Y, Chen R, Shao Z, Li T. Solartune: Real-time scheduling with load tuning for solar energy powered multicore systems. In Proc. the 19th IEEE RTCSA, Aug. 2013, pp.101-110.

  86. Wang D, Ren C, Sivasubramaniam A et al. Energy storage in datacenters: What, where, and how much? In Proc. ACM SIGMETRICS, June 2012, pp.187-198.

  87. Cheng D, Jiang C, Zhou X. Heterogeneity-aware workload placement and migration in distributed sustainable datacenters. In Proc. the 28th IEEE Int. Parallel and Distributed Processing Symposium (IPDPS), May 2014.

  88. Lama P, Zhou X. Efficient server provisioning with control for end-to-end delay guarantee on multi-tier clusters. IEEE Trans. Parallel and Distributed Systems, 2012, 23(1): 78-86.

    Article  Google Scholar 

  89. Lama P, Zhou X. Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee. ACM Transactions on Autonomous and Adaptive Systems, 2013, 8(2): Article No.9.

  90. Lin C, Lee C S G. Real-time supervised structure/parameter learning for fuzzy neural network. In Proc. IEEE Int. Conference on Fuzzy Systems, March 1992, pp.1283-1291.

  91. Lin J, Lu Q, Ding X et al. Gaining insights into multicore cache partitioning: Bridging the gap between simulation and real systems. In Proc. the 14th Int. Symp. High Performance Computer Architecture (HPCA), Feb. 2008, pp.367-378.

  92. Rao J, Wang K, Zhou X, Xu C Z. Improving virtual machine scheduling in NUMA multicore systems. In Proc. the 19th IEEE Int. Symposium on High Performance Computer Architecture (HPCA), Feb. 2013, pp.306-317.

  93. Lama P, Zhou X. NINEPIN: Non-invasive and energy efficient performance isolation in virtualized servers. In Proc. IEEE/IFIP Int. Conference on Dependable Systems and Networks (DSN), June 2012.

  94. Nathuji R, Kansal A, Ghaffarkhah A. Q-clouds: Managing performance interference effects for QoS-aware clouds. In Proc. the 5th ACM European Conference on Computer Systems (EuroSys), April 2010, pp.237-250.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Colorado, Colorado Springs, U.S.A.

    Xiaobo Zhou

  2. The Key Laboratory of Embedded System and Service Computing, Ministry of Education, Tongji University, Shanghai, 200092, China

    Xiaobo Zhou & Chang-Jun Jiang

  3. Department of Computer Science and Technology, Tongji University, Shanghai, 201804, China

    Chang-Jun Jiang

Authors
  1. Xiaobo Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chang-Jun Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaobo Zhou.

Additional information

This research was supported in part by the National Science Foundation of USA under Grant Nos. CNS-0844983 (CAREER Award) and CNS-1217979, and the National Natural Science Foundation of China under Grant No. 61328203.

Electronic supplementary material

Below is the link to the electronic supplementary material.

ESM 1

(PDF 264 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, X., Jiang, CJ. Autonomic Performance and Power Control on Virtualized Servers: Survey, Practices, and Trends. J. Comput. Sci. Technol. 29, 631–645 (2014). https://doi.org/10.1007/s11390-014-1455-4

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-014-1455-4

Keywords

Search

Navigation