Skip to main content
SpringerLink
Log in

1000 islands: an integrated approach to resource management for virtualized data centers

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Recent advances in hardware and software virtualization offer unprecedented management capabilities for the mapping of virtual resources to physical resources. It is highly desirable to further create a “service hosting abstraction” that allows application owners to focus on service level objectives (SLOs) for their applications. This calls for a resource management solution that achieves the SLOs for many applications in response to changing data center conditions and hides the complexity from both application owners and data center operators. In this paper, we describe an automated capacity and workload management system that integrates multiple resource controllers at three different scopes and time scales. Simulation and experimental results confirm that such an integrated solution ensures efficient and effective use of data center resources while reducing service level violations for high priority applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. HP Virtual Connect Enterprise Manager: http://h18004.www1.hp.com/products/blades/components/ethernet/vcem/index.html

  2. VMware ESX Server: http://vmware.com/products/vi/esx/

  3. Citrix XenServer: http://www.citrixxenserver.com/products/Pages/XenEnterprise.aspx

  4. Microsoft Hyper-V: http://www.microsoft.com/windowsserver2008/en/us/hyperv.aspx

  5. Virtual Iron: http://www.virtualiron.com/products/

  6. Zhu, X., Wang, Z., Singhal, S.: Utility-driven workload management using nested control design. In: Proc. of the American Control Conference (ACC’06), June 2006

  7. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proc. of the 2nd Symposium on Networked Systems Design and Implementation (NSDI’05), May 2005

  8. Hyser, C., Mckee, B., Gardner, R., Watson, B.J.: Autonomic virtual machine placement in the data center. HP Labs Technical Report HPL-2007-189, February 2007

  9. Seltzsam, S., Gmach, D., Krompass, S., Kemper, A.: AutoGlobe: An automatic administration concept for service-oriented database applications. In: Proc. of the 22nd Intl. Conference on Data Engineering (ICDE’06), Industrial Track, April 2006

  10. Gmach, D., Rolia, J., Cherkasova, L., Belrose, G., Turicchi, T., Kemper, A.: An integrated approach to resource pool management: policies, efficiency and quality metrics. In: Proc. of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08), June 2008

  11. Rolia, J., Cherkasova, L., Arlitt, M., Andrzejak, A.: A capacity management service for resource pools. In: Proc. of the 5th Intl. Workshop on Software and Performance (WOSP’05), Spain, July 2005

  12. Mosberger, D., Jin, T.: Httperf—A tool for measuring Web server performance. In: Proc. of the Workshop on Internet Server Performance, June 1998

  13. Khana, G., Beaty, K., Kar, G., Kochut, A.: Application performance management in virtualized server environments. In: Proc. of the IEEE/IFIP Network Operations & Management Symposium (NOMS’06), April 2006

  14. Kephart, J., Chan, H., Das, R., Levine, D., Tesauro, G., Rawson, F., Lefurgy, C.: Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs. In: Proc. of the 4th IEEE Int. Conf. on Autonomic Computing (ICAC’07), June 2007

  15. Heo, J., Henriksson, D., Liu, X., Abdelzaher, T.: Integrating adaptive components: An emerging challenge in performance adaptive systems and a server farm case-study. In: Proc. of the 28th IEEE Int. Real-Time Systems Symposium (RTSS’07), December 2007

  16. Xu, J., Zhao, M., Fortes, J., Carpenter, R., Yousif, M.: Autonomic resource management in virtualized data centers using fuzzy logic-based approaches. Cluster Comput. J. 11, 213–227 (2008)

    Article  Google Scholar 

  17. Wood, T., Shenoy, P., Venkataramani, A., Yousif, M.: Black-box and gray-box strategies for virtual machine migration. In: Proc. of the 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI’07), April 2007

  18. Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., Zhu, X.: No power struggles: Coordinated multi-level power management for the data center. In: Proc. of the 13th Int. Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS’08), March 2008

  19. Hellerstein, J., Diao, Y., Parekh, S., Tilbury, D.: Feedback Control of Computing Systems. Wiley-IEEE Press, New York (2004). ISBN: 0-471266-37-X

    Book  Google Scholar 

  20. Kamra, A., Misra, V., Nahum, E.: Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In: Proc. of the Int. Workshop on Quality of Service (IWQoS’04), June 2004

  21. Karlsson, M., Karamanolis, C., Zhu, X.: Triage: Performance differentiation for storage systems using adaptive control. ACM Trans. Storage 1(4), 457–480 (2005)

    Article  Google Scholar 

  22. Abdelzaher, T., Shin, K., Bhatti, N.: Performance guarantees for web server end-systems: A control-theoretical approach. IEEE Trans. Parallel Distrib. Syst. 13, 80–96 (2002)

    Article  Google Scholar 

  23. Lu, Y., Abdelzaher, T., Saxena, A.: Design, implementation, and evaluation of differentiated caching services. IEEE Trans. Parallel Distrib. Syst. 15(5), 440–452 (2004)

    Article  Google Scholar 

  24. Urgaonkar, B., Shenoy, P., Chandra, A., Goyal, P.: Dynamic provisioning of multi-tier internet applications. In: Proc. of the Int. Conf. on Autonomic Computing (ICAC’05), June 2005

  25. Wang, Z., Zhu, X., Singhal, S.: Utilization and SLO-based control for dynamic sizing of resource partitions. In: Proc. of the 16th IFIP/IEEE Distributed Systems: Operations and Management (DSOM’05), October 2005

  26. Padala, P., Zhu, X., Uysal, M., Wang, Z., Singhal, S., Merchant, A., Salem, K., Shin, K.: Adaptive control of virtualized resources in utility computing environments. In: Proc. of the EuroSys’07, March 2007

  27. Bash, C.E., Patel, C.D., Sharma, R.K.: Dynamic thermal management of air cooled data centers. In: Proc. of the Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITHERM’06), May 2006

  28. Cherkasova, L., Rolia, J.: R-Opus: A composite framework for application performability and QoS in shared resource pools. In: Proc. of the Int. Conf. on Dependable Systems and Networks (DSN’06), June 2006

  29. Chen, Y., Iyer, S., Liu, X., Milojicic, D., Sahai, A.: SLA decomposition: Translating service level objectives to system level thresholds. In: Proc. of the 4th IEEE Int. Conf. on Autonomic Computing (ICAC’07), June 2007

Download references

Author information

Authors and Affiliations

  1. Hewlett-Packard Laboratories, Palo Alto, CA, 94304, USA

    Xiaoyun Zhu, Donald Young, Brian J. Watson, Zhikui Wang, Jerry Rolia, Sharad Singhal, Bret McKee, Chris Hyser, Robert Gardner, Tom Christian & Ludmila Cherkasova

  2. Technical University of Munich (TUM), Munich, Germany

    Daniel Gmach

Authors
  1. Xiaoyun Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Donald Young
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brian J. Watson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhikui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jerry Rolia
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sharad Singhal
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bret McKee
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Chris Hyser
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Daniel Gmach
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Robert Gardner
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Tom Christian
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Ludmila Cherkasova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaoyun Zhu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhu, X., Young, D., Watson, B.J. et al. 1000 islands: an integrated approach to resource management for virtualized data centers. Cluster Comput 12, 45–57 (2009). https://doi.org/10.1007/s10586-008-0067-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-008-0067-6

Keywords

Search

Navigation