Skip to main content
Log in

Autonomic resource management in virtualized data centers using fuzzy logic-based approaches

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Data centers, as resource providers, are expected to deliver on performance guarantees while optimizing resource utilization to reduce cost. Virtualization techniques provide the opportunity of consolidating multiple separately managed containers of virtual resources on underutilized physical servers. A key challenge that comes with virtualization is the simultaneous on-demand provisioning of shared physical resources to virtual containers and the management of their capacities to meet service-quality targets at the least cost. This paper proposes a two-level resource management system to dynamically allocate resources to individual virtual containers. It uses local controllers at the virtual-container level and a global controller at the resource-pool level. An important advantage of this two-level control architecture is that it allows independent controller designs for separately optimizing the performance of applications and the use of resources. Autonomic resource allocation is realized through the interaction of the local and global controllers. A novelty of the local controller designs is their use of fuzzy logic-based approaches to efficiently and robustly deal with the complexity and uncertainties of dynamically changing workloads and resource usage. The global controller determines the resource allocation based on a proposed profit model, with the goal of maximizing the total profit of the data center. Experimental results obtained through a prototype implementation demonstrate that, for the scenarios under consideration, the proposed resource management system can significantly reduce resource consumption while still achieving application performance targets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Abdelzaher, T., Shin, K.G., Bhatti, N.: Performance guarantees for web server end-systems: a control-theoretical approach. In: IEEE Trans. Parallel Distrib. Syst. 13(1) (2002)

  2. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proc. of the ACM Symposium on Operating Systems Principles (SOSP), October 2003

  3. Bennani, M.N., Menascé, D.A.: Resource allocation for autonomic data centers using analytic performance models. In: Proc. of 2nd IEEE International Conference on Autonomic Computing (ICAC) (2005)

  4. Chandra, A., Gong, W., Shenoy, P.: Dynamic resource allocation for shared data centers using online measurements. In: Proc. of IEEE International Workshop on Quality of Service (IWQoS), June 2003

  5. Chiu, S.: Fuzzy model identification based on cluster estimation. J. Intell. Fuzzy Syst. 2(3) (1994)

  6. Diao, Y., Hellerstein, J.L., Parekh, S.: Using fuzzy control to maximize profits in service level management. IBM Syst. J. 41(3) (2002)

  7. Dike, J.: A user-mode port of the Linux kernel. In: Proc. of 4th Annual Linux Showcase & Conference (ALS 2000) (2000)

  8. Doyle, R., Chase, J., Asad, O., Jin, W., Vahdat, A.: Model-based resource provisioning in a web service utility. In: Proc. of the 4th Conference on USENIX Symposium on Internet Technologies and Systems, March 2003

  9. Liu, X., Zhu, X., Singhal, S., Arlitt, M.: Adaptive entitlement control of resource containers on shared servers. In: Proc. of 9th IFIP/IEEE International Symposium on Integrated Network Management, May 2005

  10. Martello, S., Toth, P.: Knapsack Problems: Algorithms and Computer Implementations. Wiley, New York (1990)

    MATH  Google Scholar 

  11. Mosberger, D., Jin, T.: httperf: a tool for measuring web server performance. Perform. Eval. Rev. 26(3) (1998)

  12. Rolia, J., Cherkasova, L., McCarthy, C.: Configuring workload manager control parameters for resource pools. In: Proc. of 10th IEEE/IFIP Network Operations and Management Symposium (NOMS), April 2006

  13. Sha, L., Liu, X., Lu, Y., Abdelzaher, T.: Queueing model based network server performance control. In: Proc. of the 23rd IEEE Real-Time Systems Symposium (RTSS’02) (2002)

  14. Sugeno, M., Yasukawa, T.: A fuzzy-logic-based approach to qualitative modeling. IEEE Trans. Fuzzy Syst. 1(1) (1993)

  15. Sugerman, J., Venkitachalam, G., Lim, B.: Virtualizing I/O devices on VMware workstation’s hosted virtual machine monitor. In: Proc. of 2001 USENIX Annual Technical Conference, June 2001

  16. Tesauro, G.: Online resource allocation using decompositional reinforcement learning. In: Proc. of the Twentieth National Conference on Artificial Intelligence (AAAI-05), July 2005

  17. Tesauro, G., Jong, N., Das, R., Bennani, M.: On the use of hybrid reinforcement learning for autonomic resource allocation. Clust. Comput. 10(3) (2007)

  18. Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., Tantawi, A.: An analytical model for multi-tier internet services and its applications. In: Proc. of ACM Sigmetrics Conference (SIGMETRICS), Jun 2005

  19. Wang, Z., Zhu, X., Singhal, S.: Utilization and SLO-based control for dynamic sizing of resource partitions. In: Proc. of 16th IFIP/IEEE Distributed Systems: Operations and Management (DSOM), October 2005

  20. Xu, W., Zhu, X., Singhal, S., Wang, Z.: Predictive control for dynamic resource allocation in enterprise data centers. In: Proc. of 2006 IEEE/IFIP Network Operations & Management Symposium, April 2006

  21. Zadeh, L.A.: Fuzzy sets. Inf. Control 8(3), 338–353 (1965)

    Article  MATH  MathSciNet  Google Scholar 

  22. Zhu, X., Wang, Z., Singhal, S.: Utility-driven workload management using nested control design. In: Proc. of American Control Conference (ACC), June 2006

  23. HP-UX Workload Manager, http://docs.hp.com/en/5990-8153/ch05s12.html

  24. See http://www.cs.virginia.edu/~rz5b/software/software.htm

  25. See http://ita.ee.lbl.gov/html/contrib/WorldCup.html

  26. See https://blueprints.dev.java.net/petstore/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jing Xu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xu, J., Zhao, M., Fortes, J. et al. Autonomic resource management in virtualized data centers using fuzzy logic-based approaches. Cluster Comput 11, 213–227 (2008). https://doi.org/10.1007/s10586-008-0060-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-008-0060-0

Keywords

Navigation