Abstract
Data centers, as resource providers, are expected to deliver on performance guarantees while optimizing resource utilization to reduce cost. Virtualization techniques provide the opportunity of consolidating multiple separately managed containers of virtual resources on underutilized physical servers. A key challenge that comes with virtualization is the simultaneous on-demand provisioning of shared physical resources to virtual containers and the management of their capacities to meet service-quality targets at the least cost. This paper proposes a two-level resource management system to dynamically allocate resources to individual virtual containers. It uses local controllers at the virtual-container level and a global controller at the resource-pool level. An important advantage of this two-level control architecture is that it allows independent controller designs for separately optimizing the performance of applications and the use of resources. Autonomic resource allocation is realized through the interaction of the local and global controllers. A novelty of the local controller designs is their use of fuzzy logic-based approaches to efficiently and robustly deal with the complexity and uncertainties of dynamically changing workloads and resource usage. The global controller determines the resource allocation based on a proposed profit model, with the goal of maximizing the total profit of the data center. Experimental results obtained through a prototype implementation demonstrate that, for the scenarios under consideration, the proposed resource management system can significantly reduce resource consumption while still achieving application performance targets.
We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
References
Abdelzaher, T., Shin, K.G., Bhatti, N.: Performance guarantees for web server end-systems: a control-theoretical approach. In: IEEE Trans. Parallel Distrib. Syst. 13(1) (2002)
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proc. of the ACM Symposium on Operating Systems Principles (SOSP), October 2003
Bennani, M.N., Menascé, D.A.: Resource allocation for autonomic data centers using analytic performance models. In: Proc. of 2nd IEEE International Conference on Autonomic Computing (ICAC) (2005)
Chandra, A., Gong, W., Shenoy, P.: Dynamic resource allocation for shared data centers using online measurements. In: Proc. of IEEE International Workshop on Quality of Service (IWQoS), June 2003
Chiu, S.: Fuzzy model identification based on cluster estimation. J. Intell. Fuzzy Syst. 2(3) (1994)
Diao, Y., Hellerstein, J.L., Parekh, S.: Using fuzzy control to maximize profits in service level management. IBM Syst. J. 41(3) (2002)
Dike, J.: A user-mode port of the Linux kernel. In: Proc. of 4th Annual Linux Showcase & Conference (ALS 2000) (2000)
Doyle, R., Chase, J., Asad, O., Jin, W., Vahdat, A.: Model-based resource provisioning in a web service utility. In: Proc. of the 4th Conference on USENIX Symposium on Internet Technologies and Systems, March 2003
Liu, X., Zhu, X., Singhal, S., Arlitt, M.: Adaptive entitlement control of resource containers on shared servers. In: Proc. of 9th IFIP/IEEE International Symposium on Integrated Network Management, May 2005
Martello, S., Toth, P.: Knapsack Problems: Algorithms and Computer Implementations. Wiley, New York (1990)
Mosberger, D., Jin, T.: httperf: a tool for measuring web server performance. Perform. Eval. Rev. 26(3) (1998)
Rolia, J., Cherkasova, L., McCarthy, C.: Configuring workload manager control parameters for resource pools. In: Proc. of 10th IEEE/IFIP Network Operations and Management Symposium (NOMS), April 2006
Sha, L., Liu, X., Lu, Y., Abdelzaher, T.: Queueing model based network server performance control. In: Proc. of the 23rd IEEE Real-Time Systems Symposium (RTSS’02) (2002)
Sugeno, M., Yasukawa, T.: A fuzzy-logic-based approach to qualitative modeling. IEEE Trans. Fuzzy Syst. 1(1) (1993)
Sugerman, J., Venkitachalam, G., Lim, B.: Virtualizing I/O devices on VMware workstation’s hosted virtual machine monitor. In: Proc. of 2001 USENIX Annual Technical Conference, June 2001
Tesauro, G.: Online resource allocation using decompositional reinforcement learning. In: Proc. of the Twentieth National Conference on Artificial Intelligence (AAAI-05), July 2005
Tesauro, G., Jong, N., Das, R., Bennani, M.: On the use of hybrid reinforcement learning for autonomic resource allocation. Clust. Comput. 10(3) (2007)
Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., Tantawi, A.: An analytical model for multi-tier internet services and its applications. In: Proc. of ACM Sigmetrics Conference (SIGMETRICS), Jun 2005
Wang, Z., Zhu, X., Singhal, S.: Utilization and SLO-based control for dynamic sizing of resource partitions. In: Proc. of 16th IFIP/IEEE Distributed Systems: Operations and Management (DSOM), October 2005
Xu, W., Zhu, X., Singhal, S., Wang, Z.: Predictive control for dynamic resource allocation in enterprise data centers. In: Proc. of 2006 IEEE/IFIP Network Operations & Management Symposium, April 2006
Zadeh, L.A.: Fuzzy sets. Inf. Control 8(3), 338–353 (1965)
Zhu, X., Wang, Z., Singhal, S.: Utility-driven workload management using nested control design. In: Proc. of American Control Conference (ACC), June 2006
HP-UX Workload Manager, http://docs.hp.com/en/5990-8153/ch05s12.html
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Xu, J., Zhao, M., Fortes, J. et al. Autonomic resource management in virtualized data centers using fuzzy logic-based approaches. Cluster Comput 11, 213–227 (2008). https://doi.org/10.1007/s10586-008-0060-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-008-0060-0