Skip to main content
Log in

An autonomic provisioning framework for outsourcing data center based on virtual appliances

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

As outsourcing data centers emerge to host applications and services from many different organizations, it is critical for data center owners to isolate different applications while dynamically and optimally allocate sharable resources among them. To address this issue, we propose a virtual-appliance-based autonomic resource provisioning framework for large virtualized data centers. We present the architecture of the data center with enriched autonomic features. We define a non-linear constrained optimization model for dynamic resource provisioning and present a novel analytic solution. Key factors, including virtualization overhead and reconfiguration delay, are incorporated into the model. Experimental results based on a prototype demonstrate that the system-level performance has been greatly improved by taking advantage of fine-grained server consolidation, and the whole system exhibits flexible adaptation in failure scenarios. Experiments with the impact of switching delay also show the efficiency of the framework due to significantly reduced provisioning time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Walsh, W.E., Tesauro, G., Kephart, J.O., et al.: Utility functions in autonomic systems. In: Proceedings of the First IEEE International Conference on Autonomic Computing (ICAC’2004) (2004)

  2. IBM Redbooks: High performance on demand solutions. http://www.redbooks.ibm.com/abstracts/sg246644.html

  3. Ruth, P., Rhee, J., Xu, D., et al.: Autonomic live adaptation of virtual computational environments in a multi-domain infrastructure. In: Proceedings of the 3rd IEEE International Conference on Autonomic Computing (ICAC’2006) (2006)

  4. Rosenblum, M., Garfinkel, T.: Virtual machine monitors: current technology and future trends. Computer 38, 39–47 (2005)

    Article  Google Scholar 

  5. Barham, P., Dragovic, B., Fraser, K., et al.: Xen and the art of virtualization. In: Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (2003)

  6. Waldspurger, C.A.: Memory resource management in VMware ESX server. ACM SIGOPS Oper. Syst. Rev. 36, 181 (2002)

    Article  Google Scholar 

  7. Wang, X., Lan, D., Wang, G., et al.: Appliance-based autonomic provisioning framework for virtualized outsourcing data center. In: Proceedings of the 4th IEEE International Conference on Autonomic Computing (ICAC’2007), Florida, USA (2007)

  8. Chess, D.M., Pacifici, G., Tantawi, A.: Experience with collaborating managers: node group manager and provisioning manager. In: Proceedings of the Second International Conference on Autonomic Computing, pp. 39–50 (2005)

  9. Gilat, D., Landau, A., Sela, A.: Autonomic self-optimization according to business objectives. In: Proceedings of the First International Conference on Autonomic Computing (ICAC’2004) (2004)

  10. Chess, D.M., Segal, A., Whalley, I.: Unity: experiences with a prototype autonomic computing system. In: Proceedings of the First International Conference on Autonomic Computing (ICAC’04) (2004)

  11. Bennani, M.N., Menasce, D.A.: Resource allocation for autonomic data centers using analytic performance models. In: Proceedings of the 2nd IEEE International Conference on Autonomic Computing (ICAC’2005), Seattle, WA (2005)

  12. Tesauro, G., Das, R., Walsh, W.E., et al.: Utility-function-driven resource allocation in autonomic systems. In: Proceedings of the 2nd IEEE International Conference on Autonomic Computing (ICAC’2005) (2005)

  13. Menascé, D.A., Bennani, M.N.: Autonomic virtualized environments. In: Proceedings of IEEE International Conference on Autonomic and Autonomous Systems (ICAS’06), Silicon Valley, CA, USA (2006)

  14. Tesauro, G., Jong, N.K., Das, R., et al.: A hybrid reinforcement learning approach to autonomic resource allocation. In: Proceedings of the 3rd IEEE International Conference on Autonomic Computing (ICAC’2006) (2006)

  15. Lumezanu, C., Bhola, S., Astley, M.: Utility optimization for event-driven distributed infrastructures. In: Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (2006)

  16. Das, R., Kephart, J.O., Whalley, I.N., et al.: Towards commercialization of utility-based resource allocation. In: Proceedings of the 3rd IEEE International Conference on Autonomic Computing (ICAC’2006) (2006)

  17. Ranjan, S., Rolia, J., Fu, H., et al.: QoS-driven server migration for Internet data centers. In: Tenth IEEE International Workshop on Quality of Service, pp. 3–12 (2002)

  18. Chandra, A., Gong, W., Shenoy, P.: Dynamic resource allocation for shared data centers using online measurements. In: Proceedings of ACM Sigmetrics, San Diego, CA (2003)

  19. Mahabhashyam, S.R.: Dynamic resource allocation of shared data centers supporting multiclass requests. In: Proceedings of the First International Conference on Autonomic Computing (ICAC’04) (2004)

  20. Almeida, J., Almeida, V., Ardagna, D., et al.: Resource management in the autonomic service-oriented architecture. In: Proceedings of the Third International Conference on Autonomic Computing (ICAC’06) (2006)

  21. Karve, A., Kimbrel, T., Pacifici, G. et al.: Dynamic placement for clustered web applications. In: Proceedings of the 15th International Conference on World Wide Web, pp. 595–604 (2006)

  22. Tesauro, G.: Online resource allocation using decompositional reinforcement learning. In: National Conference on Artificial Intelligence (AAAI/IAAI), Pittsburgh, PA, USA (2005)

  23. Doyle, R.P., Chase, J., Asad, O. et al.: Model-based resource provisioning in a web service utility. In: The 4th USENIX Symposium on Internet Technologies and Systems, Seattle, WA, USA (2003)

  24. White, S.R., Hanson, J.E., Whalley, I. et al.: An architectural approach to autonomic computing. In: Proceedings of the First IEEE International Conference on Autonomic Computing (ICAC’ 2004) (2004)

  25. Quetier, B., Neri, V., Cappello, F.: Scalability comparison of 4 host virtualization tools. J. Grid Comput. (2006)

  26. Quetier, B., Neri, V., Cappello, F.: Selecting a virtualization system for Grid/P2P large scale emulation. In: Proceedings of the EXPGRID (HPDC-15’s workshop), Paris, France (2006)

  27. McKenna, J.: A generalization of Little’s law to moments of queue lengths and waiting times in closed, product-form queuing networks. J. Appl. Probab. 26, 121–133 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  28. SWsoft: OpenVZ (2006)

  29. Jin, C., Soundararajan, G., Amza, C.: Autonomic provisioning of backend databases in dynamic content web servers. In: IEEE International Conference on Autonomic Computing (ICAC’06) (2006)

  30. Arlitt, M., Jin, T.: A workload characterization study of the 1998 world cup web site. IEEE Netw. 14, 30–37 (2000)

    Article  Google Scholar 

  31. Nair, S.K., Thakur, L.S., Wen, K.W.: Near optimal solutions for product line design and selection: beam search heuristics. Manag. Sci. 41, 767–785 (1995)

    Article  MATH  Google Scholar 

  32. Aarts, E., Lenstra, J.K.: Local Search in Combinatorial Optimization. Wiley, New York (1997)

    MATH  Google Scholar 

  33. Kirkpatrick, S., Gelatt, C.D. Jr., Vecchi, M.P.: Optimization by simulated annealing. Science 220, 671 (1983)

    Article  MathSciNet  Google Scholar 

  34. Vose, M.D.: The Simple Genetic Algorithm: Foundations and Theory. Bradford Books (1999)

  35. IBM HiPOD group: Using VMware ESX Server with IBM WebSphere application server. http://www-900.ibm.com/cn/crl/download/ESX_WAS_WP_24Jul06_final.pdf

  36. Urgaonkar, B., Shenoy, P., Chandra, A., et al.: Agile, dynamic provisioning of multi-tier Internet applications. Technical Report. Dept. of Computer Science, Univ. of Massachusetts, October 2004

  37. IDEAS International: http://www.ideasinternational.com/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhihui Du.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, X., Du, Z., Chen, Y. et al. An autonomic provisioning framework for outsourcing data center based on virtual appliances. Cluster Comput 11, 229–245 (2008). https://doi.org/10.1007/s10586-008-0053-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-008-0053-z

Keywords

Navigation