Hui Lv
ABSTRACT
Server consolidation, by running multiple virtual machines on top of a single platform with virtualization, provides an efficient solu-tion to parallelism and utilization of modern multi-core processors system. However, the performance and scalability of server con-solidation solution on modern massive advanced server is not well addressed. In this paper, we conduct a comprehensive study of Xen per-formance and scalability characterization running SPECvirt_sc2010, and identify that large memory and cache footprint, due to the unnecessary high frequent context switch, introduce additional challenges to the system performance and scalability. We propose two optimizations (dynamically-allocable tasklets and context-switch rate controller) to improve the performance. The results show the improved memory and cache efficiency with a reduction of the overall CPI, resulting in an improvement of server consolidation capability by 15% in SPECvirt_sc2010. In the meantime, our optimization achieves an up to 50% acceleration of service response, which greatly improves the QoS of Xen virtualization solution.
- Intel Corporation. Terascale computing. http://www.intel.com/research/platform/terascale/index.htm.Google Scholar
- Intel Corporation. Intel Develops Tera-Scale Research Chips. http://www.intel.com/pressroom/archive/releases/20060926corpb.htm.Google Scholar
- VMware. http://www.vmware.com/.Google Scholar
- Microsoft Virtual Server, http://www.microsoft.com/hyper-v-server/Google Scholar
- Kernel Based Virtual Machine http://www.linux-kvm.org/Google Scholar
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the Symposium on Operating Systems Principles (SOSP), Oct. 2003 Google ScholarDigital Library
- SPECvirt_sc2010 http://www.spec.org/virt_sc2010/Google Scholar
- P. ApparaoNewell, Towards Modeling & Analysis of Consolidated CMP Servers, Workshop on the Design, Analysis, and Simulation of Chip Multi-Processors (dasCMP), 2007Google Scholar
- Jeffrey P. Casazza, Redefining server performance characterization for virtualization benchmarking, Intel Technology journal August 2006Google Scholar
- I. M. Leslie, D. Mcauley, R. Black, T. Roscoe, P. T. Barham, D. Evers, R. Fairbairns, and E. Hyden. The Design and Implementation of an Operating System to Support Distributed Multimedia Applications. IEEE Journal of Selected Areas in Communications, 1996 Google ScholarDigital Library
- VMmark http://www.vmware.com/products/vmmark/Google Scholar
- M. Rosenblum. VMware's Virtual Platform: A virtual machine monitor for commodity PCs. In Hot Chips 11: Stanford University, Stanford, CA, August 15--17, 1999Google Scholar
- K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. War_eld, and M. Williamson. Safe hardware access with the Xen virtual machine monitor. In 1st Workshop on Operating System and Architectural Support for the on demand IT InfraStructure (OASIS), Oct 2004Google Scholar
- A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel. Diagnosing performance overheads in the Xen virtual machine environment. In Proceedings of the First ACM/USENIX International Conference on Virtual Execution Environments (VEE), pages 13--23, June 2005 Google ScholarDigital Library
- Selvamuthukumar Senthilvelan and Murugappan Senthilvelan. Study of content-based sharing on the xen virtual machine monitor http://www.cs.wisc.edu/~remzi/Classes/736/Spring2005/Projects/Muru-Selva/cs736-report.pdf.Google Scholar
- Wiegert, J., et al.: Challenges for Scalable Networking in a Virtualized Server. In: 16th International Conference on Computer Communications and NetworksGoogle Scholar
- A. Menon, A.L. Cox, and W. Zwaenepoel. Optimizing network virtualization in Xen. In Proceedings of the 2006 USENIX Annual Technical Conference, pages 15--28, June 2006 Google ScholarDigital Library
- L. Cherkasova and R. Gardner. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In USENIX Annual Technical Conference, Apr. 2005 Google ScholarDigital Library
- Diego Ongaro , Alan L. Cox , Scott Rixner, Scheduling I/O in virtual machine monitors, Proceedings of the fourth ACM SIG-PLAN/SIGOPS international conference on Virtual execution environments, March 05-07, 2008, Seattle, WA, USA Google ScholarDigital Library
- Susan J. Eggers, Joel S. Emer, Henry M. Levy, Jack L. Lo, Rebecca L. Stamm , Dean M. Tullsen, Simultaneous Multithreading: A Platform for Next-Generation Processors, IEEE Micro, v.17 n.5, p.12--19, September 1997 Google ScholarDigital Library
- Xudong Zheng, Jiangang Duan, Shameem F Akhter, Zhidong Yu, Hui Lv, A Consolidation Workload Characterization Study on Modern Platform, CMG'09Google Scholar
- UHLIG, R., NEIGER, G., RODGERS, D., SANTONI, A. L., MARTINS, F. C. M., ANDERSON, A. V., BENNETT, S. M., KAGI, A., LEUNG, F. H., AND SIMTH, L. 2005. Intel Virtualization Technology. IEEE Computer. 38, 5, 48--56 Google ScholarDigital Library
- Yaozu Dong, Zhao Yu, Greg Rose: SR-IOV Networking in Xen: Architecture, Design and Implementation. Workshop on I/O Virtualization 2008 Google ScholarDigital Library
- DONG, Y., YANG, X., LI, X., LI, J., TIAN, K., AND GUAN, H. 2010. High Performance Network Virtualization with SR-IOV. In Proceeding of the 16th IEEE International Symposium on High-Performance Computer Architecture (HPCA'10). IEEE, Bangalore, India, 271--280Google Scholar
- L. Cherkasova, D. Gupta, and A. Vahdat. Comparison of the Three CPU Schedulers in Xen. ACM SIGMETRICS Performance Evaluation Review, 35(2):42--51, 2007 Google ScholarDigital Library
- Credit Scheduler. http://wiki.xensource.com/xenwiki/CreditSchedulerGoogle Scholar
- RAJ, H., AND SCHWAN, K. 2007. High performance and scalable I/O virtualization via self-virtualized devices. In Proceeding of the 16th international symposium on high performance distributed computing (HPDC'07). ACM, Monterrey, CA, 179--188 Google ScholarDigital Library
- K. J. Duda and D. R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. In Proceedings of the 17th ACM SOSP, 1999. Google ScholarDigital Library
- GUO, D., LIAO, G., AND BHUYAN, L. N. 2009. Performance characterization and cache-aware core scheduling in a virtualized multi-core server under 10GbE. In Proceeding of 2009 IEEE International Symposium on Workload Characterization (IISWC'09). IEEE, Austin, TX, 168--177 Google ScholarDigital Library
- Yaozu Dong, Xiaowei Yang, Xiaoyong Li, Jianhui Li, Kun Tian, Haibing Guan. High performance network virtualization with SR-IOV. HPCA'2010. pp.1~10Google Scholar
- SANTOS, J. R., TURNER, Y. JANAKIRAMAN, G., AND PRATT, I. 2008. Bridging the gap between software and hardware techniques for I/O virtualization, In Proceeding of the USENIX Annual Technical Conference (USENIX'08). USENIX, Boston, MA, 29--42. Google ScholarDigital Library
- Hui Lv, Xudong Zheng, Zhiteng Huang, Jiangang Duan, Tackling the Challenges of Server Consolidation on Multi-Core Systems. IISWC'2010 Google ScholarDigital Library
- Open-iscsi project http://www.open-iscsi.org/Google Scholar
- J. Calandrino and J. Anderson. On the design and implementation of a cache-aware multicore real-time scheduler. In Proceedings of the 21st Euromicro Conference on Real-Time Systems, July 2009. Google ScholarDigital Library
- Arcangeli, Andrea ; Eidus, Izik ; Wright, Chris: Increasing memory density by using KSM. http://www.kernel.org/doc/ols/2009/#19--28. Version: 2009Google Scholar
- LIAO, G., BHUYAN, L. N., WU, W., YU, H., AND KING, S. R. 2010. A new TCB cache to efficiently manage TCP sessions for Web servers. In Proceeding of the 6th ACM/IEEE Symposium on Architecture for Networking and Communication Systems (ANCS'10). ACM, San Diego, CA, 1--10. Google ScholarDigital Library
- Jun Nakajima, Qian Lin, Sheng Yang, Min Zhu, Shang Gao, Mingyuan Xia, Peijie Yu, Yaozu Dong, Zhengwei Qi, Kai Chen, Haibing Guan: Optimizing virtual machines using hybrid virtualization. SAC 2011: 573--578 Google ScholarDigital Library
- A. J. Bernstein, Program Analysis for Parallel Processing, IEEE Trans. on Electronic Computers". EC-15, pp. 757--62, 1966Google ScholarCross Ref
- X. Zhang, A. E. Eichenberger, Y. Luo, K. O'Brien , K. O'Brien, Exploiting Parallelism with Dependence-Aware Scheduling, In Proceedings of the 18th International Conference on Parallel Architecture and Compilation Techniques (PACT'09) (Raleigh, NC, USA, Sept. 2009), ACM, pp. 193--202 Google ScholarDigital Library
Index Terms
- Virtualization challenges: a view from server consolidation perspective
Recommendations
Virtualization challenges: a view from server consolidation perspective
VEE '12Server consolidation, by running multiple virtual machines on top of a single platform with virtualization, provides an efficient solu-tion to parallelism and utilization of modern multi-core processors system. However, the performance and scalability ...
Improving machine virtualisation with 'hotplug memory'
Machine virtualisation is a key technology for server consolidation and on-demand server provisioning. To support this trend, it is essential to improve the performance of virtualisation software and enable the efficient running of many virtual ...
Virtualization-Based Operation Support Systems: Performance Evaluation and Systems Design
APNOMS '08: Proceedings of the 11th Asia-Pacific Symposium on Network Operations and Management: Challenges for Next Generation Network Operations and Service ManagementRecent advances in virtualization technologies have allowed telecommunications carriers to apply virtualization-based operation support systems. By separating logical view of computing resources from physical view, virtualization is expected to help ...
Comments