Jungkil Kim
ABSTRACT
The ever increasing demand of effective resource utilization in data centers has resulted in the dramatic development of various virtualization environments. Furthermore, the requirements on rapid processing of large data has not only caused to the replacement of spinning disks with flash-based SSD but also has led to the implementation of efficient software I/O stacks for SSDs. The software I/O stacks in most hypervisors have been developed for SATA interface-based storages. Therefore, high throughput and various functionalities provided by the NVMebased SSDs cannot be fully utilized. Also, it was found that the inefficiency of the existing storage I/O is due to the nonoptimized I/O stack of virtual machines in a hypervisor. In this paper, we have proposed a new I/O architecture that optimizes the I/O path by eliminating the overhead of user-level threads, bypassing unnecessary I/O routines and enhancing the interrupt delivery delay. The purpose of the proposed architecture is to enhance the throughput and scalability by mitigating the overhead of the existing software stack to take full advantage of NVMe SSDs. Experimental results with a real system show that the proposed approach improves the I/O performance by up to 47% compared to the existing approach.
- VMware homepage. 2015. http://www.vmware.comGoogle Scholar
- Kivity, A., Kamay, Y., Laor, D., Lublin, U., and Liguori, A. KVM: the Linux virtual machine monitor. In Proceedings of the Linux Symposium (Ottawa, Ontario, Canada, June 2007). 225--230.Google Scholar
- Xen Project Software Overview. 2015. http://wiki.xen.org/wiki/Xen_Overview.Google Scholar
- Dong, Y., Yu, Z., and Rose, G. SR-IOV Networking in Xen: Architecture, Design and Implementation. In Workshop on I/O Virtualization (WIOV '08) (San Diego, CA., Dec. 10-11, 2008). Google ScholarDigital Library
- AMD I/O virtualization technology (IOMMU) specification. 2011. http://developer.amd.com/wordpress/media/2012/10/488821.pdfGoogle Scholar
- Russell, R. virtio: towards a de-facto standard for virtual I/O devices. ACM SIGOPS Operating Systems Review, 42, 5 (July 2008), 95--103. Google ScholarDigital Library
- NVM Express specification. 2015. http://www.nvmexpress.org/specifications/Google Scholar
- Bjørling, M., Axboe, J., Nellans, D., and Bonnet, P. Linux block IO: introducing multi-queue SSD access on multi-core systems. In Proceedings of the 6th International Systems and Storage Conference (SYSTOR '13) (Haifa, Israel, June 30-July 2). ACM Press, New York, NY, 2013. Google ScholarDigital Library
- Huynh, K. Exploiting the latest KVM features for optimized virtualized enterprise storage performance. In CloudOpen, North America (2013).Google Scholar
- Lei, M., Virtio-blk Multi-queue Conversion and QEMU Optimization. In KVM Forum (Düsseldorf, Germany, Oct. 14-16, 2014). http://events.linuxfoundation.org/sites/events/files/slides/virti o-blk_qemu_v0.96.pdfGoogle Scholar
- Kim, T. Y., Kang, D. H., Lee, D. W., and Eom, Y. I. Improving performance by bridging the semantic gap between multi-queue SSD and I/O virtualization framework. In Proceedings of 31st Symposium on Mass Storage Systems and Technologies (MSST '15) (Santa Clara, CA, May 30-June 5, 2015), IEEE, 2015, 1--11.Google ScholarCross Ref
- Gordon, A., Har'El, N., Landau, A., Ben-Yehuda, M., and Traeger, A. Towards exitless and efficient paravirtual I/O. In Proceedings of the 5th Annual International Systems and Storage Conference (SYSTOR '12) (Haifa, Israel, June 4-6, 2012). ACM Press, New York, NY, 2012. Google ScholarDigital Library
- Oh, M., Eom, H., and Yeom, H. Y. Enhancing the I/O system for virtual machines using high performance SSDs. In Performance Computing and Communications Conference (IPCCC), 2014 IEEE International (Austin, TX, Dec. 5-7, 2014). IEEE, 1--8.Google ScholarCross Ref
- Cobb, D., and Huffman, A. Nvm express and the pci express ssd revolution. 2012. http://nvmexpress.org/wp-content/uploads/2013/04/IDF-2012-NVM-Express-and-the-PCIExpress-SSD-Revolution.pdf.Google Scholar
- Bellard, F. QEMU, a Fast and Portable Dynamic Translator. In Proceedings of the annual conference on USENIX Annual Technical Conference (ATEC '05) (Anaheim, CA, April 10-15, 2005). USENIX Association, Berkeley, CA, USA, 2005. Google ScholarDigital Library
- Axboe, J. Flexible IO Tester. 2015. http://git.kernel.dk/?p=fio.git;a=summaryGoogle Scholar
- Kernel Asynchronous I/O. 2015. http://lse.sourceforge.net/io/aio.htmlGoogle Scholar
- Nakajima, J. Enabling Optimized Interrupt/APIC Virtualization in KVM. In KVM Forum 2012 (Barcelona, Spain, November 7-9, 2012). http://www.linuxkvm.org/images/7/70/2012-forum-nakajima_apicv.pdfGoogle Scholar
Index Terms
- Improving I/O performance of NVMe SSD on virtual machines
Recommendations
LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs
ASPLOS '20: Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating SystemsToday's cloud storage stack is extremely resource hungry, burning 10-20% of datacenter x86 cores, a major "storage tax" that cloud providers must pay. Yet, the complex cloud storage stack is not completely offload-ready to today's IO accelerators. We ...
Optimizing virtual machine live storage migration in heterogeneous storage environment
VEE '13Virtual machine (VM) live storage migration techniques significantly increase the mobility and manageability of virtual machines in the era of cloud computing. On the other hand, as solid state drives (SSDs) become increasingly popular in data centers, ...
Optimizing virtual machine live storage migration in heterogeneous storage environment
VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environmentsVirtual machine (VM) live storage migration techniques significantly increase the mobility and manageability of virtual machines in the era of cloud computing. On the other hand, as solid state drives (SSDs) become increasingly popular in data centers, ...
Comments