Abstract
Desktop virtualization is a very hot concept in both industry and academic communities. Since virtualized desktop system is based on multiple virtual machines (VM), it is necessary to design a distributed storage system to manage the VM images. In this paper, we design a distributed storage system, VMStore, by taking into account three important characteristics: high performance VM snapshot, booting optimization from multiple images and redundancy removal of images data. We adopt a direct index structure of blocks for VM snapshots to speed up VM booting performance significantly; provide a distribute storage structure with good bandwidth scalability by dynamically changing the number of storage nodes; and propose a data preprocessing strategy with intelligent object partitioning techniques, which would eliminate duplication more effectively. Performance analysis for VMStore focuses on two metrics: the speedup of VM booting and the overhead of de-duplication. Experimental results show the efficiency and effectiveness of VMStore.
Similar content being viewed by others
References
Wang X L, Sun Y F, Luo Y W, et al. Dynamic memory paravirtualization transparent to guest OS. Sci China Inf Sci, 2010, 53: 77–88
Liao X F, Jin H, Hu L T, et al. Towards virtualized desktop environment. Concurr Comp-Pract E, 2010, 22: 419–440
Xiao N, Chen T, Liu F. RSEDP: Reliable, scalable and efficient data placement algorithm. Int J Super Comput, 2011, 55: 103–122
Zhao Y J, Xiao N, Liu F. Red: An efficient replacement algorithm based on REsident distance for exclusive storage caches. In: Proceedings of the 26th IEEE Symposium on Mass Storage Systems and Technologies (MSST), Nevada, America, 2010
Meyer D, Aggarwal G, Cully B, et al. Parallax: Virtual disks for virtual machines. In: Proceedings of the ACM SIGOPS/EuroSys European Conference on Computer Systems (EuroSys 2008), ACM, 2008
Richardson T. Virtual network computing. IEEE Internet Comput, 1998, 2: 33–38
Peterson Z, Burns R. Ext3cow: A time-shifting file system for regulatory compliance. ACM Trans Stor, 2005, 1: 190–212
VMware, Inc. VMware VMFS product datasheet. http://www.vmware.com/pdf/vmfs\_datasheet.pdf
Warfield A. Virtual devices for virtual machines. PhD thesis, University of Cambridge, 2006
Karger D, Lehman E, Leighton F, et al. Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web. In: Proceedings of the 29th Annual ACM Symposium on Theory of Computing, ACM, 2009. 654–663
Anthony L, Eric V H. Experiences with content addressable storage and virtual disks. In: Proceedings of the First Workshop on I/O Virtualization, ACM, 2008
Dubnicki C, Gryz L, Heldt L, et al. Hydrastor: A scalable secondary storage. In: Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST 2009), ACM, 2009
Lillibridge M, Eshghi K, Bhagwat D, et al. Sparse indexing: Large scale, inline de-duplication using sampling and locality. In: Proceedings of the Eighth USENIX Conferenceon on File and Storage Technologies (FAST 2009), ACM, 2009
Bobbarjung D, Dubnicki C, Jagannathan S. Fingerdiff: Improved duplicate elimination in storage systems. In: Proceedings of IEEE/NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2006), IEEE, 2006
Tang S, Chen Y, Zhang Z. Machine Bank: Own your virtual personal computer. In: The 2007 IEEE International Parallel and Distributed Processing Symposium (IPDPS’07), IEEE, 2007
Meyer D T, Wires J, Ivanova M, et al. Capo: Recapitulating storage for virtual desktops. In: Proceeding of FAST’11: 9th USENIX Conference on File and Storage. Technologies, ACM, 2011
Pfaff B, Garfinkel T, Rosenblum M. Virtualization aware file systems: Getting beyond the limitations of virtual disks. In: Proceedings of the 3rd Symposium on Networked Systems Design and Implementation, ACM, 2006
Factor M, Meth K, Naor D, et al. Object storage: The future building block for storage systems. In: Proceedings of the 2nd International IEEE Symposium on Mass Storage Systems and Technologies, Sardinia, Italy, IEEE, 2005
Suzaki K, Yagi T, Iijima K, et al. Effect of disk prefetching of guest OS on storage deduplication. In: Proceeding of Runtime Environments/Systems, Layering, and Virtualized Environments(RESoLVE) Workshop, ACM, 2011
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liao, X., Li, H., Jin, H. et al. VMStore: Distributed storage system for multiple virtual machines. Sci. China Inf. Sci. 54, 1104–1118 (2011). https://doi.org/10.1007/s11432-011-4273-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-011-4273-0