Jacob Gorm Hansen
Abstract
In virtualized data centers, storage systems have traditionally been treated as black boxes administered separately from the compute nodes. Direct-attached storage is often left unused, to not have VM availabilty depend on individual hosts. Our work aims to integrate storage and compute, addressing the fundamental limitations of contemporary centralized storage solutions. We are building Lithium, a distributed storage system designed specifically for virtualization workloads running in large-scale data centers and clouds. Lithium aims to be scalable, highly available, and compatible with commodity hardware and existing application software. The design of Lithium borrows techniques from Byzantine Fault Tolerance, stream processing, and distributed version control software, and demonstrates their practical applicability to the performance-sensitive task of virtual machine storage
- N. Agrawal, V. Prabhakaran, T. Wobber, J. D. Davis, M. Manasse, and R. Panigrahy. Design tradeoffs for ssd performance. In ATC'08: USENIX 2008 Annual Technical Conference on Annual Technical Conference, pages 57--70, Berkeley, CA, USA, 2008. USENIX Association. Google Scholar
Digital Library
- L. N. Bairavasundaram, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, G. R. Goodson, and B. Schroeder. An analysis of data corruption in the storage stack. Trans. Storage, 4(3):1--28, 2008. Google ScholarDigital Library
- C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of the 2nd Networked Systems Design and Implementation NSDI '05, May 2005. Google ScholarDigital Library
- W. de Jonge, M. F. Kaashoek, and W. C. Hsieh. The logical disk: a new approach to improving file systems. In SOSP '93: Proceedings of the fourteenth ACM symposium on Operating systems principles, pages 15--28, New York, NY, USA, 1993. ACM Press. Google ScholarDigital Library
- J. G. Hansen and E. Jul. Lithium: virtual machine storage for the cloud. In SoCC '10: Proceedings of the 1st ACM symposium on Cloud computing, pages 15--26, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Trans. Comput. Syst., 6(1):51--81, 1988. Google ScholarDigital Library
- J. J. Kistler and M. Satyanarayanan. Disconnected operation in the Coda file system. ACM Trans. Comput. Syst., 10(1):3--25, 1992. Google ScholarDigital Library
- L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133--169, 1998. Google ScholarDigital Library
- E. K. Lee and C. A. Thekkath. Petal: distributed virtual disks. SIGOPS Oper. Syst. Rev., 30(5):84--92, 1996. Google ScholarDigital Library
- A. W. Leung, S. Pasupathy, G. Goodson, and E. L. Miller. Measurement and analysis of large-scale network file system workloads. In ATC'08: USENIX 2008 Annual Technical Conference, pages 213--226, Berkeley, CA, USA, 2008. USENIX Association. Google ScholarDigital Library
- M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proceedings of the 2005 Annual USENIX Technical Conference, April 2005. Google ScholarDigital Library
- B. M. Oki and B. H. Liskov. Viewstamped replication: A new primary copy method to support highly-available distributed systems. In PODC '88: Proceedings of the seventh annual ACM Symposium on Principles of distributed computing, pages 8--17, New York, NY, USA, 1988. ACM. Google ScholarDigital Library
- M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26--52, 1992. Google ScholarDigital Library
- F. B. Schneider. Implementing fault-tolerant services using the state machine approach: a tutorial. ACM Comput. Surv., 22(4):299--319, 1990. Google ScholarDigital Library
- D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conflicts in Bayou, a weakly connected replicated storage system. In SOSP '95: Proceedings of the fifteenth ACM symposium on Operating systems principles, pages 172--182, New York, NY, USA, 1995. ACM. Google ScholarDigital Library
Index Terms
- Scalable virtual machine storage using local disks
Recommendations
Storage Deduplication by Virtual Large-Scale Disks
NBIS '12: Proceedings of the 2012 15th International Conference on Network-Based Information SystemsRecently, the demand of low cost large scale storages increases. We developed VLSD (Virtual Large Scale Disks) toolkit for constructing virtual disk based distributed storages, which aggregate free spaces of individual disks. VLSD realizes low-cost ...
Optimizing virtual machine live storage migration in heterogeneous storage environment
VEE '13Virtual machine (VM) live storage migration techniques significantly increase the mobility and manageability of virtual machines in the era of cloud computing. On the other hand, as solid state drives (SSDs) become increasingly popular in data centers, ...
Optimizing virtual machine live storage migration in heterogeneous storage environment
VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environmentsVirtual machine (VM) live storage migration techniques significantly increase the mobility and manageability of virtual machines in the era of cloud computing. On the other hand, as solid state drives (SSDs) become increasingly popular in data centers, ...
Comments