Christoph Kleineweber
ABSTRACT
We present a reservation scheduler for object-based file systems. It supports storage virtualization for multi-tenant cloud environments with quality of service (QoS) guarantees. The reservation scheduler has been integrated into the XtreemFS cloud file system to maximize the resource utilization under the given QoS demands. Our simulation results obtained with a discrete event simulator indicate that a considerable number of active object stores can be saved while still ensuring the requested service guarantees (capacity, throughput, IOPS, etc.).
- Amazon elastic block storage (EBS). Online at http://aws.amazon.com/ebs/, accessed on April 25th, 2014.Google Scholar
- Google compute engine - disks. Online at https://developers.google.com/compute/docs/disks, accessed on April 25th, 2014.Google Scholar
- G. A. Alvarez, E. Borowsky, S. Go, T. H. Romer, R. Becker-Szendy, R. Golding, A. Merchant, M. Spasojevic, A. Veitch, and J. Wilkes. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst., 19(4):483--518, Nov. 2001. Google ScholarDigital Library
- J. Bruno, J. Brustoloni, E. Gabber, B. Ozden, and A. Silberschatz. Disk scheduling with quality of service guarantees. In Multimedia Computing and Systems, 1999. IEEE International Conference on, volume 2, pages 400--405 vol.2, Jul 1999. Google ScholarDigital Library
- J. Bruno, E. Gabber, O. Banu, and A. Silberschatz. The eclipse operating system: Providing quality of service via reservation domains. In Proceedings of the USENIX Annual Technical Conference, ATC'98, pages 235--246, 1998. Google ScholarDigital Library
- C. Dirik and B. Jacob. The performance of PC solid-state disks (SSDs) as a function of bandwidth, concurrency, device architecture, and system organization. In Proceedings of the 36th Annual International Symposium on Computer Architecture, ISCA '09, pages 279--289, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- A. Gulati, I. Ahmad, and C. Waldspurger. PARDA: proportional allocation of resources for distributed storage access. In Proceedings of the 7th USENIX Conference on File and Storage Technologies, FAST'09, pages 85--98, 2009. Google ScholarDigital Library
- A. Gulati, A. Merchant, and P. J. Varman. pclock: An arrival curve based approach for QoS guarantees in shared storage systems. In Proceedings of the 2007 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '07, pages 13--24, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- A. Gulati, A. Merchant, and P. J. Varman. mclock: Handling throughput variability for hypervisor io scheduling. In Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, OSDI'10, pages 1--7, Berkeley, CA, USA, 2010. USENIX Association. Google ScholarDigital Library
- L. Huang, G. Peng, and T.-c. Chiueh. Multi-dimensional storage virtualization. SIGMETRICS Perform. Eval. Rev., 32(1):14--24, June 2004. Google ScholarDigital Library
- F. Hupfeld, T. Cortes, B. Kolbeck, J. Stender, E. Focht, M. Hess, J. Malo, J. Marti, and E. Cesario. The XtreemFS architecture{a case for object-based file systems in grids. Concurrency and Computation: Practice and Experience, 20(17):2049--2060, 2008. Google ScholarDigital Library
- S. Li and H. Huang. Black-box performance modeling for solid-state drives. In Modeling, Analysis Simulation of Computer and Telecommunication Systems (MASCOTS), 2010 IEEE International Symposium on, pages 391--393, Aug 2010. Google ScholarDigital Library
- M. Mesnier, G. Ganger, and E. Riedel. Object-based storage. Communications Magazine, IEEE, 41(8):84--90, 2003. Google ScholarDigital Library
- F. Mu, J. Shu, B. Li, and W. Zheng. Multi-dimensional storage QoS guarantees for an object-based storage system. In V. Alexandrov, G. Albada, P. Sloot, and J. Dongarra, editors, Computational Science -- ICCS 2006, volume 3993 of Lecture Notes in Computer Science, pages 687--694. Springer Berlin Heidelberg, 2006. Google ScholarDigital Library
- C. Ruemmler and J. Wilkes. An introduction to disk drive modeling. Computer, 27(3):17--28, March 1994. Google ScholarDigital Library
- J. Schindler, J. L. Griffin, C. R. Lumb, and G. R. Ganger. Track-aligned extents: Matching access patterns to disk drive characteristics. In Proceedings of the USENIX Conference on File and Storage Technologies, FAST'02, pages 259--274, 2002. Google ScholarDigital Library
- P. J. Shenoy and H. M. Vin. Cello: A disk scheduling framework for next generation operating systems. In Proceedings of the 1998 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '98/PERFORMANCE '98, pages 44--55, New York, NY, USA, 1998. ACM. Google ScholarDigital Library
- J. Stender, M. Berlin, and A. Reinefeld. XtreemFS -- a file system for the cloud. In D. Kyriazis, A. Voulodimos, S. V. Gogouvitis, and T. Varvarigou, editors, Data Intensive Storage Services for Cloud Environments. IGI Global, 2013.Google Scholar
- Y. Toyoda. A simplified algorithm for obtaining approximate solutions to zero-one programming problems. Management Science, 21(12):1417--1427, 1975.Google ScholarDigital Library
- M. Wachs, M. Abd-El-Malek, E. Thereska, and G. R. Ganger. Argon: performance insulation for shared storage servers. In Proceedings of the 5th USENIX Conference on File and Storage Technologies, FAST'07, pages 61--76, 2007. Google ScholarDigital Library
- Y. Wang and A. Merchant. Proportional-share scheduling for distributed storage systems. In Proceedings of the 5th USENIX Conference on File and Storage Technologies, FAST'07, pages 47--60, 2007. Google ScholarDigital Library
- M. Welsh, D. Culler, and E. Brewer. Seda: An architecture for well-conditioned, scalable internet services. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles, SOSP '01, pages 230--243, New York, NY, USA, 2001. ACM. Google ScholarDigital Library
Index Terms
- QoS-aware storage virtualization for cloud file systems
Recommendations
Multi-dimensional storage virtualization
Most state-of-the-art commercial storage virtualization systems focus only on one particular storage attribute, capacity. This paper describes the design, implementation and evaluation of a multi-dimensional storage virtualization system called ...
Multi-dimensional storage virtualization
SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systemsMost state-of-the-art commercial storage virtualization systems focus only on one particular storage attribute, capacity. This paper describes the design, implementation and evaluation of a multi-dimensional storage virtualization system called ...
VM aware journaling: improving journaling file system performance in virtualization environments
Journaling file systems, which are widely used in modern operating systems, guarantee file system consistency and data integrity by logging file system updates to a journal, which is a reserved space on the storage, before the updates are written to the ...
Comments