research-article

QoS-aware storage virtualization for cloud file systems

Authors:

Christoph Kleineweber,

Alexander Reinefeld,

Thorsten SchüttAuthors Info & Claims

PFSW '14: Proceedings of the 1st ACM International Workshop on Programmable file systems

Pages 19 - 26

https://doi.org/10.1145/2603941.2603944

Published: 23 June 2014 Publication History

Abstract

We present a reservation scheduler for object-based file systems. It supports storage virtualization for multi-tenant cloud environments with quality of service (QoS) guarantees. The reservation scheduler has been integrated into the XtreemFS cloud file system to maximize the resource utilization under the given QoS demands. Our simulation results obtained with a discrete event simulator indicate that a considerable number of active object stores can be saved while still ensuring the requested service guarantees (capacity, throughput, IOPS, etc.).

References

[1]

Amazon elastic block storage (EBS). Online at http://aws.amazon.com/ebs/, accessed on April 25th, 2014.

[2]

Google compute engine - disks. Online at https://developers.google.com/compute/docs/disks, accessed on April 25th, 2014.

[3]

G. A. Alvarez, E. Borowsky, S. Go, T. H. Romer, R. Becker-Szendy, R. Golding, A. Merchant, M. Spasojevic, A. Veitch, and J. Wilkes. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst., 19(4):483--518, Nov. 2001.

Digital Library

[4]

J. Bruno, J. Brustoloni, E. Gabber, B. Ozden, and A. Silberschatz. Disk scheduling with quality of service guarantees. In Multimedia Computing and Systems, 1999. IEEE International Conference on, volume 2, pages 400--405 vol.2, Jul 1999.

Digital Library

[5]

J. Bruno, E. Gabber, O. Banu, and A. Silberschatz. The eclipse operating system: Providing quality of service via reservation domains. In Proceedings of the USENIX Annual Technical Conference, ATC'98, pages 235--246, 1998.

Digital Library

[6]

C. Dirik and B. Jacob. The performance of PC solid-state disks (SSDs) as a function of bandwidth, concurrency, device architecture, and system organization. In Proceedings of the 36th Annual International Symposium on Computer Architecture, ISCA '09, pages 279--289, New York, NY, USA, 2009. ACM.

Digital Library

[7]

A. Gulati, I. Ahmad, and C. Waldspurger. PARDA: proportional allocation of resources for distributed storage access. In Proceedings of the 7th USENIX Conference on File and Storage Technologies, FAST'09, pages 85--98, 2009.

Digital Library

[8]

A. Gulati, A. Merchant, and P. J. Varman. pclock: An arrival curve based approach for QoS guarantees in shared storage systems. In Proceedings of the 2007 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '07, pages 13--24, New York, NY, USA, 2007. ACM.

Digital Library

[9]

A. Gulati, A. Merchant, and P. J. Varman. mclock: Handling throughput variability for hypervisor io scheduling. In Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, OSDI'10, pages 1--7, Berkeley, CA, USA, 2010. USENIX Association.

Digital Library

[10]

L. Huang, G. Peng, and T.-c. Chiueh. Multi-dimensional storage virtualization. SIGMETRICS Perform. Eval. Rev., 32(1):14--24, June 2004.

Digital Library

[11]

F. Hupfeld, T. Cortes, B. Kolbeck, J. Stender, E. Focht, M. Hess, J. Malo, J. Marti, and E. Cesario. The XtreemFS architecture{a case for object-based file systems in grids. Concurrency and Computation: Practice and Experience, 20(17):2049--2060, 2008.

Digital Library

[12]

S. Li and H. Huang. Black-box performance modeling for solid-state drives. In Modeling, Analysis Simulation of Computer and Telecommunication Systems (MASCOTS), 2010 IEEE International Symposium on, pages 391--393, Aug 2010.

Digital Library

[13]

M. Mesnier, G. Ganger, and E. Riedel. Object-based storage. Communications Magazine, IEEE, 41(8):84--90, 2003.

Digital Library

[14]

F. Mu, J. Shu, B. Li, and W. Zheng. Multi-dimensional storage QoS guarantees for an object-based storage system. In V. Alexandrov, G. Albada, P. Sloot, and J. Dongarra, editors, Computational Science -- ICCS 2006, volume 3993 of Lecture Notes in Computer Science, pages 687--694. Springer Berlin Heidelberg, 2006.

Digital Library

[15]

C. Ruemmler and J. Wilkes. An introduction to disk drive modeling. Computer, 27(3):17--28, March 1994.

Digital Library

[16]

J. Schindler, J. L. Griffin, C. R. Lumb, and G. R. Ganger. Track-aligned extents: Matching access patterns to disk drive characteristics. In Proceedings of the USENIX Conference on File and Storage Technologies, FAST'02, pages 259--274, 2002.

Digital Library

[17]

P. J. Shenoy and H. M. Vin. Cello: A disk scheduling framework for next generation operating systems. In Proceedings of the 1998 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '98/PERFORMANCE '98, pages 44--55, New York, NY, USA, 1998. ACM.

Digital Library

[18]

J. Stender, M. Berlin, and A. Reinefeld. XtreemFS -- a file system for the cloud. In D. Kyriazis, A. Voulodimos, S. V. Gogouvitis, and T. Varvarigou, editors, Data Intensive Storage Services for Cloud Environments. IGI Global, 2013.

[19]

Y. Toyoda. A simplified algorithm for obtaining approximate solutions to zero-one programming problems. Management Science, 21(12):1417--1427, 1975.

Digital Library

[20]

M. Wachs, M. Abd-El-Malek, E. Thereska, and G. R. Ganger. Argon: performance insulation for shared storage servers. In Proceedings of the 5th USENIX Conference on File and Storage Technologies, FAST'07, pages 61--76, 2007.

Digital Library

[21]

Y. Wang and A. Merchant. Proportional-share scheduling for distributed storage systems. In Proceedings of the 5th USENIX Conference on File and Storage Technologies, FAST'07, pages 47--60, 2007.

Digital Library

[22]

M. Welsh, D. Culler, and E. Brewer. Seda: An architecture for well-conditioned, scalable internet services. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles, SOSP '01, pages 230--243, New York, NY, USA, 2001. ACM.

Digital Library

Cited By

Yang YShi XLiu WJin HHua YJiang Y(2019)DDL‐QoS: A dynamic I/O scheduling strategy of QoS for HPC applicationsConcurrency and Computation: Practice and Experience10.1002/cpe.545333:7(1-1)Online publication date: 10-Jul-2019
https://doi.org/10.1002/cpe.5453
Rampersaud SGrosu D(2017)Sharing-Aware Online Virtual Machine Packing in Heterogeneous Resource CloudsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.264193728:7(2046-2059)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2641937
Rampersaud SGrosu D(2015)Sharing-Aware Online Algorithms for Virtual Machine Packing in Cloud EnvironmentsProceedings of the 2015 IEEE 8th International Conference on Cloud Computing10.1109/CLOUD.2015.100(718-725)Online publication date: 27-Jun-2015
https://dl.acm.org/doi/10.1109/CLOUD.2015.100
Show More Cited By

Index Terms

QoS-aware storage virtualization for cloud file systems
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
    2. Software system structures
      1. Distributed systems organizing principles

Recommendations

Multi-dimensional storage virtualization

Most state-of-the-art commercial storage virtualization systems focus only on one particular storage attribute, capacity. This paper describes the design, implementation and evaluation of a multi-dimensional storage virtualization system called ...
Multi-dimensional storage virtualization
SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systems

Most state-of-the-art commercial storage virtualization systems focus only on one particular storage attribute, capacity. This paper describes the design, implementation and evaluation of a multi-dimensional storage virtualization system called ...
VM aware journaling: improving journaling file system performance in virtualization environments

Journaling file systems, which are widely used in modern operating systems, guarantee file system consistency and data integrity by logging file system updates to a journal, which is a reserved space on the storage, before the updates are written to the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PFSW '14: Proceedings of the 1st ACM International Workshop on Programmable file systems

June 2014

34 pages

ISBN:9781450329125

DOI:10.1145/2603941

Program Chairs:
Carlos Maltzahn
University of California, Santa Cruz, USA
,
Patrick McCormick
Los Alamos National Laboratory, USA

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC'14

Sponsor:

University of Arizona
SIGARCH

HPDC'14: The 23rd International Symposium on High-Performance Parallel and Distributed Computing

June 23 - 27, 2014

BC, Vancouver, Canada

Acceptance Rates

PFSW '14 Paper Acceptance Rate 3 of 7 submissions, 43%;

Overall Acceptance Rate 3 of 7 submissions, 43%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
301
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yang YShi XLiu WJin HHua YJiang Y(2019)DDL‐QoS: A dynamic I/O scheduling strategy of QoS for HPC applicationsConcurrency and Computation: Practice and Experience10.1002/cpe.545333:7(1-1)Online publication date: 10-Jul-2019
https://doi.org/10.1002/cpe.5453
Rampersaud SGrosu D(2017)Sharing-Aware Online Virtual Machine Packing in Heterogeneous Resource CloudsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.264193728:7(2046-2059)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2641937
Rampersaud SGrosu D(2015)Sharing-Aware Online Algorithms for Virtual Machine Packing in Cloud EnvironmentsProceedings of the 2015 IEEE 8th International Conference on Cloud Computing10.1109/CLOUD.2015.100(718-725)Online publication date: 27-Jun-2015
https://dl.acm.org/doi/10.1109/CLOUD.2015.100
Kim HByun HSong EJeong Y(2015)Sustainable Operation Algorithm for High Availability with Integrated Desktop Storage Based on VirtualizationAdvanced Multimedia and Ubiquitous Engineering10.1007/978-3-662-47487-7_19(123-128)Online publication date: 2015
https://doi.org/10.1007/978-3-662-47487-7_19
Martini BChoo K(2014)Distributed filesystem forensicsDigital Investigation: The International Journal of Digital Forensics & Incident Response10.1016/j.diin.2014.08.00211:4(295-313)Online publication date: 1-Dec-2014
https://dl.acm.org/doi/10.1016/j.diin.2014.08.002

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten