ABSTRACT
Enterprises are moving their IT infrastructure to cloud service providers with the goal of saving costs and simplifying management overhead. One of the critical services for any enterprise is its file system, where users require real-time access to files. Cloud service providers provide several building blocks such as Amazon EBS, or Azure Cache, each with very different pricing structures that differ on the basis of storage, access and bandwidth costs. Moving an entire file system to the cloud using such services is not cost-optimal if we rely on only one of these services. In this paper, we propose FCFS, a storage solution that drastically reduces the cost of operating a file system in the cloud. Our solution integrates multiple storage services and dynamically adapts the storage volume sizes of each service to provide a cost-efficient solution with provable performance bounds. Using real-world large scale data sets spanning a variety of work loads from an enterprise data center, we show that FCFS can reduce file storage and access costs in current cloud services by a factor of two or more, while allowing users to utilize the benefits of the various cloud storage services.
- Amazon. EBS to S3 Snapshot Block Size. https://forums.aws.amazon.com/message.jspa?messageID =142082.Google Scholar
- Amazon. Elastic block store. http://aws.amazon.com/ebs/.Google Scholar
- Amazon. Elasticache. http://aws.amazon.com/elasticache/.Google Scholar
- Amazon. Simple storage service faqs. http://aws.amazon.com/s3/faqs/.Google Scholar
- Azure. Caching service. http://msdn.microsoft.com/en-us/library/windowsazure/gg278356.aspx.Google Scholar
- S.-H. Gary Chan and F. A. Tobagi. Modeling and dimensioning hierarchical storage systems for low-delay video services. IEEE Transactions on Computers, 52, July 2003. Google ScholarDigital Library
- D. Isaac. Hierarchical storage management for relational databases. In Symposium on Mass Storage Systems, 1993.Google ScholarCross Ref
- A. Karlin, M. Manasse, L. McGeoch, and S. Owicki. Competitive randomized algorithms for non-uniform problems. In Proc. of ACM-SIAM Symposium on Discrete Algorithms (SODA), 1990. Google ScholarDigital Library
- A. W. Leung, S. Pasupathy, G. Goodson, and E. L. Miller. Measurement and analysis of large-scale network file system workloads. In Proc. of the USENIX (ATC) Annual Technical Conference, 2008. Google ScholarDigital Library
- N. Megiddo and D. Modha. Arc: A self-tuning,. low overhead replacement cache. In Proceedings of the USENIX Conference on (FAST) File and Storage Technologies, 2003. Google ScholarDigital Library
- D. Narayanan, A. Donnelly, and A. Rowstron. MSR Cambridge Traces. http://iotta.snia.org/traces/388.Google Scholar
- D. Narayanan, A. Donnelly, and A. Rowstron. Write off-loading: practical power management for enterprise storage. In Proceedings of the USENIX Conference on (FAST) File and Storage Technologies, 2008. Google ScholarDigital Library
- S3-EBS. Amazon's Elastic Block Store explained. http://blog.rightscale.com/2008/08/20/amazon-ebs-explained/.Google Scholar
- S3Backer. FUSE-based single file backing store via Amazon S3. http://code.google.com/p/s3backer/wiki/ChoosingBlockSize.Google Scholar
- Wikipedia. Hierarchical storage management. http://en.wikipedia.org/wiki/Hierarchical_storage_management.Google Scholar
- J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The hp autoraid hierarchical storage system. ACM Transactions on Computer Systems, 14, Feb 1996. Google ScholarDigital Library
Index Terms
- Frugal storage for cloud file systems
Recommendations
Towards Hybrid Multi-Cloud Storage Systems: Understanding How to Perform Data Transfer
AbstractNowadays, storing and retrieving information over the Cloud is critical for the survival and growth of organizations and people. In this context, the possibility to store a huge amount of data and files on remote third-party Cloud ...
A Contract-aware and Cost-effective LSM Store for Cloud Storage with Low Latency Spikes
Cloud storage is gaining popularity because features such as pay-as-you-go significantly reduce storage costs. However, the community has not sufficiently explored its contract model and latency characteristics. As LSM-Tree-based key-value stores (LSM ...
Cloud Storage as the Infrastructure of Cloud Computing
ICICCI '10: Proceedings of the 2010 International Conference on Intelligent Computing and Cognitive InformaticsAs an emerging technology and business paradigm, Cloud Computing has taken commercial computing by storm. Cloud computing platforms provide easy access to a company’s high-performance computing and storage infrastructure through web services. With cloud ...
Comments