Sukwoo Kang
Skip Abstract Section
Abstract
This article presents virtual allocation, a scheme for flexible storage allocation. Virtual allocation separates storage allocation from the file system. It employs an allocate-on-write strategy which lets applications fit into the actual usage of storage space, without regard to the configured file system size. This improves flexibility by allowing storage space to be shared across different file systems. This article presents the design of virtual allocation and its evaluation through benchmarks. To illustrate our approach, we implemented a prototype system on PCs running Linux. We present the results from the prototype implementation and its evaluation.
- 3PARdata. 2003. Thin provisioning. http://www.3pardata.com/products/thinprovisioning.html.]]Google Scholar
- Adya, A., Bolosky, W. J., Castro, M., Cermak, G., Chaiken, R., Douceur, J. R., Howell, J., Lorch, J. R., Theimer, M., and Wattenhofer, R. 2002. Farsite: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of the 5th Symposium on Operating System Design and Implementation.]] Google ScholarDigital Library
- Anderson, D. C., Chase, J. S., and Vahdat, A. 2000. Interposed request routing for scalable network storage. In Proceedings of the 4th Symposium on Operating System Design and Implementation. 259--272.]]Google Scholar
- Best, S. 2000. Jfs overview. http://www-106.ibm.com/developerworks/library/1-jfs.html.]]Google Scholar
- Coker, R. 2000. Zcav: A hard drive testing program. http://www.coker.com.au/bonnie++/zcav.]]Google Scholar
- Coker, R. 2001. Bonnie++: A benchmark suite of hard drive and file system performance. http://www.coker.com.au/bonnie++.]]Google Scholar
- Cox, L. P., Murray, C. D., and Noble, B. D. 2002. Pastiche: Making backup cheap and easy. In Proceedings of the 5th Symposium on Operating System Design and Implementation.]] Google ScholarDigital Library
- de Jonge, W., Kaashoek, M. F., and Hsieh, W. C. 1993. The logical disk: A new approach to improving file systems. In Proceedings of the 14th ACM Symposium on Operating System Principles. 15--28.]] Google ScholarDigital Library
- Ellard, D. and Seltzer, M. I. 2003. Nfs tricks and benchmarking traps. In Proceedings of the USENIX Annual Technical Conference, FREENIX Track. 101--114.]] Google ScholarDigital Library
- English, R. M. and Stepanov, A. A. 1992. Boxwood: Abstractions as the foundation for storage infrastructure. In Proceedings of the USENIX Winter Technical Conference. 237--251.]]Google Scholar
- Ganger, G. R. and Patt, Y. N. 1994. Metadata update performance in file systems. In Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation. 49--60.]] Google ScholarDigital Library
- He, X., Yang, Q., and Zhang, M. 2002. A caching strategy to improve iscsi performance. In Proceedings of the 27th Annual IEEE Conference on Local Computer Networks. 278--288.]] Google ScholarDigital Library
- Hitz, D., Lau, J., and Malcolm, M. A. 1994. File system design for an nfs file server appliance. In Proceedings of the USENIX Winter Technical Conference. 235--246.]] Google ScholarDigital Library
- Huang, L., Peng, G., and cker Chiueh, T. 2004. Multi-Dimensional storage virtualization. In Proceedings of the International Conference on Measurements and Modeling of Computer Systems. ACM, New York, 14--24.]] Google ScholarDigital Library
- Kaczmarski, M., Jiang, T., and Pease, D. A. 2003. Beyond backup toward storage management. IBM Syst. J. 42, 2, 322--337.]] Google ScholarDigital Library
- Katcher, J. 1997. Postmark: A new filesystem benchmark. http://www.netapp.com/tech_library/3022.html.]]Google Scholar
- Krueger, M., Haagens, R., Sapuntzakis, C., and Bakke, M. 2002. Rfc 3347: Small computer systems interface protocol over the internet (iscsi) requirements and design considerations. http://tools.ietf.org/html/rfc3347.]] Google Scholar
- Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S. E., Eaton, P. R., Geels, D., Gummadi, R., Rhea, S. C., Weatherspoon, H., Weimer, W., Wells, C., and Zhao, B. Y. 2000. Oceanstore: An architecture for global-scale persistent storage. In Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems. 190--201.]] Google ScholarDigital Library
- Lee, E. K. and Thekkath, C. A. 1996. Petal: Distributed virtual disks. In Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems. 84--92.]] Google ScholarDigital Library
- Levine, C. 1997. Tpc-c: The oltp benchmark. In Proceedings of the ACM SIGMOD International Conference on Management of Data (Industrial Session 5).]]Google Scholar
- MacCormick, J., Murphy, N., Najork, M., Thekkath, C. A., and Zhou, L. 2004. Boxwood: Abstractions as the foundation for storage infrastructure. In Proceedings of the 6th Symposium on Operating System Design and Implementation. 105--120.]]Google Scholar
- McKusick, M. K., Joy, W. N., Leffler, S. J., and Fabry, R. S. 1984. A fast file system for unix. ACM Trans. Comput. Syst. 2, 3, 181--197.]] Google ScholarDigital Library
- McVoy, L. W. and Kleiman, S. R. 1991. Extent-Like performance from a unix file system. In Proceedings of the USENIX Winter Conference. 33--44.]]Google Scholar
- Menon, J., Pease, D. A., Rees, R. M., Duyanovich, L., and Hillsberg, B. 2003. Ibm storage tank---A heterogeneous scalable san file system. IBM Syst. J. 42, 2, 250--267.]] Google ScholarDigital Library
- Mesnier, M., Ganger, G. R., and Riedel, E. 2003. Object-Based storage. IEEE Communi. Mag. 41, 8, 84--90.]]Google ScholarDigital Library
- Meter, R. V. 1997. Observing the effects of multi-zone disks. In Proceedings of the USENIX Annual Technical Conference.]] Google ScholarDigital Library
- Ng, W. T., Hillyer, B., Shriver, E. A. M., Gabber, E., and Özden, B. 2002. Obtaining high performance for storage outsourcing. In Proceedings of the FAST Conference on File and Storage Technologies. 145--158.]] Google ScholarDigital Library
- Patterson, D. A., Gibson, G. A., and Katz, R. H. 1988. A case for redundant arrays of inexpensive disks (raid). In Proceedings of the ACM SIGMOD International Conference on Management of Data. 109--116.]] Google ScholarDigital Library
- Peacock, J. K. 1988. The counterpoint fast file system. In Proceedings of the USENIX Winter Conference. 243--249.]]Google Scholar
- Reiser, H. 2004. Reiserfs: Journaling file system for linux based on balance tree algorithms. http://www.namesys.com.]]Google Scholar
- Rosenblum, M. and Ousterhout, J. K. 1992. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst. 10, 1 (Feb.), 26--52.]] Google ScholarDigital Library
- Shaw, S. 2002. Hammerora: The open source oracle load test tool. http://hammerora.sourceforge.net.]]Google Scholar
- Sivathanu, M., Bairavasundaram, L. N., Arpaci-Dusseau, A. C., and Arpaci-Dusseau, R. H. 2004. Life or death at block-level. In Proceedings of the 6th Symposium on Operating System Design and Implementation. 379--394.]] Google ScholarDigital Library
- Sivathanu, M., Prabhakaran, V., Popovici, F. I., Denehy, T. E., Arpaci-Dusseau, A. C., and Arpaci-Dusseau, R. H. 2003. Semantically-Smart disk systems. In Proceedings of the FAST Conference on File and Storage Technologies.]] Google ScholarDigital Library
- Smith, K. A. and Seltzer, M. I. 1996. A comparison of ffs disk allocation policies. In Proceedings of the USENIX Annual Technical Conference. 15--26.]] Google ScholarDigital Library
- Veritas. 2002. Volume manager for windows with mscs. http://www.veritas.com/van/products/volumemanagerwin.html.]]Google Scholar
- VMware. 2000. Vmware workstation. http://www.itc.virginia.edu/atg/techtalks/powerpoint/vmware/sld018.htm.]]Google Scholar
- Vogels, W. 1999. File system usage in windows nt 4.0. In Proceedings of the 17th ACM Symposium on Operating System Principles. 93--109.]] Google ScholarDigital Library
- Wang, R. Y., Anderson, T. E., and Patterson, D. A. 1999. Virtual log based file systems for a programmable disk. In Proceedings of the 3rd USENIX Symposium on Operating Systems Design and Implementation. 29--43.]] Google ScholarDigital Library
- Wilkes, J., Golding, R. A., Staelin, C., and Sullivan, T. 1996. The hp autoraid hierarchical storage system. ACM Trans. Comput. Syst. 14, 1, 108--136.]] Google ScholarDigital Library
- Zadok, E., Iyer, R., Joukov, N., Sivathanu, G., and Wright, C. P. 2006. On incremental file system development. ACM Trans. Storage 2, 3. To appear.]] Google ScholarDigital Library
Index Terms
- An approach to virtual allocation in storage systems
Recommendations
Analysis of the Periodic Update Write Policy for Disk Cache
A disk cache is typically used in file systems to reduce average access time for data storage and retrieval. The 'periodic update' write policy, widely used in existing computer systems, is one in which dirty cache blocks are written to a disk on a ...
Storage systems for movies-on-demand video servers
MSS '95: Proceedings of the 14th IEEE Symposium on Mass Storage SystemsWe evaluate storage system alternatives for movies-on-demand video servers. We begin by characterizing the movies-on-demand workload. We briefly discuss performance in disk arrays. First, we study disk farms in which one movie is stored per disk. This ...
Performance Evaluation of Storage Systems Based on Network-Attached Disks
The emergence of network-attached disks provides the possibility of transferring data between the storage system and the client directly. This offers new possibilities in building a distributed storage system. In this paper, we examine different storage ...
Comments