Abstract
Developers often describe testing as being tedious and boring. This work challenges this notion; we describe tools and methodologies crafted to test object-based storage devices (OSDs) for correctness and compliance with the T10 OSD standard. A special consideration is given to test the security model of an OSD implementation. Additionally, some work was carried out on building OSD benchmarks. This work can be a basis for a general-purpose benchmark suite for OSDs in the future, as more OSD implementations emerge. Originally designed to test performance, it was surprisingly useful for discovering unexpected peculiar behaviors and special type of bugs that are otherwise not considered bugs.
The tool described here has been used to verify object-disks built by Seagate and IBM research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aharon, A., Goodman, D., Levinger, M., Lichtenstein, Y., Malka, Y., Metzger, C., Molcho, M., Shurek, G.: Test program generation for functional verificatio of powerpc processors in ibm. In: DAC 1995: Proceedings of the 32nd ACM/IEEE conference on Design automation, pp. 279–285. ACM Press, New York (1995)
Arkoudas, K., Zee, K., Kuncak, V., Rinard, M.: Verifying a File System Implementation. In: Davies, J., Schulte, W., Barnett, M. (eds.) ICFEM 2004. LNCS, vol. 3308, pp. 373–390. Springer, Heidelberg (2004)
Chen, P.M., Patterson, D.A.: A new approach to i/o performance evaluation: self-scaling i/o benchmarks, predicted i/o performance. ACM Transactions on Computer Systems (TOCS)Â 12(4) (November 1994)
DeMillo, R.A., Offutt, A.J.: Constraint-based test data generation. IEEE Transactions on Software Engineering 17(9) (1991)
A Demonstration of an OSD-based File System. In: Storage Networking World Conference, Spring 2005 (April 2005)
Factor, M., Meth, K., Naor, D., Rodeh, O., Satran, J.: Object storage: The future building block for storage systems. a position paper. In: Proceedings of the 2nd International IEEE Symposium on Mass Storage Systems and Technologies, Sardinia Italy, June 2005, pp. 119–123 (2005)
IOZone Filesystem Benchmark, http://www.iozone.org/
The Linux 2.6.10 SCSI Mid-layer Implementation, scsi_do_req API
NetApp. The PostMark Benchmark, http://www.netapp.com/tech_library/3022.html
A T10 iSCSI OSD Initiator, http://sourceforge.net/projects/osd-initiator
IBM Object Storage Device Simulator for Linux. Released on IBM’s AlphaWorks, http://www.alphaworks.ibm.com/tech/osdsim
Seltzer, M.I., Smith, K.A., Balakrishnan, H., Chang, J., McMains, S., Padmanabhan, V.N.: File system logging versus clustering: A performance comparison. In: USENIX Winter, pp. 249–264 (1995)
SNIA - Storage Networking IndustryAssociation. OSD:Object Based Storage Devices Technical Work Group, http://www.snia.org/tech_activities/workgroups/osd/
Standard Performance Evaluation Corporation. SPEC SFS97 R1 V3.0 Benchmarks (August 2004), http://www.spec.org/sfs97r1
Tan, Y.-L., Wong, T., Strunk, J.D., Ganger, G.R.: Comparison-based File Server Verification. In: USENIX 2005. Annual Technical Conference (April 2005)
Weber, R.O.: SCSI Object-Based Storage Device Commands (OSD), DocumentNumber: ANSI/INCITS 400-2004. InterNational Committee for Information Technology Standards (formerly NCITS) (December 2004), http://www.t10.org/drafts.htm
Yang, J., Twohey, P., Engler, D.R., Musuvathi, M.: Using Model Checking to Find System Errors. In: OSDI, pp. 273–288 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Naor, D., Reshef, P., Rodeh, O., Shafrir, A., Wolman, A., Yaffe, E. (2006). Benchmarking and Testing OSD for Correctness and Compliance. In: Ur, S., Bin, E., Wolfsthal, Y. (eds) Hardware and Software, Verification and Testing. HVC 2005. Lecture Notes in Computer Science, vol 3875. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11678779_12
Download citation
DOI: https://doi.org/10.1007/11678779_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32604-5
Online ISBN: 978-3-540-32605-2
eBook Packages: Computer ScienceComputer Science (R0)