Skip to main content

Storage Deduplication and Management for Application Testing over a Virtual Network Testbed

  • Conference paper
Book cover Testbeds and Research Infrastructure. Development of Networks and Communities (TridentCom 2011)

Abstract

With the virtual machine technologies, Virtual Ad hoc Network (VAN) testbed was designed to evaluate functional correctness and communication performance of Mobile Ad hoc Network (MANET) applications. When VAN is used for large-scale testing that requires hundreds of virtual machines, storage redundancy becomes an issue. Although Content Addressable Storage (CAS) techniques were designed to address the storage redundancy issue, it incurred online hash computation overhead for every write access to disk blocks, which affects testing accuracy. We present File-level Block Sharing (FBS) that achieves the same functionality of CAS while removing the online computation overhead. By getting file-to-block mappings through read-only mounting, FBS only needs to handle the blocks belonging to newly-installed files offline and thus incurs little online overhead. Our prototype showed no online overhead statistically and low offline overhead. The prototype was developed and its overhead with respect to block-level storage deduplication was analyzed under both Ext2/3/4 and NTFS file systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Poylisher, A., Serban, C., Lee, J., Lu, T.-C., Chadha, R., Chiang, C.-Y.J., Orlando, R., Jakubowski, K.: A Virtual Ad hoc Network Testbed. International Journal of Communicaiton Networks and Distributed Systems 5(1/2), 5–24 (2010)

    Article  Google Scholar 

  2. Pfaff, B., Garfinkel, T., Rosenblum, M.: Virtualization Aware File Systems: Getting Beyond the Limitations of Virtual Disks. In: 3rd Symposium on Networked Systems Design and Implementation, San Jose, California, pp. 353–366 (2006)

    Google Scholar 

  3. Hong, B., Plantenberg, D., Long, D.D.E., Sivan-Zimet, M.: Duplicate Data Elimination in a SAN File System. In: 21st IEEE/12th NASA Goddard Symposium on Mass Storage Systems, Adelphi, Maryland, pp. 101–114 (2004)

    Google Scholar 

  4. Bonnie++ benchmark suite, http://www.coker.com.au/bonnie++/

  5. Clements, A.T., Ahmad, I., Vilayannur, M., Li, J.: Decentralized Deduplication in SAN Cluster File Systems. In: USENIX Annual Technical Conference, San Diego, California (2009)

    Google Scholar 

  6. Teigland, D.: Volume Managers in Linux. In: USENIX Annual Technical Conference, Boston, Massachusetts, pp. 185–198 (2001)

    Google Scholar 

  7. Quigley, D., Sipek, J., Wright, C.P., Zadok, E.: Unionfs: User- and Community-Oriented Development of a Unification File System. In: Linux Symposium, Ottawa, Canada, pp. 349–362 (2006)

    Google Scholar 

  8. Menon, J., Pease, D.A., Rees, R., Dulanovich, L., Hillsburg, B.: IBM Storage Tank-A Heterogeneous Scalable SAN File System. IBM Systems Journal 42(2), 250–267 (2003)

    Article  Google Scholar 

  9. Oracle VirtualBox, http://www.virtualbox.org/

  10. OpenSSL cryptography library, http://www.openssl.org/

  11. Biswas, P.K., Serban, C., Poylisher, A., Lee, J., Mau, S., Chadha, R., Chiang, C.J.: An Intergrated Testbed for Virtual Ad Hoc Networks. In: 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities Internet, Washington D.C, pp. 1–10 (2009)

    Google Scholar 

  12. Radkov, P., Yin, L., Goyal, P., Sarkar, P., Shenoy, P.: A Performance Comparison of NFS and iSCSI for IP-Networked Storage. In: 3rd USENIX Conference on File and Storage Technologies, San Francisco, California (2004)

    Google Scholar 

  13. Geambasu, R., John, J.P.: Study of Virtual Machine Performance over Network File System. University of Washington Technical Report (2006)

    Google Scholar 

  14. Lu, Y., Du, D.H.C.: Performance Study of iSCSI-Based Storage Subsystems. IEEE Communications Magazine, 76–82 (2003)

    Google Scholar 

  15. Clark, T.: Storage virtualization: technologies for simplifying data storage and management. Addison Wesley (2005)

    Google Scholar 

  16. VMWare: VMWare Virtual Machine File System: Technical Overview and Best Practices. VMWare Technical report, http://www.vmware.com/pdf/vmfs-best-practices-wp.pdf (retrived on November 30, 2010)

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Jong, CH., Chiang, PJ., Lu, T., Chiang, CY. (2012). Storage Deduplication and Management for Application Testing over a Virtual Network Testbed. In: Korakis, T., Li, H., Tran-Gia, P., Park, HS. (eds) Testbeds and Research Infrastructure. Development of Networks and Communities. TridentCom 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 90. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29273-6_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29273-6_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29272-9

  • Online ISBN: 978-3-642-29273-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics