Abstract
Traditional network file systems, like NFS, do not extend to wide-area due to low bandwidth and high network latency. We present WireFS, a Wide Area File System, which enables delegation of metadata management to nodes at client sites (homes). The home of a file stores the most recent copy of the file, serializes all updates, and streams updates to the central file server. WireFS uses access history to migrate the home of a file to the client site which accesses the file most frequently.
We formulate the home migration problem as an integer programming problem, and present two algorithms: a dynamic programming approach to find the optimal solution, and a non-optimal but more efficient greedy algorithm. We show through extensive simulations that even in the WAN setting, access latency over WireFS is comparable to NFS performance in the LAN setting; the migration overhead is also marginal.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Callaghan, B., Pawlowski, B., Staubach, P.: NFS Version 3 Protocol Specification, RFC 1813. IETF, Network Working Group (1995)
Microsoft Corporation: Cifs: Common internet file system (2006), http://msdn.microsoft.com/library/default.asp?url=/library/en-us/cifs/protocol/portalcifs.asp
Muthitacharoen, A., Chen, B., Mazières, D.: A low-bandwidth network file system. In: Proc. of SOSP 2001 (2001)
Annapureddy, S., Freedman, M.J., Mazières, D.: Shark: Scaling File Servers via Cooperative Caching. In: Proc. of NSDI 2005 (2005)
Krishnan, P., Raz, D., Shavitt, Y.: The cache location problem. IEEE/ACM Trans. on Networking 8(5), 568–582 (2000)
Shah, R., et al.: Efficient dissemination of personalized information using content-based multicast. IEEE Trans. on Mobile Computing 3(4), 394–408 (2004)
Tamir, A.: An o(pn 2) algorithm for the p-median and related problems on tree graphs. Operations Research Letters 19, 59–64 (1996)
Mazieres, D.: A toolkit for user-level file systems. In: Proc. Usenix 2001, Boston, MA (2001)
Ellard, D., Seltzer, M.: New NFS Tracing Tools and Techniques for System Analysis. In: Proc. of LISA 2003, pp. 73–86 (2003)
Stribling, J.: All-Pairs-Pings for PlanetLab (2005), http://pdos.csail.mit.edu/~strib/pl_app/
Kistler, J., Satyanarayanan, M.: Disconnected Operation in the Coda File System. ACM Trans. on Computer Systems 10(1), 3–25 (1992)
Birrell, A.D., et al.: The Echo Distributed File System. Technical Report 111, DEC SRC (1993)
Nelson, M.N., Welch, B.B., Ousterhout, J.K.: Caching in the sprite network file system. ACM Trans. Comput. Syst. 6(1), 134–154 (1988)
Hartman, J.H., Ousterhout, J.K.: The Zebra Striped Network File System. ACM Trans. on Computer Systems 13(3), 274–310 (1995)
Satyanarayanan, M.: A survey of distributed file systems. Technical Report CMU-CS-89-116, Carnegie Mellon University, Pittsburgh, Pennsylvania (1989)
Dabek, F., et al.: Wide-area cooperative storage with CFS. In: Proc. of SOSP 2001 (2001)
Rowstron, A., Druschel, P.: Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In: Proc. of SOSP 2001 (2001)
Kubiatowicz, J., et al.: OceanStore: an Architecture for Global-Scale Persistent Storage. In: Proc. of ASPLOS 2000, pp. 190–201 (2000)
Muthitacharoen, A., et al.: Ivy: A read/write peer-to-peer file system. In: Proc. of OSDI 2002 (2002)
Peterson, L., et al.: A Blueprint for Introducing Disruptive Technology into the Internet. In: Proc. of HotNets 2002 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liang, J., Bohra, A., Zhang, H., Ganguly, S., Izmailov, R. (2006). Minimizing Metadata Access Latency in Wide Area Networked File Systems. In: Robert, Y., Parashar, M., Badrinath, R., Prasanna, V.K. (eds) High Performance Computing - HiPC 2006. HiPC 2006. Lecture Notes in Computer Science, vol 4297. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11945918_32
Download citation
DOI: https://doi.org/10.1007/11945918_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68039-0
Online ISBN: 978-3-540-68040-6
eBook Packages: Computer ScienceComputer Science (R0)