research-article

Panache: a parallel WAN cache for clustered filesystems

Authors:

M. Naik,

R. TewariAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 42, Issue 1

Pages 48 - 53

https://doi.org/10.1145/1341312.1341322

Published: 01 January 2008 Publication History

Get Access

Abstract

Panache is a scalable, high-performance, remote file data caching solution integrated with the GPFS cluster file system. It leverages the inherent scalability of GPFS to provide a multi-node, consistent cache of data exported by a remote file system cluster. Panache exploits the soon-to-be standard pNFS protocol to move data in parallel from the remote file cluster. Furthermore, it provides a POSIX compliant file system interface making the cache completely transparent to applications. Panache can mask the fluctuating wide-area-network latencies and outages by supporting asynchronous and disconnected-mode operations. It allows concurrent updates to be made at the cache and at the remote cluster and synchronizes them by using conflict detection techniques to flag and handle conflicts. To maintain commercial viability, Panache relies on open standards for high-performance file serving and does not require any proprietary hardware or software to be deployed at the remote cluster. In this paper we present the overall architecture of Panache and its key features.

References

[1]

IOR Benchmark: Scalable I/O Project http://www.llnl.gov/icc/lc/siop.

Google Scholar

[2]

OpenAFS: http://www.openafs.org.

Google Scholar

[3]

G. Gibson, B. Welch, G. Goodson, and P. Corbett. Parallel NFS Requirements and Design Considerations. IETF Draft.

Google Scholar

[4]

J. Howard and et al. An Overview of the Andrew Filesystem. In Usenix Winter Techinal Conference, Februrary 1988.

Google Scholar

[5]

J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Trans. Comput. Syst., 6(1):51--81, 1988.

Digital Library

Google Scholar

[6]

D. Howells. FS-Cache: A Network Filesystem Caching Facility. In Proceedings of the Ottawa Linux Symposium, 2006.

Google Scholar

[7]

D. Muntz and P. Honeyman. Multi-level Caching in Distributed File Systems. In Proceedings of the USENIX Winter 1992 Technical Conference, pages 305--313, San Fransisco, CA, USA, 1992.

Google Scholar

[8]

Packeteer Inc. Wide Area File Services: Delivering on the Promse of Storage and Server Consolidation at the Branch Office. http://www.packeteer.com/resources/prodsol/WAFS_WP.pdf.

Google Scholar

[9]

M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere. Coda: A Highly Available File System for a Distributed Workstation Environment. IEEE Transactions on Computers, 39(4):447--459, 1990.

Digital Library

Google Scholar

[10]

F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In Proc. of the First Conference on File and Storage Technologies (FAST), pages 231--244, Jan. 2002.

Digital Library

Google Scholar

[11]

S. Shepler and et al. NFS version 4 Protocol. RFC 3530.

Google Scholar

[12]

G. Sivathanu and E. Zadok. A Versatile Persistent Caching Framework for File Systems. Technical report.

Google Scholar

Cited By

View all

Xu HLiu X(2018)Cooperating with high available write cache and local read only buffer to reduces the latency of small read and writeProceedings of the 3rd International Conference on Big Data and Computing10.1145/3220199.3220210(44-48)Online publication date: 28-Apr-2018
https://dl.acm.org/doi/10.1145/3220199.3220210
Tu TRendleman CMiller PSacerdoti FDror RShaw D(2010)Accelerating parallel analysis of scientific simulation data via ZazenProceedings of the 8th USENIX conference on File and storage technologies10.5555/1855511.1855521(10-10)Online publication date: 23-Feb-2010
https://dl.acm.org/doi/10.5555/1855511.1855521
Lebutsch DBolik CHennecke M(2010)Content Management as a Service—Financial Archive CloudDatenbank-Spektrum10.1007/s13222-010-0028-010:3(131-142)Online publication date: 6-Nov-2010
https://doi.org/10.1007/s13222-010-0028-0
Show More Cited By

Index Terms

Panache: a parallel WAN cache for clustered filesystems
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Distributed memory
    2. Software system structures
      1. Distributed systems organizing principles

Recommendations

Large files, small writes, and pNFS
ICS '06: Proceedings of the 20th annual international conference on Supercomputing

Workload characterization studies highlight the prevalence of small and sequential data requests in scientific applications. Parallel file systems excel at large data transfers but sometimes at the expense of small I/O performance. pNFS is an NFSv4.1 ...
Research of Massive Small Files Reading Optimization Based on Parallel Network File System
HPCC-CSS-ICESS '15: Proceedings of the 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conf on Embedded Software and Systems

With the rapid development of cloud computing and big data, there are more and more small files. How to manage those massive small files efficiently and provide low-latency service is becoming a hot topic in Parallel Network File System (pNFS). When ...
tpNFS: Efficient Support of Small Files Processing over pNFS
IPDPSW '13: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and PhD Forum

Large scale data-intensive applications that consume and produce terabytes or even pet bytes of data raise an ever increasing demand on I/O bandwidth. In order to meet this demand, NFSv4 architects design parallel NFS (pNFS), an NFS extension allowing ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 42, Issue 1

January 2008

133 pages

ISSN:0163-5980

DOI:10.1145/1341312

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2008

Published in SIGOPS Volume 42, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
563
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xu HLiu X(2018)Cooperating with high available write cache and local read only buffer to reduces the latency of small read and writeProceedings of the 3rd International Conference on Big Data and Computing10.1145/3220199.3220210(44-48)Online publication date: 28-Apr-2018
https://dl.acm.org/doi/10.1145/3220199.3220210
Tu TRendleman CMiller PSacerdoti FDror RShaw D(2010)Accelerating parallel analysis of scientific simulation data via ZazenProceedings of the 8th USENIX conference on File and storage technologies10.5555/1855511.1855521(10-10)Online publication date: 23-Feb-2010
https://dl.acm.org/doi/10.5555/1855511.1855521
Lebutsch DBolik CHennecke M(2010)Content Management as a Service—Financial Archive CloudDatenbank-Spektrum10.1007/s13222-010-0028-010:3(131-142)Online publication date: 6-Nov-2010
https://doi.org/10.1007/s13222-010-0028-0
Cohen DPetrini FDay MBen-Yehuda MHunter SCummings U(2009)Applying Amdahl's other law to the data centerIBM Journal of Research and Development10.5555/1850670.185067553:5(683-694)Online publication date: 1-Sep-2009
https://dl.acm.org/doi/10.5555/1850670.1850675

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Large files, small writes, and pNFS

Research of Massive Small Files Reading Optimization Based on Parallel Network File System

tpNFS: Efficient Support of Small Files Processing over pNFS

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations