Abstract
Caching has been intensively used in memory and traditional file systems to improve system performance. However, the use of caching in parallel file systems has been limited to I/O nodes to avoid cache coherence problems. In this paper we present the cache mechanisms implemented in ParFiSys, a parallel file system developed at the UPM. ParFiSys exploits the use of cache, both at processing and I/O nodes, with aggressive pre-fetching and delayed-write techniques. The cache coherence problem is solved by using a dynamic scheme of cache coherence protocols with different sizes and shapes of granularity. Performance results, obtained on an IBM SP2, are presented to demonstrate the advantages offered by the cache management methods used in ParFiSys.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Burrows, M.: Efficient Data Sharing. PhD thesis, Computer Laboratory, University of Cambridge (December 1988)
Carretero, J.: Un Sistema de Ficheros Paralelo con Coherencia de Cache para Multiprocesadores de Proposito General. PhD thesis, Universidad Politécnica de Madrid (May 1995)
Carretero, J., Pérez, F., De Miguel, P., García, F., Alonso, L.: Performance Increase Mechanisms for Parallel and Distributed File Systems. Parallel Computing 23, 525–542 (1997)
Choudhary, A., Bordawekar, R., More, S., Sivaram, K., Thakur, R.: PASSION Runtime Library for the Intel Paragon. In: Proceedings of the Intel Supercomputer User’s Group Conference (June 1995)
Corbett, P., Feitelson, D.: The Vesta Parallel File System. ACM Transactions on Computer Systems 14, 225–264 (1996)
Corbett, P., et al.: MPI-IO: A Parallel File I/O Interface for MPI. Technical Report NAS-95-002, NASA Ames Research Center (June 1995)
Cortes, T., Girona, S., Labarta, J.: Design Issues of a Cooperative Cache with no Coherence Problems. In: 5th Workshop on I/O in Parallel and Distributed Systems (IOPADS 1997), San Jose, CA (November 1997)
High Performance Fortran Forum.: High Performance Fortran Language Specification (May 1993)
García, F.: Coherencia de Cache en Sistemas de Ficheros para Entornos Distribuidos y Paralelos. PhD thesis, Universidad Politécnica de Madrid, España (September 1996)
García, F., Carretero, J., Pérez, F., De Miguel, P., Alonso, L.: Cache Coherence in Parallel and Distributed File Systems. In: 5th EUROMICRO Workshop on Parallel and Distributed Processing, pp. 60–65. IEEE, London (1997)
Gibson, G.: The Scotch Paralell Storage Systems. Technical Report CMU-CS-95-107, Scholl of Computer Science. Carnegie Mellon University, Pittsburbh, Pennsylvania (1995)
Howard, J., et al.: Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems 6(1), 51–81 (1988)
Huber, J., et al.: PPFS: A High Performance Portable Parallel File System. In: Proceedings of the 9th ACM International Conference on Supercomputing, July 1995, pp. 385–394 (1995)
Kotz, D.: Prefetching and Caching Techniques in File Systems for MIMD Multiprocessors. PhD thesis, Duke University, USA (April 1991)
Kotz, D.: Multiprocessor file system interfaces. In: Proceedings of the 2nd International Conference on Parallel and Distributed Information Systems, May 1993, pp. 194–201 (1993)
Kotz, D., Nieuwejaar, N.: File System Workload on a Scientific Multiprocessor. IEEE Parallel and Distributed Technology. Systems and Applications, 134–154 (Spring 1995)
Moyer, S.A., Sunderam, V.S.: Scalable Concurrency Control for Parallel File Systems. Technical Report CSTR-950202, Department of Math and Computer Science, Emory University, Atlanta, GA 30322, USA (1995)
Nelson, M., Welch, B., Ousterhout, J.: Caching in the Sprite Network File System. ACM Transactions on Computer Systems 6(1), 134–154 (1988)
Nieuwejaar, N., Kotz, D.: The Galley Parallel File System. Technical Report PCSTR96-286, Darmouth College Computer Science (1996)
Pieper, J.: Parallel I/O Systems for Multicomputers. Technical Report CMU-CS- 89-143, Carnegie Mellon University, Computer Science Department, Pittsburgh, USA (1989)
Purakayastha, A., Ellis, C.S., Kotz, D.: ENWRICH: A Computer-Processor Write Caching Scheme for Parallel File Systems. Technical Report TRCS-1995-22, Department of Computer Science, Duke University, Durhan North Carolina (October 1995)
Del Rosario, J., Choudhary, A.: High-Performance I/O for Massively Parallel Computers. IEEE Computer, 59–68 (March 1994)
Sandberg, R., et al.: Design and Implementation of the SUN Network Filesystem. In: Proceedings of the 1985 USENIX Conference. USENIX (1985)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
García, F., Carretero, J., Pérez, F., de Miguel, P. (1999). High Performance Cache Management for Parallel File Systems. In: Hernández, V., Palma, J.M.L.M., Dongarra, J.J. (eds) Vector and Parallel Processing – VECPAR’98. VECPAR 1998. Lecture Notes in Computer Science, vol 1573. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10703040_35
Download citation
DOI: https://doi.org/10.1007/10703040_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66228-0
Online ISBN: 978-3-540-48516-2
eBook Packages: Springer Book Archive