Abstract
Caching jukeboxes combine the low media cost of CD and DVD with the higher performance of magnetic disk drives. We propose and evaluate the combination of aggressive file prefetching based on the a priori affinity among a file’s blocks, with block-level usage tracking and removal. This apparently-inconsistent approach takes into account the usage time constants rather than merely the relative performance of two storage levels: the expected lifetime of a block in the large disk cache is long, rendering the fine-grain usage information much more meaningful than in higher levels of the memory hierarchy. Preliminary measurements carried out on our IntelliJuke prototype, along with comparative simulations, confirm the direct cost-performance benefits of our approach. One side benefit is increased effective mechanical reliability of the jukebox. Finally, this work motivates the support of sparse files on disk and illustrates the benefits of making additional information available to storage systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smith, A.J., “Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms,” IEEE Transactions on Software Engineering, vol. 7no. 4, 1981, pp. 403–417.
Gibson, T., Miller, E.L., Long, D., “Long-term File Activity and Inter-Reference Patterns,” submitted to the CMG’ 98 Conference, December 1998, Anaheim, CA.
Baker, M.G., Hartman, J.H., Kupfer, M.D., Shirriff, K.W., and Ousterhout, J.K., “Measurements of a Distributed File System,” Proceedings of the 13 th ACM Symposium on Operating Systems Principles, 1991, pp. 198–212.
Ousterhout, J.K., Da Costa, H., Harrison, D., Kunze, J.A., Kupfer, M.,and Thompson, J.G.,“A Trace-Driven Analysis of the UNIX 4.2 BSD File System,” Proceedings of the 10 th Symposium on Operating System Principles, Orcas Island, WA, December 1985, pp. 15–24.
Smith, A.J., “Long Term File Migration: Development and Evaluation of Algorithms,” Communications of the ACM, vol. 24no. 8, 1981, pp. 521–532.
Strange, S., “Analysis of Long-Term Unix File Access Patterns for Application to Automatic File Migration Strategies,” Technical Report UCB/CSD-92-700, Computer Science Division (EECS), University of California, Berkeley, CA, 1992.
Gibson, T., Long-term File System Activity and the Efficacy of Automatic File Migration, Computer Science Doctoral Dissertation, University of Maryland Baltimore County, May 1998.
Johnson, T., and Shasha, D., “2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm,” Proceedings of the 20 th Very Large Database (VLDB) Conference, Santiago, Chile, 1994, pp. 439–450.
O’Neil, E.J., O’Neil, P.E., and Weikum, G., “The LRU-k Page Replacement Algorithm for Database Disk Buffering,” Proc. 1993 ACM SIGMOD International Conference on Management of Data, 1993, pp. 297–306.
Menon, J., and Treiber, K., “Daisy: Virtual-disk Hierarchical Storage Manager,” SIGMETRICS Performance Evaluation Review, vol. 25no. 3, 1997, pp.37–44.
Rochberg, D.,and Gibson, G.,“Prefetching Over a Network: Early Experience with CTIP,” SIGMETRICS Performance Evaluation Review, vol. 25no.3, 1997, pp. 29–36.
Howard, J.H., Kazar, M.L., Menees, S.G., Nichols, D.A., Satyanarayanan, M., Sidebotham, R.N., and West, M.J., “Scale and Performance in a Distributed File System,” ACM Transactions on Computer Systems, vol. 6no.1, Feb. 1988, pp. 51–81.
Nelson, M.N., Welch, B.B., and Ousterhout, J.K., “Caching in the Sprite Network File System,” ACM Transactions on Computer Systems, vol. 6no. 1, Feb. 1988, pp.134–154.
Satyanarayanan, M., Kistler, J.J., Kumar, P., Okasaki, M.E., Siegel, E.H., and Steere, D.C. “Coda: A Highly Available File System for a Distributed Workstation Environment,” IEEE Transactions on Computers, vol. 39no. 4, Apr. 1990, pp. 447–459.
Sandberg, R., Goldberg, D., Kleiman, S., Walsh, D., and Lyon, B., “Design and Implementation of the Sun Network File System,” Proc. of the Summer 1985 USENIX, June 1985, pp. 119–130.
Ixos Inc., web site: http://www.ixos.com
Ornetix Inc., web site: http://www.ornetix.com
SmartStorage Inc., web site: http://www.smartstorage.com
TenX Technology Inc., 100 Mbit Ethernet TenXpert CD-ROM File Server Reference Manual, P/N 25-079, April 1998.
SilverPlatter Information inc., ERL Administrator’s Manual, September 1998.
Govrin, A.I., Herzberg, R., Kareev, U., Rosenberg, E., and Zangi, E., “IntelliJuke-A Smart Hierarchical Storage Server,” Parallel Systems Lab Project Reports, Elec. Eng. Dept. Technion, Israel Institute of Technology, 1996.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Birk, Y., Mokryn, M. (1999). Cost-Effective Jukebox Storage via Hybrid File-Block Caching. In: Pinter, R.Y., Tsur, S. (eds) Next Generation Information Technologies and Systems. NGITS 1999. Lecture Notes in Computer Science, vol 1649. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48521-X_13
Download citation
DOI: https://doi.org/10.1007/3-540-48521-X_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66225-9
Online ISBN: 978-3-540-48521-6
eBook Packages: Springer Book Archive