Skip to main content

Adaptive Sequential Prefetching for Multiple Streams

  • Conference paper
Web-Age Information Management (WAIM 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7901))

Included in the following conference series:

  • 1499 Accesses

Abstract

Modern storage systems are becoming increasingly consolidated. As a result, there exists a competition for resources among concurrent streams. Sequential prefetching is widely used in modern storage system. Most of them always ignore the impact of diversified access rate of concurrent streams. However the concurrent streams with diversified access rate will introduce several problems. The streams with fast access rate may evict the cache blocks of the streams with slow access rate and lead the slow streams re-fetch the evicted cache blocks in future access, which makes the prefetching wastage and unfairness to the slow streams. We design and implement a novel, adaptive algorithm, named ASPM to solve these problems. Our experiments show that, compared with LRU and AMP, ASPM can achieve significantly improvement in fairness among concurrent streams and slightly in performance (average on 6.8%).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Carr, R.W., Hennessy, J.L.: WSCLOCK-a simple and effective algorithm for virtual memory management. SIGOPS Oper. Syst. Rev. 15, 87–95 (1981)

    Article  Google Scholar 

  2. O’Neil, E.J., O’Neil, P.E., Weikum, G.: The LRU-K page replacement algorithm for database disk buffering. SIGMOD Rec. 22, 297–306 (1993)

    Article  Google Scholar 

  3. O’Neil, E.J., O’Neil, P.E., Weikum, G.: An optimality proof of the LRU-K page replacement algorithm. J. ACM 46, 92–112 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  4. Jiang, S., Zhang, X.: LIRS: an efficient low inter-reference recency set replacement policy to improve buffer cache performance. SIGMETRICS Perform. Eval. Rev. 30, 31–42 (2002)

    Article  Google Scholar 

  5. Zhou, Y., Philbin, J., Li, K.: The Multi-Queue Replacement Algorithm for Second Level Buffer Caches. In: Proceedings of the General Track: 2002 USENIX Annual Technical Conference, pp. 91–104. USENIX Association (2001)

    Google Scholar 

  6. Li, Z., Chen, Z., Srinivasan, S.M., Zhou, Y.: C-Miner: mining block correlations in storage systems. In: Proceedings of the 3rd USENIX Conference on File and Storage Technologies, p. 13. USENIX Association, San Francisco (2004)

    Google Scholar 

  7. Gill, B.S., Modha, D.S.: SARC: sequential prefetching in adaptive replacement cache. In: Proceedings of the Annual Conference on USENIX Annual Technical Conference, p. 33. USENIX Association, Anaheim (2005)

    Google Scholar 

  8. Gill, B.S., Bathen, L.A.D.: AMP: adaptive multi-stream prefetching in a shared cache. In: Proceedings of the 5th USENIX Conference on File and Storage Technologies, p. 26. USENIX Association, San Jose (2007)

    Google Scholar 

  9. Zhang, Z., Kulkarni, A., Ma, X., Zhou, Y.: Memory resource allocation for file system prefetching: from a supply chain management perspective. In: Proceedings of the 4th ACM European Conference on Computer Systems, pp. 75–88. ACM, Nuremberg (2009)

    Chapter  Google Scholar 

  10. Bucy, J.S., Schindler, J., Schlosser, S.W., Ganger, G.R., Contributors: The DiskSim simulation environment version 4.0 reference manual (2008)

    Google Scholar 

  11. Lab, O.S.D.: Iometer I/O performance analysis tool (2003)

    Google Scholar 

  12. Axboe, J., Brunelle, A.D., Scott, N.: blktrace(8) - linux man page (2013)

    Google Scholar 

  13. Li, M., Varki, E., Bhatia, S., Merchant, A.: TaP: table-based prefetching for storage caches. In: Proceedings of the 6th USENIX Conference on File and Storage Technologies, pp. 1–16. USENIX Association, San Jose (2008)

    Google Scholar 

  14. Liang, S., Jiang, S., Zhang, X.: STEP: Sequentiality and Thrashing Detection Based Prefetching to Improve Performance of Networked Storage Servers. In: Proceedings of the 27th International Conference on Distributed Computing Systems, p. 64. IEEE Computer Society (2007)

    Google Scholar 

  15. Patterson, R.H., Gibson, G.A., Ginting, E., Stodolsky, D., Zelenka, J.: Informed prefetching and caching. SIGOPS Oper. Syst. Rev. 29, 79–95 (1995)

    Article  Google Scholar 

  16. Wachs, M., Abd-El-Malek, M., Thereska, E., Ganger, G.R.: Argon: performance insulation for shared storage servers. In: Proceedings of the 5th USENIX Conference on File and Storage Technologies, p. 5. USENIX Association, San Jose (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Li, Y., Feng, D., Shi, Z., Liu, Q. (2013). Adaptive Sequential Prefetching for Multiple Streams. In: Gao, Y., et al. Web-Age Information Management. WAIM 2013. Lecture Notes in Computer Science, vol 7901. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39527-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-39527-7_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-39526-0

  • Online ISBN: 978-3-642-39527-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics