Skip to main content

Exploiting Recurring Usage Patterns to Enhance Filesystem and Memory Subsystem Performance

  • Conference paper
Advances in Knowledge Discovery and Data Mining (PAKDD 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3056))

Included in the following conference series:

Abstract

In many cases, normal uses of a system form patterns that will repeat. The most common patterns can be collected into a prediction model which will essentially predict that usage patterns common in the past will occur again in the future. Systems can then use the prediction models to provide advance notice to their implementations about how they are likely to be used in the near future. This technique creates opportunities to enhance system implementation performance since implementations can be better prepared to handle upcoming usage.

The key component of our system is the ability to intelligently learn about system trends by tracking file system and memory system activity patterns. The usage data that is tracked can be subsequently queried and visualized. More importantly, this data can also be mined for intelligent qualitative and quantitative system enhancements including predictive file prefetching, selective file compression and and application-driven adaptive memory allocation. We conduct an in-depth performance evaluation to demonstrate the potential benefits of the proposed system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kroeger, T.M., Long, D.D.E.: The case for efficient file access pattern modeling. In: Proceedings of the 1996 USENIX Technical Conference (January 1996)

    Google Scholar 

  2. Lee, K.F., Mahajan, S.: Automatic Speech Recognition: The Development of the SPHINX System. Kluwer Publishers, Dordrecht (1989)

    Google Scholar 

  3. Su, Y.L.Z., Yang, Q., Zhang, H.-J.: Whatnext: A prediction system for web requests using n-gram sequence models. In: Proceedings of the First International Conference on Web Information System and Engineering Conference (2000)

    Google Scholar 

  4. Mowry, T.C., Demke, A.K., Krieger, O.: Automatic compilerinserted I/O prefetching for out-of-core applications. In: Proceedings of the 1996 Symposium on Operating Systems Design and Implementation, pp. 3–17. USENIX Association (1996)

    Google Scholar 

  5. Brown, A.D., Mowry, T.C.: Taming the memory hogs: Using Compiler-Inserted releases to manage physical memory intelligently. In: Proceedings of the 4th Symposium on Operating Systems Design and Implementation (OSDI 2000), pp. 31–44 (2000)

    Google Scholar 

  6. Zukerman, I., Albrecht, D., Nicholson, A.: Predicting users’ requests on the WWW. In: UM 1999 – Proceedings of the Seventh International Conference on User Modeling (1999)

    Google Scholar 

  7. Grunwald, D., Zorn, B.G.: Customalloc: Efficient synthesized memory allocators. Software - Practice and Experience 23(8), 851–869 (1993)

    Article  Google Scholar 

  8. Parthasarathy, S., Zaki, M.J., Li, W.: Memory placement techniques for parallel association mining. In: Knowledge Discovery and Data Mining, pp. 304–308 (1998)

    Google Scholar 

  9. Agrawal, R., Srikant, R.: Fast algorithms for mining association rules. In: Proceedings of the 20th International Conference on Very Large Databases (September 1995)

    Google Scholar 

  10. Borgelt, C., Kruse, R.: Induction of association rules: A priori implementation, http://citeseer.nj.nec.com/547526.html

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rutt, B., Parthasarathy, S. (2004). Exploiting Recurring Usage Patterns to Enhance Filesystem and Memory Subsystem Performance. In: Dai, H., Srikant, R., Zhang, C. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2004. Lecture Notes in Computer Science(), vol 3056. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24775-3_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24775-3_59

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22064-0

  • Online ISBN: 978-3-540-24775-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics