Skip to main content
SpringerLink
Log in

Integrating Web Prefetching and Caching Using Prediction Models

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Web caching and prefetching have been studied in the past separately. In this paper, we present an integrated architecture for Web object caching and prefetching. Our goal is to design a prefetching system that can work with an existing Web caching system in a seamless manner. In this integrated architecture, a certain amount of caching space is reserved for prefetching. To empower the prefetching engine, a Web-object prediction model is built by mining the frequent paths from past Web log data. We show that the integrated architecture improves the performance over Web caching alone, and present our analysis on the tradeoff between the reduced latency and the potential increase in network load.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. M. Arlitt, R. F. L. Cherkasova, J. Dilley, and T. Jin, “Evaluating content management techniques for Web proxy caches,” HP Technical Report, Palo Alto, 1999.

  2. P. Cao, E. W. Felten, A. R. Karlin, and K. Li, “A study of integrated prefetching and caching strategies,” in Proc. of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 1995.

  3. P. Cao and S. Irani, “Cost-aware WWW proxy caching algorithms,” in USENIX Symposium on Internet Technology and Systems, Monterey, CA, USA, 1997, pp. 193-206.

  4. L. Cherkasova, “Improving WWW proxies performance with greedy-dual-size-frequency caching policy,” HP Technical Report, Palo Alto, 1998.

  5. K. Chinen and S. Yamaguchi, “An interactive prefetching proxy server for improvement of WWW latency,” in Proc. of the 7th Annual Conf. of the Internet Society (INET'97), Kuala Lumpur, Malaysia, 1997.

  6. F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul, “Rate of change and other metrics: A live study of the World Wide Web,” in Proc. of USENIX Symposium on Internet Technologies and Systems, Monterey, CA, 1997.

  7. D. Duchamp, “Prefetching hyperlinks,” in Proc. of the 2nd USENIX Symposium on Internet Technologies and Systems (USITS'99), Boulder, CO, 1999.

  8. J. Griffioen and R. Appleton, “Reducing file system latency using a predictive approach,” in Proc. of USENIX Summer Conf., 1994, pp. 197-207.

  9. J. H. Hine, C. E. Wills, A. Martel, and J. Sommers, “Combining client knowledge and resource dependencies for improved World Wide Web performance,” in Proc. of the INET'98 Conf., Geneva, Switzerland, 1998.

  10. T. Kroeger and D. Long, “Predicting file system actions from prior events,” in Proc. of the USENIX 1996 Annual Technical Conf., 1996, pp. 319-328.

  11. H. Lei and D. Duchamp, “An analytical approach to file prefetching,” in Proc. of USENIX 1997 Annual Technical Conf., 1997.

  12. E. P. Markatos and C. E. Chironaki, “A Top 10 approach for prefetching the Web,” in Proc. of INET'98: Internet Global Summit, 1998.

  13. V. Padmanabhan and J. Mogul, “Using predictive prefetching to improve World Wide Web latency,” Proc. of ACM SIGComm, 1996, 22-36.

  14. T. Palpanas and A. Mendelzon, “Web prefetching using partial match prediction,” in Web Caching Workshop, San Diego, CA, 1999.

  15. Z. Su, Q. Yang, Y. Lu, and H. Zhang, “WhatNext: A prediction system for Web requests using N-gram sequence models,” in Proc. of the 1st Internat. Conf. on Web Information Systems and Engineering, Hong Kong, 2000, pp. 200-207.

  16. J. S. Vitter and P. Krishnan, “Optimal prefetching via data compression,” J. ACM, 1996, 771-793.

  17. C. E. Wills and M. Mikhailov, “Examining the cacheability of user-requested Web resources,” in Proc. of 4th Internat. Web Caching Workshop, San Diego, CA, 1999.

  18. R. P. Wooster and M. Abrams, “Proxy caching that estimates page load delays,” in Proc. of the 6th Internat. World Wide Web Conf., Santa Clara, CA, 1997, pp. 325-334.

  19. Q. Yang, H. H. Zhang, and I. T. Li, “Mining Web logs for prediction models inWWWcaching and prefetching,” in Proc. of the 7th ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining, 2001, pp. 473-478.

Download references

Author information

Authors and Affiliations

  1. Department of Computing Science, Hong Kong University of Science and Technology, Clearwater Bay, Kowloon, Hong Kong

    Qiang Yang

  2. IBM E-Business Innovation Center, Vancouver, Burnaby BC, Canada, V5G 4X3

    Henry Hanning Zhang

Authors
  1. Qiang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Henry Hanning Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, Q., Zhang, H.H. Integrating Web Prefetching and Caching Using Prediction Models. World Wide Web 4, 299–321 (2001). https://doi.org/10.1023/A:1015185802583

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1015185802583

Search

Navigation