Skip to main content
Log in

Network-aware partial caching for Internet streaming media

  • OriginalPaper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract.

The delivery of multimedia over the Internet is affected by adverse network conditions such as high packet loss rate and long delay. This paper aims at mitigating such effects by leveraging client-side caching proxies. We present a novel cache architecture and associated cache management algorithms that turn edge caches into accelerators of streaming media delivery. This architecture allows partial caching of media objects and joint delivery from caches and origin servers. Most importantly, the caching algorithms are both network-aware and stream-aware; they take into account the popularity of streaming media objects, their bit rate requirements, and the available bandwidth between clients and servers. Using Internet bandwidth models derived from proxy cache logs and measured over real Internet paths, we have conducted extensive simulations to evaluate the performance of various cache management algorithms. Our experiments demonstrate that network-aware caching algorithms can significantly reduce startup delay and improve stream quality. Our experiments also show that partial caching is particularly effective when bandwidth variability is not very high.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Abrams M, Standridge CR, Abdulla G (1995) Caching proxies: limitations and potentials. In: Proceedings of the WWW conference, Darmstadt, Germany, December 1995

  2. Acharya S, Smith B (1998) An experiment to characterize videos stored on the Web. In: Proceedings of S&T/SPIE conference on multimedia computing and networking (MMCN), San Jose, January 1998

  3. Acharya S, Smith B (2000) MiddleMan: A video caching proxy server. In: Proceedings of the 10th international workshop on network and operating system support for digital audio and video (NOSSDAV), Chapel Hill, NC, June 2000

  4. Acharya S, Smith B, Parns P (2000) Characterizing user access to video on the World Wide Web. In: Proceedings of the S&T/SPIE conference on multimedia computing and networking (MMCN), San Jose, January 2000

  5. Almeida J, Krueger J, Eager D, Vernon M (2001) Analysis of educational media server workloads. In: Proceedings of the 11th international workshop on network and operating system support for digital audio and video (NOSSDAV), Port Jefferson, NY, June 2001

  6. Bestavros A, Carter R, Crovella M, Cunha C, Heddaya A, Mirdad S (1995) Application level document caching in the Internet. In: Proceedings of SDNE: the 2nd international workshop on services in distributed and networked environments, Whistler, BC, Canada, June 1995

  7. Cao P, Irani S (1997) Cost-aware WWW proxy caching algorithms. In: Proceedings of the USENIX symposium on Internet technologies and systems (USITS), Monterey, CA, December 1997

  8. Chan SHG, Tobagi F (2001) Distributed servers architecture for networked video services. IEEE/ACM Trans Netw 9(2):125-136

    Google Scholar 

  9. Chankhunthod A, Danzig P, Neerdaels C, Schwartz MF, Worrell KJ (1996) A hierarchical Internet object cache. In: Proceedings of USENIX, San Diego, January 1996

  10. Chesire M, Wolman A, Voelker G, Levy H (2001) Measurement and analysis of a streaming workload. In: Proceedings of the USENIX symposium on Internet technologies and systems (USITS), San Francisco, March 2001

  11. Crovella M, Bestavros A (1996) Self-similarity in World Wide Web traffic: evidence and possible causes. In: Proceedings of ACM SIGMETRICS, Philadelphia, May 1996

  12. Floyd S, Fall K (1999) Promoting the use of end-to-end congestion control in the Internet. IEEE/ACM Trans Netw 7(4):458-472

    Google Scholar 

  13. Glossglauser M, Bolot J (1996) On the relevance of long-range dependence in network traffic. In: Proceedings of ACM SIGCOMM, Stanford, August 1996

  14. Harfoush K, Bestavros A, Byers J (2001) Measuring bottleneck bandwidth of targeted path segments. Technical Report BUCS-TR-2001-016, Computer Science Department, Boston University, July 2001

  15. Jin S, Bestavros A (2000) Popularity-aware greedydual-size Web proxy caching algorithm. In: Proceedings of IEEE ICDCS, Taipei, Taiwan, ROC, April 2000

  16. Jin S, Bestavros A (2001) GISMO: Generator of streaming media ojects and workloads. ACM SIGMETRICS Perform Eval Rev 29(3):2-10

  17. Miao Z, Ortega A (1999) Proxy caching for efficient video services over the Internet. In: Proceedings of PVW, Columbia University, New York, April 1999

  18. National Laboratory for Applied Network Research. http://ircache.nlanr.net/

  19. Padhye J, Firoiu V, Towsley D, Kurose J (1998) Modeling TCP throughput: a simple model and its empirical validation. In: Proceedings of ACM SIGCOMM, Vancouver, BC, Canada, August 1998

  20. Padhye J, Kurose J (1998) An empirical study of client interactions with a continuous-media courseware server. In: Proceedings of the 8th international workshop on network and operating system support for digital audio and video (NOSSDAV), Cambridge, UK, June 1998

  21. Paknikar S, Kankanhalli M, Ramakrishnan KR, Srinivasan SH, Ngoh LH (2000) A caching and streaming framework for multimedia. In: Proceedings of ACM MULTIMEDIA, Los Angeles, October 2000

  22. Paxson V (1994) Wide-area traffic: the failure of Poisson modeling. In: Proceedings of ACM SIGCOMM, London, August 1994

  23. Reisslein M, Hartanto F, Ross KW (2000) Interactive video streaming with proxy servers. In: Proceedings of the 1st international workshop on intelligent multimedia computing and networking (IS&T/SPIE conference on multimedia computing and networking (MMCN)), San Jose, February 2000

  24. Rejaie R, Handley M, Estrin D (1999) RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet. In: Proceedings of IEEE INFOCOM, New York, April 1999

  25. Rejaie R, Yu H, Handley M, Estrin D (2000) Multimedia proxy caching mechanism for quality adaptive streaming applications in the Internet. In: Proceedings of IEEE INFOCOM, Tel-Aviv, March 2000

  26. Salehi JD, Zhang ZL, Kurose JF, Towsley D (1996) Supporting stored video: reducing rate variability and end-to-end resource requirements through optimal smoothing. In: Proceedings of ACM SIGMETRICS, Philadelphia, May 1996

  27. Schulzrinne H, Rao A, Lanphier R (1998) Real Time Streaming Protocol(RTSP), RFC 2326, The Internet Society, April 1998

  28. Sen S, Rexford J, Towsley D (1999) Proxy prefix caching for multimedia streams. In: Proceedings of IEEE INFOCOM, New York, April 1999

  29. Wang Y, Zhang ZL, Du DH, Su D (1998) A network-conscious approach to end-to-end video delivery over wide area networks using proxy servers. In: Proceedings of IEEE INFOCOM, San Francisco, March 1998

  30. Widmer J, Denda R, Mauve M (2001) A survey on tcp-friendly congestion control. IEEE Netw, 15(3):28-37

    Google Scholar 

  31. Williams S, Abrams M, Standridge CR, Abdulla G, Fox EA (1996) Removal policies in network caches for World-Wide Web documents. In: Proceedings of ACM SIGCOMM, Stanford, CA, August 1996

  32. Wooster R, Abrams M (1997) Proxy caching that estimates page load delays. In: Proceedings of the WWW conference, Santa Clara, CA, April 1997

  33. Zink M, Griwodz C, Schmitt J, Steinmetz R (2002) Exploiting the fair share to smoothly transport layered encoded video int o proxy caches. In: Proceedings of the S&T/SPIE conference on multimedia computing and networking (MMCN), San Jose, January 2002

  34. Zipf GK (1929) Relative frequency as a determinant of phonetic change. Reprinted from Harvard Studies in Classical Philology, XL

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shudong Jin.

Additional information

Shudong Jin: Corespondence to

This research was supported in part by NSF (awards ANI-9986397, ANI-0095988, ANI-0205294 and EJA-0202067) and by IBM. Part of this work was done while the first author was at IBM Research in 2001.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jin, S., Bestavros, A. & Iyengar, A. Network-aware partial caching for Internet streaming media. Multimedia Systems 9, 386–396 (2003). https://doi.org/10.1007/s00530-003-0109-0

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-003-0109-0

Keywords:

Navigation