Skip to main content

Memory Management for Large Scale Data Stream Recorders

  • Conference paper
Enterprise Information Systems VI
  • 640 Accesses

Abstract

Presently, digital continuous media (CM) are well established as an integral part of many applications. In recent years, a considerable amount of research has focused on the efficient retrieval of such media. Scant attention has been paid to servers that can record such streams in real time. However, more and more devices produce direct digital output streams. Hence, the need arises to capture and store these streams with an efficient data stream recorder that can handle both recording and playback of many streams simultaneously and provide a central repository for all data.

In this report we investigate memory management in the context of large scale data stream recorders. We are especially interested in finding the minimal buffer space needed that still provides adequate resources with varying workloads. We show that computing the minimal memory is an NP-complete problem and will require further study to discover efficient heuristics.

This research has bee funded in part by NSF grants EEC-9529152 (IMSC ERC) and IIS-0082826, and an unrestricted cash gift from the Lord Eoundation

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Aref, W., Kamel, I., Niranjan, T. N., and Ghandeharizadeh, S. (1997). Disk Scheduling for Displaying and Recording Video in Non-Linear News Editing Systems. In Proceedings of the Multimedia Computing and Networking Conference, pages 228–239, San Jose, California. SPIE Proceedings Series, Volume 3020.

    Google Scholar 

  • Chae, Y., Guo, K., Buddhikot, M. M., Suri, S., and Zegura, E. W. (2002). Silo, rainbow, and caching token: Schemes for scalable, fault tolerant stream caching. Special Issue of IEEE Journal of Selected Area in Communications on Internet Proxy Services.

    Google Scholar 

  • Cui, Y. and Nahrstedt, K. (2003). Proxy-based asynchronous multicast for efficient on-demand media distribution. In The SPIE Conference on Multimedia Computing and Networking 2003 (MMCN 2003), Santa Clara, California, pages 162–176.

    Google Scholar 

  • Garey, M. R. and Johnson, D. S. (1979). Computers and Intractability: A Guide to Theory of NP-Completeness. W.H.Freeman and Company, New York.

    Google Scholar 

  • Huffstutter, P. J. and Healey, J. (2002). Filming Without the Film. Los Angeles Times, page A.1.

    Google Scholar 

  • Lee, S.-H., Whang, K.-Y., Moon, Y.-S., and Song, I.-Y. (2001). Dynamic Buffer Allocation in Video-On-Demand Systems. In Proceedings of the international conference on Management of data (ACM SIGMOD’2001), Santa Barbara, California, United States, pages 343–354.

    Google Scholar 

  • Makaroff, D. J. and Ng, R. T. (1995). Schemes for Implementing Buffer Sharing in Continuous-Media Systems. Information Systems, Vol. 20, No. 6., pages 445–464.

    Article  Google Scholar 

  • Papadimitriou, C. H. and Steiglitz, K. (1982). Combinatorial Optimization: Algorithms and Complexity. Prentice Hall, Inc., Englewood Cliffs, New Jersey 07632.

    Google Scholar 

  • Ramesh, S., Rhee, I., and Guo, K. (2001). Multicast with cache (mcache): An adaptive zero delay video-ondemand service. In IEEE INFOCOM’ 01, pages 85–94.

    Google Scholar 

  • Sen, S., Rexford, J., and Towsley, D. F. (1999). Proxy prefix caching for multimedia streams. In IEEE INFOCOM’ 99, pages 1310–1319.

    Google Scholar 

  • Shahabi, C. and Alshayeji, M. (2000). Super-streaming: A new object delivery paradigm for continuous media servers. Journal of Multimedia Tools and Applications, 11(1).

    Google Scholar 

  • Shahabi, C., Zimmermann, R., Fu, K., and Yao, S.-Y. D. (2002). Yima: A Second Generation Continuous Media Server. IEEE Computer, 35(6):56–64.

    Google Scholar 

  • Shi, W. and Ghandeharizadeh, S. (1997). Buffer Sharing in Video-On-Demand Servers. SIGMETRICS Performance Evaluation Review, 25(2):13–20.

    Google Scholar 

  • Smith, T. (2003). Next DVD spec. to offer Net access not more capacity. The Register.

    Google Scholar 

  • Tsai, W.-J. and Lee, S.-Y. (1998). Dynamic Buffer Management for Near Video-On-Demand Systems. Multimedia Tools and Applications, Volume 6, Issue 1, pages 61–83.

    Article  Google Scholar 

  • Tsai, W.-J. and Lee, S.-Y. (1999). Buffer-Sharing Techniques in Service-Guaranteed Video Servers. Multimedia Tools and Applications, Volume 9, Issue 2, pages 121–145.

    Article  Google Scholar 

  • Waldvogel, M., Deng, W., and Janakiraman, R. (2003). Efficient buffer management for scalable media-ondemand. In The SPIE Conference on Multimedia Computing and Networking 2003 (MMCN 2003), Santa Clara, California.

    Google Scholar 

  • Wallich, P. (2002). Digital Hubbub. IEEE Spectrum, 39(7):26–29.

    Article  Google Scholar 

  • Zimmermann, R. and Fu, K. (2003). Comprehensive Statistical Admission Control for Streaming Media Servers. In Proceedings of the 11th ACM International Multimedia Conference (ACM Multimedia 2003), Berkeley, California.

    Google Scholar 

  • Zimmermann, R., Fu, K., and Ku, W.-S. (2003). Design of a large scale data stream recorder. In The 5th International Conference on Enterprise Information Systems (ICEIS 2003), Angers — France.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer

About this paper

Cite this paper

Fu, K., Zimmermann, R. (2006). Memory Management for Large Scale Data Stream Recorders. In: Seruca, I., Cordeiro, J., Hammoudi, S., Filipe, J. (eds) Enterprise Information Systems VI. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3675-2_12

Download citation

  • DOI: https://doi.org/10.1007/1-4020-3675-2_12

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-3674-3

  • Online ISBN: 978-1-4020-3675-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics