Skip to main content
SpringerLink
Log in

Design considerations for the symphony integrated multimedia file system

  • OriginalPaper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract.

A multimedia file system supports diverse application classes that access data with heterogeneous characteristics. In this paper, we describe our experiences in the design and implementation of the Symphony multimedia file system. We first discuss various methodologies for designing multimedia file systems and examine their trade-offs. We examine the design requirements for such file systems and argue that to efficiently manage the heterogeneity in application requirements and data characteristics, a multimedia file system should enable the coexistence of multiple data-type-specific and application-specific techniques. We describe the architecture and novel features of Symphony and then demonstrate their efficacy through an experimental evaluation. Our results show that Symphony yields a factor of 1.9 improvement in text response time over conventional disk scheduling algorithms while continuing to meet the real-time requirements of video clients. Finally, we reflect upon the lessons learned from the Symphony project.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Almeida J, Eager D, Vernon M (2001) Hybrid caching strategy for streaming media files. In: Proceedings of ACM/SPIE Multimedia computing and networking 2001, San Jose, January 2001, pp 200-212

  2. Anastasiadis SV, Sevcik K, Stumm M (2001) Disk-striping scalability in the Exedra media server. In: Proceedings of ACM/SPIE Multimedia computing and networking 2001, San Jose, January 2001, pp 175-189

  3. Anderson D, Osawa Y, Govindan R (1992) A file system for continuous media. ACM Trans Comput Sys 10(4):311-337

    Google Scholar 

  4. Bach MJ (1986) The design of the Unix operating system. Prentice-Hall, New York

  5. Bacon J, Moody K, Thomson S, Wilson T (1991) A multi-service storage architecure. ACM SIGOPS Operat Sys Rev 25(4):47-65

    Google Scholar 

  6. Bershad B, Savage S, Pardyak P, Sirer E, Fiuczynski M, Becker D, Chambers C, Eggers S (1995) Extensibility, safety, and performance in the SPIN operating system. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 267-284

  7. Buddhikot M, Parulkar G, Cox J (1994) Design of a large scale multimedia storage server. J Comput Netw ISDN Sys pp 504--524

  8. Cao P (1996) Application controlled file caching and prefetching. PhD thesis, Princeton University

  9. Chang E, Zakhor A (1994) Scalable video placement on parallel disk arrays. In: Proceedings of IS&T/SPIE international symposium on electronic imaging: science and technology, San Jose, January 1997, pp 208-221

  10. Chen PM, Lee EK, Gibson GA, Katz RH, Patterson DA (1994) RAID: high-performance, reliable secondary storage. ACM Comput Surv 26(2):pp 145-185

    Google Scholar 

  11. Coffman EG, Klimko LA, Ryan B (1972) Analysis of scanning policies for reducing disk seek times. SIAM J Comput 1(3):269-279

    Google Scholar 

  12. Dan A, Sitaram D (1996) A generalized interval caching policy for mixed interactive and long video workloads. In: Proceedings of the conference on multimedia computing and networking (MMCN), San Jose, January 1996, pp 344-351

  13. Danskin JM, Davies GM, Song X (1995) Fast lossy Internet image transmission. In: Proceedings of the 3rd ACM conference on multimedia, San Francisco, November 1995, pp 321-332

  14. Engler D, Kaashoek M, O’Toole J (1995) Exokernel: an operating system architecture for application-level resource management. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 251-266

  15. Gribble SD, Manku G, Roselli D, Brewer E, Gibson T, Miller E (1998) Self-similarity in file systems. In: Proceedings of ACM SIGMETRICS ‘98, Madison, WI, June 1996, pp 141-150

  16. Haskin R (1998) Tiger Shark-a scalable file system for multimedia. IBM J Res Develop 42(2):185-197

    Google Scholar 

  17. Holton M, Das R (1996) XFS: a next generation journalled 64-bit file system with guaranteed rate I/O. Technical report, Silicon Graphics. Available online at http://www.sgi.com/software/xfs

  18. International Organisation for Standardisation (1994) Information technology - generic coding of moving pictures and associated audio systems: systems, video and audio, international standard (MPEG2), ISO/IEC 13818

  19. Jardetzky PW (1992) Network file server design for continuous media. PhD thesis, University of Cambridge

  20. Jonge W, Kaashoek MF, Hsieh WC (1993) The logical disk: a new approach to improving file systems. In: Proceedings of the 14th symposium on operating systems principles, Asheville, NC, December 1993, pp 15-28

  21. Khalidi Y, Nelson M (1993) Extensible file systems in spring. In: Proceedings of the 14th ACM symposium on operating systems principles, Asheville, NC, December 1993, pp 1-14

  22. Knuth DE (1973) The art of computer programming, vol 1: Fundamental algorithms. Addison-Wesley, Reading, MA

  23. Leffler SJ, McKusick MK, Karels MJ, Quartermann JS (1989) The design and implementation of the 4.3BSD Unix operating system. Addison-Wesley, Reading MA

  24. Lehoczky JP, Ramos-Thuel S (1992) An optimal algorithm for scheduling soft-aperiodic tasks in fixed-priority preemptive systems. In: Proceedings of the real-time systems symposium, Phoenix, AZ, December 1992, pp 110-123

  25. Martin C, Narayan PS, Ozden B, Rastogi R, Silberschatz A (1996) The Fellini multimedia storage server. In: Chung SM (ed) Multimedia information storage and management, Kluwer, Amsterdam

  26. McKusick MK, Joy WN, Leffler SJ, Fabry RS (1984) A fast file system for UNIX. ACM Trans Comput Sys 2(3):181-197

    Google Scholar 

  27. McVoy L, Klieman S (1990) Extent-like performance from a UNIX file system. In: Proceedings of summer USENIX conference, Anaheim, CA, June 1990, pp 137-144

  28. Narasimha Reddy AL, Wyllie J (1993) Disk scheduling in multimedia I/O system. In: Proceedings of ACM Multimedia’93, Anaheim, CA, October 1991, pp 225-234

  29. Niranjan T, Chiueh T, Schloss G (1997) Implementation and evaluation of a multimedia file system. In: Proceedings of ICMCS’97, Ottawa, Canada, June 1997, pp 169-276

  30. Noble B, Satyanarayanan M, Narayanan D, Tilton J, Flinn J, Walker K (1997) Agile application-aware adaptation for mobility. In: Proceedings of the 16th ACM symposium on operating system principles, St Malo, France, October 1997, pp 276-287

  31. Patterson D, Gibson G, Katz R (1988) A case for redundant array of inexpensive disks (RAID). In: Proceedings of ACM SIGMOD’88, pp 109-116

  32. Patterson RH(1995) Informed prefetching and caching. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 79-95

  33. Rao SS, Vin HM, Tarafdar A (1996) Comparative evaluation of server-push and client-pull architectures for multimedia servers. In: Proceedings of the workshop on network and operating system support for digital audio and video (NOSSDAV’96), Zushi, Japan, April 1996, pp 45-48

  34. Rejaie R, Kangasharju J (2001) Mocha: a quality adaptive multimedia proxy cache for Internet streaming. In: Proceedings of the workshop on network and operating system support for digital audio and video (NOSSDAV 2001), Port Jefferson, NY, June 2001, pp 3-10

  35. Roscoe T (1995) The structure of a multi-service operating system. PhD thesis, University of Cambridge Computer Laboratory. Available as Technical Report No. 376

  36. Rosenblum M, Ousterhout J (1991) The design and implementation of a log-structured file system. In: Proceedings of the 13th ACM symposium on operating systems principles, Anaheim, CA, October 1991, pp 1-15

  37. Santos J, Muntz R, Ribeiro-Neto B (2000) Comparing random data allocation and data striping in multimedia servers. In: Proceedings of ACM SIGMETRICS 2000, Santa Clara, CA, June 2000, pp 44-55

  38. Shenoy P, Vin HM (1999a) Efficient striping techniques for variable bit rate continuous media file servers. Perform Eval J 38(3):175-199

    Google Scholar 

  39. Shenoy P, Vin HM (1999b) Efficient support for interactive operations in multi-resolution video servers. ACM/Springer Multimedia Sys J 7(3):241-253

  40. Shenoy P, Vin H (2002) Cello: a disk scheduling framework for next generation operating systems. Real Time Sys J (Special issue on flexible scheduling of real-time systems) 22:9-47

  41. Shenoy P, Goyal P, Vin HM (2002) Architectural considerations for next generation file systems. ACM/Springer Multimedia Sys J 8(4):270-283

  42. Shenoy PJ, Goyal P, Rao S, Vin HM (1997) Design and implementation of Symphony: an integrated multimedia file system. Technical Report TR97-09, Department of Computer Sciences, University of Texas at Austin

  43. Tewari R, Vin HM, Dan A, Sitaram D (1996) Caching in bandwidth and space constrained hierarchical hyper-media servers. Technical Report TR96-30, Department of Computer Sciences, University of Texas at Austin

  44. Tobagi FA, Pang J, Baird R, Gang M (1993) Streaming RAID - a disk array management system for video files. In: Proceedings of ACM Multimedia ‘93, Anaheim, CA, pp 393-400

  45. Venkat Rangan P, Vin HM (1991) Designing file systems for digital video and audio. In: Proceedings of the 13th symposium on operating systems principles (SOSP’91), Operat Sys Rev 25(5):81-94

  46. Vernick M, Venkatramini C, Chiueh T (1996) Adventures in building the Stony Brook video server. In: Proceedings of ACM Multimedia’96, Boston, November 1996, pp 287-295

  47. Vin HM, Goyal P, Goyal A (1994) A statistical admission control algorithm for multimedia servers. In: Proceedings of ACM Multimedia’94, San Francisco, October 1994, pp 33-40

  48. Vin HM, Goyal A, Goyal P (1995a) Algorithms for designing large-scale multimedia servers. Comput Commun 18(3):192-203

    Google Scholar 

  49. Vin HM, Shenoy PJ, Rao S (1995b) Efficient failure recovery in multi-disk multimedia servers. In: Proceedings of the 25th international symposium on fault tolerant computing systems, Pasadena, CA, June 1995, pp 12-21

  50. Vin HM, Rao SS, Goyal P (1995c) Optimizing the placement of multimedia objects on disk arrays. In: Proceedings of the 2nd IEEE international conference on multimedia computing and systems, Washington, DC, May 1995, pp 158-165

  51. Wijayaratne R, Narasimha Reddy A (2001) System support for providing integrated services from networked multimedia servers. In: Proceedings of ACM Multimedia 2001, Ottowa, Canada, October 2001, pp 270-279

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Massachusetts, MA 01003, Amherst, USA

    Prashant Shenoy

  2. IBM Research Division, Almaden Research Center, CA 95120, San Jose, USA

    Pawan Goyal

  3. Department of Computer Sciences, University of Texas, TX 78712, Austin, USA

    Sriram Rao & Harrick M. Vin

Authors
  1. Prashant Shenoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pawan Goyal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sriram Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Harrick M. Vin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Prashant Shenoy.

Additional information

Prashant Shenoy: Correspondence to

This research was supported in part by NSF Awards CCR-9624757 and CCR-9984030. Any opinions, findings, conclusions, and recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the funding agencies.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shenoy, P., Goyal, P., Rao, S. et al. Design considerations for the symphony integrated multimedia file system. Multimedia Systems 9, 337–352 (2003). https://doi.org/10.1007/s00530-003-0104-5

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-003-0104-5

Keywords

Search

Navigation