Skip to main content
Log in

Advanced networking services for distributed multimedia streaming applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Increased network speeds coupled with new services delivered via the Internet have increased the demand for intelligence and flexibility in network systems. This paper argues that both can be provided by new hardware platforms comprised of heterogeneous multi-core systems with specialized communication support. We present and evaluate an experimental network service platform that uses an emergent class of devices—network processors—as its communication support, coupled via a dedicated interconnect to a host processor acting as a computational core. A software infrastructure spanning both enables the dynamic creation of application-specific services on the network processor, mediated by middleware and controlled by kernel-level communication support. Experimental evaluations use a Pentium IV-based computational core coupled with an IXP 2400 network processor. The sample application services run on both include an image manipulation application and application-level multicasting.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Apostolopoulos G, Aubespin D, Peris V, Pradhan P, Debanjan Saha (2000) Design, implementation and performance of a content-based switch, In: Proc. of IEEE INFOCOM 2000, Tel Aviv, Israel (March 2000)

  2. Braun F, Lockwood J, Waldvogel M (2002) Protocol wrappers for layered network packet processing in reconfigurable networks. IEEE MICRO 22(1), (Jan/Feb)

  3. Bustamante F, Eisenhauer G, Schwan K (2000) Efficient wire formats for high performance computing. In: Supercomputing 2000 (November 2000)

  4. Carzagina A, Rosenblum DS, Wolf AL (2001) Design and evaluation of a wide-area event notification service. In: ACM transactions on computer systems, vol 19, no 3 (August)

  5. Cisco Press Release (2005) Cisco unveils application oriented networking, In: Networkers’05 (June 2005)

  6. Clark C, Lee W, Schimmel D, ContisD, Kone M, Thomas A (2004) A hardware platform for network intrusion detection and prevention. In: Proceedings of the 3rd workshop on network processors and applications (NP3), Madrid, Spain (February 2004)

  7. Consel C, Hamdi H, Reveillere L, Singaravelu L, Yu H, Pu C (2003) Spidle: a DSL approach to specifying streaming applications. In: Proceedings of the 2nd international conference on generative programming and component engineering, Erfurt, Germany (September 2003)

  8. Diot L, Gautier A (1999) A distributed architecture for multiplayer interactive applications on the Internet. In: Network, vol 13, no 4. IEEE, New York (July–August)

  9. Eisenhauer G, Bustamante F, Schwan K (2000) Event services for high performance computing. In: 9th symposium on high performance distributed computing (HPDC-9), Pittsburgh, PA (August)

  10. Feng Wu-ching, Bulusu N, Feng Wu-chang (2005) Dissecting the video sensing landscape. In: ACM NOSSDAV 2005, Stevenson, WA (June)

  11. Feng W-C, Hurwitz G, Newman H, Ravot S, Cottrell L, Martin O, Coccetti F, Jin C, Wei D, Low S (2003) Optimizing 10-Gigabit ethernet for networks of workstations, clusters and grids: a case study. In: SC2003: high-performance networking and computing conference, Phoenix, AZ (November)

  12. Gavrilovska A, Oleson V, Schwan K (2002) Practical approach for zero downtime in an operational information system. In: 22nd IEEE international conference on distributed computing systems (ICDCS-2005), Vienna, Austria (July)

  13. Gavrilovska A, Kumar S, Schwan K (2004) The execution of event–action rules on programmable network processors. In: OASIS 2004, held with ASPLOS-XI (October)

  14. Gavrilovska A, Kumar S, Sundaragopalan S, Schwan K (2005) Platform overlays: enabling in-network stream processing in large scale distributed applications. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05), Stevenson, WA (June)

  15. Gavrilovska A, Schwan K, Nordstrom O, Seifu H (2003) Network processors as building blocks in overlay networks. In: Hot interconnects

  16. Guo J, Yao J, Bhuyan L (2005) An efficient packet scheduling algorithm in network processors. In: IEEE infocom (March)

  17. IBM MQSeries, http://www.mqseries.net.

  18. Intel Corporation (2001) Intel IXA programming framework

  19. IXP Intel Network Processor Family, http://developer.intel.com/design/npfamily

  20. Kong J, Schwan K (2005) K-streams: kernel support for efficient data streaming in proxy servers. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05) (June)

  21. Krishnamurthy R, Yalamanchili S, Schwan K, West R (2002) Architecture and hardware for scheduling gigabit packet streams. In: Proceedings of hot interconnects, vol 10, Stanford, CA (August)

  22. Kumar V, Cooper B, Cai Z, Eisenhauer G, Schwan K (2005) Resource-aware distributed stream management using dynamic overlays. In: 25th IEEE international conference on distributed computing systems (ICDCS-2005), Columbus, OH

  23. Kumar S, Gavrilovska A, Sundaragopalan S, Schwan K (2005) C-core: using communication cores for high performance network services. In: 4th IEEE conference on network computing and applications (July)

  24. Liao C, Martinosi M, Clark, D W (1998) Performance monitoring in a myrinet-connected shrimp cluster. In: ACM sigmetrics symposium on parallel and distributed tools (SPDT) (August)

  25. Lin Y-D, Lin Y-N, Yang S-C, Lin Y-S (2002) DiffServ over network processors: implementation and evaluation. In: Proceedings of hot interconnects, vol 10 (August)

  26. [LIN] Linksys Home Router, Linksys Broadband and Wireless Networking, http://www.linksys.com.

  27. Liu L, Tang W, Buttler D, Pu C (2001) Information monitoring on the web: a scalable solution. In: World Wide Web Journal, vol 4, no 4. Kluwer, New York

  28. Mehra P (2003) Apsara: The quest for the perfect server for network computing applications. In: Proceedings of network computing and applications (NCA), Cambridge, MA (April)

  29. [NPF] Network Processing Forum, http://www.npforum.org

  30. Otey M, Noronha R, Parthasarathy S, Panda DK (2002) NIC-based intrusion detection: a feasibility study. In: Proceedings of the workshop on data mining for cyber threat analysis

  31. Oleson V, Eisenhauer G, Schwan K, Plale B, Pu C, Amin D (2000) Operational information systems—an example from the airline industry. In: 1st workshop on industrial experiences and systems software (WEISS 2000), San Diego, CA

  32. Pai V, Cox A, Pai V, Zwaenepoel W (2003) A flexible and efficient application programming interface (API) for a customizable proxy cache. In: Proceedings of 4th USENIX symposium on internet technologies and systems, Seattle, WA (August)

  33. Path 1 Network Technologies (2002) Professional digital video gateways for the broadcaster and multi-service operator: delivered by Path 1 Network Technologies* and Intel® Network Processors. White paper, http://www.intel.com/design/network/casestudies/path1.htm

  34. Regnier G, Minturn D, McAlpine G, Saletore V, Foong A (2003) ETA: experience with an Intel Xeon processor as a packet processing engine, hot interconnects, vol XI, Stanford, CA (August)

  35. Rosu M-C, Schwan K, Fujimoto R (1998) Supporting parallel applications on clusters of workstations: the virtual communication machine-based architecture. In: Cluster computing, Special issue on high performance distributed computing, vol. 1 (May)

  36. Roy S, Ankcorn J, Wee S (2003) An Architecture for componentized, network-based media services. In: Proceedings of IEEE international conference on multimedia and expo (July)

  37. Rowstron A, Kermarrec A-M, Castro M, Druschel P (2001) SCRIBE: the design of a large-scale event notification infrastructure. In: Proceedings of 3rd international workshop on networked group communication, London, UK (November)

  38. Shah N, Plishker W, Keutzer K (2003) NP-click: a programming model for the Intel IXP1200. In: 2nd workshop on network processors (NP-2), Anaheim, CA. (February)

  39. Shivam P, Wyckoff P, Panda DK (2002) Can user level protocols take advantage of multi-CPU NICs? In: International parallel and distributed processing symposium (IPDPS ‘02) (April)

  40. Spalink T, Karlin S, Peterson L, Gottlieb Y (2001) Building a robust software-based router using network processors. In: SOSP 2001, Banff, Canada (December)

  41. Sundaragopalan S, Gavrilovska A, Kumar S, Schwan K (2005) An approach towards enabling intelligent networking services for distributed multimedia applications. In: IMMCN’05 (April)

  42. Teja NP Software Platform for Intel IXP2xxx Network Processor Family, White Paper, http://www.teja.com

  43. Taylor DE, Lockwood JW, Sproull TS, Turner JS, Parlour DB (2002) Scalable IP lookup for programmable routers. In: Proceedings of IEEE INFOCOM 2002, New York, NY (June)

  44. Tibco Software Inc., http://www.tibco.com

  45. Thies W, Karczmarek M, Amarasinghe S (2002) StreamIt: A language for streaming applications, international conference on compiler construction (ICCC’02), Grenoble, France (April)

  46. West R, Schwan K (1999) Dynamic window-constrained scheduling for multimedia applications. In: Proceedings of 6th international conference on multimedia computing and systems, Florence, Italy (June)

  47. Wolf M, Cai Z, Huang W, Schwan K (2002) WCH02s: Personalized scientific data portals in your hand. In: Supercomputing 2002 (November)

  48. Yocum K, Chase J (2001) Payload caching: high-speed data forwarding for network intermediaries. In: Proceedings of USENIX technical conference (USENIX’01), Boston, MA (June)

  49. Zhao Y, Storm R (2001) Exploiting event stream interpretation in publish-subscribe systems. In: Proceedings of ACM symposium on principles of distributed computing, Newport, RI (August)

  50. Zhuang X, Shi W, Paul I, Schwan K (2002) Efficient implementation of the DWCS algorithm on high-speed programmable network processors. In: Proceedings of multimedia networks and systems (MMNS) (October)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Srikanth Sundaragopalan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gavrilovska, A., Kumar, S., Sundaragopalan, S. et al. Advanced networking services for distributed multimedia streaming applications. Multimed Tools Appl 34, 179–200 (2007). https://doi.org/10.1007/s11042-006-0089-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0089-0

Keywords

Navigation