Skip to main content
SpringerLink
Log in

Optimization of media processing workflows with adaptive operator behaviors

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present the ARIA media processing workflow architecture that processes, filters, and fuses sensory inputs and actuates responses in real-time. The components of the architecture are programmable and adaptable; i.e. the delay, size, and quality/precision characteristics of the individual operators can be controlled via a number of parameters. Each data object processed by qStream components is subject to transformations based on the parameter values. For instance, the quality of an output data object and the corresponding processing delay and resource usage depend on the values assigned to parameters of the operators in the object flow path. In Candan, Peng, Ryu, Chatha, Mayer (Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems, 2004), we introduced a class of flow optimization problems that promote creation and delivery of small delay or small resource-usage objects to the actuators in single-sensor, single-actuator workflows. In this paper, we extend our attention to multi-sensor media processing workflow scenarios. The algorithms we present take into account the implicit dependencies between various system parameters, such as resource consumption and object sizes. We experimentally show the effectiveness and efficiency of the algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Babu S, Widom J (2001) Continuous queries over data streams. SIGMOD Rec 30(3):109–120, September

    Article  Google Scholar 

  2. Babu S, et al (2004) Adaptive ordering of pipelined stream filters. In: Proceedings of the 2004 ACM SIGMOD international conference on management of data, Paris, France, pp 407–418

  3. Black A, Huang J, Koster R, Walpole J, Pu C (2002) Infopipes: an abstraction for multimedia streaming. Multimedia Syst 8:406–419

    Article  Google Scholar 

  4. Bom J, Marques P, Correia M, Pinto P (1998) An architecture for dynamic multimedia QoS control. In: 7th IFIP/ICCC conf. on information networks and data communications, Aveiro, June

  5. Candan KS, Peng L, Ryu KD, Chatha KS, Mayer C (2004) Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems

  6. Candan KS, Yang Y (1999) Least-cost high-quality object retrieval for distributed multimedia collaborations ICMCS99

  7. Candan KS et al (1998) Collaborative multimedia systems: synthesis of media objects. IEEE TKDE, 10(3): 433–457, May–June

    Google Scholar 

  8. Chang F, Karamcheti V (2001) A framework for automatic adaptation of tunable distributed applications. Cluster Comput 4(1), May

  9. Chatterjee S (1999) Dynamic application structuring on heterogeneous, distributed systems. In: Proc. IPPS/SPDP’99, WPDRTS99

  10. Fu X, Shi W, Akkerman A, Karamcheti V (2001) CANS: Composable, Adaptive Network Services infrastructure. In: Proceedings of USENIX Symposium on Internet Technologies and Systems (USITS), March

  11. Gu X, Nahrstedt K (2005) Distributed Multimedia Service Composition with Statistical QoS Assurances. IEEE Transactions on Multimedia

  12. Hellerstein, JM et al (2000) Adaptive Query Processing: Technology in Evolution. IEEE Data Eng Bltn 23(2): 7–18

    Google Scholar 

  13. Keleher P, Hollingsworth J, Perkovic D (1999) Exploiting application alternatives. In: Proc. 19th intl. conf. on dist. computing systems

  14. Korkmaz T, Krunz M (2001) Multi-constrained optimal path selection. INFOCOM

  15. Lee C, Lehoczky J, Rajkumar R, Siewiorek D (1999) On quality of service optimization with discrete QoS options. In: IEEE Real Time Technology and Applications Symp. 276

  16. Lorenz DH, Orda A (1998) QoS routing in networks with uncertain parameters. In: INFOCOM98

  17. Madden S, Franklin MJ (2002) Fjording the stream: an architecture for queries over streaming sensor data. In: ICDE 2002

  18. Nahrstedt K, Smith JM (1995) The QOS broker. IEEE MultiMed 2(1):53–67

    Article  Google Scholar 

  19. Peng L, Candan KS Adaptive multi-sensor, multi-actuator media workflow system for interactive arts. In: Workshop on managing data for Emerging Multimedia Applications (EMMA05)

  20. Peng L, Candan KS, Ryu KD, Chatha KS, Sundaram H (2004) ARIA: an adaptive and programmable media-flow architecture for interactive arts. In: ACM MM Interactive Arts Program

  21. Raman B, Katz RH (2003a) An architecture for highly available wide-area service composition. Computer Communication Journal 26(15):1727–1740, September

    Article  Google Scholar 

  22. Raman B, Katz RH (2003b) Load balancing and stability issues in algorithms for service composition. IEEE INFOCOM

  23. Sen A et al (2000) On shortest path problems with “non-Markovian” link contribution to path lengths. NETWORKING 2000, pp 859–870

  24. Siachalou S, Georgiadis L (2003) Efficient QoS routing. INFOCOM

  25. Tatbul N et al. (2003) Load shedding in a data stream manager. VLDB

  26. Tian F, DeWitt D (2003) Tuple routing strategies for distributed eddies. VLDB

  27. Wang Z, Crowcroft J (September 1996) Quality of service routing for supporting multimedia applications. IEEE JSAC 14(7)

  28. Wang N, Pavlou G (2003) DQM : an overlay scheme for quality of service differentiation in source specific multicast. In: workshop on quality of service in multiservice IP networks, pp 306–319

  29. Xu D, Nahrstedt K (2002) Finding services paths in a media service proxy network. In: Proc. of SPIE/ACM MMCN

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Ira A. Fulton School of Engineering, Arizona State University, Tempe, AZ, 85287, USA

    Lina Peng, K. Selçuk Candan, Christopher Mayer & Karamvir S. Chatha

  2. IBM T.J. Watson Research Center, Yorktown Heights, NY, 10598, USA

    Kyung Dong Ryu

Authors
  1. Lina Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. Selçuk Candan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christopher Mayer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karamvir S. Chatha
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kyung Dong Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Selçuk Candan.

Additional information

This work has been supported by NSF grant # IIS-0308268. This is an extended version of “Efficient Stream Routing in Quality- and Resource-adaptive Flow Architectures” published in MIS2004 [5].

This work was performed when the author was at the Arizona State University.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Peng, L., Candan, K.S., Mayer, C. et al. Optimization of media processing workflows with adaptive operator behaviors. Multimed Tools Appl 33, 245–272 (2007). https://doi.org/10.1007/s11042-007-0105-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-007-0105-z

Keywords

Search

Navigation