Skip to main content
SpringerLink
Log in

MedSMan: a live multimedia stream querying system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Querying live media streams is a challenging problem that is becoming an essential requirement in a growing number of applications. Research in multimedia information systems has addressed and made good progress in dealing with archived data. Meanwhile, research in stream databases has received significant attention for querying alphanumeric symbolic streams. The lack of a data model capable of representing different multimedia data in a declarative way, hiding the media heterogeneity and providing reasonable abstractions for querying live multimedia streams poses the challenge of how to make the best use of data in video, audio and other media sources for various applications. In this paper we propose a system that enables directly capturing media streams from sensors and automatically generating more meaningful feature streams that can be queried by a data stream processor. The system provides an effective combination between extendible digital processing techniques and general data stream management research. Together with other query techniques developed in related data stream management streams, our system can be used in those application areas where multifarious live media senors are deployed for surveillance, disaster response, live conferencing, telepresence, etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abadi D, Carney D, Cetintemel U et al (2003) Aurora: a new model and architecture for data stream management. VLDB J 12(2):120–139, Aug

    Article  Google Scholar 

  2. Arasu A, Babu S, Widom J (2003) The cql continuous query language: semantic foundations and query execution. Technical report, Stanford University, Oct

  3. Aref WG, Catlin AC et al. (2004) Vdbms: a testbed facility for research in video database benchmarking. ACM Multimed Syst J, Special Issue on Multimed Doc Manag Syst 9(6):575–585, June

    Google Scholar 

  4. Babcock B, Babu S, Datar M, Motwani R, Widom J (2002) Models and issues in data stream systems. In: Symposium on principles of database systems, Madison, Wisconsin, pp 1–16, May

  5. Bonnet P, Gehrke J, Seshadri P (2001) Towards sensor database systems. In: Proc. 2nd int. conf. on mobile data management, pp 3–14

  6. Chen J, DeWitt DJ, Tian F, Wang Y (2000) Niagaracq: a scalable continuous query system for internet databases. In: International conference on management of data, Dallas, Texas, pp 379–390, May

  7. Elmasri R, Wuu GTJ, Kim YJ (1990) The time index: an access structure for temporal data. VLDB, pp 1–12

  8. Enderle J, Hampel M, Seidl T (2004) Joining interval data in relational databases. In: Proc. ACM SIGMOD

  9. Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the qbic system. IEEE Comput 28(9):23–32, Sept

    Google Scholar 

  10. Golab L, Ozsu MT (2003) Issues in data stream management. ACM SIGMOD Record 32(2):5–14, June

    Article  Google Scholar 

  11. Hongeng S, Nevatia R, Bremond F (2004) Video-based event recognition: activity representation and probabilistic recognition methods. Comput Vis Image Underst (96)2:129–162, November

    Article  Google Scholar 

  12. Intel (2007) Open source computer vision library. Opencv. web site at http://www.intel.com/research/mrl/research/opencv/

  13. Jain R (2003) Experiential computing. Communications of the ACM 46(7):48–55, July

    Article  Google Scholar 

  14. Lillethun D, Hilley D, Horrigan S, Ramachandran U (2007) MB++: an integrated architecture for pervasive computing and high-performance computing. In: Proceedings of the 13th IEEE international conference on embedded and real-time computing systems and applications (RTCSA ’07), pp 241–248, Aug

  15. Liu B, Gupta A, Jain R (2005) Medsman: a streaming data management system over live multimedia. In: Proceedings of the 13th annual ACM international conference on multimedia, pp 171–180, Nov

  16. Liu B, Gupta A, Jain R (2006) Using temporal semantics for live media stream queries. In: International Conference on Semantics of a Networked World, March

  17. Liu L, Pu C, Tang W (1999) Continual queries for internet scale event-driven information delivery. IEEE Trans Knowl Data Eng 11(4):610–628

    Article  Google Scholar 

  18. Liu X, Corner M, Shenoy P (2005) Seva: sensor-enhanced video annotation. In: Proceedings of the 13th annual ACM international conference on multimedia, pp 171–180, Nov

  19. Madden S, Shah M, Hellerstein JM, Raman V (2002) Continously adaptive continous queries over streams. In: ACM SIGMOD international conference on management of data, Madison, Wisconsin

  20. Ramachandran U, Modahl M, Bagrak I, Wolenetz M, Lillethun D, Liu B, Kim J, Hutto P, Jain R (2005) Media broker: a pervasive computing infrastructure for adaptive transformation and sharing of stream data. To appear in Pervasive and Mobile Computing (PMC) Journal, vol 2

  21. Salemier P, Smith JR (2002) Introduction to MPEG-7: multimedia content description interface. Wiley

  22. Seshadri P, Livny M, Ramakrishnan R (1994) Sequence query processing. ACM SIGMOD, pp 430–441

  23. Seshadri P, Livny M, Ramakrishnan R (1995) Seq: a model for sequence databases. ICDE, pp 232–239

  24. Soo MD, Snodgrass RT, Jensen CS (1994) Efficient evaluation of the valid-time natural join. ICDE, pp 282–292

  25. Steinmetz R, Nahrstedt K (1995) Multimedia computing, communications and applications. Prentice Hall

  26. Tansel AU, Clifford J, Gadia SK, Segev A, Snodgrass RT (1993) Temporal databases: theory, design, and implementation. Benjamin/Cummings

  27. Vinod VV, Murase H (1997) Video shot analysis using efficient multiple object tracking. In: ICMCS ’97, Ottawa, Ontario, CANADA, June

  28. Viola P, Jones MJ (2001) Rapid object detection using a boosted cascade of simple features. In: IEEE CVPR, vol 1, pp 511–518

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA

    Bin Liu

  2. San Diego Supercomputer Center, University of California San Diego, La Jolla, CA, 92093, USA

    Amarnath Gupta

  3. Department of Computer Science, University of California Irvine, Irvine, CA, 92697, USA

    Ramesh Jain

Authors
  1. Bin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amarnath Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ramesh Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, B., Gupta, A. & Jain, R. MedSMan: a live multimedia stream querying system. Multimed Tools Appl 38, 209–232 (2008). https://doi.org/10.1007/s11042-007-0177-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-007-0177-9

Keywords

Search

Navigation