Skip to main content
SpringerLink
Log in

Event-driven Video Awareness Providing Physical Security

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

The Video Event Awareness Workbench (VEAW) analyzes surveillance video from thousands of video cameras and automatically detects complex events in near-real-time-at pace with their input video streams. For events of interest to security personnel, VEAW generates and routes alerts and related video evidence to subscribing security personnel. Complex event processing in VEAW is driven by user-authored awareness specifications comprised of inter-connected spatio-temporal stream and statistical operators that consume and produce events described in VEAW’s surveillance ontology. In this paper we introduce VEAW’s event driven architecture and describe its solutions for automating video surveillance, including the orchestration of continuous and tasked video analysis algorithms (e.g., for entity tracking and identification), fusion of events from multiple sources in an installation-specific “world” model, and proactive information gathering to deal with missing or incomplete information (this is done by tasking video analysis algorithms and security personnel to provide it). We also discuss how VEAW deals with late arriving information (due to out-of-band video analysis tasks and overhead), as well as a related resource optimization aimed at minimizing computation costs. We illustrate the benefits of VEAW by illustrating its application on the automation of real-world security policies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abadi, D.J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: Aurora: a new model and architecture for data stream management. VLDB J. 12(2), (2003)

  2. Abadi, D.J., Ahmad, Y., Balazinska, M., Çetintemel, U., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., Zdonik, S.: The design of the borealis stream processing engine. In: Second Biennial Conference on Innovative Data Systems Research (DR 2005) (2005)

  3. Arasu, A., Widom, J.: Resource sharing in continuous sliding-window aggregates. In: VLDB 2004, (2004)

  4. Aref, W., Catlin, A.C., Elmagarmid, A., Fan, J., Guo, J., Hammad, M., Ilyas, I., Marzouk, M., Prabhakar, S., Rezgui, A., Teoh, S., Terzi, E., Tu, Y., Vakali, A., Zhu, X.: A distributed server for continuous media. In: 18th International Conference on Data Engineering (ICDE’02), 2002

  5. Baker, D., Cassandra, A., Rashid, M.: CEDMOS: Complex event detection and monitoring system. MCC Technical Report CEDMOS-002-99. Retrieved 2005 from http://citeseer.ist.psu.edu/baker99cedmos.html (1999)

  6. Baker, D., Georgakopoulos, D., Schuster, H., Cichocki, A.: Customized process and situation awareness. Int. J. Coop. Inf. Syst. 11(3, 4), (2002) (World Scientific)

  7. Borealis Project: Borealis second generation stream processing engine. Retrieved 2005 from http://nms.lcs.mit.edu/projects/borealis/

  8. Chakravarthy, S.: Snoop: an expressive event specification language for active databases. IEEE Data Knowl. Eng. 14(10), (1994)

  9. Georgakopoulos, D., Baker, D.: Providing physical security via video event awareness. In: Int. Conf. on Signal Processing and Multimedia Applications (SIGMAP), (2006)

  10. Georgakopoulos, D., Schuster, H., Baker, D., Cichocki, A.: Managing escalation of collaboration processes in crisis mitigation situations. In: 16th International Conference on Data Engineering (ICDE’00) (2000)

  11. GVI: GVI TRAK. Retrieved 2006 from http://www.samsung-security.com/

  12. Hongeng, S., Nevatia, R., Bremond, F.: Video-based event recognition: activity representation and probabilistic recognition methods. Comput. Vis. Image Underst. 96 (2003)

  13. Moser, F., Kraiss, A., Klas, W.L.: A buffer management strategy for interactive continuous data flows in a multimedia DBMS. In: 21st International Conference on Very Large Data Bases (VLDB’95), 1995

  14. ObjectVideo: ObjectVideo VEW. Retrieved 2006 from http://www.objectvideo.com/products/vew/

  15. Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. I.E.E.E. 77(2), (1989)

  16. Sankoff, D., Kruskal, J.B. (eds.): Time Warps, String Edits, and Macro-molecules: The Theory and Practice of Sequence Comparison. Addison-Wesley, Reading, MA (1983)

  17. Srivastava, U., Widom, J.: Flexible time management in data stream systems. In: PODS 2004, (2004)

  18. Stanford University: STREAM: The Stanford Stream Data Manager. Retrieved 2006 from http://infolab.stanford.edu/stream/

  19. Streambase: Streambase System. Retrieved 2006 from http://www.streambase.com/

  20. TIBCO: TIBCO Staffware Process Suite. Retrieved 2006 from http://www.tibco.com

  21. UC Berkeley: TinyDB: A Declarative Database for Sensor Networks. Retrieved 2005 from http://telegraph.cs.berkeley.edu/tinydb/

Download references

Author information

Authors and Affiliations

  1. Telcordia Technologies, Austin Research Center, 106 E. Sixth Street, Suite 415, Austin, TX, 78701, USA

    Dimitrios Georgakopoulos, Donald Baker, Marian Nodine & Andrzej Cichoki

Authors
  1. Dimitrios Georgakopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Donald Baker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marian Nodine
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrzej Cichoki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dimitrios Georgakopoulos.

Additional information

© Telcordia Technologies, Inc. 2007

Rights and permissions

Reprints and permissions

About this article

Cite this article

Georgakopoulos, D., Baker, D., Nodine, M. et al. Event-driven Video Awareness Providing Physical Security. World Wide Web 10, 85–109 (2007). https://doi.org/10.1007/s11280-006-0015-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-006-0015-4

Keywords

Search

Navigation