skip to main content
10.1145/1099396.1099420acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Surveillance camera scheduling: a virtual vision approach

Published: 11 November 2005 Publication History

Abstract

We present a surveillance system, comprising wide field-of-view (FOV) passive cameras and pan/tilt/zoom (PTZ) active cameras, which automatically captures and labels high-resolution videos of pedestrians as they move through a designated area. A wide-FOV stationary camera can track multiple pedestrians, while any PTZ active camera can capture high-quality videos of a single pedestrian at a time. We propose a multi-camera control strategy that combines information gathered by the wide-FOV cameras with weighted round-robin scheduling to guide the available PTZ cameras, such that each pedestrian is viewed by at least one active camera during their stay in the designated area.A distinctive centerpiece of our work is the exploitation of a visually and behaviorally realistic virtual environment simulator for the development and testing of surveillance systems. Our research would be more or less infeasible in the real world given the impediments to deploying and experimenting with an appropriately complex camera sensor network in a large public space the size of, say, a train station. In particular, we demonstrate our surveillance system in a virtual train station environment populated by autonomous, lifelike virtual pedestrians, wherein easily reconfigurable virtual cameras generate synthetic video feeds that emulate those generated by real surveillance cameras monitoring richly populated public spaces.

References

[1]
D. Terzopoulos and T. Rabie, "Animat vision: Active vision in artificial animals," Videre: Journal of Computer Vision Research, vol. 1, pp. 2--19, September 1997.
[2]
D. Terzopoulos, "Perceptive agents and systems in virtual reality," in Proc. 10th ACM Symposium on Virtual Reality Software and Technology, (Osaka, Japan), pp. 1--3, October 2003.
[3]
W. Shao and D. Terzopoulos, "Autonomous pedestrians," in Proc. ACM SIGGRAPH / Eurographics Symposium on Computer Animation, (Los Angeles, CA), pp. 19--28, July 2005.
[4]
F. Qureshi and D. Terzopoulos, "Towards intelligent camera networks: A virtual vision approach," in Proc. The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, (Beijing), October 2005. In press.
[5]
F. Pedersini, A. Sarti, and S. Tubaro, "Accurate and simple geometric calibration of multi-camera systems," Signal Processing, vol. 77, no. 3, pp. 309--334, 1999.
[6]
T. Gandhi and M. M. Trivedi, "Calibration of a reconfigurable array of omnidirectional cameras using a moving person," in Proc. 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York, NY), pp. 12--19, ACM Press, 2004.
[7]
R. Collins, O. Amidi, and T. Kanade, "An active camera system for acquiring multi-view video," in Proc. International Conference on Image Processing, (Rochester, NY), pp. 517--520, September 2002.
[8]
J. Kang, I. Cohen, and G. Medioni, "Multi-views tracking within and across uncalibrated camera streams," in Proc. First ACM SIGMM International Workshop on Video Surveillance, (New York, NY), pp. 21--33, ACM Press, 2003.
[9]
D. Comaniciu, F. Berton, and V. Ramesh, "Adaptive resolution system for distributed surveillance," Real Time Imaging, vol. 8, no. 5, pp. 427--437, 2002.
[10]
M. Trivedi, K. Huang, and I. Mikic, "Intelligent environments and active camera networks," in Proc. IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 804--809, October 2000.
[11]
S. Stillman, R. Tanawongsuwan, and I. Essa, "A system for tracking and recognizing multiple people with multiple cameras," Tech. Rep. GIT-GVU-98-25, Georgia Institute of Technology, Graphics, Visualization, and Usability Center, 1998.
[12]
S. Khan and M. Shah, "Consistent labeling of tracked objects in multiple cameras with overlapping fields of view," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, pp. 1355--1360, October 2003.
[13]
R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade, "Algorithms for cooperative multisensor surveillance," Proceedings of the IEEE, vol. 89, pp. 1456--1477, October 2001.
[14]
X. Zhou, R. T. Collins, T. Kanade, and P. Metes, "A master-slave system to acquire biometric imagery of humans at distance," in Proc. First ACM SIGMM International Workshop on Video Surveillance, (New York, NY), pp. 113--120, ACM Press, 2003.
[15]
A. Hampapur, S. Pankanti, A. Senior, Y.-L. Tian, L. Brown, and R. Bolle, "Face cataloger: Multi-scale imaging for relating identity to location," in Proc. IEEE Conference on Advanced Video and Signal Based Surveillance, (Washington, DC, USA), pp. 13--21, 2003.
[16]
C. J. Costello, C. P. Diehl, A. Banerjee, and H. Fisher, "Scheduling an active camera to observe people," in Proc. 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York, NY), pp. 39--45, ACM Press, 2004.
[17]
A. Bar-Noy, S. Guha, J. Naor, and B. Schieber, "Approximating the throughput of multiple machines in real-time scheduling," SIAM Journal on Computing, vol. 31, no. 2, pp. 331--352, 2002.
[18]
J. Sgall, "Online scheduling - a survey," in On-Line Algorithms: The State of the Art, Lecture Notes in Computer Science, pp. 192--231, Springer-Verlag, 1998.
[19]
T. Ling and N. Shroff, "Scheduling real-time traffic in ATM networks," in Proc. IEEE Infocom, pp. 198--205, 1996.
[20]
R. Givan, E. Chong, and H. Chang, "Scheduling multiclass packet streams to minimize weighted loss," Queueing Systems: Theory and Application, vol. 41, no. 3, pp. 241--270, 2002.
[21]
N. T. Siebel, Designing and Implementing People Tracking Applications for Automated Visual Surveillance. PhD thesis, Dept. of Computer Science. The University of Reading., UK, March 2003.

Cited By

View all
  • (2015)Multi-Camera Coordination and Control in Surveillance SystemsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/271012811:4(1-30)Online publication date: 2-Jun-2015
  • (2015)PTZ Camera Scheduling for Selected Area Coverage in Visual Sensor Networks2015 IEEE 35th International Conference on Distributed Computing Systems10.1109/ICDCS.2015.46(379-388)Online publication date: Jun-2015
  • (2014)Online control of active camera networks for computer vision tasksACM Transactions on Sensor Networks10.1145/253028310:2(1-40)Online publication date: 31-Jan-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VSSN '05: Proceedings of the third ACM international workshop on Video surveillance & sensor networks
November 2005
168 pages
ISBN:1595932429
DOI:10.1145/1099396
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. camera control
  2. camera scheduling
  3. sensor coordination
  4. surveillance systems
  5. virtual vision

Qualifiers

  • Article

Conference

MM&Sec '05
MM&Sec '05: Multimedia and Security Workshop 2005
November 11, 2005
Hilton, Singapore

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2015)Multi-Camera Coordination and Control in Surveillance SystemsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/271012811:4(1-30)Online publication date: 2-Jun-2015
  • (2015)PTZ Camera Scheduling for Selected Area Coverage in Visual Sensor Networks2015 IEEE 35th International Conference on Distributed Computing Systems10.1109/ICDCS.2015.46(379-388)Online publication date: Jun-2015
  • (2014)Online control of active camera networks for computer vision tasksACM Transactions on Sensor Networks10.1145/253028310:2(1-40)Online publication date: 31-Jan-2014
  • (2014)Coverage in visual sensor networks with Pan-Tilt-Zoom cameras: The MaxFoV problemIEEE INFOCOM 2014 - IEEE Conference on Computer Communications10.1109/INFOCOM.2014.6848084(1492-1500)Online publication date: Apr-2014
  • (2013)All about the with statement in JavaScriptACM SIGPLAN Notices10.1145/2578856.250817349:2(73-84)Online publication date: 28-Oct-2013
  • (2013)WhalesongACM SIGPLAN Notices10.1145/2578856.250817249:2(97-108)Online publication date: 28-Oct-2013
  • (2013)Learning sparse representations for view-independent human action recognition based on fuzzy distancesNeurocomputing10.1016/j.neucom.2013.05.021121(344-353)Online publication date: 1-Dec-2013
  • (2012)All-hex meshing using singularity-restricted fieldACM Transactions on Graphics10.1145/2366145.236619631:6(1-11)Online publication date: 1-Nov-2012
  • (2012)An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographsACM Transactions on Graphics10.1145/2366145.236616431:6(1-10)Online publication date: 1-Nov-2012
  • (2012)Interactive bi-scale editing of highly glossy materialsACM Transactions on Graphics10.1145/2366145.236616331:6(1-7)Online publication date: 1-Nov-2012
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media