Abstract
We present a surveillance system, comprising wide field-of-view (FOV) passive cameras and pan/tilt/zoom (PTZ) active cameras, which automatically captures high-resolution videos of pedestrians as they move through a designated area. A wide-FOV static camera can track multiple pedestrians, while any PTZ active camera can capture high-quality videos of one pedestrian at a time. We formulate the multi-camera control strategy as an online scheduling problem and propose a solution that combines the information gathered by the wide-FOV cameras with weighted round-robin scheduling to guide the available PTZ cameras, such that each pedestrian is observed by at least one PTZ camera while in the designated area. A centerpiece of our work is the development and testing of experimental surveillance systems within a visually and behaviorally realistic virtual environment simulator. The simulator is valuable as our research would be more or less infeasible in the real world given the impediments to deploying and experimenting with appropriately complex camera sensor networks in large public spaces. In particular, we demonstrate our surveillance system in a virtual train station environment populated by autonomous, lifelike virtual pedestrians, wherein easily reconfigurable virtual cameras generate synthetic video feeds. The video streams emulate those generated by real surveillance cameras monitoring richly populated public spaces.
Similar content being viewed by others
References
Qureshi, F., Terzopoulos, D.: Surveillance camera scheduling: a virtual vision approach. In: Proceedings of the 3rd ACM International Workshop on Video Surveillance and Sensor Networks, (Singapore), pp. 131–139 (2005)
Terzopoulos D., Rabie T. (1997): Animat vision: active vision in artificial animals. Videre. J. Comput. Vision Res. 1, 2–19
Terzopoulos, D.: Perceptive agents and systems in virtual reality. In: Proceedings of the 10th ACM Symposium on Virtual Reality Software and Technology, (Osaka, Japan), pp. 1–3 (2003)
Shao, W., Terzopoulos, D.: Autonomous pedestrians. In: Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, (Los Angeles, CA), pp. 19–28 (2005)
Qureshi, F., Terzopoulos, D.: Towards intelligent camera networks: a virtual vision approach. In: Proceedings of the 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS05), (Beijing, China), pp. 177–184 (2005)
Pedersini F., Sarti A., Tubaro S. (1999): Accurate and simple geometric calibration of multi-camera systems. Signal Process. 77(3): 309–334
Gandhi, T., Trivedi, M.M.: Calibration of a reconfigurable array of omnidirectional cameras using a moving person. In: Proceedings of the 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York), pp. 12–19 (2004)
Collins, R., Amidi, O., Kanade, T.: An active camera system for acquiring multi-view video. In: Proceedings of the International Conference on Image Processing, (Rochester), pp. 517–520 (2002)
Kang, J., Cohen, I., Medioni, G.: Multi-views tracking within and across uncalibrated camera streams. In: Proceedings of the ACM SIGMM International Workshop on Video Surveillance, (New York), pp. 21–33 (2003)
Comaniciu D., Berton F., Ramesh V. (2002): Adaptive resolution system for distributed surveillance. Real Time Imag. 8(5): 427–437
Trivedi, M., Huang, K., Mikic, I.: Intelligent environments and active camera networks. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 804–809 (2000)
Stillman, S., Tanawongsuwan, R., Essa, I.: A system for tracking and recognizing multiple people with multiple cameras. Technical Report GIT-GVU-98-25, Georgia Institute of Technology, GVU Center (1998)
Khan S., Shah M. (2003): Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1355–1360
Bar-Noy A., Guha S., Naor J., Schieber B. (2002): Approximating the throughput of multiple machines in real-time scheduling. SIAM J. Comput. 31(2), 331–352
Sgall, J.: Online scheduling: a survey. In: On-Line Algorithms: The State of the Art, Lecture Notes in Computer Science, pp. 192–231. Springer, Berlin Heidelberg New York (1998)
Ling, T., Shroff, N.: Scheduling real-time traffic in ATM networks. In: Proceedings of IEEE Infocom pp. 198–205 (1996)
Givan R., Chong E., Chang H. (2002): Scheduling multiclass packet streams to minimize weighted loss. Queueing Syst. Theory Appl. 41(3): 241–270
Collins R., Lipton A., Fujiyoshi H., Kanade T. (2001): Algorithms for cooperative multisensor surveillance. Proc IEEE, 89, 1456–1477
Zhou, X., Collins, R.T., Kanade, T., Metes, P.: A master–slave system to acquire biometric imagery of humans at distance. In: Proceedings of the ACM SIGMM International Workshop on Video Surveillance, (New York), pp. 113–120 (2003)
Hampapur, A., Pankanti, S., Senior, A., Tian, Y.-L., Brown, L., Bolle, R.: Face cataloger: Multi-scale imaging for relating identity to location. In: Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, (Washington, DC), pp. 13–21 (2003)
Costello, C.J., Diehl, C.P., Banerjee, A., Fisher, H.: Scheduling an active camera to observe people. In: Proceedings of the 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York), pp. 39–45 (2004)
Santuari, A., Lanz, O., Brunelli, R.: Synthetic movies for computer vision applications. In: Proceedings of the 3rd IASTED International Conference: Visualization, Imaging, and Image Processing (VIIP 2003), no. 1, (Spain), pp. 1–6 (2004)
Bertamini, F., Brunelli, R., Lanz, O., Roat, A., Santuari, A., Tobia, F., Xu, Q.: Olympus: An ambient intelligence architecture on the verge of reality. In: Proceedings of the 12th International Conference on Image Analysis and Processing, (Italy), pp. 139–145 (2003)
Siebel, N.T.: Designing and Implementing People Tracking Applications for Automated Visual Surveillance. PhD Thesis, Department of Computer Science. The University of Reading (2003)
Swain M.J., Ballard D.M. (1991): Color indexing. Int. J. Comput. Vision 7, 11–32
Fiat A., Woeginger G.J. (eds) (1998): Online Algorithms, The State of the Art vol. 1442 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg New York
Graham R.L., Lawler E.L., Lenstra J.K., Kan A.H.G.R. (1997): Optimization and approximation in deterministic sequencing and scheduling: a survey. Ann. Discrete Math 5, 287–326
Du J., Leung J.-T., Wong C. (1992): Minimizing the number of late jobs with release time constraints. J. Combinatorial Math. Combinatorial Comput 11, 97–107
Dobson G. (1984): “Scheduling independent tasks on unrelated processors. J. ACM 13, 705–716
Author information
Authors and Affiliations
Corresponding author
Additional information
A preliminary version of this paper appeared as [1].
Rights and permissions
About this article
Cite this article
Qureshi, F.Z., Terzopoulos, D. Surveillance camera scheduling: a virtual vision approach. Multimedia Systems 12, 269–283 (2006). https://doi.org/10.1007/s00530-006-0059-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-006-0059-4