Skip to main content
Log in

Surveillance camera scheduling: a virtual vision approach

  • Regular paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

We present a surveillance system, comprising wide field-of-view (FOV) passive cameras and pan/tilt/zoom (PTZ) active cameras, which automatically captures high-resolution videos of pedestrians as they move through a designated area. A wide-FOV static camera can track multiple pedestrians, while any PTZ active camera can capture high-quality videos of one pedestrian at a time. We formulate the multi-camera control strategy as an online scheduling problem and propose a solution that combines the information gathered by the wide-FOV cameras with weighted round-robin scheduling to guide the available PTZ cameras, such that each pedestrian is observed by at least one PTZ camera while in the designated area. A centerpiece of our work is the development and testing of experimental surveillance systems within a visually and behaviorally realistic virtual environment simulator. The simulator is valuable as our research would be more or less infeasible in the real world given the impediments to deploying and experimenting with appropriately complex camera sensor networks in large public spaces. In particular, we demonstrate our surveillance system in a virtual train station environment populated by autonomous, lifelike virtual pedestrians, wherein easily reconfigurable virtual cameras generate synthetic video feeds. The video streams emulate those generated by real surveillance cameras monitoring richly populated public spaces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Qureshi, F., Terzopoulos, D.: Surveillance camera scheduling: a virtual vision approach. In: Proceedings of the 3rd ACM International Workshop on Video Surveillance and Sensor Networks, (Singapore), pp. 131–139 (2005)

  2. Terzopoulos D., Rabie T. (1997): Animat vision: active vision in artificial animals. Videre. J. Comput. Vision Res. 1, 2–19

    Google Scholar 

  3. Terzopoulos, D.: Perceptive agents and systems in virtual reality. In: Proceedings of the 10th ACM Symposium on Virtual Reality Software and Technology, (Osaka, Japan), pp. 1–3 (2003)

  4. Shao, W., Terzopoulos, D.: Autonomous pedestrians. In: Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, (Los Angeles, CA), pp. 19–28 (2005)

  5. Qureshi, F., Terzopoulos, D.: Towards intelligent camera networks: a virtual vision approach. In: Proceedings of the 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS05), (Beijing, China), pp. 177–184 (2005)

  6. Pedersini F., Sarti A., Tubaro S. (1999): Accurate and simple geometric calibration of multi-camera systems. Signal Process. 77(3): 309–334

    Article  MATH  Google Scholar 

  7. Gandhi, T., Trivedi, M.M.: Calibration of a reconfigurable array of omnidirectional cameras using a moving person. In: Proceedings of the 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York), pp. 12–19 (2004)

  8. Collins, R., Amidi, O., Kanade, T.: An active camera system for acquiring multi-view video. In: Proceedings of the International Conference on Image Processing, (Rochester), pp. 517–520 (2002)

  9. Kang, J., Cohen, I., Medioni, G.: Multi-views tracking within and across uncalibrated camera streams. In: Proceedings of the ACM SIGMM International Workshop on Video Surveillance, (New York), pp. 21–33 (2003)

  10. Comaniciu D., Berton F., Ramesh V. (2002): Adaptive resolution system for distributed surveillance. Real Time Imag. 8(5): 427–437

    Article  MATH  Google Scholar 

  11. Trivedi, M., Huang, K., Mikic, I.: Intelligent environments and active camera networks. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 804–809 (2000)

  12. Stillman, S., Tanawongsuwan, R., Essa, I.: A system for tracking and recognizing multiple people with multiple cameras. Technical Report GIT-GVU-98-25, Georgia Institute of Technology, GVU Center (1998)

  13. Khan S., Shah M. (2003): Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1355–1360

    Article  Google Scholar 

  14. Bar-Noy A., Guha S., Naor J., Schieber B. (2002): Approximating the throughput of multiple machines in real-time scheduling. SIAM J. Comput. 31(2), 331–352

    MathSciNet  Google Scholar 

  15. Sgall, J.: Online scheduling: a survey. In: On-Line Algorithms: The State of the Art, Lecture Notes in Computer Science, pp. 192–231. Springer, Berlin Heidelberg New York (1998)

  16. Ling, T., Shroff, N.: Scheduling real-time traffic in ATM networks. In: Proceedings of IEEE Infocom pp. 198–205 (1996)

  17. Givan R., Chong E., Chang H. (2002): Scheduling multiclass packet streams to minimize weighted loss. Queueing Syst. Theory Appl. 41(3): 241–270

    Article  MATH  MathSciNet  Google Scholar 

  18. Collins R., Lipton A., Fujiyoshi H., Kanade T. (2001): Algorithms for cooperative multisensor surveillance. Proc IEEE, 89, 1456–1477

    Article  Google Scholar 

  19. Zhou, X., Collins, R.T., Kanade, T., Metes, P.: A master–slave system to acquire biometric imagery of humans at distance. In: Proceedings of the ACM SIGMM International Workshop on Video Surveillance, (New York), pp. 113–120 (2003)

  20. Hampapur, A., Pankanti, S., Senior, A., Tian, Y.-L., Brown, L., Bolle, R.: Face cataloger: Multi-scale imaging for relating identity to location. In: Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, (Washington, DC), pp. 13–21 (2003)

  21. Costello, C.J., Diehl, C.P., Banerjee, A., Fisher, H.: Scheduling an active camera to observe people. In: Proceedings of the 2nd ACM International Workshop on Video Surveillance and Sensor Networks, (New York), pp. 39–45 (2004)

  22. Santuari, A., Lanz, O., Brunelli, R.: Synthetic movies for computer vision applications. In: Proceedings of the 3rd IASTED International Conference: Visualization, Imaging, and Image Processing (VIIP 2003), no. 1, (Spain), pp. 1–6 (2004)

  23. Bertamini, F., Brunelli, R., Lanz, O., Roat, A., Santuari, A., Tobia, F., Xu, Q.: Olympus: An ambient intelligence architecture on the verge of reality. In: Proceedings of the 12th International Conference on Image Analysis and Processing, (Italy), pp. 139–145 (2003)

  24. Siebel, N.T.: Designing and Implementing People Tracking Applications for Automated Visual Surveillance. PhD Thesis, Department of Computer Science. The University of Reading (2003)

  25. Swain M.J., Ballard D.M. (1991): Color indexing. Int. J. Comput. Vision 7, 11–32

    Article  Google Scholar 

  26. Fiat A., Woeginger G.J. (eds) (1998): Online Algorithms, The State of the Art vol. 1442 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg New York

    Google Scholar 

  27. Graham R.L., Lawler E.L., Lenstra J.K., Kan A.H.G.R. (1997): Optimization and approximation in deterministic sequencing and scheduling: a survey. Ann. Discrete Math 5, 287–326

    Article  Google Scholar 

  28. Du J., Leung J.-T., Wong C. (1992): Minimizing the number of late jobs with release time constraints. J. Combinatorial Math. Combinatorial Comput 11, 97–107

    MATH  MathSciNet  Google Scholar 

  29. Dobson G. (1984): “Scheduling independent tasks on unrelated processors. J. ACM 13, 705–716

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Faisal Z. Qureshi.

Additional information

A preliminary version of this paper appeared as [1].

Rights and permissions

Reprints and permissions

About this article

Cite this article

Qureshi, F.Z., Terzopoulos, D. Surveillance camera scheduling: a virtual vision approach. Multimedia Systems 12, 269–283 (2006). https://doi.org/10.1007/s00530-006-0059-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-006-0059-4

Keywords

Navigation