skip to main content
10.1145/1099396.1099419acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Acquisition of high-resolution images through on-line saccade sequence planning

Published: 11 November 2005 Publication History

Abstract

This paper considers the problem of scheduling an active observer to visit as many targets in an area of surveillance as possible. We show how it is possible to plan a sequence of decisions regarding what target to look at through such a foveal-sensing action. We propose a framework in which a pan/tilt/zoom camera executes saccades in order to visit, and acquire high resolution images (at least one) of, as many moving targets as possible before they leave the scene. An intelligent choice of the order of sensing the targets can significantly reduce the total dead-time wasted by the active camera and, consequently, its cycle time. We cast the whole problem into a dynamic discrete optimization framework. In particular, we will show that the problem can be solved by modeling the attentional gaze control as a kinetic traveling salesperson problem whose solution is approximated by iteratively solving time dependent orienteering problems.Congestion analysis experiments are reported demonstrating the effectiveness of the solution in acquiring high resolution images of a large number of moving targets in a wide area. The evaluation was conducted with a simulation of a dual camera system in a master-slave configuration. We also report on preliminary experiments conducted using live cameras in a real surveillance environment.

References

[1]
J. Batista, P. Peixoto, and H. Araujo. Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking. In Proceedings of the IEEE Workshop on Visual Surveillance, pages 18--25, 1998.
[2]
J. Batista, P. Peixoto, and H. Araujo. Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking. In Proceedings of the IEEE Workshop on Visual Surveillance, pages 18--25, 1998.
[3]
R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade. Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE, 89(10):1456--1455, October 2001.
[4]
C. Colombo, A. D. Bimbo, and F. Pernici. Metric 3d reconstruction and texture acquisition of surfaces of revolution from a single uncalibrated view. IEEE Transactions PAMI, 27(1):99--114, 2005.
[5]
C. J. Costello, C. P. Diehl, A. Banerjee, and H. Fisher. Scheduling an active camera to observe people. In Proceedings of VSSN2004, October 2004.
[6]
L. de Agapito, R. Hartley, and E. Hayman. Linear self-calibration of a rotating and zooming camera. In Proceedings of CVPR1999, pages 15--21, 1999.
[7]
A. del Bimbo and F. Pernici. Distant targets identification as an on-line dynamic vehicle routing problem using an active-zooming camera. In Proceedings of VS-PETS, 2005. (to appear).
[8]
F. V. Fomin and A. Lingas. Approximation algorithms for time-dependent orienteering. Information Processing Letters, 83(2):57--62, 2002.
[9]
M. Greiffenhagen, V. Ramesh, and D. C. H. Niemann. Statistical modeling and performance characterization of a real-time dual camera surveillance system. In Proceedings CVPR2000, volume 2, pages 335--342, Hilton Head Island, South Carolina, 2000.
[10]
A. Hampapur, S. Pankanti, A. Senior, Y.-L. Tian, L. Brown, and R. Bolle. Face cataloger: Multi-scale imaging for relating identity to location. In Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, Miami, Florida, 2003.
[11]
R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2004.
[12]
C. S. Helvig, G. Robins, and A. Zelikovsky. The moving-target traveling salesman problem. Journal of Algorithms, 49(1):153--174, 2003.
[13]
S.-N. Lim, L. S. Davis, and A. Elgammal. Scalable image-based multi-camera visual surveillance system. In Proceedings IEEE Conference on Advanced Video and Signal Based Surveillance, pages 205--212, July 2003.
[14]
L. Marchesotti, L. Marcenaro, and C. Regazzoni. Dual camera system for face detection in unconstrained environments. In Proceedings ICIP2003, volume 1, pages 681--684, 2003.
[15]
D. W. Murray, K. J. Bradshaw, P. F. McLauchlan, I. D. Reid, and P. Sharkey. Driving saccade to pursuit using image motion. IJCV, 16(3):205--228, 1995.
[16]
S. J. D. Prince, J. H. Elder, Y. Hou, and M. Sizinstev. Pre-attentive face detection for foveated wide-field surveillance. In Proceedings of the IEEE Workshop on Applications on Computer Vision, Breckenridge, Colorado, January 2005.
[17]
A. Senior, A. Hampapur, and M. Lu. Acquiring multi-scale images by pan-tilt-zoom control and automatic multi-camera calibration. In Proceedings of the IEEE Workshop on Applications on Computer Vision, Breckenridge, Colorado, January 2005.
[18]
S. Sinha and M. Pollefeys. Towards calibrating a pan-tilt-zoom cameras network. In Proceedings of OMNIVIS 2004, May 2004.
[19]
S. Stillman, R. Tanawongsuwan, and I. Essa. A system for tracking and recognizing multiple people with multiple cameras. Technical Report Technical Report GIT-GVU-98-25, Georgia Institute of Technology, Graphics, Visualization, and Usability Center, 1998.
[20]
B. Tordoff. Active Control of Zoom for Computer Vision. PhD thesis, University of Oxford, 2002.
[21]
X. Zhou, R. Collins, T. Kanade, and P. Metes. A master-slave system to acquire biometric imagery of humans at a distance. In ACM SIGMM 2003 Workshop on Video Surveillance, Berkeley, CA, 2003.

Cited By

View all
  • (2018)Extreme Trust Region Policy Optimization for Active Object RecognitionIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2017.278523329:6(2253-2258)Online publication date: Jun-2018
  • (2018)The Multi-strand Graph for a PTZ TrackerJournal of Mathematical Imaging and Vision10.1007/s10851-017-0774-960:4(594-608)Online publication date: 1-May-2018
  • (2017)Opportunistic Image Acquisition of Individual and Group Activities in a Distributed Camera NetworkIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.259362027:3(664-672)Online publication date: 1-Mar-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VSSN '05: Proceedings of the third ACM international workshop on Video surveillance & sensor networks
November 2005
168 pages
ISBN:1595932429
DOI:10.1145/1099396
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. performance modeling
  2. saccade planning
  3. scheduling
  4. video surveillance systems

Qualifiers

  • Article

Conference

MM&Sec '05
MM&Sec '05: Multimedia and Security Workshop 2005
November 11, 2005
Hilton, Singapore

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Extreme Trust Region Policy Optimization for Active Object RecognitionIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2017.278523329:6(2253-2258)Online publication date: Jun-2018
  • (2018)The Multi-strand Graph for a PTZ TrackerJournal of Mathematical Imaging and Vision10.1007/s10851-017-0774-960:4(594-608)Online publication date: 1-May-2018
  • (2017)Opportunistic Image Acquisition of Individual and Group Activities in a Distributed Camera NetworkIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.259362027:3(664-672)Online publication date: 1-Mar-2017
  • (2017)From foot to head: Active face finding using deep Q-learning2017 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2017.8296604(1862-1866)Online publication date: Sep-2017
  • (2016)Persistent people tracking and face capture using a PTZ cameraMachine Vision and Applications10.1007/s00138-016-0758-627:3(397-413)Online publication date: 1-Apr-2016
  • (2015)The multi-strand graph for a PTZ tracker2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS)10.1109/AVSS.2015.7301768(1-6)Online publication date: Aug-2015
  • (2014)Online control of active camera networks for computer vision tasksACM Transactions on Sensor Networks10.1145/253028310:2(1-40)Online publication date: 31-Jan-2014
  • (2011)Gaze directed camera control for face image acquisition2011 IEEE International Conference on Robotics and Automation10.1109/ICRA.2011.5979585(4227-4233)Online publication date: May-2011
  • (2011)On-line control of active camera networks for computer vision tasks2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras10.1109/ICDSC.2011.6042926(1-6)Online publication date: Aug-2011
  • (2010)Probabilistic surveillance with multiple active cameras2010 IEEE International Conference on Robotics and Automation10.1109/ROBOT.2010.5509736(440-445)Online publication date: May-2010
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media