skip to main content
10.1145/1099396.1099418acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Automatic pan-tilt-zoom calibration in the presence of hybrid sensor networks

Published: 11 November 2005 Publication History

Abstract

Wide-area context awareness is a crucial enabling technology for next generation smart buildings and surveillance systems. It is not practical to cover an entire building with cameras, however it is difficult to infer missing information when there are significant gaps in coverage. As a solution, we advocate a class of hybrid perceptual systems that builds a comprehensive model of activity in a large space, such as a building, by merging contextual information from a dense network of ultra-lightweight sensor nodes with video from a sparse network of high-capability sensors. In this paper we explore the task of automatically recovering the relative geometry between a pan-tilt-zoom camera and a network of one-bit motion detectors. We present results for the recovery of geometry alone, and also recovery of geometry jointly with simple activity models. Because we don't believe a metric calibration is necessary, or even entirely useful for this task, we formulate and pursue the novel goal we term functional calibration. Functional calibration is the blending of geometry estimation and simple behavioral model discovery. Accordingly, results are evaluated in terms of the ability of the system to automatically foveate targets in a large, non-convex space, not in terms of pixel reconstruction error.

References

[1]
Patrick Baker and Yiannis Aloimonos. Calibration of a multicamera network. In Robert Pless, Jose Santos-Victor, and Yasushi Yagi, editors, The fourth Workshop on Omnidirectional Vision, Camera Networks and Non-classical cameras, Madison, Wisconsin, USA, 2003.
[2]
J. Barreto and K. Daniilidis. Wide area multiple camera calibration and estimation of radial distortion. In Peter Sturm, Tomas Svoboda, and Seth Teller, editors, The fifth Workshop on Omnidirectional Vision, Camera Networks and Non-classical cameras, Prague, 2004.
[3]
Robert T. Collins and Yanghai Tsin. Calibration of an outdoor active camera system. In Computer Vision and Pattern Recognition, pages 528--534, Fort Collins, CO, USA, June 1999. IEEE.
[4]
David A. Forsyth and Jean Ponce. Computer Vision: A Modern Approach. Prentice Hall, 2003.
[5]
Richard I. Hartley. Self-calibration from multiple views with a rotating camera. In The Third European Conference on Computer Vision, pages 471--478, Stocklholm, Sweden, 1994. Springer-Verlag.
[6]
Boyoon Jung and Gaurav~S. Sukhatme. Cooperative tracking using mobile robots and environment-embedded, networked sensors. In Proceedings of the International Symposium on Computational Intelligence in Robotics and Automation, pages 206--211, Banff, Alberta, Canada, July 2001.
[7]
Leslie Pack Kaelbling, Michael L. Littman, and Andrew W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237--285, 1996.
[8]
S. Khan, O. Javed, and M. Shah. Tracking in uncalibrated cameras with overlapping field of view. In Workshop on Performance Evaluation of Tracking and Surveillance. IEEE, 2001.
[9]
Ser-Nam Lim, Larry S. Davis, and Ahmed Elgammal. A scalable image-based multi-camera visual surveillance system. In IEEE AVSS, Miami, Florida, July 2003.
[10]
Ali Rahimi, Brian Dunagan, and Trevor Darrell. Simultaneous calibration and tracking with a network of non-overlapping sensors. In Computer Vision and Pattern Recognition, pages 187--194. IEEE Computer Society, June 2004.
[11]
S.N. Sinha and M. Pollefeys. Towards calibrating a pan-tilt-zoom cameras network. In Peter Sturm, Tomas Svoboda, and Seth Teller, editors, The fifth Workshop on Omnidirectional Vision, Camera Networks and Non-classical cameras, Prague, 2004.
[12]
Sony Corporation. SNC-RZ30 CGI command manual, 2.0 edition, April 2003.
[13]
Henry Stark and John~W. Woods. Probability, Random Processes, and Estimation Theory for Engineers. Prentice Hall, 2 edition, 1994.
[14]
Chris Stauffer and Kinh Tieu. Automated multi-camera planar tracking correspondence modeling. In Computer Vision and Pattern Recognition, pages 259--266. IEEE, July 2003.
[15]
Gideon P. Stein. Tracking from multiple view points: Self-calibration of space and time. In Image Understanding Workshop, Montery, CA, USA, 1998. DARPA.
[16]
Sabastian Thrun, Dieter Fox, and WWolfram Burgard. A probabilistic approach to concurrent mapping and localization for mobile robots. Machine Learning and Autonomous Robots (joint issue), 31 & 5:29--53 & 253--271, 1998.
[17]
Miroslav Trajkovic. Interactive calibration of a pan-tilt-zoom (ptz) camera for surveillance applications. In Asian Conference on Computer Vision, 2002.
[18]
M. M. Trivedi, A. Prati, and G. Kogut. Distributed interactive video arrays for event based analysis of incidents. In International Conference on Intelligent Transportation Systems, pages 950--956, Singapore, September 2002. IEEE.
[19]
Christopher R. Wren and Srinivasa G. Rao. Self-configuring, lightweight sensor networks for ubiquitous computing. In The Fifth International Conference on Ubiquitous Computing: Adjunct Proceedings, October 2003. also MERL Technical Report TR2003-24.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VSSN '05: Proceedings of the third ACM international workshop on Video surveillance & sensor networks
November 2005
168 pages
ISBN:1595932429
DOI:10.1145/1099396
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive systems
  2. sensor networks
  3. video surveillance

Qualifiers

  • Article

Conference

MM&Sec '05
MM&Sec '05: Multimedia and Security Workshop 2005
November 11, 2005
Hilton, Singapore

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2012)Calibration Based on a Simplified D-ToA Localization Method for the Video Sensor Nodes on the Metro VehicleApplied Mechanics and Materials10.4028/www.scientific.net/AMM.263-266.963263-266(963-968)Online publication date: Dec-2012
  • (2012)Event prediction in a hybrid camera networkACM Transactions on Sensor Networks10.1145/2140522.21405298:2(1-27)Online publication date: 31-Mar-2012
  • (2011)A Hybrid Static/Active Video Surveillance SystemInternational Journal of Optomechatronics10.1080/15599612.2011.5532525:1(80-95)Online publication date: 7-Mar-2011
  • (2009)Assigning cameras to subjects in video surveillance systemsProceedings of the 2009 IEEE international conference on Robotics and Automation10.5555/1703775.1704032(3623-3629)Online publication date: 12-May-2009
  • (2009)Design of multimedia surveillance systemsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/1556134.15561405:3(1-25)Online publication date: 14-Aug-2009
  • (2009)Assigning cameras to subjects in video surveillance systems2009 IEEE International Conference on Robotics and Automation10.1109/ROBOT.2009.5152753(837-843)Online publication date: May-2009
  • (2009)Knowledge Extraction from Surveillance SensorsWiley Handbook of Science and Technology for Homeland Security10.1002/9780470087923.hhs510(1-1)Online publication date: 15-Mar-2009
  • (2006)A design methodology for selection and placement of sensors in multimedia surveillance systemsProceedings of the 4th ACM international workshop on Video surveillance and sensor networks10.1145/1178782.1178801(121-130)Online publication date: 27-Oct-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media