skip to main content
10.1145/2659021.2659056acmconferencesArticle/Chapter ViewAbstractPublication PagesicdscConference Proceedingsconference-collections
tutorial

Recovery of Temporal Synchronization Error through Online 3D Tracking with Two Cameras

Published: 04 November 2014 Publication History

Abstract

Multiple object tracking within a network of cameras with overlapping fields of views has gained interest. The acquisition of images in an asynchronous manner hinders the practical implementation of such systems. Most of the previous work reported tests over short intervals, leaving the performance degradation due to asynchronous image acquisition unknown. In this work, we propose an online method to recover the synchronization error while tracking objects. The recovered error is fed back to trackers so as to restore their performance. The time synchronization error is measured by the mismatch in the epipolar constraint between the two cameras. We show that successful recovery of the synchronization error is possible when its product with the object motion speeds are within some limits.

References

[1]
M. S. Arulampalam, S. Maskell, N. Gordonl, and T. Clapp. A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Trans. on Signal Processing, 50(2):174--188, 2002.
[2]
Y. Caspi and M. Irani. Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(11):1409--1424, 2002.
[3]
Y. Caspi, D. Simakov, and M. Irani. Feature-based sequence-to-sequence matching. International Journal of Computer Vision, 68(1), 2006.
[4]
J. Ferryman. Pets 2009. http://www.cvg.rdg.ac.uk/PETS2009/, 2009.
[5]
F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua. Multicamera people tracking with a probabilistic occupancy map. IEEE Trans. PAMI, 30(2):267--282, 2008.
[6]
L. Guan, J.-S. Franco, and M. Pollefeys. Multi-object shape estimation and tracking from silhouette cues. In IEEE Conf. CVPR, pages 1--8, 2008.
[7]
R. Hartley and A. Zisserman. Multi View Geometry in Computer Vision. Cambridge University Press, second edition edition, 2004.
[8]
M. Keck and J. W. Davis. Recovery and reasoning about occlusions in 3d using few cameras with applications to 3d tracking. IJCV, 95(3):240--264, 2011.
[9]
S. M. Khan and M. Shah. Tracking multiple occluding people by localizing on multiple scene planes. IEEE Trans. PAMI, 31(3):505--519, 2009.
[10]
D.-S. Lee. Effective gaussian mixture learning for video background subtraction. IEEE Trans. PAMI, 27(5):827--832, 2005.
[11]
M. Noguchi and T. Kato. Geometric and timing calibration for unsynchronized cameras using trajectories of a moving marker. In IEEE Workshop on Applications of Computer Vision, 2007.
[12]
S. N. Sinha and M. Pollefeys. Synchronization and calibration of camera networks from silhouettes. In Proc. 17th Intl. Conf. Pattern Recognition, pages 116--119, 2004.
[13]
F. Sivrikaya and B. Yener. Time synchronization in sensor networks: A survey. IEEE Network, 18(4):45--50, 2004.
[14]
G. P. Stein. Tracking from multiple view points: Self-calibration of space and time. In Proceedings of DARPA IU Workshop, pages 1037--1042, 1998.
[15]
O. Topcu. Icdsc2014 paper id 16 demo. http://youtu.be/YMycaf8xkjc, 2014.
[16]
O. Topcu, A. A. Alatan, and A. O. Ercan. Occlusion-aware 3d multiple object tracker with two cameras for visual surveillance. In 11th IEEE Intl. Conf. Advanced Video and Signal-Based Surveillance, 2014.
[17]
R. Tsai. A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323--344, 1987.
[18]
G. Welch and G. Bishop. An introduction to the kalman filter, 1995.
[19]
A. Whitehead, R. Laganiere, and P. Bose. Temporal synchronization of video sequences in theory and in practice. In Proceedings of the IEEE Workshop on Motion and Video Computing, 2005.

Cited By

View all
  • (2018)Camera Synchronization for Panoramic VideosMediaSync10.1007/978-3-319-65840-7_20(565-592)Online publication date: 27-Mar-2018

Index Terms

  1. Recovery of Temporal Synchronization Error through Online 3D Tracking with Two Cameras

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICDSC '14: Proceedings of the International Conference on Distributed Smart Cameras
      November 2014
      286 pages
      ISBN:9781450329255
      DOI:10.1145/2659021
      • General Chair:
      • Andrea Prati,
      • Publications Chair:
      • Niki Martinel
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 November 2014

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. 3D tracking
      2. occlusion
      3. synchronization

      Qualifiers

      • Tutorial
      • Research
      • Refereed limited

      Conference

      ICDSC '14
      Sponsor:

      Acceptance Rates

      ICDSC '14 Paper Acceptance Rate 49 of 69 submissions, 71%;
      Overall Acceptance Rate 92 of 117 submissions, 79%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 25 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2018)Camera Synchronization for Panoramic VideosMediaSync10.1007/978-3-319-65840-7_20(565-592)Online publication date: 27-Mar-2018

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media