Abstract
We present an algorithm that synchronizes two short video sequences where an object undergoes ballistic motion against stationary scene points. The object’s motion and epipolar geometry are exploited to guide the algorithm to the correct synchronization in an iterative manner. Our algorithm accurately synchronizes videos recorded at different frame rates, and takes few iterations to converge to sub-frame accuracy. We use synthetic data to analyze our algorithm’s accuracy under the influence of noise. We demonstrate that it accurately synchronizes real video sequences, and evaluate its performance against manual synchronization.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: Proceedings of International Conference on Computer Vision (2003)
Kitahara, I., Saito, H., Akimichi, S., Onno, T., Ohta, Y., Kanade, T.: Large-scale virtualized reality. In: Computer Vision and Pattern Recognition Technical Sketches (2001)
Tresadern, P.A., Reid, I.: Synchronizing image sequences of non-rigid objects. In: Proceedings of British Machine Vision Conference (2003)
Caspi, Y., Irani, M.: Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 1409–1424 (2002)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Reid, I.D., Zisserman, A.: Goal-directed video metrology. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 647–658. Springer, Heidelberg (1996)
Stein, G.P.: Tracking from multiple view points: Self-calibration of space and time. In: Proceedings of Computer Vision and Pattern Recognition, pp. 521–527 (1999)
Lee, L., Romano, R., Stein, G.: Monitoring activities from multiple video streams: Establishing a common coordinate frame. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 758–767 (2000)
Pooley, D.W., Brooks, M.J., van den Hengel, A.J., Chojnacki, W.: A voting scheme for estimating the synchrony of moving-camera videos. In: Proceedings of ICIP (2003)
Carceroni, R.L., Pádua, F.L.C., Santos, G.A.M.R., Kutulakos, K.N.: Linear sequence-to-sequence alignment. In: Proceedings of CVPR, vol. 1, pp. 746–753 (2004)
Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 381–395 (1981)
Tuytelaars, T., Van Gool, L.: Synchronizing video sequences. Computer Vision and Pattern Recognition, 762–768 (2004)
Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: ECCV Workshop on Vision and Modelling of Dynamic Scenes (2002)
Giese, M.A., Poggio, T.: Synthesis and recognition of biological motion patterns based on linear superposition of prototypical motion sequences. In: Proceedings of the IEEE Workshop on Multi-View Modeling and Analysis of Visual Scene, pp. 73–80 (1999)
Yan, J., Pollefeys, M.: Video synchronization via space-time interest point distribution. In: Proceedings of Advanced Concepts for Intelligent Vision Systems (2004)
Laptev, I., Lindeberg, T.: Space-time interest points. In: Proceedings of International Conference on Computer Vision, vol. 1, pp. 432–439 (2003)
Sinha, S.N., Pollefeys, M.: Synchronization and calibration of camera networks from silhouettes. In: International Conference on Pattern Recognition (2004)
Wedge, D., Huynh, D., Kovesi, P.: Tracking footballs through clutter in broadcast digital videos. In: Image and Vision Computing, New Zealand, pp. 155–160 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wedge, D., Huynh, D., Kovesi, P. (2006). Motion Guided Video Sequence Synchronization. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3852. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612704_83
Download citation
DOI: https://doi.org/10.1007/11612704_83
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31244-4
Online ISBN: 978-3-540-32432-4
eBook Packages: Computer ScienceComputer Science (R0)