Cited By
View all- Gnjatović MMaček NSaračević MAdamović SJoksimović DKarabašević D(2022)Cognitively Economical Heuristic for Multiple Sequence Alignment under UncertaintiesAxioms10.3390/axioms1201000312:1(3)Online publication date: 21-Dec-2022
Sequence alignment with the hilbert-schmidt independence criterion
Article No.: 7, Pages 1 - 8
Abstract
We present a technique for establishing the temporal alignment between two videos of a single scene, by measuring the statistical dependence between the videos using the Hilbert-Schmidt independence criterion. Unlike previous approaches our technique does not require any feature correspondences between views, nor does it even require the two views to have any scene points in common. We show that our technique can handle arbitrary camera configurations, and can tolerate small camera motions. We demonstrate results on a number of test sequences, including cluttered outdoor scenes and those with significant occlusions.
References
[1]
Yaron Caspi, Denis Simakov, and Michal Irani. 2006. Feature-based sequence-to-sequence matching. International Journal of Computer Vision 68, 1 (2006), 53--64.
[2]
Matthijs Douze, Jérôme Revaud, Jakob Verbeek, Hervé Jégou, and Cordelia Schmid. 2016. Circulant Temporal Encoding for Video Retrieval and Temporal Alignment. Int. J. Comput. Vision 119, 3 (Sept. 2016), 291--306.
[3]
Ahmed Elhayek, Carsten Stoll, Kwang In Kim, H-P Seidel, and Christian Theobalt. 2012. Feature-based multi-video synchronization with subframe accuracy. Springer. 266--275 pages.
[4]
Gunnar Farnebäck. 2003. Two-frame Motion Estimation Based on Polynomial Expansion. In Proceedings of the 13th Scandinavian Conference on Image Analysis (SCIA'03). 363--370.
[5]
Arthur Gretton, Karsten M. Borgwardt, Malte J. Rasch, Bernhard Schölkopf, and Alexander J. Smola. 2012. A Kernel Two-Sample Test. Journal of Machine Learning Research 13 (2012), 723--773.
[6]
Arthur Gretton, Olivier Bousquet, Alex Smola, and Bernhard Schölkopf. 2005. Measuring Statistical Dependence with Hilbert-Schmidt Norms. In Algorithmic Learning Theory, Sanjay Jain, Hans Ulrich Simon, and Etsuji Tomita (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 63--77.
[7]
Arthur Gretton, Kenji Fukumizu, Choon H Teo, Le Song, Bernhard Schölkopf, and Alex J Smola. 2007. A kernel statistical test of independence. In Advances in Neural Information Processing Systems. 585--592.
[8]
Chris Harris and Mike Stephens. 1988. A combined corner and edge detector. In Alvey vision conference, Vol. 15. Citeseer, 50.
[9]
Alexander Kraskov, Harald Stögbauer, and Peter Grassberger. 2004. Estimating mutual information. Phys. Rev. E 69 Jun 2004), 066138. Issue 6.
[10]
Cen Rao, Alexei Gritai, Mubarak Shah, and Tanveer Syeda-Mahmood. 2003. View-invariant alignment and matching of video sequences. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on. IEEE, 939--945.
[11]
Bharath K Sriperumbudur, Kenji Fukumizu, and Gert Lanckriet. 2010. On the relation between universality, characteristic kernels and RKHS embedding of measures. In International Conference on Artificial Intelligence and Statistics. 773--780.
[12]
Tinne Tuytelaars and Luc Van Gool. 2004. Synchronizing video sequences. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, vol. 1. IEEE, I-762.
[13]
Anthony Whitehead, Robert Laganiere, and Prosenjit Bose. 2005. Temporal synchronization of video sequences in theory and in practice. In Aplication of Computer Vision, 2005. WACV/MOTIONS'05 Volume 1. Seventh IEEE Workshops on, Vol. 2. IEEE, 132--137.
[14]
Jingyu Yan and Marc Pollefeys. 2004. Video synchronization via space-time interest point distribution. In Advanced Concepts for Intelligent Vision Systems, vol. 1. 12--21.
Index Terms
- Sequence alignment with the hilbert-schmidt independence criterion
Recommendations
Linear Sequence-to-Sequence Alignment
In this paper, we consider the problem of estimating the spatiotemporal alignment between N unsynchronized video sequences of the same dynamic 3D scene, captured from distinct viewpoints. Unlike most existing methods, which work for N=2 and rely on a ...
Local tangent space alignment based on Hilbert–Schmidt independence criterion regularization
AbstractLocal tangent space alignment (LTSA) is a famous manifold learning algorithm, and many other manifold learning algorithms are developed based on LTSA. However, from the viewpoint of dimensionality reduction, LTSA is only a local feature preserving ...
Temporal synchronization of non-overlapping videos using known object motion
This paper presents a robust technique for temporally aligning multiple video sequences that have no spatial overlap between their fields of view. It is assumed that (i) a moving target with known trajectory is viewed by all cameras at non-overlapping ...
Comments
Information & Contributors
Information
Published In
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 December 2018
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
CVMP '18
Sponsor:
CVMP '18: European Conference on Visual Media Production
December 13 - 14, 2018
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 40 of 67 submissions, 60%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 66Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
Cited By
View all- Gnjatović MMaček NSaračević MAdamović SJoksimović DKarabašević D(2022)Cognitively Economical Heuristic for Multiple Sequence Alignment under UncertaintiesAxioms10.3390/axioms1201000312:1(3)Online publication date: 21-Dec-2022
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in