Hakan Haberdar
ABSTRACT
Synchronization of videos of the same scene recorded at different times is the first step in many applications related to video surveillance, remote sensing, and medical diagnosis. When a pair of corresponding frames from different videos is provided, synchronization of the rest of the frames is a relatively easy task. Unfortunately, this initial correspondence is usually not available. To avoid an exhaustive search for the initial match, most existing solutions rely either on prior information or additional hardware. It would be beneficial to have a method providing the initial match in an automated manner. In this paper, we investigate the feasibility of one--class learning for the problem of video synchronization. We propose a hybrid one--class learner that can assess a similarity score based on the visual features between two frames from different videos by combining outputs of Support Vector Machines and Replicator Neural Network. The learner first finds a small set of potentially corresponding frames. Then, the exact match is determined by minimizing the similarity error in the set. We apply proposed synchronization method to the videos of dynamic outdoor environments recorded by mobile platforms.
- G. Bilgin, S. Erturk, and T. Yildirim. Unsupervised classification of hyperspectral-image data using fuzzy approaches that spatially exploit membership relations. Geoscience and Remote Sensing Letters, IEEE, 5(4): 673--677, oct. 2008.Google Scholar
Cross Ref
- Y. Caspi and M. Irani. Spatio-temporal Alignment of Sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24: 1409--1424, 2002. Google ScholarDigital Library
- C.-C. Chang and C.-J. Lin. LIBSVM: A library for svms. ACM Transactions on Intelligent Systems and Technology, 2: 27:1--27:27, 2011. Google ScholarDigital Library
- C. Clifton. Change Detection in Overhead Imagery Using Neural Networks. Applied Intelligence, 18(2): 215--234, Mar. 2003. Google ScholarDigital Library
- F. Diego, D. Ponsa, J. Serrat, and A. Lopez. Video alignment for change detection. Image Processing, IEEE Transactions on, 20(7): 1858--1869, july 2011. Google ScholarDigital Library
- J. M. Geusebroek, G. J. Burghouts, and A. W. M. Smeulders. The amsterdam library of object images. Int. Journal of Computer Vision, 61(1): 103--112, 2005. Google ScholarDigital Library
- S. Gopal and C. Woodcock. Remote sensing of forest change using artificial neural networks. Geoscience and Remote Sensing, IEEE Trans. on, 34: 398--404, 1996.Google Scholar
- H. Haberdar and S. Shah. Disparity Map Refinement for Video Based Scene Change Detection Using a Mobile Stereo Camera Platform. In 20th ICPR, pages 3890--3893, Aug. 2010. Google ScholarDigital Library
- S. Hawkins, H. He, G. J. Williams, and R. A. Baxter. Outlier detection using RNNs. In Data Warehousing and Knowledge Discovery, pages 170--180, 2002. Google ScholarDigital Library
- V. J. Hodge and J. Austin. A survey of outlier detection methodologies. AI Review, 22: 2004, 2004. Google ScholarDigital Library
- A. Jain, K. Nandakumar, and A. Ross. Score normalization in multimodal biometric systems. Pattern Recogn., 38(12): 2270--2285, Dec. 2005. Google ScholarDigital Library
- L. Li and M. Leung. Integrating intensity and texture differences for robust change detection. Image Processing, IEEE Trans. on, 11(2): 105--112, feb 2002. Google ScholarDigital Library
- F. Padua, R. Carceroni, G. Santos, and K. Kutulakos. Linear sequence-to-sequence alignment. IEEE PAMI, 32: 304--320, February 2010. Google ScholarDigital Library
- P. Sand and S. Teller. Video matching. In ACM SIGGRAPH 2004 Papers, SIGGRAPH '04, pages 592--599, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- D. M. Tax and R. P. Duin. Combining one-class classifiers. In in Proc. Multiple Classifier Systems, 2001, pages 299--308. Springer Verlag, 2001. Google ScholarDigital Library
- E. L. B. van den. Human-Centered Content-Based Image Retrieval. PhD thesis, Radboud University, Nijmegen, September 2005.Google Scholar
- G. Yang, C. V. Stewart, M. Sofka, and C.-L. Tsai. Registration of challenging image pairs: Initialization, estimation, decision. IEEE PAMI, 29: 1973--1989, 2007. Google ScholarDigital Library
- E. Yeniaras, Z. Deng, M. A. Syed, and M. G. Davies. A novel virtual reality environment for preoperative planning and simulation of image guided intracardiac surgeries with robotic manipulators. In MMVR, pages 716--722, 2011.Google Scholar
- A. Zergainoh, F.-Z. Nacer, and A. Merigot. Global discrete cosine transform for image compression. In 6th ISSPA Symposium, volume 2, pages 545--548, 2001.Google Scholar
Index Terms
- Video synchronization as one-class learning
Recommendations
One-class support vector machines: an application in machine fault detection and classification
Fast incipient machine fault diagnosis is becoming one of the key requirements for economical and optimal process operation management. Artificial neural networks have been used to detect machine faults for a number of years and shown to be highly ...
One-class support vector machines-an application in machine fault detection and classification
Fast incipient machine fault diagnosis is becoming one of the key requirements for economical and optimal process operation management. Artificial neural networks have been used to detect machine faults for a number of years and shown to be highly ...
An application of one-class support vector machines in content-based image retrieval
Fast and accurate image classification is becoming one of the key requirements in content-based image retrieval (CBIR). Various methods including artificial neural networks have been used to classify a large image database efficiently and shown to be ...
Comments