skip to main content
10.1145/1873951.1874020acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Monitoring near duplicates over video streams

Published: 25 October 2010 Publication History

Abstract

Since near duplicates are ubiquitous over different data sources, increasing research efforts have been put to near duplicate detection recently. Among all the near duplicate detection tasks, an important one is continuous near duplicate monitoring over video streams. Existing video monitoring techniques are not effective for handling the variations that commonly exist among near duplicates. Moreover, approaches proposed for the near duplicate detection in archived video databases are inefficient when applied to high speed video streams. In this work, we propose a framework for effectively online monitoring near duplicates over video streams. Specifically, we first propose a novel representation, a video cuboid signature, to describe a video segment. To capture the local spatio-temporal information of video subclips, we employ the Earth Mover's Distance (EMD) to measure the similarity between two signatures. Both the signature construction and the sequence similarity measure are incrementally processed by exploiting the inherent property of signature series. Then, we propose a novel scheme called locality sensitive multi-leveled approximation (LSMA) that optimizes the near duplicate video similarity matching over streams based on the locality sensitive hashing under EMD metric. The extensive experiments demonstrate the high performance of our approach in terms of the detection accuracy and time cost.

References

[1]
C.-Y. Chiu, C.-H. Li, H.-A. Wang, C.-S. Chen, and L.-F. Chien. A time warping based approach for video copy detection. In ICPR, pages 228--231, 2006.
[2]
O. Chum, J. Philbin, and A. Zisserman. Near Duplicate Image Detection: min-Hash and tf-idf Weighting In BMVC, pages 493--502, 2008.
[3]
P. J. Denning. The locality principle. ACM Commun., 48(7):19--24, 2005.
[4]
M. Douze, H. Jegou, and C.Schmid An image-based approach to video copy detection with spatio-temporal post-filtering IEEE Transactions on Multimedia, 12(4):257--266, 2010.
[5]
A. W.-C. Fu, E. J. Keogh, L. Y. H. Lau, and C. A. Ratanamahatana. Scaling and time warping in time series querying. In VLDB, pages 649--660, 2005.
[6]
K. Grauman, and T. Darrell. Fast Contour Matching Using Approximate Earth Mover’s Distance. In CVPR (1), pages 220--227, 2004.
[7]
Z. Huang, H. T. Shen, J. Shao, X. Zhou, and B. Cui. Bounded coordinate system indexing for real-time video clip search. TOIS, 27(3), 2009.
[8]
Z. Huang, L. Wang, H. T. Shen, J. Shao, X. Zhou Online Near-Duplicate Video Clip Detection and Retrieval: An Accurate and Fast System. ICDE, pages 1511--1514, 2009.
[9]
P. Indyk and N. Thaper. Fast image retrieval via embeddings. In SCTV, 2003.
[10]
A. Joly, O. Buisson, and C. Frilicot. Content-based copy retrieval using distortion-based probabilistic similarity search. IEEE Transactions on Multimedia, 2(9):293--306, 2007.
[11]
Y. Ke, R. Sukthankar, and L. Huston. An efficient parts-based near-duplicate and sub-image retrieval system. In ACM Multimedia, pages 869--876, 2004.
[12]
C. Kim and B. Vasudev. Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. on CSVT, 15(1):127--132, Jan. 2005.
[13]
J. Law-To, O. Buisson, V. Gouet-Brunet, and N. Boujemaa. Robust voting algorithm based on labels of behavior for video copy detection. In ACM Multimedia, pages 835--844, 2006.
[14]
D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91--110, 2004.
[15]
Y. Rubner, C. Tomasi, and L. J. Guibas. A metric for distributions with applications to image databases. In ICCV, pages 59--66, 1998.
[16]
H. T. Shen, B. C. Ooi, X. Zhou, and Z. Huang. Towards effective indexing for very large video sequence database. In SIGMOD, pages 730--741, 2005.
[17]
Y. Tao, K. Yi, C. Sheng, and P. Kalnis. Quality and efficiency in high dimensional nearest neighbor search. In SIGMOD, pages 563--576, 2009.
[18]
X. Wu, A. G. Hauptmann, and C.-W. Ngo. Practical elimination of near-duplicates from web video search. In ACM Multimedia, pages 218--227, 2007.
[19]
X. Wu, M. Takimoto, S. Satoh, and J. Adachi. Scene duplicate detection based on the pattern of discontinuities in feature point trajectories. In ACM Multimedia, pages 51--60, 2008.
[20]
D. Xu, T.-J. Cham, S. Yan and S.-F. ChangNear Duplicate Image Identification with Spatially Aligned Pyramid Matching In CVPR, 2008.
[21]
Y. Yan, B. C. Ooi, and A. Zhou. Continuous content-based copy detection over streaming videos. In ICDE, pages 853--862, 2008.
[22]
J. Zobel and T. C. Hoad. Detection of video sequences using compact signatures. TOIS, 24(1):1--50, 2006.

Cited By

View all
  • (2021)Effective and Efficient Content Redundancy Detection of Web VideosIEEE Transactions on Big Data10.1109/TBDATA.2019.29136747:1(187-198)Online publication date: 1-Mar-2021
  • (2020)Advance on large scale near-duplicate video retrievalFrontiers of Computer Science10.1007/s11704-019-8229-714:5Online publication date: 3-Jan-2020
  • (2018)DVD: Constructing a Discriminative Video Descriptor by Convolving Frame Features2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM)10.1109/BigMM.2018.8499251(1-5)Online publication date: Sep-2018
  • Show More Cited By

Index Terms

  1. Monitoring near duplicates over video streams

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '10: Proceedings of the 18th ACM international conference on Multimedia
    October 2010
    1836 pages
    ISBN:9781605589336
    DOI:10.1145/1873951
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 October 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. earth mover's distance
    2. locality sensitive hashing
    3. near duplicates
    4. similarity measure
    5. video cuboid
    6. video stream

    Qualifiers

    • Research-article

    Conference

    MM '10
    Sponsor:
    MM '10: ACM Multimedia Conference
    October 25 - 29, 2010
    Firenze, Italy

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Effective and Efficient Content Redundancy Detection of Web VideosIEEE Transactions on Big Data10.1109/TBDATA.2019.29136747:1(187-198)Online publication date: 1-Mar-2021
    • (2020)Advance on large scale near-duplicate video retrievalFrontiers of Computer Science10.1007/s11704-019-8229-714:5Online publication date: 3-Jan-2020
    • (2018)DVD: Constructing a Discriminative Video Descriptor by Convolving Frame Features2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM)10.1109/BigMM.2018.8499251(1-5)Online publication date: Sep-2018
    • (2017)Enhancing online video recommendation using social user interactionsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-017-0469-226:5(637-656)Online publication date: 1-Oct-2017
    • (2016)F.Live: Towards interactive live broadcast FTV experienceIEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications10.1109/INFOCOM.2016.7524618(1-9)Online publication date: Apr-2016
    • (2016)Incentivizing crowdsourcing systems with network effectsIEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications10.1109/INFOCOM.2016.7524546(1-9)Online publication date: Apr-2016
    • (2016)CompoundEyes: Near-duplicate detection in large scale online video systems in the cloudIEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications10.1109/INFOCOM.2016.7524429(1-9)Online publication date: Apr-2016
    • (2015)Online Video Recommendation in Sharing CommunityProceedings of the 2015 ACM SIGMOD International Conference on Management of Data10.1145/2723372.2749444(1645-1656)Online publication date: 27-May-2015
    • (2015)On efficient content-based near-duplicate video detection2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI)10.1109/CBMI.2015.7153633(1-6)Online publication date: Jun-2015
    • (2015)MarlinProceedings of the 2015 IEEE International Conference on Big Data (Big Data)10.1109/BigData.2015.7363947(1755-1764)Online publication date: 29-Oct-2015
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media