skip to main content
research-article

Efficient Video Stream Monitoring for Near-Duplicate Detection and Localization in a Large-Scale Repository

Published: 01 November 2013 Publication History

Abstract

In this article, we study the efficiency problem of video stream near-duplicate monitoring in a large-scale repository. Existing stream monitoring methods are mainly designed for a short video to scan over a query stream; they have difficulty being scalable for a large number of long videos. We present a simple but effective algorithm called incremental similarity update to address the problem. That is, a similarity upper bound between two videos can be calculated incrementally by leveraging the prior knowledge of the previous calculation. The similarity upper bound takes a lightweight computation to filter out unnecessary time-consuming computation for the actual similarity between two videos, making the search process more efficient. We integrate the algorithm with inverted indexing to obtain a candidate list from the repository for the given query stream. Meanwhile, the algorithm is applied to scan each candidate for locating exact near-duplicate subsequences. We implement several state-of-the-art methods for comparison in terms of accuracy, execution time, and memory consumption. Experimental results demonstrate the proposed algorithm yields comparable accuracy, compact memory size, and more efficient execution time.

References

[1]
Bay, H., Ess, A., Tuytelaars, T., and Gool, L. V. 2008. SURF: Speeded up robust features. Comput. Vision Image Understand. 110, 3, 346--359.
[2]
Bhat, D. N. and Nayar, S. K. 1998. Ordinal measures for image correspondence. IEEE Trans. Pattern Anal. Mach. Intell. 20, 4, 415--423.
[3]
CC_WEB_VIDEO: Near-Duplicate Web Video Dataset. 2007. http://vireo.cs.cityu.edu.hk/webvideo/.
[4]
Cheung, S. C. and Zakhor, A. 2003. Efficient video similarity measurement with video signature. IEEE Trans. Circuits Syst. Video Technol. 13, 1, 59--74.
[5]
Chiu, C. Y., Li, C. H., Wang, H. A., Chen, C. S., and Chien, L. F. 2006. A time warping based approach for video copy detection. In Proceedings of the IAPR International Conference on Pattern Recognition.
[6]
Chiu, C. Y., Wang, H. M., and Chen, C. S. 2010. Fast min-hashing indexing and robust spatio-temporal matching for detecting video copies. ACM Trans. Multimedia Comput. Commun. Appl. 6, 2, 10:1--23.
[7]
Culpepper, J. S. and Moffat, A. 2010. Efficient set intersection for inverted indexing. ACM Trans. Inf. Syst. 20, 1, 1:1--25.
[8]
Dong, W., Wang, Z., Charikar, M., and Li, K. 2008. Efficiently matching sets of features with random histograms. In Proceedings of the ACM International Conference on Multimedia. 179--188.
[9]
Hoad, T. C. and Zobel, J. 2006. Detection of video sequence using compact signatures. ACM Trans. Inf. Syst. 24, 1, 1--50.
[10]
Hua, X. S., Chen, X., and Zhang, H. J. 2004. Robust video signature based on ordinal measure. In Proceedings of the IEEE International Conference on Image Processing.
[11]
Huang, Z., Shen, H. T., Shao, J., and Zhou, X. 2009. Bounded coordinate system indexing for real-time video clip search. ACM Trans. Inf. Syst. 27, 3, 17:1--33.
[12]
Huang, Z., Hu, B., Cheng, H., Shen, H. T., Liu, H., and Zhou, X. 2010a. Mining near-duplicate graph for cluster-based reranking of Web video search results. ACM Trans. Inf. Syst. 28, 4, 22:1--27.
[13]
Huang, Z., Shen, H. T., Shao, J., Cui, B, and Zhou, X. 2010b. Practical online near-duplicate subsequence detection for continuous video streams. IEEE Trans. Multimedia 12, 5, 386--398.
[14]
Jégou, H., Douze, M., and Schmid, C. 2011. Product quantization for nearest neighbor search. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1, 117--128.
[15]
Kashino, K., Kurozumi, T., and Murase, H. 2003. A quick search method for audio and video signals based on histogram pruning. IEEE Trans. Multimedia 5, 3, 348--357.
[16]
Kim, C. and Vasudev, B. 2005. Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15, 1, 127--132.
[17]
Law-To, J., Chen, L., Joly, A., Laptev, I., Buisson, O., Gouet-Brunet, V., Boujemaa, N., and Stentiford, F. 2007. Video copy detection: A comparative study. In Proceedings of the ACM International Conference on Image and Video Retrieval.
[18]
Liu, B., Li, Z., Yang, L., Wang, M., and Tian, X. 2011. Real-time video copy-location detection in large-scale repositories. IEEE Multimedia 18, 3, 22--31.
[19]
Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91--110.
[20]
Pedro, J. S., Siersdorfer, S., and Sanderson, M. 2011. Content redundancy in YouTube and its application to video tagging. ACM Trans. Inf. Syst. 29, 3, 13:1--31.
[21]
Shang, L., Yang, L., Wang, F., Chan, K. P., and Hua, X. S. 2010. Real time large scale near-duplicate web video retrieval. In Proceedings of the ACM International Conference on Multimedia. 531--540.
[22]
Shao, J., Huang, Z., Shen, H. T., Zhou, X., and Li, Y. 2007. Dynamic batch nearest neighbor search in video retrieval. In Proceedings of the IEEE International Conference on Data Engineering.
[23]
Song, J., Yang, Y., Huang, Z., Shen, H. T., and Hong, R. 2011. Multiple feature hashing for real-time large scale near-duplicate video retrieval. In Proceedings of the ACM International Conference on Multimedia. 423--432.
[24]
Tan, H. K., Ngo, C. W., Hong, R., and Chua, T. S. 2009. Scalable detection of partial near-duplicate videos by visual temporal consistency. In Proceedings of the ACM International Conference on Multimedia.
[25]
TRECVID 2011 Guidelines. 2011. http://www-nlpir.nist.gov/projects/tv2011/.
[26]
Wei, S., Zhao, Y., Zhu, C., Xu, C., and Zhu, Z. 2011. Frame fusion for video copy detection. IEEE Trans. Circuits Syst. Video Technol. 21, 1, 15--28.
[27]
Wu, X., Hauptmann, A. G., and Ngo, C. W. 2007. Practical elimination of near-duplicates from Web video search. In Proceedings of the ACM International Conference on Multimedia. 218--227.
[28]
Yan, Y., Ooi, B. C., and Zhou, A. 2008. Continuous content-based copy detection over streaming videos. In Proceedings of the IEEE International Conference on Data Engineering.
[29]
Zhou, X. and Chen, L. 2010. Monitoring near duplicates over video streams. In Proceedings of the ACM International Conference on Multimedia. 521--530.
[30]
Zhou, X., Zhou, X., Chen, L., Shu, Y., Bouguettaya, A., and Taylor, J. A. 2010. Adaptive subspace symbolization for content-based video detection. IEEE Trans. Knowl. Data Eng. 22, 10, 1372--1387.

Cited By

View all
  • (2023)Content-based Video Retrieval Systems: A Review2023 3rd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA)10.1109/ICIMIA60377.2023.10425939(441-449)Online publication date: 21-Dec-2023
  • (2017)Parallelization of Massive Textstream Compression Based on Compressed SensingACM Transactions on Information Systems10.1145/308670236:2(1-18)Online publication date: 21-Aug-2017
  • (2017)Efficient processing of video containment queries by using composite ordinal featuresMultimedia Tools and Applications10.1007/s11042-016-3270-076:2(2891-2910)Online publication date: 1-Jan-2017
  • Show More Cited By

Index Terms

  1. Efficient Video Stream Monitoring for Near-Duplicate Detection and Localization in a Large-Scale Repository

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Information Systems
    ACM Transactions on Information Systems  Volume 31, Issue 4
    November 2013
    192 pages
    ISSN:1046-8188
    EISSN:1558-2868
    DOI:10.1145/2536736
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 November 2013
    Accepted: 01 July 2013
    Revised: 01 July 2013
    Received: 01 August 2012
    Published in TOIS Volume 31, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Near-duplicate
    2. content-based retrieval
    3. inverted indexing
    4. video copy

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Content-based Video Retrieval Systems: A Review2023 3rd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA)10.1109/ICIMIA60377.2023.10425939(441-449)Online publication date: 21-Dec-2023
    • (2017)Parallelization of Massive Textstream Compression Based on Compressed SensingACM Transactions on Information Systems10.1145/308670236:2(1-18)Online publication date: 21-Aug-2017
    • (2017)Efficient processing of video containment queries by using composite ordinal featuresMultimedia Tools and Applications10.1007/s11042-016-3270-076:2(2891-2910)Online publication date: 1-Jan-2017
    • (2015)Twofold Video Hashing With Automatic SynchronizationIEEE Transactions on Information Forensics and Security10.1109/TIFS.2015.242536210:8(1727-1738)Online publication date: Aug-2015

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media