Skip to main content

Advertisement

Springer Nature Link
Log in

Quick identification of near-duplicate video sequences with cut signature

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Online video stream data are surging to an unprecedented level. Massive video publishing and sharing impose heavy demands on continuous video near-duplicate detection for many novel video applications. This paper presents an accurate and accelerated system for video near-duplicate detection over continuous video streams. We propose to transform a high-dimensional video stream into a one-dimensional Video Trend Stream (VTS) to monitor the continuous luminance changes of consecutive frames, based on which video similarity is derived. In order to do fast comparison and effective early pruning, a compact auxiliary signature named CutSig is proposed to approximate the video structure. CutSig explores cut distribution feature of the video structure and contributes to filter candidates quickly. To scan along a video stream in a rapid way, shot cuts with local maximum AI (average information value) in a query video are used as reference cuts, and a skipping approach based on reference cut alignment is embedded for efficient acceleration. Extensive experimental results on detecting diverse near-duplicates in real video streams show the effectiveness and efficiency of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Adjeroh, D.A., Lee, M.C., King, I.: A distance measure for video sequence similarity matching. In: Proceedings of International Workshop on Multi-Media Database Management Systems, pp. 72–79 (1998)

  2. Browne, P., Smeaton, A.F., Murphy, N., O’Connor, N., Marlow, S., Berrut, C.: Evaluating and combining digital video shot boundary detection algorithms. In: IMVIP 2000—Irish Machine Vision and Image Processing Conference (1999)

  3. Cernekova, Z., Pitas, I., Nikou, C.: Information theory-based shot cut/fade detection and video summarization. IEEE Trans. Circuits Syst. Video Technol. 16, 82–91 (2006)

    Article  Google Scholar 

  4. Chakrabarti, K., Keogh, E., Mehrotra, S., Pazzani, M.: Locally adaptive dimensionality reduction for indexing large time series databases. ACM Trans. Database Syst. 27, 188–228 (2002)

    Article  Google Scholar 

  5. Chang, H.S., Sull, S., Lee, S.U.: Efficient video indexing scheme for content-based retrieval. IEEE Trans. Circuits Syst. Video Technol. 9, 1269–1279 (1999)

    Article  Google Scholar 

  6. Chen, L., Ng, R.: On the marriage of lp-norms and edit distance. In: VLDB ’04: Proceedings of the 30th International Conference on Very Large Data Bases, pp. 792–803 (2004)

  7. Chen, L., Özsu, M.T., Oria, V.: Robust and fast similarity search for moving object trajectories. In: SIGMOD ’05: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pp. 491–502 (2005)

  8. Chen, Q., Chen, L., Lian, X., Liu, Y., Yu, J.X.: Indexable pla for efficient similarity search. In: VLDB ’07: Proceedings of the 33rd International Conference on Very Large Data Bases, pp. 435–446 (2007)

  9. Cheng, R., Huang, Z., Shen, H., Zhou, X.: Interactive near-duplicate video retrieval and detection. In: MM ’09: Proceedings of the 17th ACM International Conference on Multimedia, pp. 1001–1002 (2009)

  10. Cheung, S.S., Zakhor, A.: Efficient video similarity measurement with video signature. IEEE Trans. Circuits Syst. Video Technol. 13, 59–74 (2003)

    Article  Google Scholar 

  11. Chiu, C.-Y., Li, C.-H., Wang, H.-A., Chen, C.-S., Chien, L.-F.: A time warping based approach for video copy detection. In: ICPR ’06: Proceedings of the 18th International Conference on Pattern Recognition, pp. 228–231 (2006)

  12. Dailianas, A., Allen, R.B., England, P.: Comparison of automatic video segmentation algorithms. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, pp. 2–16 (1996)

  13. Diakopoulos, N., Volmer, S.: Temporally tolerant video matching. In: Proceedings of the ACM SIGIR Workshop on Multimedia Information Retrieval (2003)

  14. Fu, A.W.-C., Keogh, E., Lau, L.Y., Ratanamahatana, C.A., Wong, R.C.-W.: Scaling and time warping in time series querying. VLDB J. 17, 899–921 (2008)

    Article  Google Scholar 

  15. Hampapur, A., Hyun, K., Bolle, R.M.: Comparison of sequence matching techniques for video copy detection. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, pp. 194–201 (2001)

  16. Hoad, T.C., Zobel, J.: Fast video matching with signature alignment. In: MIR ’03: Proceedings of the 5th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 262–269 (2003)

  17. Hoi, C.-H., Wang, W., Lyu, M.R.: A novel scheme for video similarity detection. In: Image and Video Retrieval, pp. 541–546 (2003)

  18. Huang, Z., Shen, H., Shao, J., Zhou, X., Cui, B.: Bounded coordinate system indexing for real-time video clip search. ACM Trans. Inf. Syst. 27, 1–33 (2009)

    Article  Google Scholar 

  19. Joly, A., Buisson, O., Frelicot, C.: Content-based copy retrieval using distortion-based probabilistic similarity search. IEEE Trans. Multimedia 9, 293–306 (2007)

    Article  Google Scholar 

  20. Joly, A., Frelicot, C., Buisson, O.: Robust content-based video copy identification in a large reference database. In: Image and Video Retrieval, pp. 511–516 (2003)

  21. Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7, 358–386 (2008)

    Article  Google Scholar 

  22. Kim, C., Vasudev, B.: Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15, 127–132 (2005)

    Article  Google Scholar 

  23. Law-To, J., Buisson, O., Gouet-Brunet, V., Boujemaa, N.: Robust voting algorithm based on labels of behavior for video copy detection. In: MULTIMEDIA ’06: Proceedings of the 14th ACM International Conference on Multimedia, pp. 835–844 (2006)

  24. Law-To, J., Chen, L., Joly, A., Laptev, I., Buisson, O., Gouet-Brunet, V., Boujemaa, N., Stentiford, F.: Video copy detection: a comparative study. In: CIVR ’07: Proceedings of the 6th ACM International Conference on Image and Video Retrieval, pp. 371–378 (2007)

  25. Lee, S.-L., Chun, S.-J., Kim, D.-H., Lee, J.-H., Chung, C.-W.: Similarity search for multidimensional data sequences. In: ICDE ’00: Proceedings of the 16th International Conference on Data Engineering, pp. 599–608 (2000)

  26. Li, Y., Jin, J.S., Zhou, X.: Matching commercial clips from tv streams using a unique, robust and compact signature. In: DICTA ’05: Proceedings of Digital Image Computing: Techniques and Applications, pp. 266–272 (2005)

  27. Lienhart, R.W.: Comparison of automatic shot boundary detection algorithms. In: Storage and Retrieval for Image and Video Databases VII, pp. 290–301 (1998)

  28. Patel, N.V., Sethi, I.K.: Video shot detection and characterization for video databases. Pattern Recogn. 30, 583–592 (1997)

    Article  Google Scholar 

  29. Shen, H., Ooi, B.C., Zhou, X.: Towards effective indexing for very large video sequence database. In: SIGMOD ’05: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pp. 730–741 (2005)

  30. Shen, H., Zhou, X., Huang, Z., Shao, J., Zhou, X.: Uqlips: a real-time near-duplicate video clip detection system. In: VLDB ’07: Proceedings of the 33rd International Conference on Very Large Data Bases, pp. 1374–1377 (2007)

  31. Vlachos, M., Hadjieleftheriou, M., Gunopulos, D., Keogh, E.: Indexing multi-dimensional time-series with support for multiple distance measures. In: KDD ’03: Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 216–225 (2003)

  32. Xie, Q., Huang, Z., Shen, H., Zhou, X., Pang, C.: Efficient and continuous near-duplicate video detection. In: APWeb 2010: Proceedings of the 12th International Asia-Pacific Web Conference, pp. 260–266 (2010)

  33. Yan, Y., Ooi, B.C., Zhou, A.: Continuous content-based copy detection over streaming videos. In: ICDE ’08: Proceedings of IEEE 24th International Conference on Data Engineering, pp. 853–862 (2008)

  34. Zhu, X., Wu, X., Fan, J., Elmagarmid, A.K., Aref, W.G.: Exploring video content structure for hierarchical summarization. Multimedia Syst. 10, 98–115 (2004)

    Article  Google Scholar 

  35. Zobel, J., Hoad, T.C.: Detection of video sequences using compact signatures. ACM Trans. Inf. Syst. 24, 1–50 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, 4072, Australia

    Qing Xie, Zi Huang, Heng Tao Shen & Xiaofang Zhou

  2. Queensland Research Laboratory, National ICT Australia, Sydney, Australia

    Zi Huang & Xiaofang Zhou

  3. The Australian e-Health Research Centre, Herston, QLD, 4029, Australia

    Chaoyi Pang

Authors
  1. Qing Xie
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zi Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Heng Tao Shen
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Xiaofang Zhou
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Chaoyi Pang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Qing Xie.

Additional information

Part of the results in this paper appeared in Proceedings of the 12th International Asia-Pacific Web Conference (APWeb) [32].

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xie, Q., Huang, Z., Shen, H.T. et al. Quick identification of near-duplicate video sequences with cut signature. World Wide Web 15, 355–382 (2012). https://doi.org/10.1007/s11280-011-0119-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-011-0119-3

Keywords