Skip to main content
Springer Nature Link
Log in

Cinematography sequences tracking by means of fingerprinting techniques

  • Published:
annals of telecommunications - annales des télécommunications Aims and scope Submit manuscript

Abstract

Video fingerprints are short features extracted from a video sequence in order to uniquely identify its visual content and its replicas. By advancing a new robust fingerprinting method, the present paper takes the challenge of designing an enabler for the use of Internet as a distribution tool in cinematography. In this respect, a 2D-DWT-based robust video fingerprinting method is designed so as to address two use cases, namely the retrieval of video content from a database and the tracking of in-theater camcorder recorded video content. A set of largest absolute value wavelet coefficients is considered as the fingerprint and a repeated statistical test is used as the matching procedure. The video dataset consists of two corpora, one for each use case. The first corpus regroups 3 h of heterogeneous original content (organized under the framework of the HD3D-IIO French national project) and of its attacked versions (a total of 21 h of video content). The second corpus consists of 3 h of heterogeneous content (i.e., HD3D-IIO corpus) and of 1 h of live camcorder recorded video content (a total of 4 h of video content). The inner 2D-DWT properties with respect to content-preserving attacks (such as linear filtering, sharpening, geometric, conversion to grayscale, small rotations, contrast changes, brightness changes, and live camcorder recording) ensure the following results: in the first use case, the probability of false alarm and missed detection are lower than 0.0005, precision and recall are higher than 0.97; in the second use case, the probability of false alarm is 0.00009, the probability of missed detection is lower than 0.0036, precision and recall are equal to 0.72.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Oostveen J, Kalker T, Haitsma J (2002) Feature extraction and a database strategy for video fingerprinting, Lecture Notes In Computer Science, vol. 2314 archive, Proceedings of the 5th International Conference on Recent Advances in Visual Information Systems, pp 117–128

  2. Mitrea M, Dumitru O, Prêteux F, Vlad A (2007) Zero-memory information sources approximating to video watermarking attacks. Proceedings of the International Conference on Computational Science and Its Applications, Kuala Lumpur, Malaysia—Lecture Notes in Computer Science 4707, vol. 3, pp 445–459

  3. Gao W, Huang T, Tian Y, Wang Y, Li Y, Mou L, Su C, Jiang M, Fang X, Qian M (2010) PKU-IDM@TRECVID-CCD 2010: copy detection with visual-audio feature fusion and sequential pyramid matching. Proceedings of TRECVID

  4. Wong WK, Yuen CWM, Fan DD, Chan LK, Fung EHK (2009) Stitching defect detection and classification using wavelet transform and BP neural network. J Expert Syst Appl Int J 36(2):3845–3856

    Article  Google Scholar 

  5. Dumitru O, Mitrea M, Prêteux F (2008) Video modelling in the DWT domain. Proceedings SPIE, vol. 7000, Strasbourg, pp 7000 OP: 1–12

  6. Walpole RE, Myers RH, Myers S-L, Ye K (2002) Probability and statistics for engineers and scientists. Pearson Educational International

  7. Buccigrossi R, Simoncelli E (1999) Image compression via joint statistical characterization in the wavelet domain. IEEE Trans Image Process 8(12):1688–1700

    Article  Google Scholar 

  8. Chupeau B, Massoudi A, Lefèbvre F (2008) In-theater piracy: finding where the pirate was. SPIE’08, Security, Forensics, Steganography, and Watermarking of Multimedia Contents X

  9. Coskun B, Sankur B, Memon N (2006) Spatio-temporal transform based video hashing. IEEE Trans Multimedia 8(6)

  10. Yeh M-C, Hsu C-Y, Lu C-S (2010) NTNU-Academia Sinica at TRECVID 2010 content based copy detection. In: Proceedings of TRECVID

  11. Barrios JM, Bustos B (2010) Content-based video copy detection: PRISMA at TRECVID 2010. In: Proceedings of TRECVID

  12. Su X, Huang T, Gao W (2009) Robust video fingerprinting based on visual attention regions. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing. pp. 1525–1528

  13. Hampapur A, Hyun K-H, Bolle R (2002) Comparison of sequence matching techniques for video copy detection. In: Proceedings of Storage and Retrieval for Media Databases (San Jose, USA, Jan. 20–25), pp. 194–201

  14. Kim J, Nam J (2009) Content-based video copy detection using spatio-temporal compact feature. Proceedings of the 11th international conference on Advanced Communication Technology (ICACT), vol. 3

  15. Hu MK (1962) Visual pattern recognition by moment invariants. Trans Inf Theory IT-8:179–187

    Google Scholar 

  16. Lee S, Yoo CD (2008) Robust video fingerprinting for content-based video identification. IEEE Trans Circ Syst Video Technol 18(7)

  17. Hampapur A, Bolle RM (2001) Comparison of distance measures for video copy detection. IBM TJ Watson Research Center, IEEE International Conference on Multimedia and Expo, pp 737–740

  18. Law-To J, Buisson O, Gouet-Brunet, Boujemaa N (2006) Robust voting algorithm based on labels of behavior for video copy detection. 14th ACM International Conference on Multimedia, Santa Barbara, USA, pp 835–844

  19. Law-To J, Buisson O, Gouet-Brunet, Boujemaa N (2007) Video copy detection on the internet: The challenges of copyright and multiplicity. IEEE International Conference on Multimedia & Expo, Beijing pp 2082–2085

  20. Joly A, Frélicot C, Buisson O (2005) Content-based video copy detection in large databases: a local fingerprints statistical similarity search approach. In: Proceedings of the International Conference on Image Processing

  21. Sarkar A, Ghosh P, Moxley E, Manjunath BS (2008) Video fingerprinting: features for duplicate and similar video detection and query-based video retrieval. Proceedings of SPIE—Multimedia Content Access: Algorithms and Systems II

  22. Massoudi A, Lefebvre F, Demarty CH, Oisel L, Chupeau B (2006) A video fingerprint based on visual digest and local fingerprints, 2006 IEEE International Conference on Image Processing, Issue 8–11, pp 2297–2300

  23. Chen L, Stentiford FWM (2008) Video sequence matching based on temporal ordinal measurement. Pattern Recognit Lett 29(13):1824–1831

    Article  Google Scholar 

  24. Hua X-S, Chen X, Zhang H-J (2004) Robust video signature based on ordinal measure. In: Proceedings of the IEEE International Conference on Image Processing (ICIP), 2004, vol. 1, 24–27, 2004, pp 685–688

  25. Kim C, Vasudev B (2005) Spatio-temporal sequence matching for efficient video copy detection. In: Proceedings of the IEEE Transactions on Circuit Systems Video Technology, 15(1):127–132

  26. Yuan J, Duan LY, Tian Q, Ranganath S, Xu C (2004) Fast and robust short video clip search for copy detection. In: Springer: Lecture Notes in Computer Science—3332, pp 479–488

  27. Indyk P, Iyengar G, Shivakumar N (1999) Finding pirated video sequences on the internet. Stanford Infolab

  28. Radhakrishnan R, Bauer C (2008) Robust video fingerprints based on subspace embedding. IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, pp 2245–2248

  29. Roover CD, Vleeschouwer CD, Lefebvre F, Macq B (2005) Robust video hashing based on radial projections of key frames. IEEE Trans Signal Process 53(10):4020–4030

    Article  MathSciNet  Google Scholar 

  30. Garboan A, Mitrea M, Prêteux F (2011) DWT-based robust video fingerprinting. Proceedings for the 3rd European Workshop on Visual Information Processing (EUVIP), Paris, pp 216–221

  31. Garboan A, Mitrea M, Prêteux F (2011) Video retrieval by means of robust fingerprinting. Proceedings for the 15th IEEE Symposium on Consumer Electronics (ISCE), Singapore, pp 299–303

  32. Dutta D, Saha SK, Chanda B (2010) A hypothesis test based robust technique for video sequence matching. Int J Futur Gener Commun Netw 3(3)

  33. Naphade MR, Yeung MM, Yeo BL (2000) Novel scheme for fast and efficent video sequence matching using compact signatures. In: Proc. SPIE, Storage and Retrieval for Media Databases 2000, vol. 3972, pp 564–572

  34. Gauch JM Real-time feature-based video stream validation and distortion analysis system using color moments. United States Patent 6246803

  35. Sánchez JM, Binefa X, Vitrià J, Radeva P (1999) Local color analysis for scene break detection applied to TV commercials recognition. Proceedings of the Third International Conference on Visual Information and Information, pp 237–244

  36. Hill M, Hua G, Natsev A, Smith JR, Xie L, Huang B, Merler M, Ouyang H, Zhou M (2010) IBM research TRECVID-2010 video copy detection and multimedia event detection system. Proceedings of TRECVID

  37. Jégou H, Gros P, Douze M, Schmid C, Gravier G (2010) INRIA LEAR-TEXMEX: video copy detection task. Proceedings of TRECVID

  38. Mukai R, Kurozumi T, Kawanishi T, Nagano H, Kashino H (2011) NTT communication science laboratories at TRECVID 2011 content based copy detection. Proceedings of TRECVID

  39. Foucher S, Lalonde M, Gupta V, Darvish P, Gagnon L, Boulianne G (2011) CRIM at TRECVID 2011 content-based copy detection using nearest-neighbor mapping. Proceedings of TRECVID

  40. Jiang M, Shu F, Tian Y, Huang T (2011) Cascade of multimodal features and temporal pyramid matching. Proceedings of TRECVID

  41. Bhat DN, Nayar SK (1996) Ordinal measures for visual correspondence. In: Proceedings of the Conference on Computer Vision and Pattern Recognition

Download references

Author information

Authors and Affiliations

  1. Institut Mines-Télécom; Télécom SudParis, 9, rue Charles Fourier, 91011, Evry, France

    A. Garboan & M. Mitrea

  2. Institut Mines-Télécom; MINES ParisTech, 60-62, Boulevard Saint Michel, 75272, PARIS cedex 06, France

    F. Prêteux

  3. UMR CNRS 8145 MAP5, 45, rue des Saints Pères 7ème étage, 75270, Paris Cedex 06, France

    M. Mitrea & F. Prêteux

Authors
  1. A. Garboan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. M. Mitrea
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. F. Prêteux
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to A. Garboan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Garboan, A., Mitrea, M. & Prêteux, F. Cinematography sequences tracking by means of fingerprinting techniques. Ann. Telecommun. 68, 187–199 (2013). https://doi.org/10.1007/s12243-012-0334-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12243-012-0334-7

Keywords