Skip to main content

Detection of H.266/VVC video transcoding based on refined block partition and filtering modes statistics in coding domain

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Video transcoding has posed significant challenges to the authenticity and integrity of digital videos, which makes the detection of transcoded videos one of the most important video forensics techniques. However, the detection of transcoded H.266/Versatile Video Coding (H.266/VVC) videos is rarely reported in the literature. To tackle this issue, we first analyze the generation of VVC transcoding traces. It is found that the variation of the block partition and filtering modes in video frames can be used as the clue to expose VVC transcoding. Then a series of refined coding technologies in VVC, such as Multi-type Tree (QTMT) partition and new in-loop filtering, are analyzed to facilitate feature selection. On this basis, the proportions of Coding Units (CUs) with different sizes in intra-coded frames, filtering modes in Deblocking Filtering (DBF), positive and negative offsets in Sample Adaptive Offset Filtering (SAOF), and blocks with different categories in Adaptive Loop Filtering (ALF) are used for feature construction. These feature sets are further concatenated into a 61-dimensional feature vector for supervised learning and video classification. Extensive experiments are conducted to evaluate the performance. The results demonstrate the effectiveness and robustness of our method in transcoding detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Xu Q, Jiang X, Sun T, Kot AC (2022) Motion-adaptive detection of hevc double compression with the same coding parameters. IEEE Trans Inf Forensic Secur 17:2015–2029

    Article  MATH  Google Scholar 

  2. Barni M, Campisi P, Delp E, Dorr G, Fridrich J, Memon ND, Pérez-González F, Rocha A, Verdoliva L, Wu M (2023) Information forensics and security: A quarter-century-long journey. IEEE Signal Process Mag 40:67–79

    Article  Google Scholar 

  3. Bhagtani K, Yadav AKS, Bartusiak ER, Xiang Z, Shao R, Baireddy S, Delp EJ (2022) An overview of recent work in multimedia forensics. In: 2022 IEEE 5th international conference on Multimedia Information Processing and Retrieval (MIPR), pp 324–329. IEEE Computer Society

  4. Xu Q, Jiang X, Sun T, He P, Wang S (2018) Relocated i-frames detection in h.264 double compressed videos based on genetic-cnn. In: 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)

  5. Xiangyang W, Runtong M, Hongying PY (2023) Non-linear statistical image watermark detector. Appl Intell: Int J Artif Intell Neural Netw Complex Probl-Solving Technol 53(23):29242–29266

    Article  MATH  Google Scholar 

  6. Park J, Kim J, Seo J, Kim S, Lee JH (2023) Dnn-based forensic watermark tracking system for realistic content copyright protection. Electronics 12(3):553

    Article  MATH  Google Scholar 

  7. Furushita Y, Fontani M, Bressan M, Bianchi S, Piva A, Ramponi G (2024) Double compression detection ofheif images using coding ghosts. In: International Congress on information and communication technology

  8. Chen JY, Jiang XH, Sun TF, He PS, Wang SL (2016) Detecting double MPEG compression with the same quantiser scale based on MBM feature. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 2064–2068. IEEE

  9. Jiang X, He P, Sun T, Xie F, Wang S (2017) Detection of double compression with the same coding parameters based on quality degradation mechanism analysis. IEEE Trans Inf Forensic Secur 13(1):170–185

    Article  MATH  Google Scholar 

  10. Li Q, Chen S, Tan S, Li B, Huang J (2021) One-class double compression detection of advanced videos based on simple gaussian distribution model. IEEE Trans Circ Syst Video Technol

  11. Jiang X, Xu Q, Sun T, Li B, He P (2020) Detection of hevc double compression with the same coding parameters based on analysis of intra coding quality degradation process. IEEE Trans Inf Forensic Secur 15:250–263. https://doi.org/10.1109/TIFS.2019.2918085

    Article  MATH  Google Scholar 

  12. Uddin K, Yang Y, Oh BT (2022) Double compression detection in hevc-coded video with the same coding parameters using picture partitioning information. Signal Process Image Commun 103:116638

    Article  Google Scholar 

  13. Vazquez-Padin D, Fontani M, Bianchi T, Comesaña P, Piva A, Barni M (2012) Detection of video double encoding with gop size estimation. In: 2012 IEEE international Workshop on Information Forensics and Security (WIFS), pp 151–156. IEEE

  14. Vázquez-Padín D, Fontani M, Shullani D, Pérez-González F, Piva A, Barni M (2019) Video integrity verification and gop size estimation via generalized variation of prediction footprint. IEEE Trans Inf Forensic Secur 15:1815–1830

    Article  Google Scholar 

  15. Xu Q, Jiang X, Sun T, Kot AC (2021) Detection of hevc double compression with non-aligned gop structures via inter-frame quality degradation analysis. Neurocomputing 452:99–113

    Article  Google Scholar 

  16. He P, Li H, Wang H, Wang S, Jiang X, Zhang R (2020) Frame-wise detection of double hevc compression by learning deep spatio-temporal representations in compression domain. IEEE Trans Multimed 23:3179–3192

    Article  MATH  Google Scholar 

  17. Vázquez-Padın D, Pérez-González F (2019) Prediction residue analysis in mpeg-2 double compressed video sequences. In: 2019 27th European Signal Processing Conference (EUSIPCO), pp 1–5. IEEE

  18. Chen S, Sun TF, Jiang XH, He PS, Wang SL, Shi YQ (2016) Detecting double H.264 compression based on analyzing prediction residual distribution. In: International workshop on digital watermarking, pp 61–74. Springer

  19. Li Z-H, Jia R-S, Zhang Z-Z, Liang X-Y, Wang J-W (2017) Double hevc compression detection with different bitrates based on co-occurrence matrix of pu types and dct coefficients. In: ITM web of conferences, vol 12, p 01020

  20. Wang WH, Farid H (2009) Exposing digital forgeries in video by detecting double quantization. In: Proceedings of the 11th ACM workshop on multimedia and security, pp 39–48. ACM

  21. Li Q, Wang R, Xu D (2019) Detection of double compression in hevc videos based on tu size and quantised dct coefficients. IET Inf Secur 13(1):1–6

    Article  MathSciNet  MATH  Google Scholar 

  22. He P, Jiang X, Sun T, Wang S (2017) Detection of double compression in mpeg-4 videos based on block artifact measurement. Neurocomputing 228:84–96

    Article  MATH  Google Scholar 

  23. Xu Q, Sun T, Jiang X, Dong Y (2017) Hevc double compression detection based on sn-pupm feature. In: International workshop on digital watermarking, pp 3–17

  24. Liang X, Li Z, Yang Y, Zhang Z, Zhang Y (2018) Detection of double compression for hevc videos with fake bitrate. IEEE Access 6:53243–53253

    Article  MATH  Google Scholar 

  25. Yu Y, Yao H, Ni R, Zhao Y (2020) Detection of fake high definition for hevc videos based on prediction mode feature. Signal Process 166:107

    Article  MATH  Google Scholar 

  26. Bian S, Li H, Gu T, Kot AC (2019) Exposing video compression history by detecting transcoded hevc videos from avc coding. Symmetry 11(1):67

    Article  Google Scholar 

  27. Zhang Z, Liu C, Li Z, Yu L, Yan H (2019) Detection of transcoding from h. 264/avc to hevc based on cu and pu partition types. Symmetry 11(11):1343

    Article  MATH  Google Scholar 

  28. Xu Q, Jiang X, Sun T, Kot AC (2021) Detection of transcoded hevc videos based on in-loop filtering and pu partitioning analyses. Signal Process Image Commun 92:116109

    Article  Google Scholar 

  29. Xu Q, Xu D, Wang H, Mi Z, Wang Z, Yan H (2022) Detecting double h. 266/vvc compression with the same coding parameters. Neurocomputing 514:231–244

    Article  MATH  Google Scholar 

  30. Bross B, Wang Y-K, Ye Y, Liu S, Chen J, Sullivan GJ, Ohm J-R (2021) Overview of the versatile video coding (vvc) standard and its applications. IEEE Trans Circ Syst Video Technol 31(10):3736–3764

    Article  MATH  Google Scholar 

  31. Zhao X, Kim S-H, Zhao Y, Egilmez HE, Koo M, Liu S, Lainema J, Karczewicz M (2021) Transform coding in the vvc standard. IEEE Trans Circ Syst Video Technol 31(10):3878–3890

    Article  MATH  Google Scholar 

  32. Karczewicz M, Hu N, Taquet J, Chen C-Y, Misra K, Andersson K, Yin P, Lu T, François E, Chen J (2021) Vvc in-loop filters. IEEE Trans Circ Syst Video Technol 31(10):3907–3925

    Article  Google Scholar 

  33. X265. Accessed 25 Oct 2019. [Online] Available https://github.com/videolan/x265

  34. Wieckowski A, Brandenburg J, Hinz T, Bartnik C, George V, Hege G, Helmrich C, Henkel A, Lehmann C, Stoffers C, Zupancic I, Bross B, Marpe D (2021) Vvenc: An open and optimized vvc encoder implementation. In: Proc. IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp 1–2. https://doi.org/10.1109/ICMEW53276.2021.9455944

  35. YUView. Accessed 14 Oct 2021. [Online] Available: https://github.com/IENT/YUView

  36. Yuv sequence. Accessed 25 Oct 2019. [Online] Available: https://media.xiph.org/video/derf/

  37. FFmpeg. Accessed 25 Oct 2019. [Online] Available: http://ffmpeg.org/

  38. X264. Accessed 25 Oct 2019. [Online] Available: https://www.videolan.org/developers/x264.html

  39. VVC Reference Software Version 14.0. Accessed: 28 Oct 2021. [Online] Available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM

Download references

Funding

This work is supported by National Natural Science Foundation of China (Grant No.62272297), Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), Hong Kong Research Grants Council (Project 11204821), City University of Hong Kong (Project 9610034), Scientific and Technological Research Program of Chongqing Municipal Education Commission (KJZDK202300601), and Talent Echelon Promotion Plan of College of Computing Science and Technology, Chongqing University of Posts and Telecommunications (JKY-202423).

Author information

Authors and Affiliations

Authors

Contributions

Qiang Xu: Conceptualization, Methodology, Writing-original draft, Software.Hao Wang: Validation. Dongmei Xu: data curation. Jianye Yuan: Investigation, Visualization. Hong Yan: Supervision, Writing-review & editing.

Corresponding author

Correspondence to Dongmei Xu.

Ethics declarations

Conflict of interest/Competing interests

We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

YUV sequences used in this paper

YUV sequences used in this paper

CIF: akiyo, paris, bridge_far, coastguard, foreman, container, deadline, silent, hall, highway, mobile, harbour, news, mother_daughter, sign_irene, bridge_close, galleon, students, tempete, waterfall;

1080p: aspen, blue_sky, controlled_burn, crowd_run, sunflower, park_joy, ducks_take_off, in_to_tree, old_town_cross, pedstrain_area, red_kayak, riverbed, rush_field_cuts, rush_hour, tractor, snow_mnt, speed_bag, touchdown_pass, west_wind_easy, station2;

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Q., Wang, H., Xu, D. et al. Detection of H.266/VVC video transcoding based on refined block partition and filtering modes statistics in coding domain. Appl Intell 55, 121 (2025). https://doi.org/10.1007/s10489-024-06040-6

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-06040-6

Keywords