Abstract
Video transcoding has posed significant challenges to the authenticity and integrity of digital videos, which makes the detection of transcoded videos one of the most important video forensics techniques. However, the detection of transcoded H.266/Versatile Video Coding (H.266/VVC) videos is rarely reported in the literature. To tackle this issue, we first analyze the generation of VVC transcoding traces. It is found that the variation of the block partition and filtering modes in video frames can be used as the clue to expose VVC transcoding. Then a series of refined coding technologies in VVC, such as Multi-type Tree (QTMT) partition and new in-loop filtering, are analyzed to facilitate feature selection. On this basis, the proportions of Coding Units (CUs) with different sizes in intra-coded frames, filtering modes in Deblocking Filtering (DBF), positive and negative offsets in Sample Adaptive Offset Filtering (SAOF), and blocks with different categories in Adaptive Loop Filtering (ALF) are used for feature construction. These feature sets are further concatenated into a 61-dimensional feature vector for supervised learning and video classification. Extensive experiments are conducted to evaluate the performance. The results demonstrate the effectiveness and robustness of our method in transcoding detection.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Xu Q, Jiang X, Sun T, Kot AC (2022) Motion-adaptive detection of hevc double compression with the same coding parameters. IEEE Trans Inf Forensic Secur 17:2015–2029
Barni M, Campisi P, Delp E, Dorr G, Fridrich J, Memon ND, Pérez-González F, Rocha A, Verdoliva L, Wu M (2023) Information forensics and security: A quarter-century-long journey. IEEE Signal Process Mag 40:67–79
Bhagtani K, Yadav AKS, Bartusiak ER, Xiang Z, Shao R, Baireddy S, Delp EJ (2022) An overview of recent work in multimedia forensics. In: 2022 IEEE 5th international conference on Multimedia Information Processing and Retrieval (MIPR), pp 324–329. IEEE Computer Society
Xu Q, Jiang X, Sun T, He P, Wang S (2018) Relocated i-frames detection in h.264 double compressed videos based on genetic-cnn. In: 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
Xiangyang W, Runtong M, Hongying PY (2023) Non-linear statistical image watermark detector. Appl Intell: Int J Artif Intell Neural Netw Complex Probl-Solving Technol 53(23):29242–29266
Park J, Kim J, Seo J, Kim S, Lee JH (2023) Dnn-based forensic watermark tracking system for realistic content copyright protection. Electronics 12(3):553
Furushita Y, Fontani M, Bressan M, Bianchi S, Piva A, Ramponi G (2024) Double compression detection ofheif images using coding ghosts. In: International Congress on information and communication technology
Chen JY, Jiang XH, Sun TF, He PS, Wang SL (2016) Detecting double MPEG compression with the same quantiser scale based on MBM feature. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 2064–2068. IEEE
Jiang X, He P, Sun T, Xie F, Wang S (2017) Detection of double compression with the same coding parameters based on quality degradation mechanism analysis. IEEE Trans Inf Forensic Secur 13(1):170–185
Li Q, Chen S, Tan S, Li B, Huang J (2021) One-class double compression detection of advanced videos based on simple gaussian distribution model. IEEE Trans Circ Syst Video Technol
Jiang X, Xu Q, Sun T, Li B, He P (2020) Detection of hevc double compression with the same coding parameters based on analysis of intra coding quality degradation process. IEEE Trans Inf Forensic Secur 15:250–263. https://doi.org/10.1109/TIFS.2019.2918085
Uddin K, Yang Y, Oh BT (2022) Double compression detection in hevc-coded video with the same coding parameters using picture partitioning information. Signal Process Image Commun 103:116638
Vazquez-Padin D, Fontani M, Bianchi T, Comesaña P, Piva A, Barni M (2012) Detection of video double encoding with gop size estimation. In: 2012 IEEE international Workshop on Information Forensics and Security (WIFS), pp 151–156. IEEE
Vázquez-Padín D, Fontani M, Shullani D, Pérez-González F, Piva A, Barni M (2019) Video integrity verification and gop size estimation via generalized variation of prediction footprint. IEEE Trans Inf Forensic Secur 15:1815–1830
Xu Q, Jiang X, Sun T, Kot AC (2021) Detection of hevc double compression with non-aligned gop structures via inter-frame quality degradation analysis. Neurocomputing 452:99–113
He P, Li H, Wang H, Wang S, Jiang X, Zhang R (2020) Frame-wise detection of double hevc compression by learning deep spatio-temporal representations in compression domain. IEEE Trans Multimed 23:3179–3192
Vázquez-Padın D, Pérez-González F (2019) Prediction residue analysis in mpeg-2 double compressed video sequences. In: 2019 27th European Signal Processing Conference (EUSIPCO), pp 1–5. IEEE
Chen S, Sun TF, Jiang XH, He PS, Wang SL, Shi YQ (2016) Detecting double H.264 compression based on analyzing prediction residual distribution. In: International workshop on digital watermarking, pp 61–74. Springer
Li Z-H, Jia R-S, Zhang Z-Z, Liang X-Y, Wang J-W (2017) Double hevc compression detection with different bitrates based on co-occurrence matrix of pu types and dct coefficients. In: ITM web of conferences, vol 12, p 01020
Wang WH, Farid H (2009) Exposing digital forgeries in video by detecting double quantization. In: Proceedings of the 11th ACM workshop on multimedia and security, pp 39–48. ACM
Li Q, Wang R, Xu D (2019) Detection of double compression in hevc videos based on tu size and quantised dct coefficients. IET Inf Secur 13(1):1–6
He P, Jiang X, Sun T, Wang S (2017) Detection of double compression in mpeg-4 videos based on block artifact measurement. Neurocomputing 228:84–96
Xu Q, Sun T, Jiang X, Dong Y (2017) Hevc double compression detection based on sn-pupm feature. In: International workshop on digital watermarking, pp 3–17
Liang X, Li Z, Yang Y, Zhang Z, Zhang Y (2018) Detection of double compression for hevc videos with fake bitrate. IEEE Access 6:53243–53253
Yu Y, Yao H, Ni R, Zhao Y (2020) Detection of fake high definition for hevc videos based on prediction mode feature. Signal Process 166:107
Bian S, Li H, Gu T, Kot AC (2019) Exposing video compression history by detecting transcoded hevc videos from avc coding. Symmetry 11(1):67
Zhang Z, Liu C, Li Z, Yu L, Yan H (2019) Detection of transcoding from h. 264/avc to hevc based on cu and pu partition types. Symmetry 11(11):1343
Xu Q, Jiang X, Sun T, Kot AC (2021) Detection of transcoded hevc videos based on in-loop filtering and pu partitioning analyses. Signal Process Image Commun 92:116109
Xu Q, Xu D, Wang H, Mi Z, Wang Z, Yan H (2022) Detecting double h. 266/vvc compression with the same coding parameters. Neurocomputing 514:231–244
Bross B, Wang Y-K, Ye Y, Liu S, Chen J, Sullivan GJ, Ohm J-R (2021) Overview of the versatile video coding (vvc) standard and its applications. IEEE Trans Circ Syst Video Technol 31(10):3736–3764
Zhao X, Kim S-H, Zhao Y, Egilmez HE, Koo M, Liu S, Lainema J, Karczewicz M (2021) Transform coding in the vvc standard. IEEE Trans Circ Syst Video Technol 31(10):3878–3890
Karczewicz M, Hu N, Taquet J, Chen C-Y, Misra K, Andersson K, Yin P, Lu T, François E, Chen J (2021) Vvc in-loop filters. IEEE Trans Circ Syst Video Technol 31(10):3907–3925
X265. Accessed 25 Oct 2019. [Online] Available https://github.com/videolan/x265
Wieckowski A, Brandenburg J, Hinz T, Bartnik C, George V, Hege G, Helmrich C, Henkel A, Lehmann C, Stoffers C, Zupancic I, Bross B, Marpe D (2021) Vvenc: An open and optimized vvc encoder implementation. In: Proc. IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp 1–2. https://doi.org/10.1109/ICMEW53276.2021.9455944
YUView. Accessed 14 Oct 2021. [Online] Available: https://github.com/IENT/YUView
Yuv sequence. Accessed 25 Oct 2019. [Online] Available: https://media.xiph.org/video/derf/
FFmpeg. Accessed 25 Oct 2019. [Online] Available: http://ffmpeg.org/
X264. Accessed 25 Oct 2019. [Online] Available: https://www.videolan.org/developers/x264.html
VVC Reference Software Version 14.0. Accessed: 28 Oct 2021. [Online] Available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM
Funding
This work is supported by National Natural Science Foundation of China (Grant No.62272297), Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), Hong Kong Research Grants Council (Project 11204821), City University of Hong Kong (Project 9610034), Scientific and Technological Research Program of Chongqing Municipal Education Commission (KJZDK202300601), and Talent Echelon Promotion Plan of College of Computing Science and Technology, Chongqing University of Posts and Telecommunications (JKY-202423).
Author information
Authors and Affiliations
Contributions
Qiang Xu: Conceptualization, Methodology, Writing-original draft, Software.Hao Wang: Validation. Dongmei Xu: data curation. Jianye Yuan: Investigation, Visualization. Hong Yan: Supervision, Writing-review & editing.
Corresponding author
Ethics declarations
Conflict of interest/Competing interests
We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
YUV sequences used in this paper
YUV sequences used in this paper
CIF: akiyo, paris, bridge_far, coastguard, foreman, container, deadline, silent, hall, highway, mobile, harbour, news, mother_daughter, sign_irene, bridge_close, galleon, students, tempete, waterfall;
1080p: aspen, blue_sky, controlled_burn, crowd_run, sunflower, park_joy, ducks_take_off, in_to_tree, old_town_cross, pedstrain_area, red_kayak, riverbed, rush_field_cuts, rush_hour, tractor, snow_mnt, speed_bag, touchdown_pass, west_wind_easy, station2;
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xu, Q., Wang, H., Xu, D. et al. Detection of H.266/VVC video transcoding based on refined block partition and filtering modes statistics in coding domain. Appl Intell 55, 121 (2025). https://doi.org/10.1007/s10489-024-06040-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-06040-6