Skip to main content
SpringerLink
Log in

Video motion forgery detection using motion residual and object tracking

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Due to the extensive application of the video editing tools, video authentification has become an interesting topic. Video motion forgery is one of the most significant manipulations which alter the video sequence both temporally and spatially. We suggest an intra-frame motion forgery detection algorithm in this paper that detects the motion forgery throughout the video sequence. The motion residuals are applied to extract the moving parts. The moving objects are then analyzed to identify the similar ones. Then, the moving objects are tracked throughout the video sequence using the meanshift algorithm to determine the motion sequences. The two motion sequences are selected as matched if both the objects and their displacements are similar in the consecutive frames. By matching the motion sequences, the forged ones are determined. Various simulations have been conducted in different datasets to investigate the performance of the proposed scheme. We test video sequences at both frame and pixel levels and detect temporal and spatial motion forgery. For the frame level, the \(F_{1}\) score of the proposed method on both the datasets of SULFA and GRIP was \(89\%\). Also, at the pixel level, the \(F_{1}\) scores of the proposed method for the SULFA and GRIP datasets are \(89\%\) and \(81\%\), respectively. The simulation results confirm the efficiency of the suggested method in locating the forged motion sequences and outperforming its rivals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Azghani M, Aghagolzadeh A, Ghaemi S, Kouzehgar M (2010) Intelligent modified mean shift tracking using genetic algorithm. In: 2010 5th International symposium on telecommunications, IEEE, pp 806–811

  2. Bakas J, Naskar R, Dixit R (2019) Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between haralick coded frames. Multimedia Tools Appl 78(4):4905–4935

    Article  Google Scholar 

  3. Bakas J, Naskar R, Bakshi S (2021) Detection and localization of inter-frame forgeries in videos based on macroblock variation and motion vector analysis. Comput Electr Eng 89:106929

    Article  Google Scholar 

  4. Bakas J, Naskar R, Nappi M, Bakshi S (2021) Object-based forgery detection in surveillance video using capsule network. J Ambient Intell Humanized Comput 1–11

  5. Bani NT, Fekri-Ershad S (2019) Content-based image retrieval based on combination of texture and colour information extracted in spatial and frequency domains. Electron Libr

  6. Bestagini P, Milani S, Tagliasacchi M, Tubaro S (2013) Local tampering detection in video sequences. In: 2013 IEEE 15th International workshop on multimedia signal processing (MMSP), IEEE, pp 488–493

  7. Bidokhti A, Ghaemmaghami S (2015) Detection of regional copy/move forgery in mpeg videos using optical flow. In: 2015 The international symposium on artificial intelligence and signal processing (AISP), IEEE, pp 13–17

  8. Chao J, Jiang X, Sun T (2012) A novel video inter-frame forgery model detection scheme based on optical flow consistency. In: International workshop on digital watermarking, Springer, pp 267–281

  9. Chen S, Tan S, Li B, Huang J (2015) Automatic detection of object-based forgery in advanced video. IEEE Trans Circ Syst Video Technol 26(11):2138–2151

    Article  Google Scholar 

  10. D’Amiano L, Cozzolino D, Poggi G, Verdoliva L (2018) A patchmatch-based dense-field algorithm for video copy-move detection and localization. IEEE Trans Circ Syst Video Technol 29(3):669–682

    Article  Google Scholar 

  11. D’Amiano L, Cozzolino D, Poggi G, Verdoliva L (2015) Video forgery detection and localization based on 3d patchmatch. In: 2015 IEEE international conference on multimedia & expo workshops (ICMEW), IEEE, pp 1–6

  12. Elaskily MA, Elnemr HA, Dessouky MM, Faragallah OS (2019) Two stages object recognition based copy-move forgery detection algorithm. Multimedia Tools Appl 78(11):15353–15373

    Article  Google Scholar 

  13. Fadl S, Han Q, Li Q (2021) Cnn spatiotemporal features and fusion for surveillance video forgery detection. Signal Process Image Commun 90:116066

    Article  Google Scholar 

  14. Feng C, Xu Z, Jia S, Zhang W, Xu Y (2016) Motion-adaptive frame deletion detection for digital video forensics. IEEE Trans Circ Syst Video Technol 27(12):2543–2554

    Article  Google Scholar 

  15. Hammami A, Hamida AB, Amar CB (2021) Blind semi-fragile watermarking scheme for video authentication in video surveillance context. Multimedia Tools Appl 80(5):7479–7513

    Article  Google Scholar 

  16. Jia S, Xu Z, Wang H, Feng C, Wang T (2018) Coarse-to-fine copy-move forgery detection for video forensics. IEEE Access 6:25323–25335

    Article  Google Scholar 

  17. Jin X, He Z, Wang Y, Yu J, Xu J (2021) Towards general object-based video forgery detection via dual-stream networks and depth information embedding. Multimedia Tools Appl 1–17

  18. Johnston P, Elyan E, Jayne C (2020) Video tampering localisation using features learned from authentic content. Neural Comput Applic 32(16):12243–12257

    Article  Google Scholar 

  19. Kancherla K, Mukkamala S (2012) Novel blind video forgery detection using markov models on motion residue. In: Asian conference on intelligent information and database systems, Springer, pp 308–315

  20. Kharat J, Chougule S (2020) A passive blind forgery detection technique to identify frame duplication attack. Multimedia Tools Appl 79(11):8107–8123

    Article  Google Scholar 

  21. Lian S, Liu Z, Ren Z, Wang H (2007) Commutative encryption and watermarking in video compression. IEEE Trans Circ Syst Video Technol 17(6):774–778

    Article  Google Scholar 

  22. Liao S-Y, Huang T-Q (2013) Video copy-move forgery detection and localization based on tamura texture features. In: 2013 6th International congress on image and signal processing (CISP), Vol. 2, IEEE, pp 864–868

  23. Lu C-S, Liao H-Y (2003) Structural digital signature for image authentication: an incidental distortion resistant scheme. IEEE Trans Multimedia 5(2):161–173

    Article  Google Scholar 

  24. Mathai M, Rajan D, Emmanuel S (2016) Video forgery detection and localization using normalized cross-correlation of moment features. In: 2016 IEEE southwest symposium on image analysis and interpretation (SSIAI), IEEE, pp 149–152

  25. Pandey RC, Singh SK, Shukla K (2014) Passive copy-move forgery detection in videos. In: 2014 International conference on computer and communication technology (ICCCT), IEEE, pp 301–306

  26. Raskar PS, Shah SK (2021) Real time object-based video forgery detection using yolo (v2). Forensic Sci Int 327:110979

    Article  Google Scholar 

  27. Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271

  28. Saddique M, Asghar K, Bajwa UI, Hussain Aboalsamh HA, Habib Z (2020) Classification of authentic and tampered video using motion residual and parasitic layers. IEEE Access 8:56782–56797

    Article  Google Scholar 

  29. Sharma S, Dhavale SV (2016) A review of passive forensic techniques for detection of copy-move attacks on digital videos. In: 2016 3rd International conference on advanced computing and communication systems (ICACCS), Vol. 1, IEEE, pp 1–6

  30. Shelke NA, Kasana SS (2021) A comprehensive survey on passive techniques for digital video forgery detection. Multimedia Tools Appl 80(4):6247–6310

    Article  Google Scholar 

  31. Singh RD, Aggarwal N (2015) Detection of re-compression, transcoding and frame-deletion for digital video authentication. In: 2015 2nd International conference on recent advances in engineering & computational sciences (RAECS), IEEE, pp 1–6

  32. Singh RD, Aggarwal N (2017) Detection and localization of copy-paste forgeries in digital videos. Forensic Sci Int 281:75–91

    Article  Google Scholar 

  33. Singh G, Singh K (2019) Video frame and region duplication forgery detection based on correlation coefficient and coefficient of variation. Multimedia Tools Appl 78(9):11527–11562

    Article  Google Scholar 

  34. Sitara K, Mehtre B (2016) Digital video tampering detection: an overview of passive techniques. Digit Investig 18 (supplement c):8–22

  35. Su L, Li C (2018) A novel passive forgery detection algorithm for video region duplication. Multidim Syst Sign Process 29(3):1173–1190

    Article  MathSciNet  Google Scholar 

  36. Su L, Li C, Lai Y, Yang J (2017) A fast forgery detection algorithm based on exponential-fourier moments for video region duplication. IEEE Trans Multimedia 20(4):825–840

    Article  Google Scholar 

  37. Su L, Luo H, Wang S (2019) A novel forgery detection algorithm for video foreground removal. IEEE Access 7:109719–109728

    Article  Google Scholar 

  38. Tralic D, Grgic S, Zovko-Cihlar B (2014) Video frame copy-move forgery detection based on cellular automata and local binary patterns. In: 2014 X International symposium on telecommunications (BIHTEL), IEEE, pp 1–4

  39. Ulutas G, Ustubioglu B, Ulutas M, Nabiyev V (2017) Frame duplication/mirroring detection method with binary features. IET Image Process 11(5):333–342

    Article  Google Scholar 

  40. Wahab AWA, Bagiwa MA, Idris MYI, Khan S, Razak Z, Ariffin MRK (2014) Passive video forgery detection techniques: a survey. In: 2014 10th International conference on information assurance and security, IEEE, pp 29–34

  41. Wang W, Jiang X, Wang S, Wan M, Sun T (2013) Identifying video forgery process using optical flow. In: International workshop on digital watermarking, Springer, pp 244–257

  42. Wu Y, Jiang X, Sun T, Wang W (2014) Exposing video inter-frame forgery based on velocity field consistency. In: 2014 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 2674–2678

  43. Xu J, Liang Y, Tian X, Xie A (2016) A novel video inter-frame forgery detection method based on histogram intersection. In: 2016 IEEE/CIC international conference on communications in China (ICCC), IEEE, pp 1–6

  44. Yin L, Bai Z, Yang R (2014) Video forgery detection based on nonnegative tensor factorization. In: 2014 4th IEEE international conference on information science and technology, IEEE, pp 148–151

  45. Zhang Z, Hou J, Li Z, Li D (2015) Inter-frame forgery detection for static-background video based on mvp consistency. In: International workshop on digital watermarking, Springer, pp 94–106

  46. Zhi-yu H, Xiang-hong T (2011) Integrity authentication scheme of color video based on the fragile watermarking. In: 2011 International conference on electronics, communications and control (ICECC), IEEE, pp 4354–4358

  47. Zhong J-L, Gan Y-F, Yang J-X (2021) A fast forgery frame detection method for video copy-move inter/intra-frame identification. J Ambient Intell Humanized Comput 1–12

  48. Zhong J-L, Pun C-M, Gan Y-F (2020) Dense moment feature index and best match algorithms for video copy-move forgery detection. Inf Sci 537:184–202

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory of Wireless Communication and Signal Processing (WCSP), Faculty of Electrical Engineering, Sahand University of Technology, Tabriz, Iran

    Hayde Oliaei & Masoumeh Azghani

Authors
  1. Hayde Oliaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masoumeh Azghani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Masoumeh Azghani.

Ethics declarations

Conflicts of interests

The authors declare that they have no known competing financial interests, personal relationships, and conflicts of interest that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oliaei, H., Azghani, M. Video motion forgery detection using motion residual and object tracking. Multimed Tools Appl 83, 12651–12668 (2024). https://doi.org/10.1007/s11042-023-15763-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15763-6

Keywords

Search

Navigation