Skip to main content
Log in

Noise-level estimation based detection of motion-compensated frame interpolation in video sequences

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Motion-Compensated Frame Interpolation (MCFI) is commonly used to produce the fake high-frame-rate videos, and it can be regarded as a video forgery operation from a broad sense. In this paper, we use the noise-level estimation to expose MCFI operator, and exploit the periodicity of noise-level varying to propose an effective automatic detection method. To guarantee the high detection accuracy, the high-pass filtering and the spike enhancement are both employed to extract the peak outliers in the Fourier domain. Depending on these outliers, we design the criterion of credibility value to make a final decision. The extensive experiments evaluated on hundreds of video sequences with different spatial resolutions and two parameter configurations of H.264/AVC have shown that the validity of the proposed method, which has the better detection accuracy for the MCFI method and the frame repetition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. The uncompressed YUV sequences are coming from the public website: http://media.xiph.org/video/derf/.

References

  1. Alsmirat M, Jararweh Y, Al-Ayyoub M, Gupta BB (2016a) Accelerating compute intensive medical imaging segmentation algorithms using hybrid CPU-GPU implementations. Multimedia Tools and Applications 2016:1–19

    Google Scholar 

  2. Alsmirat MA, Jararweh Y, Obaidat I, Gupta BB (2016b) Automated wireless video surveillance: an evaluation framework. J Real-Time Image Proc 2016:1–20

    Google Scholar 

  3. Bestagini P, Battaglia S, Milani S, Tagliasacchi M, Tubaro S (2013) Detection of temporal interpolation in video sequences. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 3033–3037

  4. Bian S, Luo W, Huang J (2014a) Detecting video frame-rate up-conversion based on periodic properties of inter-frame similarity. Multimedia Tools and Applications 72(1):437–451

    Article  Google Scholar 

  5. Bian S, Luo W, Huang J (2014b) Exposing fake bit rate videos and estimating original bit rates. IEEE transactions on circuits and Systems for Video. Technology 24(12):2144–2154

    Google Scholar 

  6. Choi BD, Han JW, Kim CS, Ko SJ (2007) Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. IEEE transactions on circuits and Systems for Video. Technology 17(4):407–416

    Google Scholar 

  7. Dikbas S, Altunbasak T (2013) Novel true-motion estimation algorithm and its application to motion-compensated temporal frame interpolation. IEEE Trans Image Process 22(8):2931–2945

    Article  MathSciNet  MATH  Google Scholar 

  8. Donoho DL (1995) De-noising by soft-thresholding. IEEE Trans Inf Theory 41(3):613–627

    Article  MathSciNet  MATH  Google Scholar 

  9. Fu Z, Wu X, Guan C, Sun X, Ren K (2016) Towards efficient multi-keyword fuzzy search over encrypted outsourced data with accuracy improvement. IEEE Trans Inf Forensics Secur. doi:10.1109/TIFS.2016.2596138

    Google Scholar 

  10. Haan GD, Biezen PWAC, Huijgen H, Ojo OA (1993) True motion estimation with 3-D recursive search block matching. IEEE transactions on circuits and Systems for Video. Technology 3(5):368–379

    Google Scholar 

  11. Jeong SG, Lee C, Kim CS (2013) Motion-compensated frame interpolation based on multihypothesis motion estimation and texture optimization. IEEE Trans Image Process 22(11):4497–4509

    Article  MathSciNet  MATH  Google Scholar 

  12. Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518

    Article  Google Scholar 

  13. Liu HB, Xin RQ, Zhao DB, Ma SW, Gao W (2012) Multiple hypotheses bayesian frame rate up-conversion by adaptive fusion of motion-compensated interpolations. IEEE transactions on circuits and Systems for Video. Technology 22(8):1188–1198

    Google Scholar 

  14. Mallat S (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693

    Article  MATH  Google Scholar 

  15. Mehmood I, Sajjad M, Rho S, Baik SW (2015) Divide-and-conquer based summarization framework for extracting affective video content. Nerocomputing 174:393–403

    Article  Google Scholar 

  16. Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176

    Article  Google Scholar 

  17. Pan Z, Lei J, Zhang Y, Sun X, Kwong S (2016) Fast motion estimation based on content property for low-complexity H.265/HEVC encoder. IEEE Trans Broadcast 62(3):675–684

    Article  Google Scholar 

  18. Papoulis A, Pillai SU (2002) Probability, random variables and stochastic processes, 4th ed. McGraw-Hill, New York

    Google Scholar 

  19. Xia Z, Wang X, Zhang L, Qin Z, Sun X, Ren K (2016) A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing. IEEE Trans Inf Forensics Secur. doi:10.1109/TIFS.2016.2590944

    Google Scholar 

  20. Yao Y, Yang G, Sun X, Li L (2016) Detecting video frame-rate up-conversion based on periodic properties of edge-intensity. Journal of Information Security and Applications 26:39–50

    Article  Google Scholar 

  21. Yoo DG, Kang SJ, Kim YH (2013) Direction-select motion estimation for motion-compensated frame rate up-conversion. J Disp Technol 9(10):840–850

    Article  Google Scholar 

  22. Zhou Z, Wang Y, Wu QMJ, Yang C, Sun X (2016) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forensics Secur. doi:10.1109/TIFS.2016.2601065

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China, under Grants nos. 61501393, 61572417, 61502409 and 61471162.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ran Li.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, R., Liu, Z., Zhang, Y. et al. Noise-level estimation based detection of motion-compensated frame interpolation in video sequences. Multimed Tools Appl 77, 663–688 (2018). https://doi.org/10.1007/s11042-016-4268-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4268-3

Key words

Navigation