Skip to main content
Log in

Recaptured image forensics based on normalized local ternary count histograms of residual maps

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Image display and acquisition technologies have greatly developed over the past few years, which make it possible to recapture high-quality images from high-fidelity LCD (liquid crystal display) screens. These recaptured images pose serious threats on current image forensics technologies and various intelligent recognition systems, which makes the detection of such images significantly important. In this paper, we propose a recaptured image detection method based on normalized LTC (local ternary count) histograms of residual maps. Specifically, given an image, the residual maps of itself and its downsampled version are calculated in gray space via pixel-wise adaptive Wiener filtering. Then, the normalized LTC histograms of all the residual maps are extracted and concatenated as the final feature for training and testing. Single database experiments demonstrate that our proposed method not only performs very close to the state-of-the-art methods on relative low-quality NTU-ROSE and BJTU-IIS databases, but also improves the performance on the most difficult-to-detect ICL-COMMSP database obviously, which verifies the effectiveness of the proposed algorithm. Besides, mixed database experiments verify the superiority on generalization ability of our proposed method. Moreover, it has a lower computational complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. The code is available at https://github.com/nanzhu-DMFLab/recaptured-image-detection-SIVP-2021

  2. http://rose1.ntu.edu.sg/Datasets/recapturedImages.asp

  3. http://www.commsp.ee.ic.ac.uk/~pld/research/Rewind/Recapture/

References

  1. Anjum, A., Islam, S.: Recapture detection technique based on edge-types by analysing high-frequency components in digital images acquired through lcd screens. Multimed. Tools Appl. 79, 6965–6985 (2020)

    Article  Google Scholar 

  2. Bammey, Q., von Gioi, R.G., Morel, J.M.: An adaptive neural network for unsupervised mosaic consistency analysis in image forensics. In: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14182–14192 (2020)

  3. Cao, H., Kot, A.C.: Identification of recaptured photographs on lcd screens. In: Proceedings of International Conference on Acoustics, Speech and Signal Processing, pp. 1790–1793 (2010)

  4. Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)

  5. Choi, H.Y., Jang, H.U., Son, J., Kim, D., Lee, H.K.: Content recapture detection based on convolutional neural networks. In: Proceedings of International Conference on Information Science and Applications, pp. 339–346 (2017)

  6. Fridrich, J., Kodovsky, J.: Rich models for steganalysis of digital images. IEEE Trans. Inf. Forensics Secur. 7(3), 868–882 (2012)

    Article  Google Scholar 

  7. Korus, P.: Digital image integrity - a survey of protection and verification techniques. Digit. Signal Process. 71, 1–26 (2017)

    Article  MathSciNet  Google Scholar 

  8. Li, J., Wu, G.: Image recapture detection through residual-based local descriptors and machine learning. In: Proceedings of International Conference on Cloud Computing and Security, pp. 653–660 (2017)

  9. Li, R., Ni, R., Zhao, Y.: An effective detection method based on physical traits of recaptured images on lcd screens. In: Proceedings of International Workshop on Digital-Forensics and Watermarking, pp. 107–116 (2015)

  10. Mahdian, B., Novozámský, A., Saic, S.: Identification of aliasing-based patterns in re-captured lcd screens. In: Proceedings of International Conference on Image Processing, pp. 616–620 (2015)

  11. Ni, R., Zhao, Y., Zhai, X.: Recaptured images forensics based on color moments and dct coefficients features. J. Inf. Hiding Multimed. Signal Process. 6(2), 323–333 (2015)

    Google Scholar 

  12. Qureshi, M.A., Deriche, M.: A bibliography of pixel-based blind image forgery detection techniques. Signal Process. Image Commun. 39, 46–74 (2015)

    Article  Google Scholar 

  13. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Proceedings of International Conference on Learning Representations, pp. 1–14 (2015)

  14. Sun, Y., Shen, X., Chen, H., Zhao, Y.: Recaptured image forensics algorithm based on local plane linear point. J. Jilin Univ. 49(4), 1320–1328 (2019)

    Google Scholar 

  15. Sun, Y., Shen, X., Liu, C., Zhao, Y.: Recaptured image forensics algorithm based on image texture feature. Int. J. Pattern Recogn. Artif. Intell. 34(3), 2054011 (2020)

    Article  Google Scholar 

  16. Sun, Y., Shen, X., Lyu, Y., Liu, C.: Recaptured image forensics algorithm based on multi-resolution wavelet transformation and noise analysis. Int. J. Pattern Recogn. Artif. Intell. 32(2), 1854003 (2018)

    Article  MathSciNet  Google Scholar 

  17. Tan, D., Shen, X., Qin, J., Chen, H.: Detecting computer generated images based on local ternary count. Pattern Recogn. Image Anal. 26(4), 720–725 (2016)

    Article  Google Scholar 

  18. Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  19. Thongkamwitoon, T., Muammar, H., Dragotti, P.L.: Identification of image acquisition chains using a dictionary of edge profiles. In: Proceedings of European Signal Processing Conference, pp. 1757–1761 (2012)

  20. Thongkamwitoon, T., Muammar, H., Dragotti, P.L.: Robust image recapture detection using a k-svd learning approach to train dictionaries of edge profiles. In: Proceedings of International Conference on Image Processing, pp. 5317–5321 (2014)

  21. Thongkamwitoon, T., Muammar, H., Dragotti, P.L.: An image recapture detection algorithm based on learning dictionaries of edge profiles. IEEE Trans. Inf. Forensics Secur. 10(5), 953–968 (2015)

    Article  Google Scholar 

  22. Wang, K.: A simple and effective image-statistics-based approach to detecting recaptured images from lcd screens. Digit. Investig. 23, 75–87 (2017)

    Article  Google Scholar 

  23. Yang, P., Li, R., Ni, R., Zhao, Y.: Recaptured image forensics based on quality aware and histogram feature. In: Proceedings of International Workshop on Digital-Forensics and Watermarking, pp. 31–41 (2017)

  24. Yang, P., Ni, R., Zhao, Y.: Recaptured images forensics based on laplacian convolution neural networks. In: Proceedings of International Workshop on Digital-Forensics and Watermarking, pp. 119–128 (2016)

  25. Yin, J., Fang, Y.: Digital image forensics for photographic copying. In: Proceedings of Media Watermarking, Security, and Forensics 2012, pp. 83030F–1–83030F–7 (2012)

  26. Yin, J., Fang, Y.: Markov-based image forensics for photographic copying from printed picture. In: Proceedings of ACM International Conference on Multimedia, pp. 1113–1116 (2012)

  27. Yu, H., Ng, T.T., Sun, Q.: Recaptured photo detection using specularity distribution. In: Proceedings of International Conference on Image Processing, pp. 3140–3143 (2008)

  28. Yue, H., Mao, Y., Liang, L., Xu, H., Hou, C., Yang, J.: Recaptured screen image demoiréing. IEEE Trans. Circuits Syst. Video Technol. (2020). https://doi.org/10.1109/TCSVT.2020.2969984

  29. Zhai, X., Ni, R., Zhao, Y.: Recaptured image detection based on texture features. In: Proceedings of International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 234–237 (2013)

  30. Zhu, N., Li, Z.: Recaptured image detection through enhanced residual-based correlation coefficients. In: Proceedings of International Conference on Cloud Computing and Security, pp. 624–634 (2018)

Download references

Acknowledgements

The authors would like to thank Dr. Wang for making his source code of [22] freely available online. We would also want to thank Dr. Sun for sharing us the source code of [16] for comparison. Besides, we also want to thank Prof. Ni for sharing the BJTU-IIS database for experiments. This work was supported by the National Natural Science Foundation of China (No. 61901349), the Natural Science Basic Research Program of Shaanxi (No. 2019JQ-322).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nan Zhu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, N., Guo, Q., Cui, M. et al. Recaptured image forensics based on normalized local ternary count histograms of residual maps. SIViP 16, 165–173 (2022). https://doi.org/10.1007/s11760-021-01974-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-021-01974-7

Keywords

Navigation