Skip to main content
SpringerLink
Log in

Image quality assessment based fake face detection

  • 1209: Recent Advances on Social Media Analytics and Multimedia Systems: Issues and Challenges
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The tremendous growth of data in social media and other platforms has raised an interesting question of authenticity. It has led to an active research area named Digital Forensics. Especially, the face manipulation has become a major issue in character assassination. The image forgery tools are improving everyday thereby posing a challenge in detection systems. The current detection systems provide deep learning based solutions which do not bring the reliability and also have chance to fail when different forgery tool is developed to synthesise or edit the face image. Therefore, an efficient system is required which gives explainability along with efficacy. In this paper, we propose a novel method to detect the forged faces using Image Quality Assessment(IQA) based features. As far as we know IQA has not been used for detecting AI generated images. Despite the visual appearance being same for original and fake images, most of the discriminative information will be available in the frequency domain of those images. With that intuition we have extracted image quality based features from frequency domain and also spatial domain. The proposed method has achieved the highest accuracy of 99% when different types of experiments were performed on standard datasets. The generalisation and explainability of the proposed model have also been discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Akhtar Z, Dasgupta D (2019) A comparative evaluation of local feature descriptors for deepfakes detection. In: 2019 IEEE international symposium on technologies for homeland security (HST). IEEE, pp 1–5

  2. Amerini I, Galteri L, Caldelli R, Del Bimbo A (2019) Deepfake video detection through optical flow based cnn. In: Proceedings of the IEEE/CVF international conference on computer vision workshops, pp 0–0

  3. Bakshi A, Gupta S (2020) An efficient face anti-spoofing and detection model using image quality assessment parameters. Multimedia Tools Appl, pp 1–22

  4. Bappy JH, Roy-Chowdhury AK, Bunk J, Nataraj L, Manjunath B (2017) Exploiting spatial structure for localizing manipulated image regions. In: Proceedings of the IEEE international conference on computer vision, pp 4970–4979

  5. Cao Q, Shen L, Xie W, Parkhi OM, Zisserman A (2018) Vggface2: a dataset for recognising faces across pose and age. In: 2018 13Th IEEE international conference on automatic face & gesture recognition (FG 2018). IEEE, pp 67–74

  6. Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1251–1258

  7. Cristin R, Ananth JP, Raj VC (2018) Illumination-based texture descriptor and fruitfly support vector neural network for image forgery detection in face images. IET Image Process 12(8):1439–1449

    Article  Google Scholar 

  8. Dang H, Liu F, Stehouwer J, Liu X, Jain AK (2020) On the detection of digital face manipulation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5781–5790

  9. De K, Masilamani V (2013) Image sharpness measure for blurred images in frequency domain. Proced Eng 64:149–158

    Article  Google Scholar 

  10. De K, Masilamani V (2017) No-reference image contrast measure using image statistics and random forest. Multimedia Tools Appl 76(18):18641–18656

    Article  Google Scholar 

  11. Fei J, Xia Z, Yu P, Xiao F (2020) Exposing ai-generated videos with motion magnification. Multimedia Tools Appl, pp 1–14

  12. Fernando T, Fookes C, Denman S, Sridharan S (2019) Exploiting human social cognition for the detection of fake and fraudulent faces via memory networks. arXiv:1911.07844

  13. Fourati E, Elloumi W, Chetouani A (2020) Anti-spoofing in face recognition-based biometric authentication using image quality assessment. Multimedia Tools Appl 79(1-2):865–889

    Article  Google Scholar 

  14. Galbally J, Alonso-Fernandez F, Fierrez J, Ortega-Garcia J (2012) A high performance fingerprint liveness detection method based on quality related features. Futur Gener Comput Syst 28(1):311–321

    Article  Google Scholar 

  15. Galbally J, Marcel S, Fierrez J (2013) Image quality assessment for fake biometric detection: Application to iris, fingerprint, and face recognition. IEEE Trans Image Process 23(2):710–724

    Article  MathSciNet  MATH  Google Scholar 

  16. Galbally J, Marcel S, Fierrez J (2014) Biometric antispoofing methods: a survey in face recognition. IEEE Access 2:1530–1552

    Article  Google Scholar 

  17. Guan H, Kozak M, Robertson E, Lee Y, Yates AN, Delgado A, Zhou D, Kheyrkhah T, Smith J, Fiscus J (2019) Mfc datasets: Large-scale benchmark datasets for media forensic challenge evaluation. In: 2019 IEEE Winter applications of computer vision workshops (WACVW). IEEE, pp 63–72

  18. Güera D, Delp EJ (2018) Deepfake video detection using recurrent neural networks. In: 2018 15Th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–6

  19. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  20. Hsu CC, Zhuang YX, Lee CY (2020) Deep fake image detection based on pairwise learning. Appl Sci 10(1):370

    Article  Google Scholar 

  21. Karras T, Laine S, Aittala M, Hellsten J, Lehtinen J, Aila T (2020) Analyzing and improving the image quality of stylegan. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8110–8119

  22. Khalid H, Woo SS (2020) Oc-fakedect: Classifying deepfakes using one-class variational autoencoder. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 656–657

  23. Kiruthika S, Masilamani V Goal oriented image quality assessment. IET Image Processing doi:https://doi.org/10.1049/ipr2.12209. https://ietresearch.onlinelibrary.wiley.com/doi/abs/10.1049/ipr2.12209

  24. Korshunova I, Shi W, Dambre J, Theis L (2017) Fast face-swap using convolutional neural networks. In: Proceedings of the IEEE international conference on computer vision, pp 3677–3685

  25. Korus P (2017) Digital image integrity–a survey of protection and verification techniques. Digit Signal Process 71:1–26

    Article  MathSciNet  Google Scholar 

  26. Li J, Shen T, Zhang W, Ren H, Zeng D, Mei T (2019) Zooming into face forensics:, A pixel-level analysis. arXiv:1912.05790

  27. Li L, Bao J, Zhang T, Yang H, Chen D, Wen F, Guo B (2020) Face x-ray for more general face forgery detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5001–5010

  28. Li X, Yu K, Ji S, Wang Y, Wu C, Xue H (2020) Fighting against deepfake: Patch&pair convolutional neural networks (ppcnn). In: Companion proceedings of the web conference 2020, pp 88–89

  29. Li Y, Lyu S (2018) Exposing deepfake videos by detecting face warping artifacts. arXiv:1811.00656

  30. Liu L, Dong H, Huang H, Bovik AC (2014) No-reference image quality assessment in curvelet domain. Signal Process Image Commun 29 (4):494–505

    Article  Google Scholar 

  31. Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. In: Advances in neural information processing systems, pp 4765–4774

  32. Matern F, Riess C, Stamminger M (2019) Exploiting visual artifacts to expose deepfakes and face manipulations. In: 2019 IEEE Winter applications of computer vision workshops (WACVW). IEEE, pp 83–92

  33. McCloskey S, Albright M (2018) Detecting gan-generated imagery using color cues. arXiv:1812.08247

  34. Mittal A, Soundararajan R, Bovik AC (2012) Making a “completely blind” image quality analyzer. IEEE Signal Process Lett 20(3):209–212

    Article  Google Scholar 

  35. Mo H, Chen B, Luo W (2018) Fake faces identification via convolutional neural network. In: Proceedings of the 6th ACM workshop on information hiding and multimedia security, pp 43–47

  36. Nataraj L, Mohammed TM, Manjunath B, Chandrasekaran S, Flenner A, Bappy JH, Roy-Chowdhury AK (2019) Detecting gan generated fake images using co-occurrence matrices. Electron Imag 2019(5):532–1

    Google Scholar 

  37. Neves JC, Tolosana R, Vera-Rodriguez R, Lopes V, Proença H, Fierrez J (2019) Ganprintr:, Improved fakes and evaluation of the state of the art in face manipulation detection. arXiv:1911.05351

  38. Nguyen HH, Yamagishi J, Echizen I (2019) Capsule-forensics: Using capsule networks to detect forged images and videos. In: ICASSP 2019-2019 IEEE International conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2307–2311

  39. Nhu T, Na I, Kim S (2018) Forensics face detection from gans using convolutional neural network. In: Proceeding of 2018 international symposium on information technology convergence (ISITC 2018)

  40. Rana MS, Sung AH (2020) Deepfakestack: a deep ensemble-based learning technique for deepfake detection. In: 2020 7Th IEEE international conference on cyber security and cloud computing (CSCloud)/2020 6th IEEE international conference on edge computing and scalable cloud (edgecom). IEEE, pp 70–75

  41. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  42. Tariq S, Lee S, Kim H, Shin Y, Woo SS (2018) Detecting both machine and human created fake face images in the wild. In: Proceedings of the 2nd international workshop on multimedia privacy and security, pp 81–87

  43. Thies J, Zollhöfer M, Nießner M (2019) Deferred neural rendering: Image synthesis using neural textures. ACM Trans Graph (TOG) 38(4):1–12

    Article  Google Scholar 

  44. Thies J, Zollhofer M, Stamminger M, Theobalt C, Nießner M (2016) face2face: Real-time face capture and reenactment of rgb videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2387–2395

  45. Wang R, Ma L, Juefei-Xu F, Xie X, Wang J, Liu Y (2019) Fakespotter:, A simple baseline for spotting ai-synthesized fake faces. arXiv:1909.06122 2

  46. Xue W, Mou X, Zhang L, Bovik AC, Feng X (2014) Blind image quality assessment using joint statistics of gradient magnitude and laplacian features. IEEE Trans Image Process 23(11):4850–4862

    Article  MathSciNet  MATH  Google Scholar 

  47. Yang X, Li Y, Lyu S (2019) Exposing deep fakes using inconsistent head poses. In: ICASSP 2019-2019 IEEE International conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 8261–8265

  48. Yeh C, Chang H (2018) Face liveness detection based on perceptual image quality assessment features with multi-scale analysis. In: 2018 IEEE Winter conference on applications of computer vision (WACV), pp 49–56

  49. Yi D, Lei Z, Liao S, Li SZ (2014) Learning face representation from scratch. arXiv:1411.7923

  50. Zhang Y, Zheng L, Thing VL (2017) Automated face swapping and its detection. In: 2017 IEEE 2Nd international conference on signal and image processing (ICSIP). IEEE, pp 15–19

Download references

Author information

Authors and Affiliations

  1. Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, India

    Kiruthika S. & Masilamani V.

Authors
  1. Kiruthika S.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masilamani V.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kiruthika S..

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

S., K., V., M. Image quality assessment based fake face detection. Multimed Tools Appl 82, 8691–8708 (2023). https://doi.org/10.1007/s11042-021-11493-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11493-9

Keywords

Search

Navigation