Abstract
Serious security and privacy problems have arisen as a result of significant advancements in the creation of deepfakes. Attackers can easily replace a person’s face with the target person’s face in an image using sophisticated Deep learning (DL) algorithms to spoof their identity. Deepfakes detection algorithms have been proposed in response to the growing concerns about the potential harm caused by deepfakes. However, a reliable deepfakes detector that can keep up with contemporary deepfakes creation techniques is required. In this work, we have proposed an end-to-end methodology for detecting manipulated visual content. We used multiple CNN models i.e., ResNet18, ResNet50, DenseNet65, DenseNet77, and DenseNet100 along with the SVM classifier to compute effective cues from the input facial faces to distinguish between actual and altered content. We have also applied the concept of transfer learning to solve the issue of model over-fitting and improve generalizability against different manipulation algorithms. A comparison study is carried out to evaluate the performance of several feature extractors. Through thorough experiments performed using the Deepfakes Detection Challenge dataset, our results demonstrated that DenseNet100 surpasses the other CNN models by better recognizing deepfakes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akhtar, Z., Rattani, A., Hadid, A., Tistarelli, M.: Face recognition under ageing effect: a comparative analysis. In: Petrosino, A. (ed.) ICIAP 2013. LNCS, vol. 8157, pp. 309–318. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41184-7_32
Nawaz, M., et al.: Single and multiple regions duplication detections in digital images with applications in image forensic. J. Intell. Fuzzy Syst. 40(6), 10351–10371 (2021)
FaceApp (2022). https://www.faceapp.com/
Park, J.S., Chung, M.S., Hwang, S.B., Lee, Y.S., Har, D.-H.: Technical report on semiautomatic segmentation using the Adobe photoshop. J. Digit. Imaging 18(4), 333–343 (2005)
Kohli, A., Gupta, A.: Detecting DeepFake, FaceSwap and Face2Face facial forgeries using frequency CNN. Multimed. Tools Appl. 80(12), 18461–18478 (2021). https://doi.org/10.1007/s11042-020-10420-8
Güera, D., Delp, E.J.: Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE (2018)
Gellately, R.: Lenin, Stalin, and Hitler: The age of social catastrophe. Alfred a Knopf Incorporated (2007)
Masood, M., Nawaz, M., Javed, A., Nazir, T., Mehmood, A., Mahum, R.: Classification of deepfake videos using pre-trained convolutional neural networks. In: 2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2), pp. 1–6. IEEE (2021)
Nawaz, M., et al.: Image authenticity detection using DWT and circular block-based LTrP features. CMC-Comput. Mater. Continua 69(2), 1927–1944 (2021)
Moudhgalya, N.B., Divi, S., Adithya Ganesan, V., Sharan Sundar, S., Vijayaraghavan, V.: DeepTrace: a generic framework for time series forecasting. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2019. LNCS, vol. 11506, pp. 139–151. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20521-8_12
Jameel, W.J., Kadhem, S.M., Abbas, A.R.: Detecting deepfakes with deep learning and gabor filters. Aro Sci. J. Koya Univ. 10(1), 18–22 (2022)
Xu, Y., Raja, K., Pedersen, M.: Supervised contrastive learning for generalizable and explainable deepfakes detection. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 379–389 (2022)
Wang, G., Jiang, Q., Jin, X., Cui, X.: FFR_FD: effective and fast detection of deepfakes via feature point defects. Inf. Sci. 596, 472–488 (2022)
Kolagati, S., Priyadharshini, T., Rajam, V.M.A.: Exposing deepfakes using a deep multilayer perceptron–convolutional neural network model. Int. J. Inf. Manage. Data Insights 2(1), 100054 (2022)
Sun, Z., Han, Y., Hua, Z., Ruan, N., Jia, W.: Improving the efficiency and robustness of deepfakes detection through precise geometric features. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3609–3618 (2021)
Mehta, V., Gupta, P., Subramanian, R., Dhall, A.: Fakebuster: a deepfakes detection tool for video conferencing scenarios. In: 26th International Conference on Intelligent User Interfaces-Companion, pp. 61–63 (2021)
Yavuzkilic, S., Sengur, A., Akhtar, Z., Siddique, K.: Spotting deepfakes and face manipulations by fusing features from multi-stream CNNs models. Symmetry 13(8), 1352 (2021)
Yasrab, R., Jiang, W., Riaz, A.: Fighting deepfakes using body language analysis. Forecasting 3(2), 303–321 (2021)
Khalid, H., Woo, S.S.: OC-FakeDect: Classifying deepfakes using one-class variational autoencoder. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 656–657 (2020)
Montserrat, D.M., et al.: Deepfakes detection with automatic face weighting. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 668–669 (2020)
Wang, Y., Dantcheva, A.: A video is worth more than 1000 lies. Comparing 3DCNN approaches for detecting deepfakes. In: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 515–519. IEEE (2020)
Yang, X., Li, Y., Lyu, S.: Exposing deep fakes using inconsistent head poses. In: ICASSP 2019–2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8261–8265. IEEE (2019)
Baltrušaitis, T., Robinson, P., Morency, L.-P.: Openface: an open source facial behavior analysis toolkit. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–10. IEEE (2016)
Fydanaki, A., Geradts, Z.: Evaluating OpenFace: an open-source automatic facial comparison algorithm for forensics. Forensic Sci. Res. 3(3), 202–209 (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Albahli, S., Nawaz, M., Javed, A., Irtaza, A.: An improved faster-RCNN model for handwritten character recognition. Arab. J. Sci. Eng. 1–15 (2021)
Albahli, S., Nazir, T., Irtaza, A., Javed, A.: Recognition and detection of diabetic retinopathy using densenet-65 based faster-RCNN. Comput. Mater. Contin 67, 1333–1351 (2021)
Albattah, W., Nawaz, M., Javed, A., Masood, M., Albahli, S.: A novel deep learning method for detection and classification of plant diseases. Complex Intell. Syst. 8(1), 507–524 (2021). https://doi.org/10.1007/s40747-021-00536-1
Dolhansky, B., et al.: The DeepFake detection challenge dataset. arXiv preprint arXiv:2006.07397 (2020)
Acknowledgments
This work was supported by the grant of the Punjab Higher Education Commission (PHEC) of Pakistan via Award No. (PHEC/ARA/PIRCA/20527/21).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Ethics declarations
All authors declared no conflict of interest in this work.
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Nawaz, M., Javed, A., Nazir, T., Khan, M.A., Rajinikanth, V., Kadry, S. (2023). Classification of Real and Deepfakes Visual Samples with Pre-trained Deep Learning Models. In: Singh, M., Tyagi, V., Gupta, P., Flusser, J., Ören, T. (eds) Advances in Computing and Data Sciences. ICACDS 2023. Communications in Computer and Information Science, vol 1848. Springer, Cham. https://doi.org/10.1007/978-3-031-37940-6_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-37940-6_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37939-0
Online ISBN: 978-3-031-37940-6
eBook Packages: Computer ScienceComputer Science (R0)