5 March 2024 Hybrid network of convolutional neural network and transformer for deepfake geographic image detection
Xiaoyong Liu, Xiaofei Dong, Feng Xie, Pei Lu, Xi Lu, Mingzhong Jiang
Author Affiliations +
Abstract

In recent years, generative adversarial networks have been widely used to generate realistic fake images, and the current research mainly focuses on deepfake detection in face images. However, we are now facing the emergence of fake satellite images, which could potentially mislead and threaten national security. To address this issue, we propose a hybrid network of convolutional neural network and Transformer for deepfake geographic image detection. Specifically, our method combines the local modeling capability of convolutional neural networks with the global modeling capability of transformers. This allows us to effectively extract both local features and global representations from the satellite images. Additionally, we enhance the detection performance of the model by introducing channel attention mechanisms. Experimental results demonstrate that our proposed method outperforms existing approaches. Furthermore, under common image processing scenarios, such as Joint Photographic Experts Group compression and Gaussian noise corruption, our method also performs better than other comparison methods.

© 2024 SPIE and IS&T
Xiaoyong Liu, Xiaofei Dong, Feng Xie, Pei Lu, Xi Lu, and Mingzhong Jiang "Hybrid network of convolutional neural network and transformer for deepfake geographic image detection," Journal of Electronic Imaging 33(2), 023007 (5 March 2024). https://doi.org/10.1117/1.JEI.33.2.023007
Received: 26 September 2023; Accepted: 20 February 2024; Published: 5 March 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Satellite imaging

Satellites

Earth observing sensors

Transformers

Convolutional neural networks

Neural networks

Image compression

Back to Top