paper-with-me

홈 › Papers

Classifying Deepfakes Using Swin Transformers

2025-01-26 · Aprille J. Xi, Eason Chen

The proliferation of deepfake technology poses significant challenges to the authenticity and trustworthiness of digital media, necessitating the development of robust detection methods. This study explores the application of Swin Transformers, a state-of-the-art architecture leveraging shifted windows for self-attention, in detecting and classifying deepfake images. Using the Real and Fake Face Detection dataset by Yonsei University's Computational Intelligence Photography Lab, we evaluate the Swin Transformer and hybrid models such as Swin-ResNet and Swin-KNN, focusing on their ability to identify subtle manipulation artifacts. Our results demonstrate that the Swin Transformer outperforms conventional CNN-based architectures, including VGG16, ResNet18, and AlexNet, achieving a test accuracy of 71.29%. Additionally, we present insights into hybrid model design, highlighting the complementary strengths of transformer and CNN-based approaches in deepfake detection. This study underscores the potential of transformer-based architectures for improving accuracy and generalizability in image-based manipulation detection, paving the way for more effective countermeasures against deepfake threats.

📄 PDF Abstract BibTeX arXiv:2501.15656

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake DetectionFace DetectionFace Swapping

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

TALL: Thumbnail Layout for Deepfake Video Detection

2023-07-14 · ICCV 2023 1 · Yuting Xu, Jian Liang, Gengyun Jia, Ziming Yang 외

The growing threats of deepfakes to society and cybersecurity have raised enormous public concerns, and increasing efforts have been devoted to this critical topic of deepfake video detection. Existing video methods achi…

Face Swapping

SFANet: Spatial-Frequency Attention Network for Deepfake Detection

2025-10-06 · Vrushank Ahire, Aniruddh Muley, Shivam Zample, Siddharth Verma 외 arxiv

Detecting manipulated media has now become a pressing issue with the recent rise of deepfakes. Most existing approaches fail to generalize across diverse datasets and generation techniques. We thus propose a novel ensemb…

DeepFake Detection

Deep Reinforcement Learning with Swin Transformers

2022-06-30 · Li Meng, Morten Goodwin, Anis Yazidi, Paal Engelstad

Transformers are neural network models that utilize multiple layers of self-attention heads and have exhibited enormous potential in natural language processing tasks. Meanwhile, there have been efforts to adapt transfor…

Atari GamesDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1

CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer

2025-05-16 · Xinran Li, Yu Liu, Xiujuan Xu, Xiaowei Zhao

The automatic diagnosis of chest diseases is a popular and challenging task. Most current methods are based on convolutional neural networks (CNNs), which focus on local features while neglecting global features. Recentl…

Ensemble Learningimage-classificationImage Classification

A Novel Unified Approach to Deepfake Detection

2026-01-06 · Lord Sen, Shyamapada Mukherjee arxiv

The advancements in the field of AI is increasingly giving rise to various threats. One of the most prominent of them is the synthesis and misuse of Deepfakes. To sustain trust in this digital age, detection and tagging …

DeepFake DetectionBlood Detection