paper-with-me

Papers

Deepfake Video Detection Using Convolutional Vision Transformer

2021-02-22 · Deressa Wodajo, Solomon Atnafu

The rapid advancement of deep learning models that can generate and synthesis hyper-realistic videos known as Deepfakes and their ease of access to the general public have raised concern from all concerned bodies to their possible malicious intent use. Deep learning techniques can now generate faces, swap faces between two subjects in a video, alter facial expressions, change gender, and alter facial features, to list a few. These powerful video manipulation methods have potential use in many fields. However, they also pose a looming threat to everyone if used for harmful purposes such as identity theft, phishing, and scam. In this work, we propose a Convolutional Vision Transformer for the detection of Deepfakes. The Convolutional Vision Transformer has two components: Convolutional Neural Network (CNN) and Vision Transformer (ViT). The CNN extracts learnable features while the ViT takes in the learned features as input and categorizes them using an attention mechanism. We trained our model on the DeepFake Detection Challenge Dataset (DFDC) and have achieved 91.5 percent accuracy, an AUC value of 0.91, and a loss value of 0.32. Our contribution is that we have added a CNN module to the ViT architecture and have achieved a competitive result on the DFDC dataset.

📄 PDF Abstract BibTeX arXiv:2102.11126

Code (1)

erprogs/CViT 공식 구현 pytorch

Tasks

DeepFake DetectionFace Swapping

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Deepfake Video Detection Using Generative Convolutional Vision Transformer

2023-07-13 · Deressa Wodajo, Solomon Atnafu, Zahid Akhtar

Deepfakes have raised significant concerns due to their potential to spread false information and compromise digital media integrity. In this work, we propose a Generative Convolutional Vision Transformer (GenConViT) for…

DeepFake DetectionFace Swapping

Combining EfficientNet and Vision Transformers for Video Deepfake Detection

2021-07-06 · Davide Coccomini, Nicola Messina, Claudio Gennaro, Fabrizio Falchi

Deepfakes are the result of digital manipulation to forge realistic yet fake imagery. With the astonishing advances in deep generative models, fake images or videos are nowadays obtained using variational autoencoders (V…

DeepFake DetectionFace Swapping

Deepfake Detection Scheme Based on Vision Transformer and Distillation

2021-04-03 · Young-Jin Heo, Young-Ju Choi, Young-Woon Lee, Byung-Gyu Kim

Deepfake is the manipulated video made with a generative deep learning technique such as Generative Adversarial Networks (GANs) or Auto Encoder that anyone can utilize. Recently, with the increase of Deepfake videos, som…

DeepFake DetectionFace Swapping

Deep Convolutional Pooling Transformer for Deepfake Detection

2022-09-12 · Tianyi Wang, Harry Cheng, Kam Pui Chow, Liqiang Nie

Recently, Deepfake has drawn considerable public attention due to security and privacy concerns in social media digital forensics. As the wildly spreading Deepfake videos on the Internet become more realistic, traditiona…

DeepFake DetectionFace SwappingVideo Compression

Deepfake Video Detection with Spatiotemporal Dropout Transformer

2022-07-14 · Daichi Zhang, Fanzhao Lin, Yingying Hua, Pengju Wang 외

While the abuse of deepfake technology has caused serious concerns recently, how to detect deepfake videos is still a challenge due to the high photo-realistic synthesis of each frame. Existing image-level approaches oft…

Data AugmentationFace Swapping