paper-with-me

홈 › Papers

Protecting Celebrities from DeepFake with Identity Consistency Transformer

2022-03-02 · CVPR 2022 1 · Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Ting Zhang, Weiming Zhang, Nenghai Yu, Dong Chen, Fang Wen, Baining Guo

In this work we propose Identity Consistency Transformer, a novel face forgery detection method that focuses on high-level semantics, specifically identity information, and detecting a suspect face by finding identity inconsistency in inner and outer face regions. The Identity Consistency Transformer incorporates a consistency loss for identity consistency determination. We show that Identity Consistency Transformer exhibits superior generalization ability not only across different datasets but also across various types of image degradation forms found in real-world applications including deepfake videos. The Identity Consistency Transformer can be easily enhanced with additional identity information when such information is available, and for this reason it is especially well-suited for detecting face forgeries involving celebrities. Code will be released at \url{https://github.com/LightDXY/ICT_DeepFake}

📄 PDF Abstract BibTeX arXiv:2203.01318

Code (1)

lightdxy/ict_deepfake 공식 구현 pytorch

Tasks

Face Swapping

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Protecting World Leader Using Facial Speaking Pattern Against Deepfakes

2022-09-09 · IEEE Signal Processing Letters 2022 9 · Beilin Chu, Weike You, Zhen Yang, Linna Zhou 외

Face forgery instances involving celebrities are on the rise, owing to the ease with which their large quantity of videos may be accessible on the Internet, world leaders particularly. While current face manipulation det…

DeepFake Detection

Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakes

2025-05-26 · Kaiqing Lin, Zhiyuan Yan, Ke-Yue Zhang, Li Hao 외

Securing personal identity against deepfake attacks is increasingly critical in the digital age, especially for celebrities and political figures whose faces are easily accessible and frequently targeted. Most existing d…

DeepFake DetectionFace GenerationFace SwappingLarge Language Model+1

DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection

2024-10-31 · Fan Nie, Jiangqun Ni, Jian Zhang, Bin Zhang 외

With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been ex…

DecoderDeepFake DetectionFace Swapping

MagicNaming: Consistent Identity Generation by Finding a "Name Space" in T2I Diffusion Models

2024-12-19 · Jing Zhao, Heliang Zheng, Chaoyue Wang, Long Lan 외

Large-scale text-to-image diffusion models, (e.g., DALL-E, SDXL) are capable of generating famous persons by simply referring to their names. Is it possible to make such models generate generic identities as simple as th…

FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset

2021-08-11 · Hasam Khalid, Shahroz Tariq, Minha Kim, Simon S. Woo

While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be us…

DeepFake DetectionFace Swapping