paper-with-me

홈 › Papers

Generalizable Deepfake Detection Based on Forgery-aware Layer Masking and Multi-artifact Subspace Decomposition

2026-01-03 · Xiang Zhang, Wenliang Weng, Daoyong Fu, Beijing Chen, Ziqiang Li, Ziwen He, Zhangjie Fu arxiv

Deepfake detection remains highly challenging, particularly in cross-dataset scenarios and complex real-world settings. This challenge mainly arises because artifact patterns vary substantially across different forgery methods, whereas adapting pretrained models to such artifacts often overemphasizes forgery-specific cues and disturbs semantic representations, thereby weakening generalization. Existing approaches typically rely on full-parameter fine-tuning or auxiliary supervision to improve discrimination. However, they often struggle to model diverse forgery artifacts without compromising pretrained representations. To address these limitations, we propose FMSD, a deepfake detection framework built upon Forgery-aware Layer Masking and Multi-Artifact Subspace Decomposition. Specifically, Forgery-aware Layer Masking evaluates the bias-variance characteristics of layer-wise gradients to identify forgery-sensitive layers, thereby selectively updating them while reducing unnecessary disturbance to pretrained representations. Building upon this, Multi-Artifact Subspace Decomposition further decomposes the selected layer weights via Singular Value Decomposition (SVD) into a semantic subspace and multiple learnable artifact subspaces. These subspaces are optimized to capture heterogeneous and complementary forgery artifacts, enabling effective modeling of diverse forgery patterns while preserving pretrained semantic representations. Furthermore, orthogonality and spectral consistency constraints are imposed to regularize the artifact subspaces, reducing redundancy across them while preserving the overall spectral structure of pretrained weights.

📄 PDF Abstract BibTeX arXiv:2601.01041

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake Detection

Similar Papers 제목 키워드 기반

DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection

2023-06-01 · Rui Shao, Tianxing Wu, Liqiang Nie, Ziwei Liu

Existing deepfake detection methods fail to generalize well to unseen or degraded samples, which can be attributed to the over-fitting of low-level forgery patterns. Here we argue that high-level semantics are also indis…

DeepFake DetectionFace Swapping

Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approach

2025-11-24 · Fan Nie, Jiangqun Ni, Jian Zhang, Bin Zhang 외 arxiv

The widespread application of AIGC contents has brought not only unprecedented opportunities, but also potential security concerns, e.g., audio-visual deepfakes. Therefore, it is of great importance to develop an effecti…

DeepFake Detection

Decoupling Forgery Semantics for Generalizable Deepfake Detection

2024-06-14 · Wei Ye, Xinan He, Feng Ding

In this paper, we propose a novel method for detecting DeepFakes, enhancing the generalization of detection through semantic decoupling. There are now multiple DeepFake forgery technologies that not only possess unique f…

DeepFake DetectionFace Swapping

Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics

2025-07-24 · Yuezun Li, Delong Zhu, Xinjie Cui, Siwei Lyu arxiv

The rapid advancement of AI technologies has significantly increased the diversity of DeepFake videos circulating online, posing a pressing challenge for \textit{generalizable forensics}, \ie, detecting a wide range of u…

UCF: Uncovering Common Features for Generalizable Deepfake Detection

2023-04-27 · ICCV 2023 1 · Zhiyuan Yan, Yong Zhang, Yanbo Fan, Baoyuan Wu

Deepfake detection remains a challenging task due to the difficulty of generalizing to new types of forgeries. This problem primarily stems from the overfitting of existing detection methods to forgery-irrelevant feature…

Binary ClassificationDecoderDeepFake DetectionDisentanglement+3