Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection
In this work, we attempted to unleash the potential of self-supervised learning as an auxiliary task that can optimise the primary task of generalised deepfake detection. To explore this, we examined different combinations of the training schemes for these tasks that can be most effective. Our findings reveal that fusing the feature representation from self-supervised auxiliary tasks is a powerful feature representation for the problem at hand. Such a representation can leverage the ultimate potential and bring in a unique representation of both the self-supervised and primary tasks, achieving better performance for the primary task. We experimented on a large set of datasets, which includes DF40, FaceForensics++, Celeb-DF, DFD, FaceShifter, UADFV, and our results showed better generalizability on cross-dataset evaluation when compared with current state-of-the-art detectors.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningDeepFake DetectionSimilar Papers 제목 키워드 기반
Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders
Vision Transformers (ViTs) have become ubiquitous in computer vision. Despite their success, ViTs lack inductive biases, which can make it difficult to train them with limited data. To address this challenge, prior studi…
DeepFake DetectionFace SwappingSelf-Supervised LearningSD-DiT: Unleashing the Power of Self-supervised Discrimination in Diffusion Transformer
Diffusion Transformer (DiT) has emerged as the new trend of generative diffusion models on image generation. In view of extremely slow convergence in typical DiT, recent breakthroughs have been driven by mask strategy th…
DecoderImage GenerationA Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis
In this work, we benchmark with different backbones and study their impact for self-supervised learning (SSL) as an auxiliary task to blend texture-based local descriptors into feature modelling for efficient face analys…
Self-Supervised LearningRepresentation LearningEmotion ClassificationDeepFake DetectionA multimodal method based on cross-attention and convolution for postoperative infection diagnosis
Postoperative infection diagnosis is a common and serious complication that generally poses a high diagnostic challenge. This study focuses on PJI, a type of postoperative infection. X-ray examination is an imaging exami…
DiagnosticSpecificityImproving the Efficiency of Self-Supervised Adversarial Training through Latent Clustering-Based Selection
Compared with standard learning, adversarially robust learning is widely recognized to demand significantly more training examples. Recent works propose the use of self-supervised adversarial training (SSAT) with externa…
ClusteringX-ray Classification