paper-with-me

Papers

DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection

2024-06-02 · Yewon Lim, Changyeon Lee, Aerin Kim, Oren Etzioni

A dramatic influx of diffusion-generated images has marked recent years, posing unique challenges to current detection technologies. While the task of identifying these images falls under binary classification, a seemingly straightforward category, the computational load is significant when employing the "reconstruction then compare" technique. This approach, known as DIRE (Diffusion Reconstruction Error), not only identifies diffusion-generated images but also detects those produced by GANs, highlighting the technique's broad applicability. To address the computational challenges and improve efficiency, we propose distilling the knowledge embedded in diffusion models to develop rapid deepfake detection models. Our approach, aimed at creating a small, fast, cheap, and lightweight diffusion synthesized deepfake detector, maintains robust performance while significantly reducing operational demands. Maintaining performance, our experimental results indicate an inference speed 3.2 times faster than the existing DIRE framework. This advance not only enhances the practicality of deploying these systems in real-world settings but also paves the way for future research endeavors that seek to leverage diffusion model knowledge.

📄 PDF Abstract BibTeX arXiv:2406.00856

Code (1)

miraflow/DistilDIRE 공식 구현 pytorch

Tasks

Binary ClassificationDeepFake DetectionFace Swapping

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Hierarchical Variational Policies for Reward-Guided Diffusion

2026-05-20 · Kushagra Pandey, Farrin Marouf Sofian, Jan Niklas Groeneveld, Felix Draxler 외 arxiv

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-ali…

Test-time Adaptation

CutDiffusion: A Simple, Fast, Cheap, and Strong Diffusion Extrapolation Method

2024-04-23 · Mingbao Lin, Zhihang Lin, Wengyi Zhan, Liujuan Cao 외

Transforming large pre-trained low-resolution diffusion models to cater to higher-resolution demands, i.e., diffusion extrapolation, significantly improves diffusion adaptability. We propose tuning-free CutDiffusion, aim…

DenoisingGPU

Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders

2022-02-19 · Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is sl…

Image GenerationText-to-Image Generation

Toward Lightweight and Fast Decoders for Diffusion Models in Image and Video Generation

2025-03-06 · Alexey Buzovkin, Evgeny Shilov

We investigate methods to reduce inference time and memory footprint in stable diffusion models by introducing lightweight decoders for both image and video synthesis. Traditional latent diffusion pipelines rely on large…

DecoderGPUImage GenerationVideo Generation

BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion

2023-05-25 · Bo-Kyeong Kim, Hyoung-Kyu Song, Thibault Castells, Shinkook Choi

Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters. To enhance efficiency, recent studies have reduced sampling steps and applied network qu…

DreamBooth Personalized GenerationImage-to-Image TranslationText-to-Image Generation