paper-with-me

Papers

Adversarial Score Distillation: When score distillation meets GAN

2023-12-01 · CVPR 2024 1 · Min Wei, Jingkai Zhou, Junyao Sun, Xuesong Zhang

Existing score distillation methods are sensitive to classifier-free guidance (CFG) scale: manifested as over-smoothness or instability at small CFG scales, while over-saturation at large ones. To explain and analyze these issues, we revisit the derivation of Score Distillation Sampling (SDS) and decipher existing score distillation with the Wasserstein Generative Adversarial Network (WGAN) paradigm. With the WGAN paradigm, we find that existing score distillation either employs a fixed sub-optimal discriminator or conducts incomplete discriminator optimization, resulting in the scale-sensitive issue. We propose the Adversarial Score Distillation (ASD), which maintains an optimizable discriminator and updates it using the complete optimization objective. Experiments show that the proposed ASD performs favorably in 2D distillation and text-to-3D tasks against existing methods. Furthermore, to explore the generalization ability of our WGAN paradigm, we extend ASD to the image editing task, which achieves competitive results. The project page and code are at https://github.com/2y7c3/ASD.

📄 PDF Abstract BibTeX arXiv:2312.00739

Code (1)

2y7c3/asd 공식 구현 jax

Tasks

Generative Adversarial NetworkText to 3D

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
WGAN Wasserstein GAN, or WGAN, is a type of generative adversarial network that minimizes an approximation of the Earth-Mover's distance (EM) rather than the Jensen-Shannon…

Similar Papers 제목 키워드 기반

Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis

2025-07-24 · Yanzuo Lu, Yuxi Ren, Xin Xia, Shanchuan Lin 외 arxiv

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its relian…

Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step

2024-10-19 · Mingyuan Zhou, Huangjie Zheng, Yi Gu, Zhendong Wang 외

Score identity Distillation (SiD) is a data-free method that has achieved SOTA performance in image generation by leveraging only a pretrained diffusion model, without requiring any training data. However, its ultimate p…

Conditional Image GenerationGPUImage GenerationUnconditional Image Generation

Feature Adversarial Distillation for Point Cloud Classification

2023-06-25 · YuXing Lee, Wei Wu

Due to the point cloud's irregular and unordered geometry structure, conventional knowledge distillation technology lost a lot of information when directly used on point cloud tasks. In this paper, we propose Feature Adv…

ClassificationFADKnowledge DistillationModel Compression+2

Few-Step Diffusion via Score identity Distillation

2025-05-19 · Mingyuan Zhou, Yi Gu, Zhendong Wang

Diffusion distillation has emerged as a promising strategy for accelerating text-to-image (T2I) diffusion models by distilling a pretrained score network into a one- or few-step generator. While existing methods have mad…

Diversity

DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution

2026-03-23 · Zhengyao Lv, Menghan Xia, Xintao Wang, Kwan-Yee K. Wong arxiv

Diffusion-based video super-resolution (VSR) has recently achieved remarkable fidelity but still suffers from prohibitive sampling costs. While distribution matching distillation (DMD) can accelerate diffusion models tow…

Video Super-Resolution