paper-with-me

홈 › Papers

Consistency Models

2023-03-02 · Yang song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever

Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation. To overcome this limitation, we propose consistency models, a new family of models that generate high quality samples by directly mapping noise to data. They support fast one-step generation by design, while still allowing multistep sampling to trade compute for sample quality. They also support zero-shot data editing, such as image inpainting, colorization, and super-resolution, without requiring explicit training on these tasks. Consistency models can be trained either by distilling pre-trained diffusion models, or as standalone generative models altogether. Through extensive experiments, we demonstrate that they outperform existing distillation techniques for diffusion models in one- and few-step sampling, achieving the new state-of-the-art FID of 3.55 on CIFAR-10 and 6.20 on ImageNet 64x64 for one-step generation. When trained in isolation, consistency models become a new family of generative models that can outperform existing one-step, non-adversarial generative models on standard benchmarks such as CIFAR-10, ImageNet 64x64 and LSUN 256x256.

📄 PDF Abstract BibTeX arXiv:2303.01469

Code (15)

openai/consistency_models 공식 구현 pytorch
G-U-N/Awesome-Consistency-Models
G-U-N/Phased-Consistency-Model pytorch
G-U-N/Stable-Consistency-Tuning
Kinyugo/consistency_models pytorch
Mosasaur5526/BCM-iCT-torch pytorch
cloneofsimo/consistency_models pytorch
jabir-zheng/TCD pytorch
junhsss/consistency-models pytorch
locuslab/ect pytorch
openai/consistency_models_cifar10 jax
openai/consistencydecoder pytorch
p-hss/consistency-climate-downscaling pytorch
sainzerjj/sferd pytorch
sreerajr000/consistency-models pytorch

Tasks

ColorizationImage GenerationImage InpaintingSuper-ResolutionVideo Generation

Methods 이 논문이 사용한 방법론

Consistency Models 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Towards Large-scale Inconsistency Measurement

2015-05-20 · Matthias Thimm

We investigate the problem of inconsistency measurement on large knowledge bases by considering stream-based inconsistency measurement, i.e., we investigate inconsistency measures that cannot consider a knowledge base as…

How Much Consistency Is Your Accuracy Worth?

2023-10-20 · Jacob K. Johnson, Ana Marasović

Contrast set consistency is a robustness measurement that evaluates the rate at which a model correctly responds to all instances in a bundle of minimally different examples relying on the same knowledge. To draw additio…

Two Failures of Self-Consistency in the Multi-Step Reasoning of LLMs

2023-05-23 · Angelica Chen, Jason Phang, Alicia Parrish, Vishakh Padmakumar 외

Large language models (LLMs) have achieved widespread success on a variety of in-context few-shot tasks, but this success is typically evaluated via correctness rather than consistency. We argue that self-consistency is …

valid

Consistency Analysis of an Empirical Minimum Error Entropy Algorithm

2014-12-17 · Jun Fan, Ting Hu, Qiang Wu, Ding-Xuan Zhou

In this paper we study the consistency of an empirical minimum error entropy (MEE) algorithm in a regression setting. We introduce two types of consistency. The error entropy consistency, which requires the error entropy…

regression

Stable Consistency Tuning: Understanding and Improving Consistency Models

2024-10-24 · Fu-Yun Wang, Zhengyang Geng, Hongsheng Li

Diffusion models achieve superior generation quality but suffer from slow generation speed due to the iterative nature of denoising. In contrast, consistency models, a new generative family, achieve competitive performan…

DenoisingImage Generation