paper-with-me

Papers

Breaking the Likelihood-Quality Trade-off in Diffusion Models by Merging Pretrained Experts

2025-11-24 · Yasin Esfandiari, Stefan Bauer, Sebastian U. Stich, Andrea Dittadi arxiv

Diffusion models for image generation often exhibit a trade-off between perceptual sample quality and data likelihood: training objectives emphasizing high-noise denoising steps yield realistic images but poor likelihoods, whereas likelihood-oriented training overweights low-noise steps and harms visual fidelity. We introduce a simple plug-and-play sampling method that combines two pretrained diffusion experts by switching between them along the denoising trajectory. Specifically, we apply an image-quality expert at high noise levels to shape global structure, then switch to a likelihood expert at low noise levels to refine pixel statistics. The approach requires no retraining or fine-tuning -- only the choice of an intermediate switching step. On CIFAR-10 and ImageNet32, the merged model consistently matches or outperforms its base components, improving or preserving both likelihood and sample quality relative to each expert alone. These results demonstrate that expert switching across noise levels is an effective way to break the likelihood-quality trade-off in image diffusion models.

📄 PDF Abstract BibTeX arXiv:2511.19434

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

Variable-Length Tokenization via Learnable Global Merging for Diffusion Transformers

2026-06-18 · Dong Hoon Lee, Seunghoon Hong arxiv

Latent Diffusion Models (LDMs) have become dominant in visual synthesis, but their quality-compute trade-off is largely constrained by the tokenizer's fixed compression ratio. Variable-length tokenizers (VLTs) promise ad…

What happens to diffusion model likelihood when your model is conditional?

2024-09-10 · Mattias Cross, Anton Ragni

Diffusion Models (DMs) iteratively denoise random samples to produce high-quality data. The iterative sampling process is derived from Stochastic Differential Equations (SDEs), allowing a speed-quality trade-off chosen a…

domain classificationmodelSpeech Synthesistext-to-speech+2

DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-off

2025-09-02 · Jusheng Zhang, Yijia Fan, Kaitong Cai, Zimeng Huang 외 arxiv

This paper introduces DrDiff, a novel framework for long-text generation that overcomes the efficiency-quality trade-off through three core technologies. First, we design a dynamic expert scheduling mechanism that intell…

Text Generation

Discrete-state Continuous-time Diffusion for Graph Generation

2024-05-19 · Zhe Xu, Ruizhong Qiu, Yuzhong Chen, Huiyuan Chen 외

Graph is a prevalent discrete data structure, whose generation has wide applications such as drug discovery and circuit design. Diffusion generative models, as an emerging research focus, have been applied to graph gener…

Drug DiscoveryGraph Generation

Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution

2023-10-25 · Aaron Lou, Chenlin Meng, Stefano Ermon

Despite their groundbreaking performance for many generative modeling tasks, diffusion models have fallen short on discrete data domains such as natural language. Crucially, standard diffusion models rely on the well-est…

DenoisingLanguage ModelingLanguage Modelling