paper-with-me

홈 › Papers

Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generation

2025-02-10 · Soobin Um, Beomsu Kim, Jong Chul Ye

Minority samples are underrepresented instances located in low-density regions of a data manifold, and are valuable in many generative AI applications, such as data augmentation, creative content generation, etc. Unfortunately, existing diffusion-based minority generators often rely on computationally expensive guidance dedicated for minority generation. To address this, here we present a simple yet powerful guidance-free approach called Boost-and-Skip for generating minority samples using diffusion models. The key advantage of our framework requires only two minimal changes to standard generative processes: (i) variance-boosted initialization and (ii) timestep skipping. We highlight that these seemingly-trivial modifications are supported by solid theoretical and empirical evidence, thereby effectively promoting emergence of underrepresented minority features. Our comprehensive experiments demonstrate that Boost-and-Skip greatly enhances the capability of generating minority samples, even rivaling guidance-based state-of-the-art approaches while requiring significantly fewer computations. Code is available at https://github.com/soobin-um/BnS.

📄 PDF Abstract BibTeX arXiv:2502.06516

Code (1)

soobin-um/bns 공식 구현 pytorch

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling

2024-11-27 · CVPR 2025 1 · Junha Hyung, Kinam Kim, Susung Hong, Min-Jung Kim 외

Diffusion models have emerged as a powerful tool for generating high-quality images, videos, and 3D content. While sampling guidance techniques like CFG improve quality, they reduce diversity and motion. Autoguidance mit…

Diversity

ReGuidance: A Simple Diffusion Wrapper for Boosting Sample Quality on Hard Inverse Problems

2025-06-12 · Aayush Karan, Kulin Shah, Sitan Chen

There has been a flurry of activity around using pretrained diffusion models as informed data priors for solving inverse problems, and more generally around steering these models using reward models. Training-free method…

Super-Resolution

Guiding a Diffusion Model by Swapping Its Tokens

2026-04-09 · Weijia Zhang, Yuehao Liu, Shanyan Guan, Wu Ran 외 arxiv

Classifier-Free Guidance (CFG) is a widely used inference-time technique to boost the image quality of diffusion models. Yet, its reliance on text conditions prevents its use in unconditional generation. We propose a sim…

Entropy Rectifying Guidance for Diffusion and Flow Models

2025-04-18 · Tariq Berrada Ifriqi, Adriana Romero-Soriano, Michal Drozdzal, Jakob Verbeek 외

Guidance techniques are commonly used in diffusion and flow models to improve image quality and consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifi…

DiversityImage GenerationText to Image GenerationText-to-Image Generation+1

FreeU: Free Lunch in Diffusion U-Net

2023-09-20 · CVPR 2024 1 · Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu

In this paper, we uncover the untapped potential of diffusion U-Net, which serves as a "free lunch" that substantially improves the generation quality on the fly. We initially investigate the key contributions of the U-N…

DecoderDenoisingVideo Generation