paper-with-me

Papers

GUIDE: Guidance-based Incremental Learning with Diffusion Models

2024-03-06 · Bartosz Cywiński, Kamil Deja, Tomasz Trzciński, Bartłomiej Twardowski, Łukasz Kuciński

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from a generative model. Such an approach contradicts buffer-based approaches where sampling strategy plays an important role. We propose to bridge this gap by incorporating classifier guidance into the diffusion process to produce rehearsal examples specifically targeting information forgotten by a continuously trained model. This approach enables the generation of samples from preceding task distributions, which are more likely to be misclassified in the context of recently encountered classes. Our experimental results show that GUIDE significantly reduces catastrophic forgetting, outperforming conventional random sampling approaches and surpassing recent state-of-the-art methods in continual learning with generative replay.

📄 PDF Abstract BibTeX arXiv:2403.03938

Code (1)

cywinski/guide 공식 구현 pytorch

Tasks

Continual LearningIncremental Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffusionMat: Alpha Matting as Sequential Refinement Learning

2023-11-22 · Yangyang Xu, Shengfeng He, Wenqi Shao, Kwan-Yee K. Wong 외

In this paper, we introduce DiffusionMat, a novel image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes. Diverging from conventional methods that utilize trimaps me…

DenoisingImage Matting

Conditional Diffusion with Less Explicit Guidance via Model Predictive Control

2022-10-21 · Max W. Shen, Ehsan Hajiramezanali, Gabriele Scalia, Alex Tseng 외

How much explicit guidance is necessary for conditional diffusion? We consider the problem of conditional sampling using an unconditional diffusion model and limited explicit guidance (e.g., a noised classifier, or a con…

Model Predictive Control

Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance

2021-11-23 · Heeseung Kim, Sungwon Kim, Sungroh Yoon

We propose Guided-TTS, a high-quality text-to-speech (TTS) model that does not require any transcript of target speaker using classifier guidance. Guided-TTS combines an unconditional diffusion probabilistic model with a…

speech-recognitionSpeech RecognitionSpeech Synthesistext-to-speech+2

Improving Classifier-Free Guidance of Flow Matching via Manifold Projection

2026-01-29 · Jian-Feng Cai, Haixia Liu, Zhengyi Su, Chao Wang arxiv

Classifier-free guidance (CFG) is a widely used technique for controllable generation in diffusion and flow-based models. Despite its empirical success, CFG relies on a heuristic linear extrapolation that is often sensit…

Computational Efficiency

Gradient Guidance for Diffusion Models: An Optimization Perspective

2024-04-23 · Yingqing Guo, Hui Yuan, Yukang Yang, Minshuo Chen 외

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion m…