paper-with-me

Papers

Scaling Concept With Text-Guided Diffusion Models

2024-10-31 · Chao Huang, Susan Liang, Yunlong Tang, Yapeng Tian, Anurag Kumar, Chenliang Xu

Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concepts can be replaced through text conditioning (e.g., a dog to a tiger). In this work, we explore a novel approach: instead of replacing a concept, can we enhance or suppress the concept itself? Through an empirical study, we identify a trend where concepts can be decomposed in text-guided diffusion models. Leveraging this insight, we introduce ScalingConcept, a simple yet effective method to scale decomposed concepts up or down in real input without introducing new elements. To systematically evaluate our approach, we present the WeakConcept-10 dataset, where concepts are imperfect and need to be enhanced. More importantly, ScalingConcept enables a variety of novel zero-shot applications across image and audio domains, including tasks such as canonical pose generation and generative sound highlighting or removal.

📄 PDF Abstract BibTeX arXiv:2410.24151

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement

2025-11-04 · Sanghyun Lee, Sunwoo Kim, Seungryong Kim, Jongho Park 외 arxiv

Test-time scaling through reward-guided generation remains largely unexplored for discrete diffusion models despite its potential as a promising alternative. In this work, we introduce Iterative Reward-Guided Refinement …

Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance

2021-11-23 · Heeseung Kim, Sungwon Kim, Sungroh Yoon

We propose Guided-TTS, a high-quality text-to-speech (TTS) model that does not require any transcript of target speaker using classifier guidance. Guided-TTS combines an unconditional diffusion probabilistic model with a…

speech-recognitionSpeech RecognitionSpeech Synthesistext-to-speech+2

SSIMBaD: Sigma Scaling with SSIM-Guided Balanced Diffusion for AnimeFace Colorization

2025-06-04 · Junpyo Seo, Hanbin Koo, Jieun Yook, Byung-Ro Moon

We propose a novel diffusion-based framework for automatic colorization of Anime-style facial sketches. Our method preserves the structural fidelity of the input sketch while effectively transferring stylistic attributes…

ColorizationSSIM

Guided Trajectory Optimization with Sparse Scaling for Test-Time Diffusion

2026-05-21 · Gang Dai, Yining Huang, Yiming Xia, Guohao Chen 외 arxiv

The efficient Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions are limited to a static, pre-defined noise pool and s…

PRedItOR: Text Guided Image Editing with Diffusion Prior

2023-02-15 · Hareesh Ravi, Sachin Kelkar, Midhun Harikumar, Ajinkya Kale

Diffusion models have shown remarkable capabilities in generating high quality and creative images conditioned on text. An interesting application of such models is structure preserving text guided image editing. Existin…

Decodertext-guided-image-editing