paper-with-me

홈 › Papers

SliderSpace: Decomposing the Visual Capabilities of Diffusion Models

2025-02-03 · Rohit Gandikota, Zongze Wu, Richard Zhang, David Bau, Eli Shechtman, Nick Kolkin

We present SliderSpace, a framework for automatically decomposing the visual capabilities of diffusion models into controllable and human-understandable directions. Unlike existing control methods that require a user to specify attributes for each edit direction individually, SliderSpace discovers multiple interpretable and diverse directions simultaneously from a single text prompt. Each direction is trained as a low-rank adaptor, enabling compositional control and the discovery of surprising possibilities in the model's latent space. Through extensive experiments on state-of-the-art diffusion models, we demonstrate SliderSpace's effectiveness across three applications: concept decomposition, artistic style exploration, and diversity enhancement. Our quantitative evaluation shows that SliderSpace-discovered directions decompose the visual structure of model's knowledge effectively, offering insights into the latent capabilities encoded within diffusion models. User studies further validate that our method produces more diverse and useful variations compared to baselines. Our code, data and trained weights are available at https://sliderspace.baulab.info

📄 PDF Abstract BibTeX arXiv:2502.01639

Code (2)

rohitgandikota/sliderspaceweb 공식 구현
Luvata/sliderspace-flux pytorch

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

InsertDiffusion: Identity Preserving Visualization of Objects through a Training-Free Diffusion Architecture

2024-07-15 · Phillip Mueller, Jannik Wiese, Ioan Craciun, Lars Mikelsons

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training rem…

Image GenerationMarketing

ELROND: Exploring and decomposing intrinsic capabilities of diffusion models

2026-02-10 · Paweł Skierś, Tomasz Trzciński, Kamil Deja arxiv

A single text prompt passed to a diffusion model often yields a wide range of visual outputs determined solely by stochastic process, leaving users with no direct control over which specific semantic variations appear in…

Decomposing stimulus-specific sensory neural information via diffusion models

2025-05-16 · Steeve Laquitaine, Simone Azeglio, Carlo Paris, Ulisse Ferrari 외

To understand sensory coding, we must ask not only how much information neurons encode, but also what that information is about. This requires decomposing mutual information into contributions from individual stimuli and…

Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model

2024-07-07 · Danni Yang, Ruohan Dong, Jiayi Ji, Yiwei Ma 외

Recently, diffusion models have increasingly demonstrated their capabilities in vision understanding. By leveraging prompt-based learning to construct sentences, these models have shown proficiency in classification and …

SegmentationSentenceVisual Grounding

From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Pedagogical Visualization

2025-05-22 · Haonian Ji, Shi Qiu, Siyang Xin, Siwei Han 외

While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations re…

Visual Reasoning