paper-with-me

Papers

ConceptPrism: Concept Disentanglement in Personalized Diffusion Models via Residual Token Optimization

2026-02-23 · Minseo Kim, Minchan Kwon, Dongyeun Lee, Yunho Jeon, Junmo Kim arxiv

Personalized text-to-image (T2I) generation has emerged as a key application for creating user-specific concepts from a few reference images. The core challenge is concept disentanglement: separating the target concept from irrelevant residual information. Lacking such disentanglement, capturing high-fidelity features often incorporates undesired attributes that conflict with user prompts, compromising the trade-off between concept fidelity and text alignment. While existing methods rely on manual guidance, they often fail to represent intricate visual details and lack scalability. We introduce ConceptPrism, a framework that extracts shared features exclusively through cross-image comparison without external information. We jointly optimize a target token and image-wise residual tokens via reconstruction and exclusion losses. By suppressing shared information in residual tokens, the exclusion loss creates an information vacuum that forces the target token to capture the common concept. Extensive evaluations demonstrate that ConceptPrism achieves accurate concept disentanglement and significantly improves overall performance across diverse and complex visual concepts. The code is available at https://github.com/Minseo-Kimm/ConceptPrism.

📄 PDF Abstract BibTeX arXiv:2602.19575

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Personalized Residuals for Concept-Driven Text-to-Image Generation

2024-05-21 · CVPR 2024 1 · Cusuh Ham, Matthew Fisher, James Hays, Nicholas Kolkin 외

We present personalized residuals and localized attention-guided sampling for efficient concept-driven generation using text-to-image diffusion models. Our method first represents concepts by freezing the weights of a pr…

GPUImage GenerationText to Image GenerationText-to-Image Generation

FreeTuner: Any Subject in Any Style with Training-free Diffusion

2024-05-23 · Youcan Xu, Zhen Wang, Jun Xiao, Wei Liu 외

With the advance of diffusion models, various personalized image generation methods have been proposed. However, almost all existing work only focuses on either subject-driven or style-driven personalization. Meanwhile, …

DisentanglementImage GenerationPersonalized Image Generation

CatVersion: Concatenating Embeddings for Diffusion-Based Text-to-Image Personalization

2023-11-24 · Ruoyu Zhao, Mingrui Zhu, Shiyin Dong, Nannan Wang 외

We propose CatVersion, an inversion-based method that learns the personalized concept through a handful of examples. Subsequently, users can utilize text prompts to generate images that embody the personalized concept, t…

Image GenerationPersonalized Image Generation

Benchmarking and Enhancing Disentanglement in Concept-Residual Models

2023-11-30 · Renos Zabounidis, Ini Oguntola, Konghao Zhao, Joseph Campbell 외

Concept bottleneck models (CBMs) are interpretable models that first predict a set of semantically meaningful features, i.e., concepts, from observations that are subsequently used to condition a downstream task. However…

BenchmarkingDisentanglement

AttenCraft: Attention-guided Disentanglement of Multiple Concepts for Text-to-Image Customization

2024-05-28 · Junjie Shentu, Matthew Watson, Noura Al Moubayed

With the unprecedented performance being achieved by text-to-image (T2I) diffusion models, T2I customization further empowers users to tailor the diffusion model to new concepts absent in the pre-training dataset, termed…

Disentanglement