paper-with-me

홈 › Papers

MC$^2$: Multi-concept Guidance for Customized Multi-concept Generation

2024-04-08 · Jiaxiu Jiang, Yabo Zhang, Kailai Feng, Xiaohe Wu, Wenbo Li, Renjing Pei, Fan Li, WangMeng Zuo

Customized text-to-image generation, which synthesizes images based on user-specified concepts, has made significant progress in handling individual concepts. However, when extended to multiple concepts, existing methods often struggle with properly integrating different models and avoiding the unintended blending of characteristics from distinct concepts. In this paper, we propose MC$^2$, a novel approach for multi-concept customization that enhances flexibility and fidelity through inference-time optimization. MC$^2$ enables the integration of multiple single-concept models with heterogeneous architectures. By adaptively refining attention weights between visual and textual tokens, our method ensures that image regions accurately correspond to their associated concepts while minimizing interference between concepts. Extensive experiments demonstrate that MC$^2$ outperforms training-based methods in terms of prompt-reference alignment. Furthermore, MC$^2$ can be seamlessly applied to text-to-image generation, providing robust compositional capabilities. To facilitate the evaluation of multi-concept customization, we also introduce a new benchmark, MC++. The code will be publicly available at https://github.com/JIANGJiaXiu/MC-2.

📄 PDF Abstract BibTeX arXiv:2404.05268

Code (1)

jiangjiaxiu/mc-2 공식 구현

Tasks

Image GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

MC^2: Multi-concept Guidance for Customized Multi-concept Generation

2025-01-01 · CVPR 2025 1 · Jiaxiu Jiang, Yabo Zhang, Kailai Feng, Xiaohe Wu 외

Customized text-to-image generation, which synthesizes images based on user-specified concepts, has made significant progress in handling individual concepts. However, when extended to multiple concepts, existing met…

Image GenerationText to Image GenerationText-to-Image Generation

Comparison Reveals Commonality: Customized Image Generation through Contrastive Inversion

2025-08-11 · Minseo Kim, Minchan Kwon, Dongyeun Lee, Yunho Jeon 외 arxiv

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text p…

Contrastive LearningImage Generation

LatexBlend: Scaling Multi-concept Customized Generation with Latent Textual Blending

2025-03-10 · CVPR 2025 1 · Jian Jin, Zhenbo Yu, Yang shen, ZhenYong Fu 외

Customized text-to-image generation renders user-specified concepts into novel contexts based on textual prompts. Scaling the number of concepts in customized generation meets a broader demand for user creation, whereas …

Computational EfficiencyDenoisingImage GenerationText to Image Generation+1

Non-confusing Generation of Customized Concepts in Diffusion Models

2024-05-11 · Wang Lin, Jingyuan Chen, Jiaxin Shi, Yichen Zhu 외

We tackle the common challenge of inter-concept visual confusion in compositional concept generation using text-guided diffusion models (TGDMs). It becomes even more pronounced in the generation of customized concepts, d…

Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models

2023-05-29 · NeurIPS 2023 11 · YuChao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi 외

Public large-scale text-to-image diffusion models, such as Stable Diffusion, have gained significant attention from the community. These models can be easily customized for new concepts using low-rank adaptations (LoRAs)…

Attribute