paper-with-me

Papers

AnyMS: Bottom-up Attention Decoupling for Layout-guided and Training-free Multi-subject Customization

2025-12-29 · Binhe Yu, Zhen Wang, Kexin Li, Yuqian Yuan, Wenqiao Zhang, Long Chen, Juncheng Li, Jun Xiao, Yueting Zhuang arxiv

Multi-subject customization aims to synthesize multiple user-specified subjects into a coherent image. To address issues such as subjects missing or conflicts, recent works incorporate layout guidance to provide explicit spatial constraints. However, existing methods still struggle to balance three critical objectives: text alignment, subject identity preservation, and layout control, while the reliance on additional training further limits their scalability and efficiency. In this paper, we present AnyMS, a novel training-free framework for layout-guided multi-subject customization. AnyMS leverages three input conditions: text prompt, subject images, and layout constraints, and introduces a bottom-up dual-level attention decoupling mechanism to harmonize their integration during generation. Specifically, global decoupling separates cross-attention between textual and visual conditions to ensure text alignment. Local decoupling confines each subject's attention to its designated area, which prevents subject conflicts and thus guarantees identity preservation and layout control. Moreover, AnyMS employs pre-trained image adapters to extract subject-specific features aligned with the diffusion model, removing the need for subject learning or adapter tuning. Extensive experiments demonstrate that AnyMS achieves state-of-the-art performance, supporting complex compositions and scaling to a larger number of subjects.

📄 PDF Abstract BibTeX arXiv:2512.23537

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Line Drawings of Natural Scenes Guide Visual Attention

2019-12-19 · Kai-Fu Yang, Wen-Wen Jiang, Teng-Fei Zhan, Yong-Jie Li

Visual search is an important strategy of the human visual system for fast scene perception. The guided search theory suggests that the global layout or other top-down sources of scenes play a crucial role in guiding obj…

HiDe: Rethinking The Zoom-IN method in High Resolution MLLMs via Hierarchical Decoupling

2025-09-28 · Xianjie Liu, Yiman Hu, Yixiong Zou, Liang Wu 외 arxiv

Multimodal Large Language Models (MLLMs) have made significant strides in visual understanding tasks. However, their performance on high-resolution images remains suboptimal. While existing approaches often attribute thi…

Hierarchical and Step-Layer-Wise Tuning of Attention Specialty for Multi-Instance Synthesis in Diffusion Transformers

2025-04-14 · ChunYang Zhang, Zhenhong Sun, Zhicheng Zhang, Junyan Wang 외

Text-to-image (T2I) generation models often struggle with multi-instance synthesis (MIS), where they must accurately depict multiple distinct instances in a single image based on complex prompts detailing individual feat…

AttributeLayout Generation

Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection

2022-07-16 · Jingjia Huang, Baixiang Yang

Human Object Interaction (HOI) detection is a challenging task that requires to distinguish the interaction between a human-object pair. Attention based relation parsing is a popular and effective strategy utilized in HO…

DecoderHuman-Object Interaction DetectionRelation

DOne: Decoupling Structure and Rendering for High-Fidelity Design-to-Code Generation

2026-03-12 · Xinhao Huang, Jinke Yu, Wenhao Xu, Zeyi Wen 외 arxiv

While Vision Language Models (VLMs) have shown promise in Design-to-Code generation, they suffer from a "holistic bottleneck-failing to reconcile high-level structural hierarchy with fine-grained visual details, often re…

Code Generation