paper-with-me

홈 › Papers

MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansion

2025-08-20 · Fei Peng, Junqiang Wu, Yan Li, Tingting Gao, Di Zhang, Huiyuan Fu arxiv

Existing text-to-image diffusion models have demonstrated remarkable capabilities in generating high-quality images guided by textual prompts. However, achieving multi-subject compositional synthesis with precise spatial control remains a significant challenge. In this work, we address the task of layout-controllable multi-subject synthesis (LMS), which requires both faithful reconstruction of reference subjects and their accurate placement in specified regions within a unified image. While recent advancements have separately improved layout control and subject synthesis, existing approaches struggle to simultaneously satisfy the dual requirements of spatial precision and identity preservation in this composite task. To bridge this gap, we propose MUSE, a unified synthesis framework that employs concatenated cross-attention (CCA) to seamlessly integrate layout specifications with textual guidance through explicit semantic space expansion. The proposed CCA mechanism enables bidirectional modality alignment between spatial constraints and textual descriptions without interference. Furthermore, we design a progressive two-stage training strategy that decomposes the LMS task into learnable sub-objectives for effective optimization. Extensive experiments demonstrate that MUSE achieves zero-shot end-to-end generation with superior spatial accuracy and identity consistency compared to existing solutions, advancing the frontier of controllable image synthesis. Our code and model are available at https://github.com/pf0607/MUSE.

📄 PDF Abstract BibTeX arXiv:2508.14440

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization

2025-11-26 · Yingjie Xia, Xi Wang, Jinglei Shi, Vicky Kalogeiton 외 arxiv

Images evoke emotions that profoundly influence perception, often prioritized over content. Current Image Emotional Synthesis (IES) approaches artificially separate generation and editing tasks, creating inefficiencies a…

Semantic Similarity

MUSEKG: A Knowledge Graph Over Museum Collections

2025-11-20 · Jinhao Li, Jianzhong Qi, Soyeon Caren Han, Eun-Jung Holden arxiv

Digitisation in the cultural heritage sector has produced large but fragmented repositories of museum collection data, spanning structured catalogue records, images, and unstructured descriptions. Existing museum informa…

Answer Generation

ShutterMuse: Capture-Time Photography Guidance with MLLMs

2026-06-24 · Jiayu Li, Yixiao Fang, Tianyu Hu, Wei Cheng 외 arxiv

Real-world photography requires capture-time guidance for both camera framing and subject pose. Yet existing aesthetic cropping benchmarks mainly evaluate post-hoc crop prediction and overlook subject-side recommendation…

CLIP-MUSED: CLIP-Guided Multi-Subject Visual Neural Information Semantic Decoding

2024-02-14 · Qiongyi Zhou, Changde Du, Shengpei Wang, Huiguang He

The study of decoding visual neural information faces challenges in generalizing single-subject decoding models to multiple subjects, due to individual differences. Moreover, the limited availability of data from a singl…

Representation Learning

MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation

2026-06-16 · Xingyuming Liu, Ruichun Ma, Heyu Guo, Qixiu Li 외 arxiv

Humans naturally leverage diverse sensing modalities to interact with the physical world, while most Vision-Language-Action (VLA) models for robotics rely solely on RGB observations. This limits their ability to perceive…