paper-with-me

Papers

coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation

2026-03-13 · Chunhan Li, Qifeng Wu, Jia-Hui Pan, Ka-Hei Hui, Jingyu Hu, Yuming Jiang, Bin Sheng, Xihui Liu, Wenjuan Gong, Zhengzhe Liu arxiv

Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2603.12829

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts

2023-05-24 · Yunshui Li, Binyuan Hui, Zhichao Yin, Min Yang 외

Perceiving multi-modal information and fulfilling dialogues with humans is a long-term goal of artificial intelligence. Pre-training is commonly regarded as an effective approach for multi-modal dialogue. However, due to…

Dialogue State TrackingImage RetrievalMultimodal Intent RecognitionResponse Generation+2

Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation

2023-06-17 · Weihao Zeng, Lulu Zhao, Keqing He, Ruotong Geng 외

Existing controllable dialogue generation work focuses on the single-attribute control and lacks generalization capability to out-of-distribution multiple attribute combinations. In this paper, we explore the composition…

AttributeDialogue GenerationDisentanglement

Dialogue Meaning Representation for Task-Oriented Dialogue Systems

2022-04-23 · Xiangkun Hu, Junqi Dai, Hang Yan, Yi Zhang 외

Dialogue meaning representation formulates natural language utterance semantics in their conversational context in an explicit and machine-readable form. Previous work typically follows the intent-slot framework, which i…

coreference-resolutionCoreference ResolutionNegationTask-Oriented Dialogue Systems

$C^3$: Compositional Counterfactual Contrastive Learning for Video-grounded Dialogues

2021-06-16 · Hung Le, Nancy F. Chen, Steven C. H. Hoi

Video-grounded dialogue systems aim to integrate video understanding and dialogue understanding to generate responses that are relevant to both the dialogue and video context. Most existing approaches employ deep learnin…

Contrastive LearningcounterfactualDialogue UnderstandingMultimodal Reasoning+1

DialogueAgents: A Hybrid Agent-Based Speech Synthesis Framework for Multi-Party Dialogue

2025-04-20 · Xiang Li, Duyi Pan, Hongru Xiao, Jiale Han 외

Speech synthesis is crucial for human-computer interaction, enabling natural and intuitive communication. However, existing datasets involve high construction costs due to manual annotation and suffer from limited charac…

DiversitySpeech Synthesis