paper-with-me

홈 › Papers

PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting

2025-09-04 · Linqing Wang, Ximing Xing, Yiji Cheng, Zhiyuan Zhao, Donghao Li, Tiankai Hang, Jiale Tao, Qixun Wang, Ruihuang Li, Comi Chen, Xin Li, Mingrui Wu, Xinchi Deng, Shuyang Gu, Chunyu Wang, Qinglin Lu arxiv

Recent advancements in text-to-image (T2I) diffusion models have demonstrated remarkable capabilities in generating high-fidelity images. However, these models often struggle to faithfully render complex user prompts, particularly in aspects like attribute binding, negation, and compositional relationships. This leads to a significant mismatch between user intent and the generated output. To address this challenge, we introduce PromptEnhancer, a novel and universal prompt rewriting framework that enhances any pretrained T2I model without requiring modifications to its weights. Unlike prior methods that rely on model-specific fine-tuning or implicit reward signals like image-reward scores, our framework decouples the rewriter from the generator. We achieve this by training a Chain-of-Thought (CoT) rewriter through reinforcement learning, guided by a dedicated reward model we term the AlignEvaluator. The AlignEvaluator is trained to provide explicit and fine-grained feedback based on a systematic taxonomy of 24 key points, which are derived from a comprehensive analysis of common T2I failure modes. By optimizing the CoT rewriter to maximize the reward from our AlignEvaluator, our framework learns to generate prompts that are more precisely interpreted by T2I models. Extensive experiments on the HunyuanImage 2.1 model demonstrate that PromptEnhancer significantly improves image-text alignment across a wide range of semantic and compositional challenges. Furthermore, we introduce a new, high-quality human preference benchmark to facilitate future research in this direction.

📄 PDF Abstract BibTeX arXiv:2509.04545

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension

2024-12-16 · Kun Ouyang, Yuanxin Liu, Shicheng Li, Yi Liu 외

Multimodal punchlines, which involve humor or sarcasm conveyed in image-caption pairs, are a popular way of communication on online multimedia platforms. With the rapid development of multimodal large language models (ML…

BenchmarkingImage CaptioningIn-Context Learning

ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies

2025-06-15 · Chenglin Wang, Yucheng Zhou, Qianning Wang, Zhe Wang 외

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operatio…

Benchmarking

Chain of Images for Intuitively Reasoning

2023-11-09 · Fanxu Meng, Haotong Yang, Yiding Wang, Muhan Zhang

The human brain is naturally equipped to comprehend and interpret visual information rapidly. When confronted with complex problems or concepts, we use flowcharts, sketches, and diagrams to aid our thought process. Lever…

Common Sense ReasoningLanguage ModellingLarge Language ModelLogical Reasoning+1

Chain-of-Image Generation: Toward Monitorable and Controllable Image Generation

2025-12-09 · Young Kyung Kim, Oded Schlesinger, Yuzhou Zhao, J. Matias Di Martino 외 arxiv

While state-of-the-art image generation models achieve remarkable visual quality, their internal generative processes remain a "black box." This opacity limits human observation and intervention, and poses a barrier to e…

Text-to-Image Generation

A dense subgraph based algorithm for compact salient image region detection

2015-11-20 · Souradeep Chakraborty, Pabitra Mitra

We present an algorithm for graph based saliency computation that utilizes the underlying dense subgraphs in finding visually salient regions in an image. To compute the salient regions, the model first obtains a salienc…

Few-Shot Semantic Segmentation