paper-with-me

Papers

RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning

2025-05-23 · Mingrui Wu, Lu Wang, Pu Zhao, Fangkai Yang, Jianjin Zhang, Jianfeng Liu, Yuefeng Zhan, Weihao Han, Hao Sun, Jiayi Ji, Xiaoshuai Sun, QIngwei Lin, Weiwei Deng, Dongmei Zhang, Feng Sun, Qi Zhang, Rongrong Ji

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language models (LLMs), these methods frequently generate stylistic or unrealistic content due to insufficient grounding in visual semantics and real-world composition. Inspired by recent advances in reasoning for language model, we propose RePrompt, a novel reprompting framework that introduces explicit reasoning into the prompt enhancement process via reinforcement learning. Instead of relying on handcrafted rules or stylistic rewrites, our method trains a language model to generate structured, self-reflective prompts by optimizing for image-level outcomes. The tailored reward models assesse the generated images in terms of human preference, semantic alignment, and visual composition, providing indirect supervision to refine prompt generation. Our approach enables end-to-end training without human-annotated data. Experiments on GenEval and T2I-Compbench show that RePrompt significantly boosts spatial layout fidelity and compositional generalization across diverse T2I backbones, establishing new state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2505.17540

Code (1)

microsoft/dki_llm 공식 구현 pytorch

Tasks

Image GenerationLanguage ModelingLanguage ModellingText to Image GenerationText-to-Image Generation

Similar Papers 제목 키워드 기반

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

2023-05-17 · Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic

We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recip…

Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Models

2026-01-28 · Zhenchen Tang, Songlin Yang, Zichuan Wang, Bo Peng 외 arxiv

Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its…

Reinforcement Learning

SAVER: Selective Auditing of Verbal Evidence for Error Recovery in VLM Change Reasoning

2026-08-24 · Youdi Li arxiv

Vision-language models (VLMs) frequently fail at visual change reasoning, even when their vision encoders contain sufficient information. We observe that correct VLM outputs tend to contain explicit verbal evidence (obje…

Change Detection

The Illusion of Secure LLM Code: Closing the Security Gap via Iterative Reprompting

2026-07-26 · Ishpuneet Singh, Shreyas Mahajan, Gurjot Singh, Maninder Singh arxiv

Large Language Models (LLMs) are increasingly integrated into software development workflows, yet their ability to autonomously generate secure authentication code remains uncertain. This paper evaluates the security arc…

Prompt Engineering

ChatGPT for Conversational Recommendation: Refining Recommendations by Reprompting with Feedback

2024-01-07 · Kyle Dylan Spurlock, Cagla Acun, Esin Saka, Olfa Nasraoui

Recommendation algorithms have been pivotal in handling the overwhelming volume of online content. However, these algorithms seldom consider direct user input, resulting in superficial interaction between them. Efforts h…

Conversational RecommendationPrompt Engineering