paper-with-me

홈 › Papers

Image Generation from Contextually-Contradictory Prompts

2025-06-02 · Saar Huberman, Or Patashnik, Omer Dahary, Ron Mokady, Daniel Cohen-Or

Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict their learned priors. We define this failure mode as contextual contradiction, where one concept implicitly negates another due to entangled associations learned during training. To address this, we propose a stage-aware prompt decomposition framework that guides the denoising process using a sequence of proxy prompts. Each proxy prompt is constructed to match the semantic content expected to emerge at a specific stage of denoising, while ensuring contextual coherence. To construct these proxy prompts, we leverage a large language model (LLM) to analyze the target prompt, identify contradictions, and generate alternative expressions that preserve the original intent while resolving contextual conflicts. By aligning prompt information with the denoising progression, our method enables fine-grained semantic control and accurate image generation in the presence of contextual contradictions. Experiments across a variety of challenging prompts show substantial improvements in alignment to the textual prompt.

📄 PDF Abstract BibTeX arXiv:2506.01929

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage GenerationLarge Language Model

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generating customized prompts for Zero-Shot Rare Event Medical Image Classification using LLM

2025-01-27 · Payal Kamboj, Ayan Banerjee, Bin Xu, Sandeep Gupta

Rare events, due to their infrequent occurrences, do not have much data, and hence deep learning techniques fail in estimating the distribution for such data. Open-vocabulary models represent an innovative approach to im…

DescriptiveEvent Detectionimage-classificationImage Classification+2

Visually Guided Decoding: Gradient-Free Hard Prompt Inversion with Language Models

2025-05-13 · Donghoon Kim, Minji Bae, Kyuhong Shim, Byonghyo Shim

Text-to-image generative models like DALL-E and Stable Diffusion have revolutionized visual content creation across various applications, including advertising, personalized media, and design prototyping. However, crafti…

Text Generation

TRCE: Towards Reliable Malicious Concept Erasure in Text-to-Image Diffusion Models

2025-03-10 · Ruidong Chen, Honglin Guo, Lanjun Wang, Chenyu Zhang 외

Recent advances in text-to-image diffusion models enable photorealistic image generation, but they also risk producing malicious content, such as NSFW images. To mitigate risk, concept erasure methods are studied to faci…

Contrastive LearningDenoisingImage Generation

Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts

2022-12-03 · Arshiya Aggarwal, Jiao Sun, Nanyun Peng

We present a robust methodology for evaluating biases in natural language generation(NLG) systems. Previous works use fixed hand-crafted prefix templates with mentions of various demographic groups to prompt models to ge…

FairnessText Generation

Dynamic VLM-Guided Negative Prompting for Diffusion Models

2025-10-30 · Hoyeon Chang, Seungjin Kim, Yoonseok Choi arxiv

We propose a novel approach for dynamic negative prompting in diffusion models that leverages Vision-Language Models (VLMs) to adaptively generate negative prompts during the denoising process. Unlike traditional Negativ…