paper-with-me

Papers

Self-Corrected Image Generation with Explainable Latent Rewards

2026-03-26 · Yinyi Luo, Hrishikesh Gokhale, Marios Savvides, Jindong Wang, Shengfeng He arxiv

Despite significant progress in text-to-image generation, aligning outputs with complex prompts remains challenging, particularly for fine-grained semantics and spatial relations. This difficulty stems from the feed-forward nature of generation, which requires anticipating alignment without fully understanding the output. In contrast, evaluating generated images is more tractable. Motivated by this asymmetry, we propose xLARD, a self-correcting framework that uses multimodal large language models to guide generation through Explainable LAtent RewarDs. xLARD introduces a lightweight corrector that refines latent representations based on structured feedback from model-generated references. A key component is a differentiable mapping from latent edits to interpretable reward signals, enabling continuous latent-level guidance from non-differentiable image-level evaluations. This mechanism allows the model to understand, assess, and correct itself during generation. Experiments across diverse generation and editing tasks show that xLARD improves semantic alignment and visual fidelity while maintaining generative priors. Code is available at https://yinyiluo.github.io/xLARD/.

📄 PDF Abstract BibTeX arXiv:2603.24965

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

A Framework for Learning Ante-hoc Explainable Models via Concepts

2021-08-25 · CVPR 2022 1 · Anirban Sarkar, Deepak Vijaykeerthy, Anindya Sarkar, Vineeth N Balasubramanian

Self-explaining deep models are designed to learn the latent concept-based explanations implicitly during training, which eliminates the requirement of any post-hoc explanation generation technique. In this work, we prop…

Explainable ModelsExplanation Generation

The Gaussian Discriminant Variational Autoencoder (GdVAE): A Self-Explainable Model with Counterfactual Explanations

2024-09-19 · Anselm Haselhoff, Kevin Trelenberg, Fabian Küppers, Jonas Schneider

Visual counterfactual explanation (CF) methods modify image concepts, e.g, shape, to change a prediction to a predefined outcome while closely resembling the original query image. Unlike self-explainable models (SEMs) an…

ClassificationcounterfactualCounterfactual ExplanationExplainable Artificial Intelligence (XAI)+2

Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation

2024-12-22 · Quan Dao, Hao Phung, Trung Dao, Dimitris Metaxas 외

Flow matching has emerged as a promising framework for training generative models, demonstrating impressive empirical performance while offering relative ease of training compared to diffusion-based models. However, this…

Image GenerationText to Image GenerationText-to-Image Generation

Learning to Predict Explainable Plots for Neural Story Generation

2019-12-05 · Gang Chen, Yang Liu, Huanbo Luan, Meng Zhang 외

Story generation is an important natural language processing task that aims to generate coherent stories automatically. While the use of neural networks has proven effective in improving story generation, how to learn to…

SentenceStory Generation

Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection

2026-08-17 · Bowen Deng, Jiahui Zhan, Yikun Ji, Haozhen Yan 외 arxiv

The rapid progress of image generation models calls for AI-generated image (AIGI) detectors that are not only accurate but also explainable and reliable. While MLLM-based detectors can provide natural language explanatio…

Reinforcement LearningVisual GroundingImage Generation