paper-with-me

Papers

Decoding Diffusion: A Scalable Framework for Unsupervised Analysis of Latent Space Biases and Representations Using Natural Language Prompts

2024-10-25 · E. Zhixuan Zeng, Yuhao Chen, Alexander Wong

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging than other generative models, such as GANs. Recent methods have attempted to address this issue by identifying semantically meaningful directions within the latent space. However, they often need manual interpretation or are limited in the number of vectors that can be trained, restricting their scope and utility. This paper proposes a novel framework for unsupervised exploration of diffusion latent spaces. We directly leverage natural language prompts and image captions to map latent directions. This method allows for the automatic understanding of hidden features and supports a broader range of analysis without the need to train specific vectors. Our method provides a more scalable and interpretable understanding of the semantic knowledge encoded within diffusion models, facilitating comprehensive analysis of latent biases and the nuanced representations these models learn. Experimental results show that our framework can uncover hidden patterns and associations in various domains, offering new insights into the interpretability of diffusion model latent spaces.

📄 PDF Abstract BibTeX arXiv:2410.21314

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage CaptioningImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving

2025-12-06 · Mingwang Xu, Jiahao Cui, Feipeng Cai, Hanlin Shang 외 arxiv

End-to-end autonomous driving systems based on vision-language-action (VLA) models integrate multimodal sensor inputs and language instructions to generate planning and control signals. While autoregressive large languag…

Visual Question AnsweringReinforcement LearningAutonomous Driving

Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies

2025-08-27 · Zhixuan Liang, Yizhuo Li, Tianshuo Yang, Chengyue Wu 외 arxiv

Vision-Language-Action (VLA) models adapt large vision-language backbones to map images and instructions into robot actions. However, prevailing VLAs either generate actions autoregressively in a fixed left-to-right orde…

PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion

2026-05-22 · Yifan Lu, Qi Wu, Jay Zhangjie Wu, Zian Wang 외 arxiv

Most practical high-resolution text-to-image systems, including latent diffusion and autoregressive models, perform generation in a compact latent space, and a decoder maps the generated latents back to pixels. Yet the l…

Escaping Confidence Trap: Evolutionary Decoding for Mathematical Reasoning in Diffusion LLMs

2026-08-01 · Zhenhong Sun, Hanqing Zhao, Yatao Bian, Rongcheng Tu 외 arxiv

Diffusion large language models (dLLMs) have emerged as a promising alternative to autoregressive LLMs, offering efficient generation through block-wise progressive unmasking. However, their strong general-purpose perfor…

Mathematical Reasoning

SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation

2025-10-07 · Shuang Cheng, Yihan Bian, Dawei Liu, Linfeng Zhang 외 arxiv

We propose SDAR, a Synergistic Diffusion-Autoregression paradigm that unifies the training efficiency of autoregressive models with the parallel inference capability of diffusion. Instead of costly end-to-end diffusion t…