paper-with-me

홈 › Papers

Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling

2025-10-19 · Erik Riise, Mehmet Onurcan Kaya, Dim P. Papadopoulos arxiv

While inference-time scaling through search has revolutionized Large Language Models, translating these gains to image generation has proven difficult. Recent attempts to apply search strategies to continuous diffusion models show limited benefits, with simple random sampling often performing best. We demonstrate that the discrete, sequential nature of visual autoregressive models enables effective search for image generation. We show that beam search substantially improves text-to-image generation, enabling a 2B parameter autoregressive model to outperform a 12B parameter diffusion model across benchmarks. Systematic ablations show that this advantage comes from the discrete token space, which allows early pruning and computational reuse, and our verifier analysis highlights trade-offs between speed and reasoning capability. These findings suggest that model architecture, not just scale, is critical for inference-time optimization in visual generation.

📄 PDF Abstract BibTeX arXiv:2510.16751

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models

2024-10-30 · Arash Marioriyad, Parham Rezaei, Mahdieh Soleymani Baghshah, Mohammad Hossein Rohban

Text-to-image (T2I) generative models, such as Stable Diffusion and DALL-E, have shown remarkable proficiency in producing high-quality, realistic, and natural images from textual descriptions. However, these models some…

Image Generation

Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation

2024-06-10 · Peize Sun, Yi Jiang, Shoufa Chen, Shilong Zhang 외

We introduce LlamaGen, a new family of image generation models that apply original ``next-token prediction'' paradigm of large language models to visual generation domain. It is an affirmative answer to whether vanilla a…

Conditional Image GenerationImage GenerationImage Reconstruction

BitDance: Scaling Autoregressive Generative Models with Binary Tokens

2026-02-15 · Yuang Ai, Jiaming Han, Shaobin Zhuang, Weijia Mao 외 arxiv

We present BitDance, a scalable autoregressive (AR) image generator that predicts binary visual tokens instead of codebook indices. With high-entropy binary latents, BitDance lets each token represent up to $2^{256}$ sta…

Text-to-Image Generation

Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

2026-06-09 · Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee, Joungbin Lee 외 arxiv

Diffusion-based lip synchronization models achieve strong visual quality and audio-visual alignment, but full-sequence bidirectional attention and many denoising steps make them impractical for real-time inference. We pr…

ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer

2024-12-10 · Jinyi Hu, Shengding Hu, Yuxuan Song, Yufei Huang 외

The recent surge of interest in comprehensive multimodal models has necessitated the unification of diverse modalities. However, the unification suffers from disparate methodologies. Continuous visual generation necessit…

DenoisingImage GenerationVideo Generation