paper-with-me

홈 › Papers

Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

2023-10-09 · Lijun Yu, José Lezama, Nitesh B. Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Vighnesh Birodkar, Agrim Gupta, Xiuye Gu, Alexander G. Hauptmann, Boqing Gong, Ming-Hsuan Yang, Irfan Essa, David A. Ross, Lu Jiang

While Large Language Models (LLMs) are the dominant models for generative tasks in language, they do not perform as well as diffusion models on image and video generation. To effectively use LLMs for visual generation, one crucial component is the visual tokenizer that maps pixel-space inputs to discrete tokens appropriate for LLM learning. In this paper, we introduce MAGVIT-v2, a video tokenizer designed to generate concise and expressive tokens for both videos and images using a common token vocabulary. Equipped with this new tokenizer, we show that LLMs outperform diffusion models on standard image and video generation benchmarks including ImageNet and Kinetics. In addition, we demonstrate that our tokenizer surpasses the previously top-performing video tokenizer on two more tasks: (1) video compression comparable to the next-generation video codec (VCC) according to human evaluations, and (2) learning effective representations for action recognition tasks.

📄 PDF Abstract BibTeX arXiv:2310.05737

Code (3)

bornfly-detachment/asymmetric_magvitv2 pytorch
jy0205/Pyramid-Flow pytorch
lucidrains/magvit2-pytorch pytorch

Tasks

Action RecognitionImage GenerationLanguage ModelingLanguage ModellingVideo CompressionVideo GenerationVideo Prediction

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation

2024-06-10 · Peize Sun, Yi Jiang, Shoufa Chen, Shilong Zhang 외

We introduce LlamaGen, a new family of image generation models that apply original ``next-token prediction'' paradigm of large language models to visual generation domain. It is an affirmative answer to whether vanilla a…

Conditional Image GenerationImage GenerationImage Reconstruction

REAR: Rethinking Visual Autoregressive Models via Generator-Tokenizer Consistency Regularization

2025-10-06 · Qiyuan He, Yicong Li, Haotian Ye, Jinghao Wang 외 arxiv

Visual autoregressive (AR) generation offers a promising path toward unifying vision and language models, yet its performance remains suboptimal against diffusion models. Prior work often attributes this gap to tokenizer…

Diffusion Autoencoders are Scalable Image Tokenizers

2025-01-30 · Yinbo Chen, Rohit Girdhar, Xiaolong Wang, Sai Saketh Rambhatla 외

Tokenizing images into compact visual representations is a key step in learning efficient and high-quality image generative models. We present a simple diffusion tokenizer (DiTo) that learns compact visual representation…

Image GenerationImage Reconstruction

RPiAE: A Representation-Pivoted Autoencoder Enhancing Both Image Generation and Editing

2026-03-19 · Yue Gong, Hongyu Li, Shanyuan Liu, Bo Cheng 외 arxiv

Diffusion models have become the dominant paradigm for image generation and editing, with latent diffusion models shifting denoising to a compact latent space for efficiency and scalability. Recent attempts to leverage p…

Text-to-Image GenerationImage Editing

AlignTok: Aligning Visual Foundation Encoders to Tokenizers for Diffusion Models

2025-09-29 · Bowei Chen, Sai Bi, Hao Tan, He Zhang 외 arxiv

In this work, we propose aligning pretrained visual encoders to serve as tokenizers for latent diffusion models in image generation. Unlike training a variational autoencoder (VAE) from scratch, which primarily emphasize…

Image Generation