paper-with-me

Papers

NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale

2025-08-14 · NextStep Team, Chunrui Han, Guopeng Li, Jingwei Wu, Quan Sun, Yan Cai, Yuang Peng, Zheng Ge, Deyu Zhou, Haomiao Tang, Hongyu Zhou, Kenkun Liu, Ailin Huang, Bin Wang, Changxin Miao, Deshan Sun, En Yu, Fukun Yin, Gang Yu, Hao Nie, Haoran Lv, Hanpeng Hu, Jia Wang, Jian Zhou, Jianjian Sun, Kaijun Tan, Kang An, Kangheng Lin, Liang Zhao, Mei Chen, Peng Xing, Rui Wang, Shiyu Liu, Shutao Xia, Tianhao You, Wei Ji, Xianfang Zeng, Xin Han, Xuelin Zhang, Yana Wei, Yanming Xu, Yimin Jiang, Yingming Wang, Yu Zhou, Yucheng Han, Ziyang Meng, Binxing Jiao, Daxin Jiang, Xiangyu Zhang, Yibo Zhu arxiv

Prevailing autoregressive (AR) models for text-to-image generation either rely on heavy, computationally-intensive diffusion models to process continuous image tokens, or employ vector quantization (VQ) to obtain discrete tokens with quantization loss. In this paper, we push the autoregressive paradigm forward with NextStep-1, a 14B autoregressive model paired with a 157M flow matching head, training on discrete text tokens and continuous image tokens with next-token prediction objectives. NextStep-1 achieves state-of-the-art performance for autoregressive models in text-to-image generation tasks, exhibiting strong capabilities in high-fidelity image synthesis. Furthermore, our method shows strong performance in image editing, highlighting the power and versatility of our unified approach. To facilitate open research, we will release our code and models to the community.

📄 PDF Abstract BibTeX arXiv:2508.10711

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image GenerationImage Editing

Similar Papers 제목 키워드 기반

Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis

2025-07-02 · Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu 외

Recent advances in large language models (LLMs) have spurred interests in encoding images as discrete tokens and leveraging autoregressive (AR) frameworks for visual generation. However, the quantization process in AR-ba…

Density EstimationImage GenerationQuantization

MixAR: Mixture Autoregressive Image Generation

2025-11-15 · Jinyuan Hu, Jiayou Zhang, Shaobo Cui, Kun Zhang 외 arxiv

Autoregressive (AR) approaches, which represent images as sequences of discrete tokens from a finite codebook, have achieved remarkable success in image generation. However, the quantization process and the limited codeb…

Computational EfficiencyImage Generation

Unified Autoregressive Visual Generation and Understanding with Continuous Tokens

2025-03-17 · Lijie Fan, Luming Tang, Siyang Qin, Tianhong Li 외

We present UniFluid, a unified autoregressive framework for joint visual generation and understanding leveraging continuous visual tokens. Our unified autoregressive architecture processes multimodal image and text input…

Image CaptioningImage GenerationQuestion Answering

Bridging Continuous and Discrete Tokens for Autoregressive Visual Generation

2025-03-20 · Yuqing Wang, Zhijie Lin, Yao Teng, Yuanzhi Zhu 외

Autoregressive visual generation models typically rely on tokenizers to compress images into tokens that can be predicted sequentially. A fundamental dilemma exists in token representation: discrete tokens enable straigh…

Quantization

DiffCap: Exploring Continuous Diffusion on Image Captioning

2023-05-20 · Yufeng He, Zefan Cai, Xu Gan, Baobao Chang

Current image captioning works usually focus on generating descriptions in an autoregressive manner. However, there are limited works that focus on generating descriptions non-autoregressively, which brings more decoding…

Caption GenerationDiversityImage CaptioningImage Description+2