paper-with-me

홈 › Papers

DetailFlow: 1D Coarse-to-Fine Autoregressive Image Generation via Next-Detail Prediction

2025-05-27 · Yiheng Liu, Liao Qu, Huichao Zhang, Xu Wang, Yi Jiang, Yiming Gao, Hu Ye, Xian Li, Shuai Wang, Daniel K. Du, Shu Cheng, Zehuan Yuan, Xinglong Wu

This paper presents DetailFlow, a coarse-to-fine 1D autoregressive (AR) image generation method that models images through a novel next-detail prediction strategy. By learning a resolution-aware token sequence supervised with progressively degraded images, DetailFlow enables the generation process to start from the global structure and incrementally refine details. This coarse-to-fine 1D token sequence aligns well with the autoregressive inference mechanism, providing a more natural and efficient way for the AR model to generate complex visual content. Our compact 1D AR model achieves high-quality image synthesis with significantly fewer tokens than previous approaches, i.e. VAR/VQGAN. We further propose a parallel inference mechanism with self-correction that accelerates generation speed by approximately 8x while reducing accumulation sampling error inherent in teacher-forcing supervision. On the ImageNet 256x256 benchmark, our method achieves 2.96 gFID with 128 tokens, outperforming VAR (3.3 FID) and FlexVAR (3.05 FID), which both require 680 tokens in their AR models. Moreover, due to the significantly reduced token count and parallel inference mechanism, our method runs nearly 2x faster inference speed compared to VAR and FlexVAR. Extensive experimental results demonstrate DetailFlow's superior generation quality and efficiency compared to existing state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2505.21473

Code (1)

byteflow-ai/detailflow 공식 구현 pytorch

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

CARP: Visuomotor Policy Learning via Coarse-to-Fine Autoregressive Prediction

2024-12-09 · Zhefei Gong, Pengxiang Ding, Shangke Lyu, Siteng Huang 외

In robotic visuomotor policy learning, diffusion-based models have achieved significant success in improving the accuracy of action trajectory generation compared to traditional autoregressive models. However, they suffe…

Action GenerationDenoising

Improving Autoregressive Image Generation through Coarse-to-Fine Token Prediction

2025-03-20 · Ziyao Guo, Kaipeng Zhang, Michael Qizhe Shieh

Autoregressive models have shown remarkable success in image generation by adapting sequential prediction techniques from language modeling. However, applying these approaches to images requires discretizing continuous p…

Image GenerationLanguage ModelingLanguage ModellingQuantization

Spectral Image Tokenizer

2024-12-12 · Carlos Esteves, Mohammed Suhail, Ameesh Makadia

Image tokenizers map images to sequences of discrete tokens, and are a crucial component of autoregressive transformer-based image generation. The tokens are typically associated with spatial locations in the input image…

Image Generation

ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis

2021-08-19 · NeurIPS 2021 12 · Patrick Esser, Robin Rombach, Andreas Blattmann, Björn Ommer

Autoregressive models and their sequential factorization of the data likelihood have recently demonstrated great potential for image representation and synthesis. Nevertheless, they incorporate image context in a linear …

Image GenerationImage InpaintingText-to-Image Generation

SpectralAR: Spectral Autoregressive Visual Generation

2025-06-12 · Yuanhui Huang, Weiliang Chen, Wenzhao Zheng, Yueqi Duan 외

Autoregressive visual generation has garnered increasing attention due to its scalability and compatibility with other modalities compared with diffusion models. Most existing methods construct visual sequences as spatia…

Image Reconstruction