paper-with-me

홈 › Papers

Revisiting Autoregressive Models for Generative Image Classification

2026-03-19 · Ilia Sudakov, Artem Babenko, Dmitry Baranchuk arxiv

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit visual AR-based generative classifiers and identify an important limitation of prior approaches: their reliance on a fixed token order, which imposes a restrictive inductive bias for image understanding. We observe that single-order predictions rely more on partial discriminative cues, while averaging over multiple token orders provides a more comprehensive signal. Based on this insight, we leverage recent any-order AR models to estimate order-marginalized predictions, unlocking the high classification potential of AR models. Our approach consistently outperforms diffusion-based classifiers across diverse image classification benchmarks, while being up to 25x more efficient. Compared to state-of-the-art self-supervised discriminative models, our method delivers competitive classification performance - a notable achievement for generative classifiers.

📄 PDF Abstract BibTeX arXiv:2603.19122

Code (0)

등록된 구현이 없습니다.

Tasks

Image Classification

Similar Papers 제목 키워드 기반

Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis

2024-06-08 · CVPR 2024 1 · Zanlin Ni, Yulin Wang, Renping Zhou, Jiayi Guo 외

The field of image synthesis is currently flourishing due to the advancements in diffusion models. While diffusion models have been successful, their computational intensity has prompted the pursuit of more efficient alt…

Image Generation

ICAS: Detecting Training Data from Autoregressive Image Generative Models

2025-07-07 · Hongyao Yu, Yixiang Qiu, Yiheng Yang, Hao Fang 외 arxiv

Autoregressive image generation has witnessed rapid advancements, with prominent models such as scale-wise visual auto-regression pushing the boundaries of visual synthesis. However, these developments also raise signifi…

Image Generation

Learning from Next-Frame Prediction: Autoregressive Video Modeling Encodes Effective Representations

2025-12-24 · Jinghan Li, Yang Jin, Hao Jiang, Yadong Mu 외 arxiv

Recent advances in pretraining general foundation models have significantly improved performance across diverse downstream tasks. While autoregressive (AR) generative models like GPT have revolutionized NLP, most visual …

Representation Learning

Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining

2024-07-01 · Qi Zhang, Tianqi Du, Haotian Huang, Yifei Wang 외

In recent years, the rise of generative self-supervised learning (SSL) paradigms has exhibited impressive performance across visual, language, and multi-modal domains. While the varied designs of generative SSL objective…

Self-Supervised Learning

Improved Masked Image Generation with Token-Critic

2022-09-09 · José Lezama, Huiwen Chang, Lu Jiang, Irfan Essa

Non-autoregressive generative transformers recently demonstrated impressive image generation performance, and orders of magnitude faster sampling than their autoregressive counterparts. However, optimal parallel sampling…

DiversityImage Generation